Jul 10 04:26:17 devstack cinder-volume[76164]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Jul 10 04:26:17 devstack cinder-volume[76164]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Jul 10 04:26:17 devstack cinder-volume[76164]: we strongly recommend against using it for new projects. Jul 10 04:26:17 devstack cinder-volume[76164]: If you are already using Eventlet, we recommend migrating to a different Jul 10 04:26:17 devstack cinder-volume[76164]: framework. For more detail see Jul 10 04:26:17 devstack cinder-volume[76164]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Jul 10 04:26:17 devstack cinder-volume[76164]: import eventlet # noqa Jul 10 04:26:19 devstack cinder-volume[76164]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=76164) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jul 10 04:26:19 devstack cinder-volume[76164]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=76164) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jul 10 04:26:19 devstack cinder-volume[76164]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=76164) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jul 10 04:26:20 devstack cinder-volume[76164]: INFO dbcounter [None req-09f55645-c366-4244-999d-a977d516da1b None None] Registered counter for database cinder Jul 10 04:26:20 devstack cinder-volume[76164]: DEBUG oslo_db.sqlalchemy.engines [None req-09f55645-c366-4244-999d-a977d516da1b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=76164) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 10 04:26:21 devstack cinder-volume[76164]: DEBUG dbcounter [-] [76164] Writer thread running {{(pid=76164) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Jul 10 04:26:21 devstack cinder-volume[76164]: INFO cinder.rpc [None req-09f55645-c366-4244-999d-a977d516da1b None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Jul 10 04:26:21 devstack cinder-volume[76164]: INFO cinder.rpc [None req-09f55645-c366-4244-999d-a977d516da1b None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Jul 10 04:26:21 devstack cinder-volume[76164]: DEBUG oslo_db.sqlalchemy.engines [None req-09f55645-c366-4244-999d-a977d516da1b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=76164) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 10 04:26:21 devstack cinder-volume[76164]: INFO cinder.volume.manager [None req-09f55645-c366-4244-999d-a977d516da1b None None] Determined volume DB was empty at startup. Jul 10 04:26:21 devstack cinder-volume[76164]: DEBUG cinder.volume.manager [None req-09f55645-c366-4244-999d-a977d516da1b None None] Cinder Volume DB check: vol_db_empty=True {{(pid=76164) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}} Jul 10 04:26:21 devstack cinder-volume[76164]: INFO cinder.volume.manager [None req-09f55645-c366-4244-999d-a977d516da1b None None] Service not found for updating active_backend_id, assuming default for driver init. Jul 10 04:26:21 devstack cinder-volume[76164]: WARNING stevedore.named [None req-09f55645-c366-4244-999d-a977d516da1b None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Jul 10 04:26:21 devstack cinder-volume[76164]: WARNING castellan.key_manager [None req-09f55645-c366-4244-999d-a977d516da1b None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jul 10 04:26:21 devstack cinder-volume[76164]: WARNING cinder.keymgr.conf_key_mgr [None req-09f55645-c366-4244-999d-a977d516da1b None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jul 10 04:26:21 devstack cinder-volume[76164]: DEBUG cinder.volume.drivers.lvm [None req-09f55645-c366-4244-999d-a977d516da1b None None] Attempting to initialize LVM driver with the following target_driver: cinder.volume.targets.lio.LioAdm {{(pid=76164) __init__ /opt/stack/cinder/cinder/volume/drivers/lvm.py:106}} Jul 10 04:26:21 devstack cinder-volume[76164]: DEBUG oslo_concurrency.processutils [None req-09f55645-c366-4244-999d-a977d516da1b None None] Running cmd (subprocess): cinder-rtstool verify {{(pid=76164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:26:21 devstack cinder-volume[76164]: DEBUG oslo_concurrency.processutils [None req-09f55645-c366-4244-999d-a977d516da1b None None] CMD "cinder-rtstool verify" returned: 0 in 0.465s {{(pid=76164) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:26:21 devstack cinder-volume[76164]: DEBUG oslo_db.sqlalchemy.engines [None req-09f55645-c366-4244-999d-a977d516da1b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=76164) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 10 04:26:21 devstack cinder-volume[76164]: INFO cinder.rpc [None req-09f55645-c366-4244-999d-a977d516da1b None None] Automatically selected cinder-volume objects version 1.39 as minimum service version. Jul 10 04:26:21 devstack cinder-volume[76164]: INFO cinder.rpc [None req-09f55645-c366-4244-999d-a977d516da1b None None] Automatically selected cinder-volume RPC version 3.20 as minimum service version. Jul 10 04:26:21 devstack cinder-volume[76164]: WARNING stevedore.named [None req-09f55645-c366-4244-999d-a977d516da1b None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Jul 10 04:26:21 devstack cinder-volume[76164]: WARNING castellan.key_manager [None req-09f55645-c366-4244-999d-a977d516da1b None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jul 10 04:26:21 devstack cinder-volume[76164]: INFO cinder.volume.manager [None req-09f55645-c366-4244-999d-a977d516da1b None None] Image-volume cache enabled for host devstack@lvmdriver-1. Jul 10 04:26:21 devstack cinder-volume[76164]: DEBUG oslo_db.sqlalchemy.engines [None req-09f55645-c366-4244-999d-a977d516da1b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=76164) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 10 04:26:21 devstack cinder-volume[76164]: INFO oslo_service.backend._eventlet.service [None req-09f55645-c366-4244-999d-a977d516da1b None None] Starting 1 workers Jul 10 04:26:21 devstack cinder-volume[76164]: DEBUG oslo_service.backend._eventlet.service [None req-09f55645-c366-4244-999d-a977d516da1b None None] Started child 76364 {{(pid=76164) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Jul 10 04:26:21 devstack cinder-volume[76164]: DEBUG oslo_service.backend._eventlet.service [None req-09f55645-c366-4244-999d-a977d516da1b None None] Full set of CONF: {{(pid=76164) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Jul 10 04:26:21 devstack cinder-volume[76164]: DEBUG oslo_service.backend._eventlet.service [None req-09f55645-c366-4244-999d-a977d516da1b None None] ******************************************************************************** {{(pid=76164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3226}} Jul 10 04:26:21 devstack cinder-volume[76164]: DEBUG oslo_service.backend._eventlet.service [None req-09f55645-c366-4244-999d-a977d516da1b None None] Configuration options gathered from: {{(pid=76164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3227}} Jul 10 04:26:21 devstack cinder-volume[76164]: DEBUG oslo_service.backend._eventlet.service [None req-09f55645-c366-4244-999d-a977d516da1b None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=76164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3228}} Jul 10 04:26:21 devstack cinder-volume[76164]: DEBUG oslo_service.backend._eventlet.service [None req-09f55645-c366-4244-999d-a977d516da1b None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=76164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3229}} Jul 10 04:26:21 devstack cinder-volume[76164]: DEBUG oslo_service.backend._eventlet.service [None req-09f55645-c366-4244-999d-a977d516da1b None None] ================================================================================ {{(pid=76164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3234}} Jul 10 04:26:21 devstack cinder-volume[76164]: DEBUG oslo_service.backend._eventlet.service [None req-09f55645-c366-4244-999d-a977d516da1b None None] allow_availability_zone_fallback = False {{(pid=76164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 04:26:21 devstack cinder-volume[76164]: DEBUG oslo_service.backend._eventlet.service [None req-09f55645-c366-4244-999d-a977d516da1b None None] allow_compression_on_image_upload = False {{(pid=76164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 04:26:21 devstack cinder-volume[76164]: DEBUG oslo_service.backend._eventlet.service [None req-09f55645-c366-4244-999d-a977d516da1b None None] allowed_direct_url_schemes = [] {{(pid=76164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 04:26:21 devstack cinder-volume[76164]: DEBUG oslo_service.backend._eventlet.service [None req-09f55645-c366-4244-999d-a977d516da1b None None] api_rate_limit = True {{(pid=76164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 04:26:21 devstack cinder-volume[76164]: DEBUG oslo_service.backend._eventlet.service [None req-09f55645-c366-4244-999d-a977d516da1b None None] auth_strategy = keystone {{(pid=76164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 04:26:21 devstack cinder-volume[76164]: DEBUG oslo_service.backend._eventlet.service [None req-09f55645-c366-4244-999d-a977d516da1b None None] az_cache_duration = 3600 {{(pid=76164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 04:26:21 devstack cinder-volume[76164]: DEBUG oslo_service.backend._eventlet.service [None req-09f55645-c366-4244-999d-a977d516da1b None None] backend_availability_zone = None {{(pid=76164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 04:26:21 devstack cinder-volume[76164]: DEBUG oslo_service.backend._eventlet.service [None req-09f55645-c366-4244-999d-a977d516da1b None None] backend_host = None {{(pid=76164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 04:26:21 devstack cinder-volume[76164]: DEBUG oslo_service.backend._eventlet.service [None req-09f55645-c366-4244-999d-a977d516da1b None None] backend_name = None {{(pid=76164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 04:26:21 devstack cinder-volume[76164]: DEBUG oslo_service.backend._eventlet.service [None req-09f55645-c366-4244-999d-a977d516da1b None None] backend_stats_polling_interval = 60 {{(pid=76164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 04:26:21 devstack cinder-volume[76164]: DEBUG oslo_service.backend._eventlet.service [None req-09f55645-c366-4244-999d-a977d516da1b None None] backup_api_class = cinder.backup.api.API {{(pid=76164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 04:26:21 devstack cinder-volume[76164]: DEBUG oslo_service.backend._eventlet.service [None req-09f55645-c366-4244-999d-a977d516da1b None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=76164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 04:26:21 devstack cinder-volume[76164]: DEBUG oslo_service.backend._eventlet.service [None req-09f55645-c366-4244-999d-a977d516da1b None None] backup_name_template = backup-%s {{(pid=76164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 04:26:21 devstack cinder-volume[76164]: DEBUG oslo_service.backend._eventlet.service [None req-09f55645-c366-4244-999d-a977d516da1b None None] backup_use_same_host = False {{(pid=76164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 04:26:21 devstack cinder-volume[76164]: DEBUG oslo_service.backend._eventlet.service [None req-09f55645-c366-4244-999d-a977d516da1b None None] backup_use_temp_snapshot = False {{(pid=76164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 04:26:21 devstack cinder-volume[76164]: DEBUG oslo_service.backend._eventlet.service [None req-09f55645-c366-4244-999d-a977d516da1b None None] chap_password = **** {{(pid=76164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 04:26:21 devstack cinder-volume[76164]: DEBUG oslo_service.backend._eventlet.service [None req-09f55645-c366-4244-999d-a977d516da1b None None] chap_username = {{(pid=76164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 04:26:22 devstack cinder-volume[76164]: DEBUG oslo_service.backend._eventlet.service [None req-09f55645-c366-4244-999d-a977d516da1b None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=76164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 04:26:22 devstack cinder-volume[76164]: DEBUG oslo_service.backend._eventlet.service [None req-09f55645-c366-4244-999d-a977d516da1b None None] cinder_internal_tenant_project_id = b0a783484f594c9ab0b54e5c67f9920d {{(pid=76164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 04:26:22 devstack cinder-volume[76164]: DEBUG oslo_service.backend._eventlet.service [None req-09f55645-c366-4244-999d-a977d516da1b None None] cinder_internal_tenant_user_id = 6eec03a607de4ca6b3826ac80077e53f {{(pid=76164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 04:26:22 devstack cinder-volume[76364]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0) Jul 10 04:26:22 devstack cinder-volume[76164]: DEBUG oslo_service.backend._eventlet.service [None req-09f55645-c366-4244-999d-a977d516da1b None None] cloned_volume_same_az = True {{(pid=76164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 04:26:22 devstack cinder-volume[76164]: DEBUG oslo_service.backend._eventlet.service [None req-09f55645-c366-4244-999d-a977d516da1b None None] cluster = None {{(pid=76164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 04:26:22 devstack cinder-volume[76164]: DEBUG oslo_service.backend._eventlet.service [None req-09f55645-c366-4244-999d-a977d516da1b None None] compression_format = gzip {{(pid=76164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 04:26:22 devstack cinder-volume[76164]: DEBUG oslo_service.backend._eventlet.service [None req-09f55645-c366-4244-999d-a977d516da1b None None] compute_api_class = cinder.compute.nova.API {{(pid=76164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 04:26:22 devstack cinder-volume[76164]: DEBUG oslo_service.backend._eventlet.service [None req-09f55645-c366-4244-999d-a977d516da1b None None] config_dir = [] {{(pid=76164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 04:26:22 devstack cinder-volume[76164]: DEBUG oslo_service.backend._eventlet.service [None req-09f55645-c366-4244-999d-a977d516da1b None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=76164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 04:26:22 devstack cinder-volume[76164]: DEBUG oslo_service.backend._eventlet.service [None req-09f55645-c366-4244-999d-a977d516da1b None None] config_source = [] {{(pid=76164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 04:26:22 devstack cinder-volume[76164]: DEBUG oslo_service.backend._eventlet.service [None req-09f55645-c366-4244-999d-a977d516da1b None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=76164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 04:26:22 devstack cinder-volume[76164]: DEBUG oslo_service.backend._eventlet.service [None req-09f55645-c366-4244-999d-a977d516da1b None None] control_exchange = openstack {{(pid=76164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 04:26:22 devstack cinder-volume[76164]: DEBUG oslo_service.backend._eventlet.service [None req-09f55645-c366-4244-999d-a977d516da1b None None] debug = True {{(pid=76164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 04:26:22 devstack cinder-volume[76164]: DEBUG oslo_service.backend._eventlet.service [None req-09f55645-c366-4244-999d-a977d516da1b None None] default_availability_zone = None {{(pid=76164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 04:26:22 devstack cinder-volume[76164]: DEBUG oslo_service.backend._eventlet.service [None req-09f55645-c366-4244-999d-a977d516da1b None None] default_group_type = None {{(pid=76164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 04:26:22 devstack cinder-volume[76164]: DEBUG oslo_service.backend._eventlet.service [None req-09f55645-c366-4244-999d-a977d516da1b None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=76164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 04:26:22 devstack cinder-volume[76164]: DEBUG oslo_service.backend._eventlet.service [None req-09f55645-c366-4244-999d-a977d516da1b None None] default_volume_type = lvmdriver-1 {{(pid=76164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 04:26:22 devstack cinder-volume[76164]: DEBUG oslo_service.backend._eventlet.service [None req-09f55645-c366-4244-999d-a977d516da1b None None] disk_geometry = None {{(pid=76164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 04:26:22 devstack cinder-volume[76164]: DEBUG oslo_service.backend._eventlet.service [None req-09f55645-c366-4244-999d-a977d516da1b None None] driver_client_cert = None {{(pid=76164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 04:26:22 devstack cinder-volume[76164]: DEBUG oslo_service.backend._eventlet.service [None req-09f55645-c366-4244-999d-a977d516da1b None None] driver_client_cert_key = None {{(pid=76164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 04:26:22 devstack cinder-volume[76164]: DEBUG oslo_service.backend._eventlet.service [None req-09f55645-c366-4244-999d-a977d516da1b None None] driver_data_namespace = None {{(pid=76164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 04:26:22 devstack cinder-volume[76164]: DEBUG oslo_service.backend._eventlet.service [None req-09f55645-c366-4244-999d-a977d516da1b None None] driver_ssl_cert_path = None {{(pid=76164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 04:26:22 devstack cinder-volume[76164]: DEBUG oslo_service.backend._eventlet.service [None req-09f55645-c366-4244-999d-a977d516da1b None None] driver_ssl_cert_verify = False {{(pid=76164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 04:26:22 devstack cinder-volume[76164]: DEBUG oslo_service.backend._eventlet.service [None req-09f55645-c366-4244-999d-a977d516da1b None None] driver_use_ssl = False {{(pid=76164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 04:26:22 devstack cinder-volume[76164]: DEBUG oslo_service.backend._eventlet.service [None req-09f55645-c366-4244-999d-a977d516da1b None None] enable_force_upload = False {{(pid=76164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 04:26:22 devstack cinder-volume[76164]: DEBUG oslo_service.backend._eventlet.service [None req-09f55645-c366-4244-999d-a977d516da1b None None] enable_new_services = True {{(pid=76164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 04:26:22 devstack cinder-volume[76164]: DEBUG oslo_service.backend._eventlet.service [None req-09f55645-c366-4244-999d-a977d516da1b None None] enable_unsupported_driver = False {{(pid=76164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 04:26:22 devstack cinder-volume[76164]: DEBUG oslo_service.backend._eventlet.service [None req-09f55645-c366-4244-999d-a977d516da1b None None] enabled_backends = ['lvmdriver-1'] {{(pid=76164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 04:26:22 devstack cinder-volume[76164]: DEBUG oslo_service.backend._eventlet.service [None req-09f55645-c366-4244-999d-a977d516da1b None None] enforce_multipath_for_image_xfer = False {{(pid=76164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 04:26:22 devstack cinder-volume[76164]: DEBUG oslo_service.backend._eventlet.service [None req-09f55645-c366-4244-999d-a977d516da1b None None] filter_function = None {{(pid=76164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 04:26:22 devstack cinder-volume[76164]: DEBUG oslo_service.backend._eventlet.service [None req-09f55645-c366-4244-999d-a977d516da1b None None] glance_api_insecure = False {{(pid=76164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 04:26:22 devstack cinder-volume[76164]: DEBUG oslo_service.backend._eventlet.service [None req-09f55645-c366-4244-999d-a977d516da1b None None] glance_api_servers = ['http://192.168.122.158/image'] {{(pid=76164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 04:26:22 devstack cinder-volume[76164]: DEBUG oslo_service.backend._eventlet.service [None req-09f55645-c366-4244-999d-a977d516da1b None None] glance_api_ssl_compression = False {{(pid=76164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 04:26:22 devstack cinder-volume[76164]: DEBUG oslo_service.backend._eventlet.service [None req-09f55645-c366-4244-999d-a977d516da1b None None] glance_ca_certificates_file = None {{(pid=76164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 04:26:22 devstack cinder-volume[76164]: DEBUG oslo_service.backend._eventlet.service [None req-09f55645-c366-4244-999d-a977d516da1b None None] glance_catalog_info = image:glance:publicURL {{(pid=76164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 04:26:22 devstack cinder-volume[76164]: DEBUG oslo_service.backend._eventlet.service [None req-09f55645-c366-4244-999d-a977d516da1b None None] glance_certfile = None {{(pid=76164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 04:26:22 devstack cinder-volume[76164]: DEBUG oslo_service.backend._eventlet.service [None req-09f55645-c366-4244-999d-a977d516da1b None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=76164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 04:26:22 devstack cinder-volume[76164]: DEBUG oslo_service.backend._eventlet.service [None req-09f55645-c366-4244-999d-a977d516da1b None None] glance_keyfile = None {{(pid=76164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 04:26:22 devstack cinder-volume[76164]: DEBUG oslo_service.backend._eventlet.service [None req-09f55645-c366-4244-999d-a977d516da1b None None] glance_num_retries = 3 {{(pid=76164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 04:26:22 devstack cinder-volume[76164]: DEBUG oslo_service.backend._eventlet.service [None req-09f55645-c366-4244-999d-a977d516da1b None None] glance_request_timeout = None {{(pid=76164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 04:26:22 devstack cinder-volume[76164]: DEBUG oslo_service.backend._eventlet.service [None req-09f55645-c366-4244-999d-a977d516da1b None None] goodness_function = None {{(pid=76164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 04:26:22 devstack cinder-volume[76164]: DEBUG oslo_service.backend._eventlet.service [None req-09f55645-c366-4244-999d-a977d516da1b None None] graceful_shutdown_timeout = 5 {{(pid=76164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 04:26:22 devstack cinder-volume[76164]: DEBUG oslo_service.backend._eventlet.service [None req-09f55645-c366-4244-999d-a977d516da1b None None] group_api_class = cinder.group.api.API {{(pid=76164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 04:26:22 devstack cinder-volume[76164]: DEBUG oslo_service.backend._eventlet.service [None req-09f55645-c366-4244-999d-a977d516da1b None None] host = devstack {{(pid=76164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 04:26:22 devstack cinder-volume[76164]: DEBUG oslo_service.backend._eventlet.service [None req-09f55645-c366-4244-999d-a977d516da1b None None] image_compress_on_upload = True {{(pid=76164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 04:26:22 devstack cinder-volume[76164]: DEBUG oslo_service.backend._eventlet.service [None req-09f55645-c366-4244-999d-a977d516da1b None None] image_conversion_address_space_limit = 1 {{(pid=76164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 04:26:22 devstack cinder-volume[76164]: DEBUG oslo_service.backend._eventlet.service [None req-09f55645-c366-4244-999d-a977d516da1b None None] image_conversion_cpu_limit = 60 {{(pid=76164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 04:26:22 devstack cinder-volume[76164]: DEBUG oslo_service.backend._eventlet.service [None req-09f55645-c366-4244-999d-a977d516da1b None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=76164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 04:26:22 devstack cinder-volume[76164]: DEBUG oslo_service.backend._eventlet.service [None req-09f55645-c366-4244-999d-a977d516da1b None None] image_conversion_disable = False {{(pid=76164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 04:26:22 devstack cinder-volume[76164]: DEBUG oslo_service.backend._eventlet.service [None req-09f55645-c366-4244-999d-a977d516da1b None None] image_upload_use_cinder_backend = False {{(pid=76164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 04:26:22 devstack cinder-volume[76164]: DEBUG oslo_service.backend._eventlet.service [None req-09f55645-c366-4244-999d-a977d516da1b None None] image_upload_use_internal_tenant = False {{(pid=76164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 04:26:22 devstack cinder-volume[76164]: DEBUG oslo_service.backend._eventlet.service [None req-09f55645-c366-4244-999d-a977d516da1b None None] image_volume_cache_enabled = False {{(pid=76164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 04:26:22 devstack cinder-volume[76164]: DEBUG oslo_service.backend._eventlet.service [None req-09f55645-c366-4244-999d-a977d516da1b None None] image_volume_cache_max_count = 0 {{(pid=76164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 04:26:22 devstack cinder-volume[76164]: DEBUG oslo_service.backend._eventlet.service [None req-09f55645-c366-4244-999d-a977d516da1b None None] image_volume_cache_max_size_gb = 0 {{(pid=76164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 04:26:22 devstack cinder-volume[76164]: DEBUG oslo_service.backend._eventlet.service [None req-09f55645-c366-4244-999d-a977d516da1b None None] init_host_max_objects_retrieval = 0 {{(pid=76164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 04:26:22 devstack cinder-volume[76164]: DEBUG oslo_service.backend._eventlet.service [None req-09f55645-c366-4244-999d-a977d516da1b None None] instance_format = [instance: %(uuid)s] {{(pid=76164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 04:26:22 devstack cinder-volume[76164]: DEBUG oslo_service.backend._eventlet.service [None req-09f55645-c366-4244-999d-a977d516da1b None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=76164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 04:26:22 devstack cinder-volume[76164]: DEBUG oslo_service.backend._eventlet.service [None req-09f55645-c366-4244-999d-a977d516da1b None None] iscsi_target_flags = {{(pid=76164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 04:26:22 devstack cinder-volume[76164]: DEBUG oslo_service.backend._eventlet.service [None req-09f55645-c366-4244-999d-a977d516da1b None None] iscsi_write_cache = on {{(pid=76164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 04:26:22 devstack cinder-volume[76164]: DEBUG oslo_service.backend._eventlet.service [None req-09f55645-c366-4244-999d-a977d516da1b None None] iser_helper = tgtadm {{(pid=76164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 04:26:22 devstack cinder-volume[76164]: DEBUG oslo_service.backend._eventlet.service [None req-09f55645-c366-4244-999d-a977d516da1b None None] iser_ip_address = 192.168.122.158 {{(pid=76164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 04:26:22 devstack cinder-volume[76164]: DEBUG oslo_service.backend._eventlet.service [None req-09f55645-c366-4244-999d-a977d516da1b None None] iser_port = 3260 {{(pid=76164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 04:26:22 devstack cinder-volume[76164]: DEBUG oslo_service.backend._eventlet.service [None req-09f55645-c366-4244-999d-a977d516da1b None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=76164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 04:26:22 devstack cinder-volume[76164]: DEBUG oslo_service.backend._eventlet.service [None req-09f55645-c366-4244-999d-a977d516da1b None None] log_color = False {{(pid=76164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 04:26:22 devstack cinder-volume[76164]: DEBUG oslo_service.backend._eventlet.service [None req-09f55645-c366-4244-999d-a977d516da1b None None] log_config_append = None {{(pid=76164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 04:26:22 devstack cinder-volume[76164]: DEBUG oslo_service.backend._eventlet.service [None req-09f55645-c366-4244-999d-a977d516da1b None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=76164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 04:26:22 devstack cinder-volume[76164]: DEBUG oslo_service.backend._eventlet.service [None req-09f55645-c366-4244-999d-a977d516da1b None None] log_dir = None {{(pid=76164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 04:26:22 devstack cinder-volume[76164]: DEBUG oslo_service.backend._eventlet.service [None req-09f55645-c366-4244-999d-a977d516da1b None None] log_file = None {{(pid=76164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 04:26:22 devstack cinder-volume[76164]: DEBUG oslo_service.backend._eventlet.service [None req-09f55645-c366-4244-999d-a977d516da1b None None] log_options = True {{(pid=76164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 04:26:22 devstack cinder-volume[76164]: DEBUG oslo_service.backend._eventlet.service [None req-09f55645-c366-4244-999d-a977d516da1b None None] log_rotate_interval = 1 {{(pid=76164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 04:26:22 devstack cinder-volume[76164]: DEBUG oslo_service.backend._eventlet.service [None req-09f55645-c366-4244-999d-a977d516da1b None None] log_rotate_interval_type = days {{(pid=76164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 04:26:22 devstack cinder-volume[76164]: DEBUG oslo_service.backend._eventlet.service [None req-09f55645-c366-4244-999d-a977d516da1b None None] log_rotation_type = none {{(pid=76164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 04:26:22 devstack cinder-volume[76164]: DEBUG oslo_service.backend._eventlet.service [None req-09f55645-c366-4244-999d-a977d516da1b None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=76164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 04:26:22 devstack cinder-volume[76164]: DEBUG oslo_service.backend._eventlet.service [None req-09f55645-c366-4244-999d-a977d516da1b None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=76164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 04:26:22 devstack cinder-volume[76164]: DEBUG oslo_service.backend._eventlet.service [None req-09f55645-c366-4244-999d-a977d516da1b None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=76164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 04:26:22 devstack cinder-volume[76164]: DEBUG oslo_service.backend._eventlet.service [None req-09f55645-c366-4244-999d-a977d516da1b None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=76164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 04:26:22 devstack cinder-volume[76164]: DEBUG oslo_service.backend._eventlet.service [None req-09f55645-c366-4244-999d-a977d516da1b None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=76164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 04:26:22 devstack cinder-volume[76164]: DEBUG oslo_service.backend._eventlet.service [None req-09f55645-c366-4244-999d-a977d516da1b None None] max_age = 0 {{(pid=76164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 04:26:22 devstack cinder-volume[76164]: DEBUG oslo_service.backend._eventlet.service [None req-09f55645-c366-4244-999d-a977d516da1b None None] max_logfile_count = 30 {{(pid=76164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 04:26:22 devstack cinder-volume[76164]: DEBUG oslo_service.backend._eventlet.service [None req-09f55645-c366-4244-999d-a977d516da1b None None] max_logfile_size_mb = 200 {{(pid=76164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 04:26:22 devstack cinder-volume[76164]: DEBUG oslo_service.backend._eventlet.service [None req-09f55645-c366-4244-999d-a977d516da1b None None] max_over_subscription_ratio = 20.0 {{(pid=76164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 04:26:22 devstack cinder-volume[76164]: DEBUG oslo_service.backend._eventlet.service [None req-09f55645-c366-4244-999d-a977d516da1b None None] message_reap_interval = 86400 {{(pid=76164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 04:26:22 devstack cinder-volume[76164]: DEBUG oslo_service.backend._eventlet.service [None req-09f55645-c366-4244-999d-a977d516da1b None None] message_ttl = 2592000 {{(pid=76164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 04:26:22 devstack cinder-volume[76164]: DEBUG oslo_service.backend._eventlet.service [None req-09f55645-c366-4244-999d-a977d516da1b None None] migration_create_volume_timeout_secs = 300 {{(pid=76164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 04:26:22 devstack cinder-volume[76164]: DEBUG oslo_service.backend._eventlet.service [None req-09f55645-c366-4244-999d-a977d516da1b None None] monkey_patch = False {{(pid=76164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 04:26:22 devstack cinder-volume[76164]: DEBUG oslo_service.backend._eventlet.service [None req-09f55645-c366-4244-999d-a977d516da1b None None] monkey_patch_modules = [] {{(pid=76164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 04:26:22 devstack cinder-volume[76164]: DEBUG oslo_service.backend._eventlet.service [None req-09f55645-c366-4244-999d-a977d516da1b None None] my_ip = 192.168.122.158 {{(pid=76164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 04:26:22 devstack cinder-volume[76164]: DEBUG oslo_service.backend._eventlet.service [None req-09f55645-c366-4244-999d-a977d516da1b None None] no_snapshot_gb_quota = False {{(pid=76164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 04:26:22 devstack cinder-volume[76164]: DEBUG oslo_service.backend._eventlet.service [None req-09f55645-c366-4244-999d-a977d516da1b None None] num_iser_scan_tries = 3 {{(pid=76164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 04:26:22 devstack cinder-volume[76164]: DEBUG oslo_service.backend._eventlet.service [None req-09f55645-c366-4244-999d-a977d516da1b None None] num_shell_tries = 3 {{(pid=76164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 04:26:22 devstack cinder-volume[76164]: DEBUG oslo_service.backend._eventlet.service [None req-09f55645-c366-4244-999d-a977d516da1b None None] num_volume_device_scan_tries = 3 {{(pid=76164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 04:26:22 devstack cinder-volume[76164]: DEBUG oslo_service.backend._eventlet.service [None req-09f55645-c366-4244-999d-a977d516da1b None None] nvmeof_conn_info_version = 1 {{(pid=76164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 04:26:22 devstack cinder-volume[76164]: DEBUG oslo_service.backend._eventlet.service [None req-09f55645-c366-4244-999d-a977d516da1b None None] nvmet_ns_id = 10 {{(pid=76164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 04:26:22 devstack cinder-volume[76164]: DEBUG oslo_service.backend._eventlet.service [None req-09f55645-c366-4244-999d-a977d516da1b None None] nvmet_port_id = 1 {{(pid=76164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 04:26:22 devstack cinder-volume[76164]: DEBUG oslo_service.backend._eventlet.service [None req-09f55645-c366-4244-999d-a977d516da1b None None] osapi_max_limit = 1000 {{(pid=76164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 04:26:22 devstack cinder-volume[76164]: DEBUG oslo_service.backend._eventlet.service [None req-09f55645-c366-4244-999d-a977d516da1b None None] osapi_volume_ext_list = [] {{(pid=76164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 04:26:22 devstack cinder-volume[76164]: DEBUG oslo_service.backend._eventlet.service [None req-09f55645-c366-4244-999d-a977d516da1b None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=76164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 04:26:22 devstack cinder-volume[76164]: DEBUG oslo_service.backend._eventlet.service [None req-09f55645-c366-4244-999d-a977d516da1b None None] osapi_volume_listen = 0.0.0.0 {{(pid=76164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 04:26:22 devstack cinder-volume[76164]: DEBUG oslo_service.backend._eventlet.service [None req-09f55645-c366-4244-999d-a977d516da1b None None] osapi_volume_listen_port = 8776 {{(pid=76164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 04:26:22 devstack cinder-volume[76164]: DEBUG oslo_service.backend._eventlet.service [None req-09f55645-c366-4244-999d-a977d516da1b None None] osapi_volume_use_ssl = False {{(pid=76164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 04:26:22 devstack cinder-volume[76164]: DEBUG oslo_service.backend._eventlet.service [None req-09f55645-c366-4244-999d-a977d516da1b None None] osapi_volume_workers = None {{(pid=76164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 04:26:22 devstack cinder-volume[76164]: DEBUG oslo_service.backend._eventlet.service [None req-09f55645-c366-4244-999d-a977d516da1b None None] per_volume_size_limit = -1 {{(pid=76164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 04:26:22 devstack cinder-volume[76164]: DEBUG oslo_service.backend._eventlet.service [None req-09f55645-c366-4244-999d-a977d516da1b None None] periodic_fuzzy_delay = 60 {{(pid=76164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 04:26:22 devstack cinder-volume[76164]: DEBUG oslo_service.backend._eventlet.service [None req-09f55645-c366-4244-999d-a977d516da1b None None] periodic_interval = 60 {{(pid=76164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 04:26:22 devstack cinder-volume[76164]: DEBUG oslo_service.backend._eventlet.service [None req-09f55645-c366-4244-999d-a977d516da1b None None] project_id_regex = [0-9a-f\-]+ {{(pid=76164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 04:26:22 devstack cinder-volume[76164]: DEBUG oslo_service.backend._eventlet.service [None req-09f55645-c366-4244-999d-a977d516da1b None None] public_endpoint = None {{(pid=76164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 04:26:22 devstack cinder-volume[76164]: DEBUG oslo_service.backend._eventlet.service [None req-09f55645-c366-4244-999d-a977d516da1b None None] publish_errors = False {{(pid=76164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 04:26:22 devstack cinder-volume[76164]: DEBUG oslo_service.backend._eventlet.service [None req-09f55645-c366-4244-999d-a977d516da1b None None] quota_backup_gigabytes = 1000 {{(pid=76164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 04:26:22 devstack cinder-volume[76164]: DEBUG oslo_service.backend._eventlet.service [None req-09f55645-c366-4244-999d-a977d516da1b None None] quota_backups = 10 {{(pid=76164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 04:26:22 devstack cinder-volume[76164]: DEBUG oslo_service.backend._eventlet.service [None req-09f55645-c366-4244-999d-a977d516da1b None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=76164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 04:26:22 devstack cinder-volume[76164]: DEBUG oslo_service.backend._eventlet.service [None req-09f55645-c366-4244-999d-a977d516da1b None None] quota_gigabytes = 1000 {{(pid=76164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 04:26:22 devstack cinder-volume[76164]: DEBUG oslo_service.backend._eventlet.service [None req-09f55645-c366-4244-999d-a977d516da1b None None] quota_groups = 10 {{(pid=76164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 04:26:22 devstack cinder-volume[76164]: DEBUG oslo_service.backend._eventlet.service [None req-09f55645-c366-4244-999d-a977d516da1b None None] quota_snapshots = 10 {{(pid=76164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 04:26:22 devstack cinder-volume[76164]: DEBUG oslo_service.backend._eventlet.service [None req-09f55645-c366-4244-999d-a977d516da1b None None] quota_volumes = 10 {{(pid=76164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 04:26:22 devstack cinder-volume[76164]: DEBUG oslo_service.backend._eventlet.service [None req-09f55645-c366-4244-999d-a977d516da1b None None] rate_limit_burst = 0 {{(pid=76164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 04:26:22 devstack cinder-volume[76164]: DEBUG oslo_service.backend._eventlet.service [None req-09f55645-c366-4244-999d-a977d516da1b None None] rate_limit_except_level = CRITICAL {{(pid=76164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 04:26:22 devstack cinder-volume[76164]: DEBUG oslo_service.backend._eventlet.service [None req-09f55645-c366-4244-999d-a977d516da1b None None] rate_limit_interval = 0 {{(pid=76164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 04:26:22 devstack cinder-volume[76164]: DEBUG oslo_service.backend._eventlet.service [None req-09f55645-c366-4244-999d-a977d516da1b None None] reinit_driver_count = 3 {{(pid=76164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 04:26:22 devstack cinder-volume[76164]: DEBUG oslo_service.backend._eventlet.service [None req-09f55645-c366-4244-999d-a977d516da1b None None] replication_device = **** {{(pid=76164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 04:26:22 devstack cinder-volume[76164]: DEBUG oslo_service.backend._eventlet.service [None req-09f55645-c366-4244-999d-a977d516da1b None None] report_discard_supported = False {{(pid=76164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 04:26:22 devstack cinder-volume[76164]: DEBUG oslo_service.backend._eventlet.service [None req-09f55645-c366-4244-999d-a977d516da1b None None] report_interval = 120 {{(pid=76164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 04:26:22 devstack cinder-volume[76164]: DEBUG oslo_service.backend._eventlet.service [None req-09f55645-c366-4244-999d-a977d516da1b None None] reservation_clean_interval = 86400 {{(pid=76164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 04:26:22 devstack cinder-volume[76164]: DEBUG oslo_service.backend._eventlet.service [None req-09f55645-c366-4244-999d-a977d516da1b None None] reservation_expire = 86400 {{(pid=76164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 04:26:22 devstack cinder-volume[76164]: DEBUG oslo_service.backend._eventlet.service [None req-09f55645-c366-4244-999d-a977d516da1b None None] reserved_image_namespaces = [] {{(pid=76164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 04:26:22 devstack cinder-volume[76164]: DEBUG oslo_service.backend._eventlet.service [None req-09f55645-c366-4244-999d-a977d516da1b None None] reserved_percentage = 0 {{(pid=76164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 04:26:22 devstack cinder-volume[76164]: DEBUG oslo_service.backend._eventlet.service [None req-09f55645-c366-4244-999d-a977d516da1b None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=76164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 04:26:22 devstack cinder-volume[76164]: DEBUG oslo_service.backend._eventlet.service [None req-09f55645-c366-4244-999d-a977d516da1b None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=76164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 04:26:22 devstack cinder-volume[76164]: DEBUG oslo_service.backend._eventlet.service [None req-09f55645-c366-4244-999d-a977d516da1b None None] rpc_response_timeout = 120 {{(pid=76164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 04:26:22 devstack cinder-volume[76164]: DEBUG oslo_service.backend._eventlet.service [None req-09f55645-c366-4244-999d-a977d516da1b None None] run_external_periodic_tasks = True {{(pid=76164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 04:26:22 devstack cinder-volume[76164]: DEBUG oslo_service.backend._eventlet.service [None req-09f55645-c366-4244-999d-a977d516da1b None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=76164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 04:26:22 devstack cinder-volume[76164]: DEBUG oslo_service.backend._eventlet.service [None req-09f55645-c366-4244-999d-a977d516da1b None None] scst_target_driver = iscsi {{(pid=76164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 04:26:22 devstack cinder-volume[76164]: DEBUG oslo_service.backend._eventlet.service [None req-09f55645-c366-4244-999d-a977d516da1b None None] scst_target_iqn_name = None {{(pid=76164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 04:26:22 devstack cinder-volume[76164]: DEBUG oslo_service.backend._eventlet.service [None req-09f55645-c366-4244-999d-a977d516da1b None None] service_down_time = 720 {{(pid=76164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 04:26:22 devstack cinder-volume[76164]: DEBUG oslo_service.backend._eventlet.service [None req-09f55645-c366-4244-999d-a977d516da1b None None] shell_completion = None {{(pid=76164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 04:26:22 devstack cinder-volume[76164]: DEBUG oslo_service.backend._eventlet.service [None req-09f55645-c366-4244-999d-a977d516da1b None None] snapshot_name_template = snapshot-%s {{(pid=76164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 04:26:22 devstack cinder-volume[76164]: DEBUG oslo_service.backend._eventlet.service [None req-09f55645-c366-4244-999d-a977d516da1b None None] snapshot_same_host = True {{(pid=76164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 04:26:22 devstack cinder-volume[76164]: DEBUG oslo_service.backend._eventlet.service [None req-09f55645-c366-4244-999d-a977d516da1b None None] split_loggers = False {{(pid=76164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 04:26:22 devstack cinder-volume[76164]: DEBUG oslo_service.backend._eventlet.service [None req-09f55645-c366-4244-999d-a977d516da1b None None] state_path = /opt/stack/data/cinder {{(pid=76164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 04:26:22 devstack cinder-volume[76164]: DEBUG oslo_service.backend._eventlet.service [None req-09f55645-c366-4244-999d-a977d516da1b None None] storage_availability_zone = nova {{(pid=76164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 04:26:22 devstack cinder-volume[76164]: DEBUG oslo_service.backend._eventlet.service [None req-09f55645-c366-4244-999d-a977d516da1b None None] storage_protocol = iSCSI {{(pid=76164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 04:26:22 devstack cinder-volume[76164]: DEBUG oslo_service.backend._eventlet.service [None req-09f55645-c366-4244-999d-a977d516da1b None None] syslog_log_facility = LOG_USER {{(pid=76164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 04:26:22 devstack cinder-volume[76164]: DEBUG oslo_service.backend._eventlet.service [None req-09f55645-c366-4244-999d-a977d516da1b None None] target_helper = lioadm {{(pid=76164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 04:26:22 devstack cinder-volume[76164]: DEBUG oslo_service.backend._eventlet.service [None req-09f55645-c366-4244-999d-a977d516da1b None None] target_ip_address = 192.168.122.158 {{(pid=76164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 04:26:22 devstack cinder-volume[76164]: DEBUG oslo_service.backend._eventlet.service [None req-09f55645-c366-4244-999d-a977d516da1b None None] target_port = 3260 {{(pid=76164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 04:26:22 devstack cinder-volume[76164]: DEBUG oslo_service.backend._eventlet.service [None req-09f55645-c366-4244-999d-a977d516da1b None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=76164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 04:26:22 devstack cinder-volume[76164]: DEBUG oslo_service.backend._eventlet.service [None req-09f55645-c366-4244-999d-a977d516da1b None None] target_protocol = iscsi {{(pid=76164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 04:26:22 devstack cinder-volume[76164]: DEBUG oslo_service.backend._eventlet.service [None req-09f55645-c366-4244-999d-a977d516da1b None None] target_secondary_ip_addresses = [] {{(pid=76164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 04:26:22 devstack cinder-volume[76164]: DEBUG oslo_service.backend._eventlet.service [None req-09f55645-c366-4244-999d-a977d516da1b None None] trace_flags = None {{(pid=76164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 04:26:22 devstack cinder-volume[76164]: DEBUG oslo_service.backend._eventlet.service [None req-09f55645-c366-4244-999d-a977d516da1b None None] transfer_api_class = cinder.transfer.api.API {{(pid=76164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 04:26:22 devstack cinder-volume[76164]: DEBUG oslo_service.backend._eventlet.service [None req-09f55645-c366-4244-999d-a977d516da1b None None] transport_url = **** {{(pid=76164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 04:26:22 devstack cinder-volume[76164]: DEBUG oslo_service.backend._eventlet.service [None req-09f55645-c366-4244-999d-a977d516da1b None None] until_refresh = 0 {{(pid=76164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 04:26:22 devstack cinder-volume[76164]: DEBUG oslo_service.backend._eventlet.service [None req-09f55645-c366-4244-999d-a977d516da1b None None] use_chap_auth = False {{(pid=76164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 04:26:22 devstack cinder-volume[76164]: DEBUG oslo_service.backend._eventlet.service [None req-09f55645-c366-4244-999d-a977d516da1b None None] use_default_quota_class = True {{(pid=76164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 04:26:22 devstack cinder-volume[76164]: DEBUG oslo_service.backend._eventlet.service [None req-09f55645-c366-4244-999d-a977d516da1b None None] use_journal = False {{(pid=76164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 04:26:22 devstack cinder-volume[76164]: DEBUG oslo_service.backend._eventlet.service [None req-09f55645-c366-4244-999d-a977d516da1b None None] use_json = False {{(pid=76164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 04:26:22 devstack cinder-volume[76164]: DEBUG oslo_service.backend._eventlet.service [None req-09f55645-c366-4244-999d-a977d516da1b None None] use_multipath_for_image_xfer = False {{(pid=76164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 04:26:22 devstack cinder-volume[76164]: DEBUG oslo_service.backend._eventlet.service [None req-09f55645-c366-4244-999d-a977d516da1b None None] use_stderr = False {{(pid=76164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 04:26:22 devstack cinder-volume[76164]: DEBUG oslo_service.backend._eventlet.service [None req-09f55645-c366-4244-999d-a977d516da1b None None] use_syslog = False {{(pid=76164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 04:26:22 devstack cinder-volume[76164]: DEBUG oslo_service.backend._eventlet.service [None req-09f55645-c366-4244-999d-a977d516da1b None None] verify_glance_signatures = enabled {{(pid=76164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 04:26:22 devstack cinder-volume[76164]: DEBUG oslo_service.backend._eventlet.service [None req-09f55645-c366-4244-999d-a977d516da1b None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=76164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 04:26:22 devstack cinder-volume[76164]: DEBUG oslo_service.backend._eventlet.service [None req-09f55645-c366-4244-999d-a977d516da1b None None] volume_api_class = cinder.volume.api.API {{(pid=76164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 04:26:22 devstack cinder-volume[76164]: DEBUG oslo_service.backend._eventlet.service [None req-09f55645-c366-4244-999d-a977d516da1b None None] volume_backend_name = None {{(pid=76164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 04:26:22 devstack cinder-volume[76164]: DEBUG oslo_service.backend._eventlet.service [None req-09f55645-c366-4244-999d-a977d516da1b None None] volume_clear = zero {{(pid=76164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 04:26:22 devstack cinder-volume[76164]: DEBUG oslo_service.backend._eventlet.service [None req-09f55645-c366-4244-999d-a977d516da1b None None] volume_clear_ionice = None {{(pid=76164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 04:26:22 devstack cinder-volume[76164]: DEBUG oslo_service.backend._eventlet.service [None req-09f55645-c366-4244-999d-a977d516da1b None None] volume_clear_size = 0 {{(pid=76164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 04:26:22 devstack cinder-volume[76164]: DEBUG oslo_service.backend._eventlet.service [None req-09f55645-c366-4244-999d-a977d516da1b None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=76164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 04:26:22 devstack cinder-volume[76164]: DEBUG oslo_service.backend._eventlet.service [None req-09f55645-c366-4244-999d-a977d516da1b None None] volume_copy_bps_limit = 0 {{(pid=76164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 04:26:22 devstack cinder-volume[76164]: DEBUG oslo_service.backend._eventlet.service [None req-09f55645-c366-4244-999d-a977d516da1b None None] volume_dd_blocksize = 1M {{(pid=76164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 04:26:22 devstack cinder-volume[76164]: DEBUG oslo_service.backend._eventlet.service [None req-09f55645-c366-4244-999d-a977d516da1b None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=76164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 04:26:22 devstack cinder-volume[76164]: DEBUG oslo_service.backend._eventlet.service [None req-09f55645-c366-4244-999d-a977d516da1b None None] volume_name_template = volume-%s {{(pid=76164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 04:26:22 devstack cinder-volume[76164]: DEBUG oslo_service.backend._eventlet.service [None req-09f55645-c366-4244-999d-a977d516da1b None None] volume_service_inithost_offload = False {{(pid=76164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 04:26:22 devstack cinder-volume[76164]: DEBUG oslo_service.backend._eventlet.service [None req-09f55645-c366-4244-999d-a977d516da1b None None] volume_usage_audit_period = month {{(pid=76164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 04:26:22 devstack cinder-volume[76164]: DEBUG oslo_service.backend._eventlet.service [None req-09f55645-c366-4244-999d-a977d516da1b None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=76164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 04:26:22 devstack cinder-volume[76164]: DEBUG oslo_service.backend._eventlet.service [None req-09f55645-c366-4244-999d-a977d516da1b None None] zoning_mode = None {{(pid=76164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 04:26:22 devstack cinder-volume[76164]: DEBUG oslo_service.backend._eventlet.service [None req-09f55645-c366-4244-999d-a977d516da1b None None] oslo_concurrency.disable_process_locking = False {{(pid=76164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:26:22 devstack cinder-volume[76164]: DEBUG oslo_service.backend._eventlet.service [None req-09f55645-c366-4244-999d-a977d516da1b None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=76164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:26:22 devstack cinder-volume[76164]: DEBUG oslo_service.backend._eventlet.service [None req-09f55645-c366-4244-999d-a977d516da1b None None] os_brick.lightos_discovery_client_address = localhost {{(pid=76164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:26:22 devstack cinder-volume[76164]: DEBUG oslo_service.backend._eventlet.service [None req-09f55645-c366-4244-999d-a977d516da1b None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=76164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:26:22 devstack cinder-volume[76164]: DEBUG oslo_service.backend._eventlet.service [None req-09f55645-c366-4244-999d-a977d516da1b None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=76164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:26:22 devstack cinder-volume[76164]: DEBUG oslo_service.backend._eventlet.service [None req-09f55645-c366-4244-999d-a977d516da1b None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=76164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:26:22 devstack cinder-volume[76164]: DEBUG oslo_service.backend._eventlet.service [None req-09f55645-c366-4244-999d-a977d516da1b None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=76164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:26:22 devstack cinder-volume[76164]: DEBUG oslo_service.backend._eventlet.service [None req-09f55645-c366-4244-999d-a977d516da1b None None] os_brick.wait_mpath_device_interval = 1 {{(pid=76164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:26:22 devstack cinder-volume[76164]: DEBUG oslo_service.backend._eventlet.service [None req-09f55645-c366-4244-999d-a977d516da1b None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=76164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:26:22 devstack cinder-volume[76164]: DEBUG oslo_service.backend._eventlet.service [None req-09f55645-c366-4244-999d-a977d516da1b None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=76164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:26:22 devstack cinder-volume[76164]: DEBUG oslo_service.backend._eventlet.service [None req-09f55645-c366-4244-999d-a977d516da1b None None] keystone_authtoken.auth_section = None {{(pid=76164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:26:22 devstack cinder-volume[76164]: DEBUG oslo_service.backend._eventlet.service [None req-09f55645-c366-4244-999d-a977d516da1b None None] keystone_authtoken.auth_type = password {{(pid=76164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:26:22 devstack cinder-volume[76164]: DEBUG oslo_service.backend._eventlet.service [None req-09f55645-c366-4244-999d-a977d516da1b None None] keystone_authtoken.auth_version = None {{(pid=76164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:26:22 devstack cinder-volume[76164]: DEBUG oslo_service.backend._eventlet.service [None req-09f55645-c366-4244-999d-a977d516da1b None None] keystone_authtoken.cache = None {{(pid=76164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:26:22 devstack cinder-volume[76164]: DEBUG oslo_service.backend._eventlet.service [None req-09f55645-c366-4244-999d-a977d516da1b None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=76164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:26:22 devstack cinder-volume[76164]: DEBUG oslo_service.backend._eventlet.service [None req-09f55645-c366-4244-999d-a977d516da1b None None] keystone_authtoken.certfile = None {{(pid=76164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:26:22 devstack cinder-volume[76164]: DEBUG oslo_service.backend._eventlet.service [None req-09f55645-c366-4244-999d-a977d516da1b None None] keystone_authtoken.delay_auth_decision = False {{(pid=76164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:26:22 devstack cinder-volume[76164]: DEBUG oslo_service.backend._eventlet.service [None req-09f55645-c366-4244-999d-a977d516da1b None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=76164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:26:22 devstack cinder-volume[76164]: DEBUG oslo_service.backend._eventlet.service [None req-09f55645-c366-4244-999d-a977d516da1b None None] keystone_authtoken.http_connect_timeout = None {{(pid=76164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:26:22 devstack cinder-volume[76164]: DEBUG oslo_service.backend._eventlet.service [None req-09f55645-c366-4244-999d-a977d516da1b None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=76164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:26:22 devstack cinder-volume[76164]: DEBUG oslo_service.backend._eventlet.service [None req-09f55645-c366-4244-999d-a977d516da1b None None] keystone_authtoken.include_service_catalog = True {{(pid=76164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:26:22 devstack cinder-volume[76164]: DEBUG oslo_service.backend._eventlet.service [None req-09f55645-c366-4244-999d-a977d516da1b None None] keystone_authtoken.insecure = False {{(pid=76164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:26:22 devstack cinder-volume[76164]: DEBUG oslo_service.backend._eventlet.service [None req-09f55645-c366-4244-999d-a977d516da1b None None] keystone_authtoken.interface = public {{(pid=76164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:26:22 devstack cinder-volume[76164]: DEBUG oslo_service.backend._eventlet.service [None req-09f55645-c366-4244-999d-a977d516da1b None None] keystone_authtoken.keyfile = None {{(pid=76164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:26:22 devstack cinder-volume[76164]: DEBUG oslo_service.backend._eventlet.service [None req-09f55645-c366-4244-999d-a977d516da1b None None] keystone_authtoken.memcache_password = {{(pid=76164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:26:22 devstack cinder-volume[76164]: DEBUG oslo_service.backend._eventlet.service [None req-09f55645-c366-4244-999d-a977d516da1b None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=76164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:26:22 devstack cinder-volume[76164]: DEBUG oslo_service.backend._eventlet.service [None req-09f55645-c366-4244-999d-a977d516da1b None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=76164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:26:22 devstack cinder-volume[76164]: DEBUG oslo_service.backend._eventlet.service [None req-09f55645-c366-4244-999d-a977d516da1b None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=76164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:26:22 devstack cinder-volume[76164]: DEBUG oslo_service.backend._eventlet.service [None req-09f55645-c366-4244-999d-a977d516da1b None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=76164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:26:22 devstack cinder-volume[76164]: DEBUG oslo_service.backend._eventlet.service [None req-09f55645-c366-4244-999d-a977d516da1b None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=76164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:26:22 devstack cinder-volume[76164]: DEBUG oslo_service.backend._eventlet.service [None req-09f55645-c366-4244-999d-a977d516da1b None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=76164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:26:22 devstack cinder-volume[76164]: DEBUG oslo_service.backend._eventlet.service [None req-09f55645-c366-4244-999d-a977d516da1b None None] keystone_authtoken.memcache_secret_key = **** {{(pid=76164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:26:22 devstack cinder-volume[76164]: DEBUG oslo_service.backend._eventlet.service [None req-09f55645-c366-4244-999d-a977d516da1b None None] keystone_authtoken.memcache_security_strategy = None {{(pid=76164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:26:22 devstack cinder-volume[76364]: INFO cinder.volume.manager [None req-576c097b-4e06-49ee-a089-596b15698f59 None None] Starting volume driver LVMVolumeDriver (3.0.0) Jul 10 04:26:22 devstack cinder-volume[76164]: DEBUG oslo_service.backend._eventlet.service [None req-09f55645-c366-4244-999d-a977d516da1b None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=76164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:26:22 devstack cinder-volume[76164]: DEBUG oslo_service.backend._eventlet.service [None req-09f55645-c366-4244-999d-a977d516da1b None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=76164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:26:22 devstack cinder-volume[76164]: DEBUG oslo_service.backend._eventlet.service [None req-09f55645-c366-4244-999d-a977d516da1b None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=76164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:26:22 devstack cinder-volume[76164]: DEBUG oslo_service.backend._eventlet.service [None req-09f55645-c366-4244-999d-a977d516da1b None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=76164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:26:22 devstack cinder-volume[76164]: DEBUG oslo_service.backend._eventlet.service [None req-09f55645-c366-4244-999d-a977d516da1b None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=76164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:26:22 devstack cinder-volume[76164]: DEBUG oslo_service.backend._eventlet.service [None req-09f55645-c366-4244-999d-a977d516da1b None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=76164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:26:22 devstack cinder-volume[76364]: DEBUG oslo_concurrency.processutils [None req-576c097b-4e06-49ee-a089-596b15698f59 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:26:22 devstack cinder-volume[76164]: DEBUG oslo_service.backend._eventlet.service [None req-09f55645-c366-4244-999d-a977d516da1b None None] keystone_authtoken.memcache_username = {{(pid=76164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:26:22 devstack cinder-volume[76164]: DEBUG oslo_service.backend._eventlet.service [None req-09f55645-c366-4244-999d-a977d516da1b None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=76164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:26:22 devstack cinder-volume[76164]: DEBUG oslo_service.backend._eventlet.service [None req-09f55645-c366-4244-999d-a977d516da1b None None] keystone_authtoken.region_name = None {{(pid=76164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:26:22 devstack cinder-volume[76164]: DEBUG oslo_service.backend._eventlet.service [None req-09f55645-c366-4244-999d-a977d516da1b None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=76164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:26:22 devstack cinder-volume[76164]: DEBUG oslo_service.backend._eventlet.service [None req-09f55645-c366-4244-999d-a977d516da1b None None] keystone_authtoken.service_token_roles_required = True {{(pid=76164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:26:22 devstack cinder-volume[76164]: DEBUG oslo_service.backend._eventlet.service [None req-09f55645-c366-4244-999d-a977d516da1b None None] keystone_authtoken.service_type = None {{(pid=76164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:26:22 devstack cinder-volume[76164]: DEBUG oslo_service.backend._eventlet.service [None req-09f55645-c366-4244-999d-a977d516da1b None None] keystone_authtoken.token_cache_time = 300 {{(pid=76164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:26:22 devstack cinder-volume[76164]: DEBUG oslo_service.backend._eventlet.service [None req-09f55645-c366-4244-999d-a977d516da1b None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.158/identity {{(pid=76164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:26:22 devstack cinder-volume[76164]: DEBUG oslo_service.backend._eventlet.service [None req-09f55645-c366-4244-999d-a977d516da1b None None] cache.backend = dogpile.cache.null {{(pid=76164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:26:22 devstack cinder-volume[76164]: DEBUG oslo_service.backend._eventlet.service [None req-09f55645-c366-4244-999d-a977d516da1b None None] cache.backend_argument = **** {{(pid=76164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:26:22 devstack cinder-volume[76164]: DEBUG oslo_service.backend._eventlet.service [None req-09f55645-c366-4244-999d-a977d516da1b None None] cache.backend_expiration_time = None {{(pid=76164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:26:22 devstack cinder-volume[76164]: DEBUG oslo_service.backend._eventlet.service [None req-09f55645-c366-4244-999d-a977d516da1b None None] cache.config_prefix = cache.oslo {{(pid=76164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:26:22 devstack cinder-volume[76164]: DEBUG oslo_service.backend._eventlet.service [None req-09f55645-c366-4244-999d-a977d516da1b None None] cache.debug_cache_backend = False {{(pid=76164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:26:22 devstack cinder-volume[76164]: DEBUG oslo_service.backend._eventlet.service [None req-09f55645-c366-4244-999d-a977d516da1b None None] cache.enable_retry_client = False {{(pid=76164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:26:22 devstack cinder-volume[76164]: DEBUG oslo_service.backend._eventlet.service [None req-09f55645-c366-4244-999d-a977d516da1b None None] cache.enable_socket_keepalive = False {{(pid=76164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:26:22 devstack cinder-volume[76164]: DEBUG oslo_service.backend._eventlet.service [None req-09f55645-c366-4244-999d-a977d516da1b None None] cache.enabled = False {{(pid=76164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:26:22 devstack cinder-volume[76164]: DEBUG oslo_service.backend._eventlet.service [None req-09f55645-c366-4244-999d-a977d516da1b None None] cache.expiration_time = 600 {{(pid=76164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:26:22 devstack cinder-volume[76164]: DEBUG oslo_service.backend._eventlet.service [None req-09f55645-c366-4244-999d-a977d516da1b None None] cache.hashclient_dead_timeout = 60.0 {{(pid=76164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:26:22 devstack cinder-volume[76164]: DEBUG oslo_service.backend._eventlet.service [None req-09f55645-c366-4244-999d-a977d516da1b None None] cache.hashclient_retry_attempts = 2 {{(pid=76164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:26:22 devstack cinder-volume[76164]: DEBUG oslo_service.backend._eventlet.service [None req-09f55645-c366-4244-999d-a977d516da1b None None] cache.hashclient_retry_timeout = 1.0 {{(pid=76164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:26:22 devstack cinder-volume[76164]: DEBUG oslo_service.backend._eventlet.service [None req-09f55645-c366-4244-999d-a977d516da1b None None] cache.memcache_dead_retry = 300 {{(pid=76164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:26:22 devstack cinder-volume[76164]: DEBUG oslo_service.backend._eventlet.service [None req-09f55645-c366-4244-999d-a977d516da1b None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=76164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:26:22 devstack cinder-volume[76164]: DEBUG oslo_service.backend._eventlet.service [None req-09f55645-c366-4244-999d-a977d516da1b None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=76164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:26:22 devstack cinder-volume[76164]: DEBUG oslo_service.backend._eventlet.service [None req-09f55645-c366-4244-999d-a977d516da1b None None] cache.memcache_pool_maxsize = 10 {{(pid=76164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:26:22 devstack cinder-volume[76164]: DEBUG oslo_service.backend._eventlet.service [None req-09f55645-c366-4244-999d-a977d516da1b None None] cache.memcache_pool_unused_timeout = 60 {{(pid=76164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:26:22 devstack cinder-volume[76164]: DEBUG oslo_service.backend._eventlet.service [None req-09f55645-c366-4244-999d-a977d516da1b None None] cache.memcache_sasl_enabled = False {{(pid=76164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:26:22 devstack cinder-volume[76164]: DEBUG oslo_service.backend._eventlet.service [None req-09f55645-c366-4244-999d-a977d516da1b None None] cache.memcache_servers = ['localhost:11211'] {{(pid=76164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:26:22 devstack cinder-volume[76164]: DEBUG oslo_service.backend._eventlet.service [None req-09f55645-c366-4244-999d-a977d516da1b None None] cache.password = **** {{(pid=76164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:26:22 devstack cinder-volume[76164]: DEBUG oslo_service.backend._eventlet.service [None req-09f55645-c366-4244-999d-a977d516da1b None None] cache.proxies = [] {{(pid=76164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:26:22 devstack cinder-volume[76164]: DEBUG oslo_service.backend._eventlet.service [None req-09f55645-c366-4244-999d-a977d516da1b None None] cache.redis_db = 0 {{(pid=76164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:26:22 devstack cinder-volume[76164]: DEBUG oslo_service.backend._eventlet.service [None req-09f55645-c366-4244-999d-a977d516da1b None None] cache.redis_sentinel_service_name = mymaster {{(pid=76164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:26:22 devstack cinder-volume[76164]: DEBUG oslo_service.backend._eventlet.service [None req-09f55645-c366-4244-999d-a977d516da1b None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=76164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:26:22 devstack cinder-volume[76164]: DEBUG oslo_service.backend._eventlet.service [None req-09f55645-c366-4244-999d-a977d516da1b None None] cache.redis_server = localhost:6379 {{(pid=76164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:26:22 devstack cinder-volume[76164]: DEBUG oslo_service.backend._eventlet.service [None req-09f55645-c366-4244-999d-a977d516da1b None None] cache.retry_attempts = 2 {{(pid=76164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:26:22 devstack cinder-volume[76164]: DEBUG oslo_service.backend._eventlet.service [None req-09f55645-c366-4244-999d-a977d516da1b None None] cache.retry_delay = 0.0 {{(pid=76164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:26:22 devstack cinder-volume[76164]: DEBUG oslo_service.backend._eventlet.service [None req-09f55645-c366-4244-999d-a977d516da1b None None] cache.socket_keepalive_count = 1 {{(pid=76164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:26:22 devstack cinder-volume[76164]: DEBUG oslo_service.backend._eventlet.service [None req-09f55645-c366-4244-999d-a977d516da1b None None] cache.socket_keepalive_idle = 1 {{(pid=76164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:26:22 devstack cinder-volume[76164]: DEBUG oslo_service.backend._eventlet.service [None req-09f55645-c366-4244-999d-a977d516da1b None None] cache.socket_keepalive_interval = 1 {{(pid=76164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:26:22 devstack cinder-volume[76164]: DEBUG oslo_service.backend._eventlet.service [None req-09f55645-c366-4244-999d-a977d516da1b None None] cache.socket_timeout = 1.0 {{(pid=76164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:26:22 devstack cinder-volume[76164]: DEBUG oslo_service.backend._eventlet.service [None req-09f55645-c366-4244-999d-a977d516da1b None None] cache.tls_allowed_ciphers = None {{(pid=76164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:26:22 devstack cinder-volume[76164]: DEBUG oslo_service.backend._eventlet.service [None req-09f55645-c366-4244-999d-a977d516da1b None None] cache.tls_cafile = None {{(pid=76164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:26:22 devstack cinder-volume[76164]: DEBUG oslo_service.backend._eventlet.service [None req-09f55645-c366-4244-999d-a977d516da1b None None] cache.tls_certfile = None {{(pid=76164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:26:22 devstack cinder-volume[76164]: DEBUG oslo_service.backend._eventlet.service [None req-09f55645-c366-4244-999d-a977d516da1b None None] cache.tls_enabled = False {{(pid=76164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:26:22 devstack cinder-volume[76164]: DEBUG oslo_service.backend._eventlet.service [None req-09f55645-c366-4244-999d-a977d516da1b None None] cache.tls_keyfile = None {{(pid=76164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:26:22 devstack cinder-volume[76164]: DEBUG oslo_service.backend._eventlet.service [None req-09f55645-c366-4244-999d-a977d516da1b None None] cache.username = None {{(pid=76164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:26:22 devstack cinder-volume[76164]: DEBUG oslo_service.backend._eventlet.service [None req-09f55645-c366-4244-999d-a977d516da1b None None] coordination.backend_url = **** {{(pid=76164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:26:22 devstack cinder-volume[76164]: DEBUG oslo_service.backend._eventlet.service [None req-09f55645-c366-4244-999d-a977d516da1b None None] database.asyncio_connection = **** {{(pid=76164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:26:22 devstack cinder-volume[76164]: DEBUG oslo_service.backend._eventlet.service [None req-09f55645-c366-4244-999d-a977d516da1b None None] database.asyncio_slave_connection = **** {{(pid=76164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:26:22 devstack cinder-volume[76164]: DEBUG oslo_service.backend._eventlet.service [None req-09f55645-c366-4244-999d-a977d516da1b None None] database.backend = sqlalchemy {{(pid=76164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:26:22 devstack cinder-volume[76164]: DEBUG oslo_service.backend._eventlet.service [None req-09f55645-c366-4244-999d-a977d516da1b None None] database.connection = **** {{(pid=76164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:26:22 devstack cinder-volume[76164]: DEBUG oslo_service.backend._eventlet.service [None req-09f55645-c366-4244-999d-a977d516da1b None None] database.connection_debug = 0 {{(pid=76164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:26:22 devstack cinder-volume[76164]: DEBUG oslo_service.backend._eventlet.service [None req-09f55645-c366-4244-999d-a977d516da1b None None] database.connection_parameters = {{(pid=76164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:26:22 devstack cinder-volume[76164]: DEBUG oslo_service.backend._eventlet.service [None req-09f55645-c366-4244-999d-a977d516da1b None None] database.connection_recycle_time = 3600 {{(pid=76164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:26:22 devstack cinder-volume[76164]: DEBUG oslo_service.backend._eventlet.service [None req-09f55645-c366-4244-999d-a977d516da1b None None] database.connection_trace = False {{(pid=76164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:26:22 devstack cinder-volume[76164]: DEBUG oslo_service.backend._eventlet.service [None req-09f55645-c366-4244-999d-a977d516da1b None None] database.db_inc_retry_interval = True {{(pid=76164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:26:22 devstack cinder-volume[76164]: DEBUG oslo_service.backend._eventlet.service [None req-09f55645-c366-4244-999d-a977d516da1b None None] database.db_max_retries = 20 {{(pid=76164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:26:22 devstack cinder-volume[76164]: DEBUG oslo_service.backend._eventlet.service [None req-09f55645-c366-4244-999d-a977d516da1b None None] database.db_max_retry_interval = 10 {{(pid=76164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:26:22 devstack cinder-volume[76164]: DEBUG oslo_service.backend._eventlet.service [None req-09f55645-c366-4244-999d-a977d516da1b None None] database.db_retry_interval = 1 {{(pid=76164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:26:22 devstack cinder-volume[76164]: DEBUG oslo_service.backend._eventlet.service [None req-09f55645-c366-4244-999d-a977d516da1b None None] database.max_overflow = 50 {{(pid=76164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:26:22 devstack cinder-volume[76164]: DEBUG oslo_service.backend._eventlet.service [None req-09f55645-c366-4244-999d-a977d516da1b None None] database.max_pool_size = 5 {{(pid=76164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:26:22 devstack cinder-volume[76164]: DEBUG oslo_service.backend._eventlet.service [None req-09f55645-c366-4244-999d-a977d516da1b None None] database.max_retries = 10 {{(pid=76164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:26:22 devstack cinder-volume[76164]: DEBUG oslo_service.backend._eventlet.service [None req-09f55645-c366-4244-999d-a977d516da1b None None] database.mysql_sql_mode = TRADITIONAL {{(pid=76164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:26:22 devstack cinder-volume[76164]: DEBUG oslo_service.backend._eventlet.service [None req-09f55645-c366-4244-999d-a977d516da1b None None] database.mysql_wsrep_sync_wait = None {{(pid=76164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:26:22 devstack cinder-volume[76164]: DEBUG oslo_service.backend._eventlet.service [None req-09f55645-c366-4244-999d-a977d516da1b None None] database.pool_timeout = None {{(pid=76164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:26:22 devstack cinder-volume[76164]: DEBUG oslo_service.backend._eventlet.service [None req-09f55645-c366-4244-999d-a977d516da1b None None] database.retry_interval = 10 {{(pid=76164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:26:22 devstack cinder-volume[76164]: DEBUG oslo_service.backend._eventlet.service [None req-09f55645-c366-4244-999d-a977d516da1b None None] database.slave_connection = **** {{(pid=76164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:26:22 devstack cinder-volume[76164]: DEBUG oslo_service.backend._eventlet.service [None req-09f55645-c366-4244-999d-a977d516da1b None None] database.sqlite_synchronous = True {{(pid=76164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:26:22 devstack cinder-volume[76164]: DEBUG oslo_service.backend._eventlet.service [None req-09f55645-c366-4244-999d-a977d516da1b None None] database.synchronous_reader = True {{(pid=76164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:26:22 devstack cinder-volume[76164]: DEBUG oslo_service.backend._eventlet.service [None req-09f55645-c366-4244-999d-a977d516da1b None None] database.use_db_reconnect = False {{(pid=76164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:26:22 devstack cinder-volume[76164]: DEBUG oslo_service.backend._eventlet.service [None req-09f55645-c366-4244-999d-a977d516da1b None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=76164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:26:22 devstack cinder-volume[76164]: DEBUG oslo_service.backend._eventlet.service [None req-09f55645-c366-4244-999d-a977d516da1b None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=76164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:26:22 devstack cinder-volume[76164]: DEBUG oslo_service.backend._eventlet.service [None req-09f55645-c366-4244-999d-a977d516da1b None None] oslo_messaging_metrics.metrics_process_name = {{(pid=76164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:26:22 devstack cinder-volume[76164]: DEBUG oslo_service.backend._eventlet.service [None req-09f55645-c366-4244-999d-a977d516da1b None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=76164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:26:22 devstack cinder-volume[76164]: DEBUG oslo_service.backend._eventlet.service [None req-09f55645-c366-4244-999d-a977d516da1b None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=76164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:26:22 devstack cinder-volume[76164]: DEBUG oslo_service.backend._eventlet.service [None req-09f55645-c366-4244-999d-a977d516da1b None None] profiler.connection_string = messaging:// {{(pid=76164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:26:22 devstack cinder-volume[76164]: DEBUG oslo_service.backend._eventlet.service [None req-09f55645-c366-4244-999d-a977d516da1b None None] profiler.enabled = False {{(pid=76164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:26:22 devstack cinder-volume[76164]: DEBUG oslo_service.backend._eventlet.service [None req-09f55645-c366-4244-999d-a977d516da1b None None] profiler.es_doc_type = notification {{(pid=76164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:26:22 devstack cinder-volume[76164]: DEBUG oslo_service.backend._eventlet.service [None req-09f55645-c366-4244-999d-a977d516da1b None None] profiler.es_scroll_size = 10000 {{(pid=76164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:26:22 devstack cinder-volume[76164]: DEBUG oslo_service.backend._eventlet.service [None req-09f55645-c366-4244-999d-a977d516da1b None None] profiler.es_scroll_time = 2m {{(pid=76164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:26:22 devstack cinder-volume[76164]: DEBUG oslo_service.backend._eventlet.service [None req-09f55645-c366-4244-999d-a977d516da1b None None] profiler.filter_error_trace = False {{(pid=76164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:26:22 devstack cinder-volume[76164]: DEBUG oslo_service.backend._eventlet.service [None req-09f55645-c366-4244-999d-a977d516da1b None None] profiler.hmac_keys = **** {{(pid=76164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:26:22 devstack cinder-volume[76164]: DEBUG oslo_service.backend._eventlet.service [None req-09f55645-c366-4244-999d-a977d516da1b None None] profiler.sentinel_service_name = mymaster {{(pid=76164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:26:22 devstack cinder-volume[76164]: DEBUG oslo_service.backend._eventlet.service [None req-09f55645-c366-4244-999d-a977d516da1b None None] profiler.socket_timeout = 0.1 {{(pid=76164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:26:22 devstack cinder-volume[76164]: DEBUG oslo_service.backend._eventlet.service [None req-09f55645-c366-4244-999d-a977d516da1b None None] profiler.trace_requests = False {{(pid=76164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:26:22 devstack cinder-volume[76164]: DEBUG oslo_service.backend._eventlet.service [None req-09f55645-c366-4244-999d-a977d516da1b None None] profiler.trace_sqlalchemy = False {{(pid=76164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:26:22 devstack cinder-volume[76164]: DEBUG oslo_service.backend._eventlet.service [None req-09f55645-c366-4244-999d-a977d516da1b None None] profiler_jaeger.process_tags = {} {{(pid=76164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:26:22 devstack cinder-volume[76364]: DEBUG oslo_concurrency.processutils [None req-576c097b-4e06-49ee-a089-596b15698f59 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.044s {{(pid=76364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:26:22 devstack cinder-volume[76164]: DEBUG oslo_service.backend._eventlet.service [None req-09f55645-c366-4244-999d-a977d516da1b None None] profiler_jaeger.service_name_prefix = None {{(pid=76164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:26:22 devstack cinder-volume[76164]: DEBUG oslo_service.backend._eventlet.service [None req-09f55645-c366-4244-999d-a977d516da1b None None] profiler_otlp.service_name_prefix = None {{(pid=76164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:26:22 devstack cinder-volume[76164]: DEBUG oslo_service.backend._eventlet.service [None req-09f55645-c366-4244-999d-a977d516da1b None None] oslo_policy.enforce_new_defaults = True {{(pid=76164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:26:22 devstack cinder-volume[76164]: DEBUG oslo_service.backend._eventlet.service [None req-09f55645-c366-4244-999d-a977d516da1b None None] oslo_policy.enforce_scope = False {{(pid=76164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:26:22 devstack cinder-volume[76164]: DEBUG oslo_service.backend._eventlet.service [None req-09f55645-c366-4244-999d-a977d516da1b None None] oslo_policy.policy_default_rule = default {{(pid=76164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:26:22 devstack cinder-volume[76164]: DEBUG oslo_service.backend._eventlet.service [None req-09f55645-c366-4244-999d-a977d516da1b None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=76164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:26:22 devstack cinder-volume[76364]: DEBUG oslo_concurrency.processutils [None req-576c097b-4e06-49ee-a089-596b15698f59 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:26:22 devstack cinder-volume[76164]: DEBUG oslo_service.backend._eventlet.service [None req-09f55645-c366-4244-999d-a977d516da1b None None] oslo_policy.policy_file = policy.yaml {{(pid=76164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:26:22 devstack cinder-volume[76164]: DEBUG oslo_service.backend._eventlet.service [None req-09f55645-c366-4244-999d-a977d516da1b None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=76164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:26:22 devstack cinder-volume[76164]: DEBUG oslo_service.backend._eventlet.service [None req-09f55645-c366-4244-999d-a977d516da1b None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=76164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:26:22 devstack cinder-volume[76164]: DEBUG oslo_service.backend._eventlet.service [None req-09f55645-c366-4244-999d-a977d516da1b None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=76164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:26:22 devstack cinder-volume[76164]: DEBUG oslo_service.backend._eventlet.service [None req-09f55645-c366-4244-999d-a977d516da1b None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=76164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:26:22 devstack cinder-volume[76164]: DEBUG oslo_service.backend._eventlet.service [None req-09f55645-c366-4244-999d-a977d516da1b None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=76164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:26:22 devstack sudo[76370]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1 Jul 10 04:26:22 devstack cinder-volume[76164]: DEBUG oslo_service.backend._eventlet.service [None req-09f55645-c366-4244-999d-a977d516da1b None None] oslo_policy.remote_timeout = 60.0 {{(pid=76164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:26:22 devstack cinder-volume[76164]: DEBUG oslo_service.backend._eventlet.service [None req-09f55645-c366-4244-999d-a977d516da1b None None] privsep_osbrick.capabilities = [21, 2] {{(pid=76164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:26:22 devstack cinder-volume[76164]: DEBUG oslo_service.backend._eventlet.service [None req-09f55645-c366-4244-999d-a977d516da1b None None] privsep_osbrick.group = None {{(pid=76164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:26:22 devstack cinder-volume[76164]: DEBUG oslo_service.backend._eventlet.service [None req-09f55645-c366-4244-999d-a977d516da1b None None] privsep_osbrick.helper_command = None {{(pid=76164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:26:22 devstack cinder-volume[76164]: DEBUG oslo_service.backend._eventlet.service [None req-09f55645-c366-4244-999d-a977d516da1b None None] privsep_osbrick.log_daemon_traceback = False {{(pid=76164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:26:22 devstack cinder-volume[76164]: DEBUG oslo_service.backend._eventlet.service [None req-09f55645-c366-4244-999d-a977d516da1b None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=76164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:26:22 devstack cinder-volume[76164]: DEBUG oslo_service.backend._eventlet.service [None req-09f55645-c366-4244-999d-a977d516da1b None None] privsep_osbrick.thread_pool_size = 4 {{(pid=76164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:26:22 devstack sudo[76370]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:26:22 devstack cinder-volume[76164]: DEBUG oslo_service.backend._eventlet.service [None req-09f55645-c366-4244-999d-a977d516da1b None None] privsep_osbrick.user = None {{(pid=76164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:26:22 devstack cinder-volume[76164]: DEBUG oslo_service.backend._eventlet.service [None req-09f55645-c366-4244-999d-a977d516da1b None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=76164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:26:22 devstack cinder-volume[76164]: DEBUG oslo_service.backend._eventlet.service [None req-09f55645-c366-4244-999d-a977d516da1b None None] cinder_sys_admin.group = None {{(pid=76164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:26:22 devstack cinder-volume[76164]: DEBUG oslo_service.backend._eventlet.service [None req-09f55645-c366-4244-999d-a977d516da1b None None] cinder_sys_admin.helper_command = None {{(pid=76164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:26:22 devstack cinder-volume[76164]: DEBUG oslo_service.backend._eventlet.service [None req-09f55645-c366-4244-999d-a977d516da1b None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=76164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:26:22 devstack cinder-volume[76164]: DEBUG oslo_service.backend._eventlet.service [None req-09f55645-c366-4244-999d-a977d516da1b None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=76164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:26:22 devstack cinder-volume[76164]: DEBUG oslo_service.backend._eventlet.service [None req-09f55645-c366-4244-999d-a977d516da1b None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=76164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:26:22 devstack cinder-volume[76164]: DEBUG oslo_service.backend._eventlet.service [None req-09f55645-c366-4244-999d-a977d516da1b None None] cinder_sys_admin.user = None {{(pid=76164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:26:22 devstack cinder-volume[76164]: DEBUG oslo_service.backend._eventlet.service [None req-09f55645-c366-4244-999d-a977d516da1b None None] service_user.auth_section = None {{(pid=76164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:26:22 devstack cinder-volume[76164]: DEBUG oslo_service.backend._eventlet.service [None req-09f55645-c366-4244-999d-a977d516da1b None None] service_user.auth_type = password {{(pid=76164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:26:22 devstack cinder-volume[76164]: DEBUG oslo_service.backend._eventlet.service [None req-09f55645-c366-4244-999d-a977d516da1b None None] service_user.cafile = None {{(pid=76164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:26:22 devstack cinder-volume[76164]: DEBUG oslo_service.backend._eventlet.service [None req-09f55645-c366-4244-999d-a977d516da1b None None] service_user.certfile = None {{(pid=76164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:26:22 devstack cinder-volume[76164]: DEBUG oslo_service.backend._eventlet.service [None req-09f55645-c366-4244-999d-a977d516da1b None None] service_user.collect_timing = False {{(pid=76164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:26:22 devstack cinder-volume[76164]: DEBUG oslo_service.backend._eventlet.service [None req-09f55645-c366-4244-999d-a977d516da1b None None] service_user.insecure = False {{(pid=76164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:26:22 devstack cinder-volume[76164]: DEBUG oslo_service.backend._eventlet.service [None req-09f55645-c366-4244-999d-a977d516da1b None None] service_user.keyfile = None {{(pid=76164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:26:22 devstack cinder-volume[76164]: DEBUG oslo_service.backend._eventlet.service [None req-09f55645-c366-4244-999d-a977d516da1b None None] service_user.send_service_user_token = True {{(pid=76164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:26:22 devstack cinder-volume[76164]: DEBUG oslo_service.backend._eventlet.service [None req-09f55645-c366-4244-999d-a977d516da1b None None] service_user.split_loggers = False {{(pid=76164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:26:22 devstack cinder-volume[76164]: DEBUG oslo_service.backend._eventlet.service [None req-09f55645-c366-4244-999d-a977d516da1b None None] service_user.timeout = None {{(pid=76164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:26:22 devstack cinder-volume[76164]: DEBUG oslo_service.backend._eventlet.service [None req-09f55645-c366-4244-999d-a977d516da1b None None] glance.auth_section = None {{(pid=76164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:26:22 devstack cinder-volume[76164]: DEBUG oslo_service.backend._eventlet.service [None req-09f55645-c366-4244-999d-a977d516da1b None None] glance.auth_type = password {{(pid=76164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:26:22 devstack cinder-volume[76164]: DEBUG oslo_service.backend._eventlet.service [None req-09f55645-c366-4244-999d-a977d516da1b None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=76164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:26:22 devstack cinder-volume[76164]: DEBUG oslo_service.backend._eventlet.service [None req-09f55645-c366-4244-999d-a977d516da1b None None] glance.certfile = None {{(pid=76164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:26:22 devstack cinder-volume[76164]: DEBUG oslo_service.backend._eventlet.service [None req-09f55645-c366-4244-999d-a977d516da1b None None] glance.collect_timing = False {{(pid=76164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:26:22 devstack cinder-volume[76164]: DEBUG oslo_service.backend._eventlet.service [None req-09f55645-c366-4244-999d-a977d516da1b None None] glance.insecure = False {{(pid=76164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:26:22 devstack cinder-volume[76164]: DEBUG oslo_service.backend._eventlet.service [None req-09f55645-c366-4244-999d-a977d516da1b None None] glance.keyfile = None {{(pid=76164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:26:22 devstack cinder-volume[76164]: DEBUG oslo_service.backend._eventlet.service [None req-09f55645-c366-4244-999d-a977d516da1b None None] glance.region_name = None {{(pid=76164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:26:22 devstack cinder-volume[76164]: DEBUG oslo_service.backend._eventlet.service [None req-09f55645-c366-4244-999d-a977d516da1b None None] glance.split_loggers = False {{(pid=76164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:26:22 devstack cinder-volume[76164]: DEBUG oslo_service.backend._eventlet.service [None req-09f55645-c366-4244-999d-a977d516da1b None None] glance.timeout = None {{(pid=76164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:26:22 devstack cinder-volume[76164]: DEBUG oslo_service.backend._eventlet.service [None req-09f55645-c366-4244-999d-a977d516da1b None None] backend_defaults.backend_availability_zone = None {{(pid=76164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:26:22 devstack cinder-volume[76164]: DEBUG oslo_service.backend._eventlet.service [None req-09f55645-c366-4244-999d-a977d516da1b None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=76164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:26:22 devstack cinder-volume[76164]: DEBUG oslo_service.backend._eventlet.service [None req-09f55645-c366-4244-999d-a977d516da1b None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=76164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:26:22 devstack cinder-volume[76164]: DEBUG oslo_service.backend._eventlet.service [None req-09f55645-c366-4244-999d-a977d516da1b None None] backend_defaults.chap_password = **** {{(pid=76164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:26:22 devstack cinder-volume[76164]: DEBUG oslo_service.backend._eventlet.service [None req-09f55645-c366-4244-999d-a977d516da1b None None] backend_defaults.chap_username = {{(pid=76164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:26:22 devstack cinder-volume[76164]: DEBUG oslo_service.backend._eventlet.service [None req-09f55645-c366-4244-999d-a977d516da1b None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=76164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:26:22 devstack cinder-volume[76164]: DEBUG oslo_service.backend._eventlet.service [None req-09f55645-c366-4244-999d-a977d516da1b None None] backend_defaults.disk_geometry = None {{(pid=76164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:26:22 devstack cinder-volume[76164]: DEBUG oslo_service.backend._eventlet.service [None req-09f55645-c366-4244-999d-a977d516da1b None None] backend_defaults.driver_client_cert = None {{(pid=76164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:26:22 devstack cinder-volume[76164]: DEBUG oslo_service.backend._eventlet.service [None req-09f55645-c366-4244-999d-a977d516da1b None None] backend_defaults.driver_client_cert_key = None {{(pid=76164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:26:22 devstack cinder-volume[76164]: DEBUG oslo_service.backend._eventlet.service [None req-09f55645-c366-4244-999d-a977d516da1b None None] backend_defaults.driver_data_namespace = None {{(pid=76164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:26:22 devstack cinder-volume[76164]: DEBUG oslo_service.backend._eventlet.service [None req-09f55645-c366-4244-999d-a977d516da1b None None] backend_defaults.driver_ssl_cert_path = None {{(pid=76164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:26:22 devstack cinder-volume[76164]: DEBUG oslo_service.backend._eventlet.service [None req-09f55645-c366-4244-999d-a977d516da1b None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=76164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:26:22 devstack cinder-volume[76164]: DEBUG oslo_service.backend._eventlet.service [None req-09f55645-c366-4244-999d-a977d516da1b None None] backend_defaults.driver_use_ssl = False {{(pid=76164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:26:22 devstack cinder-volume[76164]: DEBUG oslo_service.backend._eventlet.service [None req-09f55645-c366-4244-999d-a977d516da1b None None] backend_defaults.enable_unsupported_driver = False {{(pid=76164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:26:22 devstack cinder-volume[76164]: DEBUG oslo_service.backend._eventlet.service [None req-09f55645-c366-4244-999d-a977d516da1b None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=76164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:26:22 devstack cinder-volume[76164]: DEBUG oslo_service.backend._eventlet.service [None req-09f55645-c366-4244-999d-a977d516da1b None None] backend_defaults.extra_capabilities = {} {{(pid=76164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:26:22 devstack cinder-volume[76164]: DEBUG oslo_service.backend._eventlet.service [None req-09f55645-c366-4244-999d-a977d516da1b None None] backend_defaults.filter_function = None {{(pid=76164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:26:22 devstack cinder-volume[76164]: DEBUG oslo_service.backend._eventlet.service [None req-09f55645-c366-4244-999d-a977d516da1b None None] backend_defaults.goodness_function = None {{(pid=76164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:26:22 devstack cinder-volume[76164]: DEBUG oslo_service.backend._eventlet.service [None req-09f55645-c366-4244-999d-a977d516da1b None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=76164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:26:22 devstack cinder-volume[76164]: DEBUG oslo_service.backend._eventlet.service [None req-09f55645-c366-4244-999d-a977d516da1b None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=76164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:26:22 devstack cinder-volume[76164]: DEBUG oslo_service.backend._eventlet.service [None req-09f55645-c366-4244-999d-a977d516da1b None None] backend_defaults.image_volume_cache_enabled = False {{(pid=76164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:26:22 devstack cinder-volume[76164]: DEBUG oslo_service.backend._eventlet.service [None req-09f55645-c366-4244-999d-a977d516da1b None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=76164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:26:22 devstack cinder-volume[76164]: DEBUG oslo_service.backend._eventlet.service [None req-09f55645-c366-4244-999d-a977d516da1b None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=76164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:26:22 devstack cinder-volume[76164]: DEBUG oslo_service.backend._eventlet.service [None req-09f55645-c366-4244-999d-a977d516da1b None None] backend_defaults.iscsi_target_flags = {{(pid=76164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:26:22 devstack cinder-volume[76164]: DEBUG oslo_service.backend._eventlet.service [None req-09f55645-c366-4244-999d-a977d516da1b None None] backend_defaults.iscsi_write_cache = on {{(pid=76164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:26:22 devstack cinder-volume[76164]: DEBUG oslo_service.backend._eventlet.service [None req-09f55645-c366-4244-999d-a977d516da1b None None] backend_defaults.iser_helper = tgtadm {{(pid=76164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:26:22 devstack cinder-volume[76164]: DEBUG oslo_service.backend._eventlet.service [None req-09f55645-c366-4244-999d-a977d516da1b None None] backend_defaults.iser_ip_address = 192.168.122.158 {{(pid=76164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:26:22 devstack cinder-volume[76164]: DEBUG oslo_service.backend._eventlet.service [None req-09f55645-c366-4244-999d-a977d516da1b None None] backend_defaults.iser_port = 3260 {{(pid=76164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:26:22 devstack cinder-volume[76164]: DEBUG oslo_service.backend._eventlet.service [None req-09f55645-c366-4244-999d-a977d516da1b None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=76164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:26:22 devstack cinder-volume[76164]: DEBUG oslo_service.backend._eventlet.service [None req-09f55645-c366-4244-999d-a977d516da1b None None] backend_defaults.lvm_conf_file = /etc/cinder/lvm.conf {{(pid=76164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:26:22 devstack cinder-volume[76164]: DEBUG oslo_service.backend._eventlet.service [None req-09f55645-c366-4244-999d-a977d516da1b None None] backend_defaults.lvm_mirrors = 0 {{(pid=76164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:26:22 devstack cinder-volume[76164]: DEBUG oslo_service.backend._eventlet.service [None req-09f55645-c366-4244-999d-a977d516da1b None None] backend_defaults.lvm_share_target = False {{(pid=76164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:26:22 devstack cinder-volume[76164]: DEBUG oslo_service.backend._eventlet.service [None req-09f55645-c366-4244-999d-a977d516da1b None None] backend_defaults.lvm_suppress_fd_warnings = False {{(pid=76164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:26:22 devstack cinder-volume[76164]: DEBUG oslo_service.backend._eventlet.service [None req-09f55645-c366-4244-999d-a977d516da1b None None] backend_defaults.lvm_type = auto {{(pid=76164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:26:22 devstack cinder-volume[76164]: DEBUG oslo_service.backend._eventlet.service [None req-09f55645-c366-4244-999d-a977d516da1b None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=76164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:26:22 devstack cinder-volume[76164]: DEBUG oslo_service.backend._eventlet.service [None req-09f55645-c366-4244-999d-a977d516da1b None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=76164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:26:22 devstack cinder-volume[76164]: DEBUG oslo_service.backend._eventlet.service [None req-09f55645-c366-4244-999d-a977d516da1b None None] backend_defaults.num_shell_tries = 3 {{(pid=76164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:26:22 devstack cinder-volume[76164]: DEBUG oslo_service.backend._eventlet.service [None req-09f55645-c366-4244-999d-a977d516da1b None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=76164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:26:22 devstack cinder-volume[76164]: DEBUG oslo_service.backend._eventlet.service [None req-09f55645-c366-4244-999d-a977d516da1b None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=76164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:26:22 devstack cinder-volume[76164]: DEBUG oslo_service.backend._eventlet.service [None req-09f55645-c366-4244-999d-a977d516da1b None None] backend_defaults.nvmet_ns_id = 10 {{(pid=76164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:26:22 devstack cinder-volume[76164]: DEBUG oslo_service.backend._eventlet.service [None req-09f55645-c366-4244-999d-a977d516da1b None None] backend_defaults.nvmet_port_id = 1 {{(pid=76164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:26:22 devstack cinder-volume[76164]: DEBUG oslo_service.backend._eventlet.service [None req-09f55645-c366-4244-999d-a977d516da1b None None] backend_defaults.replication_device = **** {{(pid=76164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:26:22 devstack cinder-volume[76164]: DEBUG oslo_service.backend._eventlet.service [None req-09f55645-c366-4244-999d-a977d516da1b None None] backend_defaults.report_discard_supported = False {{(pid=76164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:26:22 devstack cinder-volume[76364]: DEBUG oslo_concurrency.processutils [None req-576c097b-4e06-49ee-a089-596b15698f59 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.036s {{(pid=76364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:26:22 devstack cinder-volume[76164]: DEBUG oslo_service.backend._eventlet.service [None req-09f55645-c366-4244-999d-a977d516da1b None None] backend_defaults.reserved_percentage = 0 {{(pid=76164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:26:22 devstack cinder-volume[76364]: DEBUG oslo_concurrency.processutils [None req-576c097b-4e06-49ee-a089-596b15698f59 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:26:22 devstack cinder-volume[76164]: DEBUG oslo_service.backend._eventlet.service [None req-09f55645-c366-4244-999d-a977d516da1b None None] backend_defaults.scst_target_driver = iscsi {{(pid=76164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:26:22 devstack cinder-volume[76164]: DEBUG oslo_service.backend._eventlet.service [None req-09f55645-c366-4244-999d-a977d516da1b None None] backend_defaults.scst_target_iqn_name = None {{(pid=76164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:26:22 devstack cinder-volume[76164]: DEBUG oslo_service.backend._eventlet.service [None req-09f55645-c366-4244-999d-a977d516da1b None None] backend_defaults.storage_protocol = iSCSI {{(pid=76164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:26:22 devstack cinder-volume[76164]: DEBUG oslo_service.backend._eventlet.service [None req-09f55645-c366-4244-999d-a977d516da1b None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=76164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:26:22 devstack cinder-volume[76164]: DEBUG oslo_service.backend._eventlet.service [None req-09f55645-c366-4244-999d-a977d516da1b None None] backend_defaults.target_helper = tgtadm {{(pid=76164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:26:22 devstack cinder-volume[76164]: DEBUG oslo_service.backend._eventlet.service [None req-09f55645-c366-4244-999d-a977d516da1b None None] backend_defaults.target_ip_address = 192.168.122.158 {{(pid=76164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:26:22 devstack cinder-volume[76164]: DEBUG oslo_service.backend._eventlet.service [None req-09f55645-c366-4244-999d-a977d516da1b None None] backend_defaults.target_port = 3260 {{(pid=76164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:26:22 devstack cinder-volume[76164]: DEBUG oslo_service.backend._eventlet.service [None req-09f55645-c366-4244-999d-a977d516da1b None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=76164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:26:22 devstack cinder-volume[76164]: DEBUG oslo_service.backend._eventlet.service [None req-09f55645-c366-4244-999d-a977d516da1b None None] backend_defaults.target_protocol = iscsi {{(pid=76164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:26:22 devstack cinder-volume[76164]: DEBUG oslo_service.backend._eventlet.service [None req-09f55645-c366-4244-999d-a977d516da1b None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=76164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:26:22 devstack cinder-volume[76164]: DEBUG oslo_service.backend._eventlet.service [None req-09f55645-c366-4244-999d-a977d516da1b None None] backend_defaults.trace_flags = None {{(pid=76164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:26:22 devstack cinder-volume[76164]: DEBUG oslo_service.backend._eventlet.service [None req-09f55645-c366-4244-999d-a977d516da1b None None] backend_defaults.unique_fqdn_network = True {{(pid=76164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:26:22 devstack cinder-volume[76164]: DEBUG oslo_service.backend._eventlet.service [None req-09f55645-c366-4244-999d-a977d516da1b None None] backend_defaults.use_chap_auth = False {{(pid=76164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:26:22 devstack cinder-volume[76164]: DEBUG oslo_service.backend._eventlet.service [None req-09f55645-c366-4244-999d-a977d516da1b None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=76164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:26:22 devstack cinder-volume[76164]: DEBUG oslo_service.backend._eventlet.service [None req-09f55645-c366-4244-999d-a977d516da1b None None] backend_defaults.volume_backend_name = None {{(pid=76164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:26:22 devstack cinder-volume[76164]: DEBUG oslo_service.backend._eventlet.service [None req-09f55645-c366-4244-999d-a977d516da1b None None] backend_defaults.volume_clear = zero {{(pid=76164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:26:22 devstack cinder-volume[76164]: DEBUG oslo_service.backend._eventlet.service [None req-09f55645-c366-4244-999d-a977d516da1b None None] backend_defaults.volume_clear_ionice = None {{(pid=76164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:26:22 devstack cinder-volume[76164]: DEBUG oslo_service.backend._eventlet.service [None req-09f55645-c366-4244-999d-a977d516da1b None None] backend_defaults.volume_clear_size = 0 {{(pid=76164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:26:22 devstack cinder-volume[76164]: DEBUG oslo_service.backend._eventlet.service [None req-09f55645-c366-4244-999d-a977d516da1b None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=76164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:26:22 devstack cinder-volume[76164]: DEBUG oslo_service.backend._eventlet.service [None req-09f55645-c366-4244-999d-a977d516da1b None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=76164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:26:22 devstack cinder-volume[76164]: DEBUG oslo_service.backend._eventlet.service [None req-09f55645-c366-4244-999d-a977d516da1b None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=76164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:26:22 devstack cinder-volume[76164]: DEBUG oslo_service.backend._eventlet.service [None req-09f55645-c366-4244-999d-a977d516da1b None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=76164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:26:22 devstack cinder-volume[76164]: DEBUG oslo_service.backend._eventlet.service [None req-09f55645-c366-4244-999d-a977d516da1b None None] backend_defaults.volume_group = cinder-volumes {{(pid=76164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:26:22 devstack cinder-volume[76164]: DEBUG oslo_service.backend._eventlet.service [None req-09f55645-c366-4244-999d-a977d516da1b None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=76164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:26:22 devstack cinder-volume[76164]: DEBUG oslo_service.backend._eventlet.service [None req-09f55645-c366-4244-999d-a977d516da1b None None] oslo_reports.file_event_handler = None {{(pid=76164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:26:22 devstack cinder-volume[76164]: DEBUG oslo_service.backend._eventlet.service [None req-09f55645-c366-4244-999d-a977d516da1b None None] oslo_reports.file_event_handler_interval = 1 {{(pid=76164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:26:22 devstack cinder-volume[76164]: DEBUG oslo_service.backend._eventlet.service [None req-09f55645-c366-4244-999d-a977d516da1b None None] oslo_reports.log_dir = None {{(pid=76164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:26:22 devstack cinder-volume[76164]: DEBUG oslo_service.backend._eventlet.service [None req-09f55645-c366-4244-999d-a977d516da1b None None] lvmdriver-1.backend_availability_zone = None {{(pid=76164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:26:22 devstack cinder-volume[76164]: DEBUG oslo_service.backend._eventlet.service [None req-09f55645-c366-4244-999d-a977d516da1b None None] lvmdriver-1.backend_host = None {{(pid=76164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:26:22 devstack cinder-volume[76164]: DEBUG oslo_service.backend._eventlet.service [None req-09f55645-c366-4244-999d-a977d516da1b None None] lvmdriver-1.backend_native_threads_pool_size = None {{(pid=76164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:26:22 devstack cinder-volume[76164]: DEBUG oslo_service.backend._eventlet.service [None req-09f55645-c366-4244-999d-a977d516da1b None None] lvmdriver-1.backup_use_temp_snapshot = None {{(pid=76164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:26:22 devstack cinder-volume[76164]: DEBUG oslo_service.backend._eventlet.service [None req-09f55645-c366-4244-999d-a977d516da1b None None] lvmdriver-1.chap_password = **** {{(pid=76164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:26:22 devstack cinder-volume[76164]: DEBUG oslo_service.backend._eventlet.service [None req-09f55645-c366-4244-999d-a977d516da1b None None] lvmdriver-1.chap_username = None {{(pid=76164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:26:22 devstack cinder-volume[76164]: DEBUG oslo_service.backend._eventlet.service [None req-09f55645-c366-4244-999d-a977d516da1b None None] lvmdriver-1.chiscsi_conf = None {{(pid=76164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:26:22 devstack cinder-volume[76164]: DEBUG oslo_service.backend._eventlet.service [None req-09f55645-c366-4244-999d-a977d516da1b None None] lvmdriver-1.disk_geometry = None {{(pid=76164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:26:22 devstack cinder-volume[76164]: DEBUG oslo_service.backend._eventlet.service [None req-09f55645-c366-4244-999d-a977d516da1b None None] lvmdriver-1.driver_client_cert = None {{(pid=76164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:26:22 devstack cinder-volume[76164]: DEBUG oslo_service.backend._eventlet.service [None req-09f55645-c366-4244-999d-a977d516da1b None None] lvmdriver-1.driver_client_cert_key = None {{(pid=76164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:26:22 devstack cinder-volume[76164]: DEBUG oslo_service.backend._eventlet.service [None req-09f55645-c366-4244-999d-a977d516da1b None None] lvmdriver-1.driver_data_namespace = None {{(pid=76164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:26:22 devstack cinder-volume[76164]: DEBUG oslo_service.backend._eventlet.service [None req-09f55645-c366-4244-999d-a977d516da1b None None] lvmdriver-1.driver_ssl_cert_path = None {{(pid=76164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:26:22 devstack cinder-volume[76164]: DEBUG oslo_service.backend._eventlet.service [None req-09f55645-c366-4244-999d-a977d516da1b None None] lvmdriver-1.driver_ssl_cert_verify = None {{(pid=76164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:26:22 devstack cinder-volume[76164]: DEBUG oslo_service.backend._eventlet.service [None req-09f55645-c366-4244-999d-a977d516da1b None None] lvmdriver-1.driver_use_ssl = None {{(pid=76164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:26:22 devstack cinder-volume[76164]: DEBUG oslo_service.backend._eventlet.service [None req-09f55645-c366-4244-999d-a977d516da1b None None] lvmdriver-1.enable_unsupported_driver = None {{(pid=76164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:26:22 devstack cinder-volume[76164]: DEBUG oslo_service.backend._eventlet.service [None req-09f55645-c366-4244-999d-a977d516da1b None None] lvmdriver-1.enforce_multipath_for_image_xfer = None {{(pid=76164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:26:22 devstack cinder-volume[76164]: DEBUG oslo_service.backend._eventlet.service [None req-09f55645-c366-4244-999d-a977d516da1b None None] lvmdriver-1.extra_capabilities = None {{(pid=76164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:26:22 devstack cinder-volume[76164]: DEBUG oslo_service.backend._eventlet.service [None req-09f55645-c366-4244-999d-a977d516da1b None None] lvmdriver-1.filter_function = None {{(pid=76164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:26:22 devstack cinder-volume[76164]: DEBUG oslo_service.backend._eventlet.service [None req-09f55645-c366-4244-999d-a977d516da1b None None] lvmdriver-1.goodness_function = None {{(pid=76164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:26:22 devstack cinder-volume[76164]: DEBUG oslo_service.backend._eventlet.service [None req-09f55645-c366-4244-999d-a977d516da1b None None] lvmdriver-1.image_upload_use_cinder_backend = None {{(pid=76164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:26:22 devstack cinder-volume[76164]: DEBUG oslo_service.backend._eventlet.service [None req-09f55645-c366-4244-999d-a977d516da1b None None] lvmdriver-1.image_upload_use_internal_tenant = None {{(pid=76164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:26:22 devstack cinder-volume[76164]: DEBUG oslo_service.backend._eventlet.service [None req-09f55645-c366-4244-999d-a977d516da1b None None] lvmdriver-1.image_volume_cache_enabled = True {{(pid=76164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:26:22 devstack cinder-volume[76164]: DEBUG oslo_service.backend._eventlet.service [None req-09f55645-c366-4244-999d-a977d516da1b None None] lvmdriver-1.image_volume_cache_max_count = None {{(pid=76164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:26:22 devstack cinder-volume[76164]: DEBUG oslo_service.backend._eventlet.service [None req-09f55645-c366-4244-999d-a977d516da1b None None] lvmdriver-1.image_volume_cache_max_size_gb = None {{(pid=76164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:26:22 devstack cinder-volume[76164]: DEBUG oslo_service.backend._eventlet.service [None req-09f55645-c366-4244-999d-a977d516da1b None None] lvmdriver-1.iscsi_target_flags = None {{(pid=76164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:26:22 devstack cinder-volume[76164]: DEBUG oslo_service.backend._eventlet.service [None req-09f55645-c366-4244-999d-a977d516da1b None None] lvmdriver-1.iscsi_write_cache = None {{(pid=76164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:26:22 devstack cinder-volume[76164]: DEBUG oslo_service.backend._eventlet.service [None req-09f55645-c366-4244-999d-a977d516da1b None None] lvmdriver-1.iser_helper = None {{(pid=76164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:26:22 devstack cinder-volume[76164]: DEBUG oslo_service.backend._eventlet.service [None req-09f55645-c366-4244-999d-a977d516da1b None None] lvmdriver-1.iser_ip_address = None {{(pid=76164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:26:22 devstack cinder-volume[76164]: DEBUG oslo_service.backend._eventlet.service [None req-09f55645-c366-4244-999d-a977d516da1b None None] lvmdriver-1.iser_port = None {{(pid=76164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:26:22 devstack cinder-volume[76164]: DEBUG oslo_service.backend._eventlet.service [None req-09f55645-c366-4244-999d-a977d516da1b None None] lvmdriver-1.iser_target_prefix = None {{(pid=76164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:26:22 devstack cinder-volume[76164]: DEBUG oslo_service.backend._eventlet.service [None req-09f55645-c366-4244-999d-a977d516da1b None None] lvmdriver-1.lvm_conf_file = None {{(pid=76164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:26:22 devstack cinder-volume[76164]: DEBUG oslo_service.backend._eventlet.service [None req-09f55645-c366-4244-999d-a977d516da1b None None] lvmdriver-1.lvm_mirrors = None {{(pid=76164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:26:22 devstack cinder-volume[76164]: DEBUG oslo_service.backend._eventlet.service [None req-09f55645-c366-4244-999d-a977d516da1b None None] lvmdriver-1.lvm_share_target = None {{(pid=76164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:26:22 devstack cinder-volume[76164]: DEBUG oslo_service.backend._eventlet.service [None req-09f55645-c366-4244-999d-a977d516da1b None None] lvmdriver-1.lvm_suppress_fd_warnings = None {{(pid=76164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:26:22 devstack cinder-volume[76164]: DEBUG oslo_service.backend._eventlet.service [None req-09f55645-c366-4244-999d-a977d516da1b None None] lvmdriver-1.lvm_type = auto {{(pid=76164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:26:22 devstack cinder-volume[76164]: DEBUG oslo_service.backend._eventlet.service [None req-09f55645-c366-4244-999d-a977d516da1b None None] lvmdriver-1.max_over_subscription_ratio = None {{(pid=76164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:26:22 devstack cinder-volume[76164]: DEBUG oslo_service.backend._eventlet.service [None req-09f55645-c366-4244-999d-a977d516da1b None None] lvmdriver-1.num_iser_scan_tries = None {{(pid=76164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:26:22 devstack cinder-volume[76164]: DEBUG oslo_service.backend._eventlet.service [None req-09f55645-c366-4244-999d-a977d516da1b None None] lvmdriver-1.num_shell_tries = None {{(pid=76164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:26:22 devstack cinder-volume[76164]: DEBUG oslo_service.backend._eventlet.service [None req-09f55645-c366-4244-999d-a977d516da1b None None] lvmdriver-1.num_volume_device_scan_tries = None {{(pid=76164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:26:22 devstack cinder-volume[76164]: DEBUG oslo_service.backend._eventlet.service [None req-09f55645-c366-4244-999d-a977d516da1b None None] lvmdriver-1.nvmeof_conn_info_version = None {{(pid=76164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:26:22 devstack cinder-volume[76164]: DEBUG oslo_service.backend._eventlet.service [None req-09f55645-c366-4244-999d-a977d516da1b None None] lvmdriver-1.nvmet_ns_id = None {{(pid=76164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:26:22 devstack cinder-volume[76164]: DEBUG oslo_service.backend._eventlet.service [None req-09f55645-c366-4244-999d-a977d516da1b None None] lvmdriver-1.nvmet_port_id = None {{(pid=76164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:26:22 devstack cinder-volume[76164]: DEBUG oslo_service.backend._eventlet.service [None req-09f55645-c366-4244-999d-a977d516da1b None None] lvmdriver-1.replication_device = **** {{(pid=76164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:26:22 devstack cinder-volume[76164]: DEBUG oslo_service.backend._eventlet.service [None req-09f55645-c366-4244-999d-a977d516da1b None None] lvmdriver-1.report_discard_supported = None {{(pid=76164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:26:22 devstack cinder-volume[76164]: DEBUG oslo_service.backend._eventlet.service [None req-09f55645-c366-4244-999d-a977d516da1b None None] lvmdriver-1.reserved_percentage = None {{(pid=76164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:26:22 devstack cinder-volume[76164]: DEBUG oslo_service.backend._eventlet.service [None req-09f55645-c366-4244-999d-a977d516da1b None None] lvmdriver-1.scst_target_driver = None {{(pid=76164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:26:22 devstack cinder-volume[76164]: DEBUG oslo_service.backend._eventlet.service [None req-09f55645-c366-4244-999d-a977d516da1b None None] lvmdriver-1.scst_target_iqn_name = None {{(pid=76164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:26:22 devstack cinder-volume[76164]: DEBUG oslo_service.backend._eventlet.service [None req-09f55645-c366-4244-999d-a977d516da1b None None] lvmdriver-1.storage_protocol = None {{(pid=76164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:26:22 devstack cinder-volume[76364]: DEBUG oslo_concurrency.processutils [None req-576c097b-4e06-49ee-a089-596b15698f59 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.030s {{(pid=76364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:26:22 devstack cinder-volume[76164]: DEBUG oslo_service.backend._eventlet.service [None req-09f55645-c366-4244-999d-a977d516da1b None None] lvmdriver-1.suppress_requests_ssl_warnings = None {{(pid=76164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:26:22 devstack cinder-volume[76164]: DEBUG oslo_service.backend._eventlet.service [None req-09f55645-c366-4244-999d-a977d516da1b None None] lvmdriver-1.target_helper = lioadm {{(pid=76164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:26:22 devstack cinder-volume[76364]: DEBUG oslo_concurrency.processutils [None req-576c097b-4e06-49ee-a089-596b15698f59 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1 {{(pid=76364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:26:22 devstack cinder-volume[76164]: DEBUG oslo_service.backend._eventlet.service [None req-09f55645-c366-4244-999d-a977d516da1b None None] lvmdriver-1.target_ip_address = None {{(pid=76164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:26:22 devstack cinder-volume[76164]: DEBUG oslo_service.backend._eventlet.service [None req-09f55645-c366-4244-999d-a977d516da1b None None] lvmdriver-1.target_port = 3260 {{(pid=76164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:26:22 devstack cinder-volume[76164]: DEBUG oslo_service.backend._eventlet.service [None req-09f55645-c366-4244-999d-a977d516da1b None None] lvmdriver-1.target_prefix = iqn.2010-10.org.openstack: {{(pid=76164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:26:22 devstack cinder-volume[76164]: DEBUG oslo_service.backend._eventlet.service [None req-09f55645-c366-4244-999d-a977d516da1b None None] lvmdriver-1.target_protocol = iscsi {{(pid=76164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:26:22 devstack cinder-volume[76164]: DEBUG oslo_service.backend._eventlet.service [None req-09f55645-c366-4244-999d-a977d516da1b None None] lvmdriver-1.target_secondary_ip_addresses = None {{(pid=76164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:26:22 devstack cinder-volume[76164]: DEBUG oslo_service.backend._eventlet.service [None req-09f55645-c366-4244-999d-a977d516da1b None None] lvmdriver-1.trace_flags = None {{(pid=76164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:26:22 devstack cinder-volume[76164]: DEBUG oslo_service.backend._eventlet.service [None req-09f55645-c366-4244-999d-a977d516da1b None None] lvmdriver-1.unique_fqdn_network = None {{(pid=76164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:26:22 devstack cinder-volume[76164]: DEBUG oslo_service.backend._eventlet.service [None req-09f55645-c366-4244-999d-a977d516da1b None None] lvmdriver-1.use_chap_auth = None {{(pid=76164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:26:22 devstack cinder-volume[76164]: DEBUG oslo_service.backend._eventlet.service [None req-09f55645-c366-4244-999d-a977d516da1b None None] lvmdriver-1.use_multipath_for_image_xfer = None {{(pid=76164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:26:22 devstack cinder-volume[76164]: DEBUG oslo_service.backend._eventlet.service [None req-09f55645-c366-4244-999d-a977d516da1b None None] lvmdriver-1.volume_backend_name = lvmdriver-1 {{(pid=76164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:26:22 devstack cinder-volume[76164]: DEBUG oslo_service.backend._eventlet.service [None req-09f55645-c366-4244-999d-a977d516da1b None None] lvmdriver-1.volume_clear = zero {{(pid=76164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:26:22 devstack cinder-volume[76164]: DEBUG oslo_service.backend._eventlet.service [None req-09f55645-c366-4244-999d-a977d516da1b None None] lvmdriver-1.volume_clear_ionice = None {{(pid=76164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:26:22 devstack cinder-volume[76164]: DEBUG oslo_service.backend._eventlet.service [None req-09f55645-c366-4244-999d-a977d516da1b None None] lvmdriver-1.volume_clear_size = None {{(pid=76164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:26:22 devstack cinder-volume[76164]: DEBUG oslo_service.backend._eventlet.service [None req-09f55645-c366-4244-999d-a977d516da1b None None] lvmdriver-1.volume_copy_blkio_cgroup_name = None {{(pid=76164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:26:22 devstack cinder-volume[76164]: DEBUG oslo_service.backend._eventlet.service [None req-09f55645-c366-4244-999d-a977d516da1b None None] lvmdriver-1.volume_copy_bps_limit = None {{(pid=76164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:26:22 devstack cinder-volume[76164]: DEBUG oslo_service.backend._eventlet.service [None req-09f55645-c366-4244-999d-a977d516da1b None None] lvmdriver-1.volume_dd_blocksize = None {{(pid=76164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:26:22 devstack cinder-volume[76164]: DEBUG oslo_service.backend._eventlet.service [None req-09f55645-c366-4244-999d-a977d516da1b None None] lvmdriver-1.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=76164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:26:22 devstack cinder-volume[76164]: DEBUG oslo_service.backend._eventlet.service [None req-09f55645-c366-4244-999d-a977d516da1b None None] lvmdriver-1.volume_group = stack-volumes-lvmdriver-1 {{(pid=76164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:26:22 devstack cinder-volume[76164]: DEBUG oslo_service.backend._eventlet.service [None req-09f55645-c366-4244-999d-a977d516da1b None None] lvmdriver-1.volumes_dir = None {{(pid=76164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:26:22 devstack cinder-volume[76164]: DEBUG oslo_service.backend._eventlet.service [None req-09f55645-c366-4244-999d-a977d516da1b None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=76164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:26:22 devstack cinder-volume[76164]: DEBUG oslo_service.backend._eventlet.service [None req-09f55645-c366-4244-999d-a977d516da1b None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=76164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:26:22 devstack cinder-volume[76164]: DEBUG oslo_service.backend._eventlet.service [None req-09f55645-c366-4244-999d-a977d516da1b None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=76164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:26:22 devstack cinder-volume[76164]: DEBUG oslo_service.backend._eventlet.service [None req-09f55645-c366-4244-999d-a977d516da1b None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=76164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:26:22 devstack cinder-volume[76164]: DEBUG oslo_service.backend._eventlet.service [None req-09f55645-c366-4244-999d-a977d516da1b None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=76164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:26:22 devstack cinder-volume[76164]: DEBUG oslo_service.backend._eventlet.service [None req-09f55645-c366-4244-999d-a977d516da1b None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=76164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:26:22 devstack cinder-volume[76164]: DEBUG oslo_service.backend._eventlet.service [None req-09f55645-c366-4244-999d-a977d516da1b None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=76164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:26:22 devstack cinder-volume[76164]: DEBUG oslo_service.backend._eventlet.service [None req-09f55645-c366-4244-999d-a977d516da1b None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=76164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:26:22 devstack cinder-volume[76164]: DEBUG oslo_service.backend._eventlet.service [None req-09f55645-c366-4244-999d-a977d516da1b None None] oslo_messaging_rabbit.hostname = devstack {{(pid=76164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:26:22 devstack cinder-volume[76164]: DEBUG oslo_service.backend._eventlet.service [None req-09f55645-c366-4244-999d-a977d516da1b None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=76164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:26:22 devstack cinder-volume[76164]: DEBUG oslo_service.backend._eventlet.service [None req-09f55645-c366-4244-999d-a977d516da1b None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=76164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:26:22 devstack cinder-volume[76164]: DEBUG oslo_service.backend._eventlet.service [None req-09f55645-c366-4244-999d-a977d516da1b None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=76164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:26:22 devstack cinder-volume[76164]: DEBUG oslo_service.backend._eventlet.service [None req-09f55645-c366-4244-999d-a977d516da1b None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=76164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:26:22 devstack cinder-volume[76164]: DEBUG oslo_service.backend._eventlet.service [None req-09f55645-c366-4244-999d-a977d516da1b None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=76164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:26:22 devstack cinder-volume[76164]: DEBUG oslo_service.backend._eventlet.service [None req-09f55645-c366-4244-999d-a977d516da1b None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=76164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:26:22 devstack cinder-volume[76164]: DEBUG oslo_service.backend._eventlet.service [None req-09f55645-c366-4244-999d-a977d516da1b None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=76164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:26:22 devstack cinder-volume[76164]: DEBUG oslo_service.backend._eventlet.service [None req-09f55645-c366-4244-999d-a977d516da1b None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=76164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:26:22 devstack cinder-volume[76164]: DEBUG oslo_service.backend._eventlet.service [None req-09f55645-c366-4244-999d-a977d516da1b None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=76164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:26:22 devstack cinder-volume[76164]: DEBUG oslo_service.backend._eventlet.service [None req-09f55645-c366-4244-999d-a977d516da1b None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=76164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:26:22 devstack cinder-volume[76164]: DEBUG oslo_service.backend._eventlet.service [None req-09f55645-c366-4244-999d-a977d516da1b None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=76164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:26:22 devstack cinder-volume[76164]: DEBUG oslo_service.backend._eventlet.service [None req-09f55645-c366-4244-999d-a977d516da1b None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=76164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:26:22 devstack cinder-volume[76164]: DEBUG oslo_service.backend._eventlet.service [None req-09f55645-c366-4244-999d-a977d516da1b None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=76164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:26:22 devstack cinder-volume[76164]: DEBUG oslo_service.backend._eventlet.service [None req-09f55645-c366-4244-999d-a977d516da1b None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=76164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:26:22 devstack cinder-volume[76164]: DEBUG oslo_service.backend._eventlet.service [None req-09f55645-c366-4244-999d-a977d516da1b None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=76164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:26:22 devstack cinder-volume[76164]: DEBUG oslo_service.backend._eventlet.service [None req-09f55645-c366-4244-999d-a977d516da1b None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=76164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:26:22 devstack cinder-volume[76164]: DEBUG oslo_service.backend._eventlet.service [None req-09f55645-c366-4244-999d-a977d516da1b None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=76164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:26:22 devstack cinder-volume[76164]: DEBUG oslo_service.backend._eventlet.service [None req-09f55645-c366-4244-999d-a977d516da1b None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=76164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:26:22 devstack cinder-volume[76164]: DEBUG oslo_service.backend._eventlet.service [None req-09f55645-c366-4244-999d-a977d516da1b None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=76164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:26:22 devstack cinder-volume[76164]: DEBUG oslo_service.backend._eventlet.service [None req-09f55645-c366-4244-999d-a977d516da1b None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=76164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:26:22 devstack cinder-volume[76164]: DEBUG oslo_service.backend._eventlet.service [None req-09f55645-c366-4244-999d-a977d516da1b None None] oslo_messaging_rabbit.ssl = False {{(pid=76164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:26:22 devstack cinder-volume[76164]: DEBUG oslo_service.backend._eventlet.service [None req-09f55645-c366-4244-999d-a977d516da1b None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=76164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:26:22 devstack cinder-volume[76164]: DEBUG oslo_service.backend._eventlet.service [None req-09f55645-c366-4244-999d-a977d516da1b None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=76164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:26:22 devstack cinder-volume[76164]: DEBUG oslo_service.backend._eventlet.service [None req-09f55645-c366-4244-999d-a977d516da1b None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=76164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:26:22 devstack cinder-volume[76164]: DEBUG oslo_service.backend._eventlet.service [None req-09f55645-c366-4244-999d-a977d516da1b None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=76164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:26:22 devstack cinder-volume[76164]: DEBUG oslo_service.backend._eventlet.service [None req-09f55645-c366-4244-999d-a977d516da1b None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=76164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:26:22 devstack cinder-volume[76164]: DEBUG oslo_service.backend._eventlet.service [None req-09f55645-c366-4244-999d-a977d516da1b None None] oslo_messaging_rabbit.ssl_version = {{(pid=76164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:26:22 devstack cinder-volume[76164]: DEBUG oslo_service.backend._eventlet.service [None req-09f55645-c366-4244-999d-a977d516da1b None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=76164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:26:22 devstack cinder-volume[76164]: DEBUG oslo_service.backend._eventlet.service [None req-09f55645-c366-4244-999d-a977d516da1b None None] oslo_messaging_notifications.driver = [] {{(pid=76164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:26:22 devstack cinder-volume[76164]: DEBUG oslo_service.backend._eventlet.service [None req-09f55645-c366-4244-999d-a977d516da1b None None] oslo_messaging_notifications.retry = -1 {{(pid=76164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:26:22 devstack cinder-volume[76164]: DEBUG oslo_service.backend._eventlet.service [None req-09f55645-c366-4244-999d-a977d516da1b None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=76164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:26:22 devstack cinder-volume[76164]: DEBUG oslo_service.backend._eventlet.service [None req-09f55645-c366-4244-999d-a977d516da1b None None] oslo_messaging_notifications.transport_url = **** {{(pid=76164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:26:22 devstack cinder-volume[76164]: DEBUG oslo_service.backend._eventlet.service [None req-09f55645-c366-4244-999d-a977d516da1b None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=76164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:26:22 devstack cinder-volume[76164]: DEBUG oslo_service.backend._eventlet.service [None req-09f55645-c366-4244-999d-a977d516da1b None None] key_manager.fixed_key = **** {{(pid=76164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:26:22 devstack cinder-volume[76164]: DEBUG oslo_service.backend._eventlet.service [None req-09f55645-c366-4244-999d-a977d516da1b None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=76164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:26:22 devstack cinder-volume[76164]: DEBUG oslo_service.backend._eventlet.service [None req-09f55645-c366-4244-999d-a977d516da1b None None] barbican.barbican_api_version = None {{(pid=76164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:26:22 devstack cinder-volume[76164]: DEBUG oslo_service.backend._eventlet.service [None req-09f55645-c366-4244-999d-a977d516da1b None None] barbican.barbican_endpoint = None {{(pid=76164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:26:22 devstack cinder-volume[76164]: DEBUG oslo_service.backend._eventlet.service [None req-09f55645-c366-4244-999d-a977d516da1b None None] barbican.barbican_endpoint_type = public {{(pid=76164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:26:22 devstack cinder-volume[76164]: DEBUG oslo_service.backend._eventlet.service [None req-09f55645-c366-4244-999d-a977d516da1b None None] barbican.barbican_region_name = None {{(pid=76164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:26:22 devstack cinder-volume[76164]: DEBUG oslo_service.backend._eventlet.service [None req-09f55645-c366-4244-999d-a977d516da1b None None] barbican.cafile = None {{(pid=76164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:26:22 devstack cinder-volume[76164]: DEBUG oslo_service.backend._eventlet.service [None req-09f55645-c366-4244-999d-a977d516da1b None None] barbican.certfile = None {{(pid=76164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:26:22 devstack cinder-volume[76164]: DEBUG oslo_service.backend._eventlet.service [None req-09f55645-c366-4244-999d-a977d516da1b None None] barbican.collect_timing = False {{(pid=76164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:26:22 devstack cinder-volume[76164]: DEBUG oslo_service.backend._eventlet.service [None req-09f55645-c366-4244-999d-a977d516da1b None None] barbican.insecure = False {{(pid=76164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:26:22 devstack cinder-volume[76164]: DEBUG oslo_service.backend._eventlet.service [None req-09f55645-c366-4244-999d-a977d516da1b None None] barbican.keyfile = None {{(pid=76164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:26:22 devstack cinder-volume[76164]: DEBUG oslo_service.backend._eventlet.service [None req-09f55645-c366-4244-999d-a977d516da1b None None] barbican.number_of_retries = 60 {{(pid=76164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:26:22 devstack cinder-volume[76164]: DEBUG oslo_service.backend._eventlet.service [None req-09f55645-c366-4244-999d-a977d516da1b None None] barbican.retry_delay = 1 {{(pid=76164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:26:22 devstack cinder-volume[76164]: DEBUG oslo_service.backend._eventlet.service [None req-09f55645-c366-4244-999d-a977d516da1b None None] barbican.send_service_user_token = False {{(pid=76164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:26:22 devstack cinder-volume[76164]: DEBUG oslo_service.backend._eventlet.service [None req-09f55645-c366-4244-999d-a977d516da1b None None] barbican.split_loggers = False {{(pid=76164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:26:22 devstack cinder-volume[76164]: DEBUG oslo_service.backend._eventlet.service [None req-09f55645-c366-4244-999d-a977d516da1b None None] barbican.timeout = None {{(pid=76164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:26:22 devstack cinder-volume[76164]: DEBUG oslo_service.backend._eventlet.service [None req-09f55645-c366-4244-999d-a977d516da1b None None] barbican.verify_ssl = True {{(pid=76164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:26:22 devstack cinder-volume[76164]: DEBUG oslo_service.backend._eventlet.service [None req-09f55645-c366-4244-999d-a977d516da1b None None] barbican.verify_ssl_path = None {{(pid=76164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:26:22 devstack cinder-volume[76164]: DEBUG oslo_service.backend._eventlet.service [None req-09f55645-c366-4244-999d-a977d516da1b None None] barbican_service_user.auth_section = None {{(pid=76164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:26:22 devstack cinder-volume[76164]: DEBUG oslo_service.backend._eventlet.service [None req-09f55645-c366-4244-999d-a977d516da1b None None] barbican_service_user.auth_type = None {{(pid=76164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:26:22 devstack cinder-volume[76164]: DEBUG oslo_service.backend._eventlet.service [None req-09f55645-c366-4244-999d-a977d516da1b None None] barbican_service_user.cafile = None {{(pid=76164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:26:22 devstack cinder-volume[76164]: DEBUG oslo_service.backend._eventlet.service [None req-09f55645-c366-4244-999d-a977d516da1b None None] barbican_service_user.certfile = None {{(pid=76164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:26:22 devstack cinder-volume[76164]: DEBUG oslo_service.backend._eventlet.service [None req-09f55645-c366-4244-999d-a977d516da1b None None] barbican_service_user.collect_timing = False {{(pid=76164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:26:22 devstack cinder-volume[76164]: DEBUG oslo_service.backend._eventlet.service [None req-09f55645-c366-4244-999d-a977d516da1b None None] barbican_service_user.insecure = False {{(pid=76164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:26:22 devstack cinder-volume[76164]: DEBUG oslo_service.backend._eventlet.service [None req-09f55645-c366-4244-999d-a977d516da1b None None] barbican_service_user.keyfile = None {{(pid=76164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:26:22 devstack cinder-volume[76164]: DEBUG oslo_service.backend._eventlet.service [None req-09f55645-c366-4244-999d-a977d516da1b None None] barbican_service_user.split_loggers = False {{(pid=76164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:26:22 devstack cinder-volume[76164]: DEBUG oslo_service.backend._eventlet.service [None req-09f55645-c366-4244-999d-a977d516da1b None None] barbican_service_user.timeout = None {{(pid=76164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:26:22 devstack cinder-volume[76164]: DEBUG oslo_service.backend._eventlet.service [None req-09f55645-c366-4244-999d-a977d516da1b None None] vault.approle_role_id = **** {{(pid=76164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:26:22 devstack cinder-volume[76164]: DEBUG oslo_service.backend._eventlet.service [None req-09f55645-c366-4244-999d-a977d516da1b None None] vault.approle_secret_id = **** {{(pid=76164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:26:22 devstack cinder-volume[76164]: DEBUG oslo_service.backend._eventlet.service [None req-09f55645-c366-4244-999d-a977d516da1b None None] vault.kv_mountpoint = secret {{(pid=76164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:26:22 devstack cinder-volume[76164]: DEBUG oslo_service.backend._eventlet.service [None req-09f55645-c366-4244-999d-a977d516da1b None None] vault.kv_path = None {{(pid=76164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:26:22 devstack cinder-volume[76164]: DEBUG oslo_service.backend._eventlet.service [None req-09f55645-c366-4244-999d-a977d516da1b None None] vault.kv_version = 2 {{(pid=76164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:26:22 devstack cinder-volume[76164]: DEBUG oslo_service.backend._eventlet.service [None req-09f55645-c366-4244-999d-a977d516da1b None None] vault.namespace = None {{(pid=76164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:26:22 devstack cinder-volume[76164]: DEBUG oslo_service.backend._eventlet.service [None req-09f55645-c366-4244-999d-a977d516da1b None None] vault.root_token_id = **** {{(pid=76164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:26:22 devstack cinder-volume[76164]: DEBUG oslo_service.backend._eventlet.service [None req-09f55645-c366-4244-999d-a977d516da1b None None] vault.ssl_ca_crt_file = None {{(pid=76164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:26:22 devstack cinder-volume[76164]: DEBUG oslo_service.backend._eventlet.service [None req-09f55645-c366-4244-999d-a977d516da1b None None] vault.timeout = 60.0 {{(pid=76164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:26:22 devstack cinder-volume[76164]: DEBUG oslo_service.backend._eventlet.service [None req-09f55645-c366-4244-999d-a977d516da1b None None] vault.use_ssl = False {{(pid=76164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:26:22 devstack cinder-volume[76164]: DEBUG oslo_service.backend._eventlet.service [None req-09f55645-c366-4244-999d-a977d516da1b None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=76164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:26:22 devstack cinder-volume[76164]: DEBUG oslo_service.backend._eventlet.service [None req-09f55645-c366-4244-999d-a977d516da1b None None] ******************************************************************************** {{(pid=76164) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3260}} Jul 10 04:26:22 devstack sudo[76370]: pam_unix(sudo:session): session closed for user root Jul 10 04:26:22 devstack cinder-volume[76364]: DEBUG oslo_concurrency.processutils [None req-576c097b-4e06-49ee-a089-596b15698f59 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1" returned: 0 in 0.700s {{(pid=76364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:26:22 devstack cinder-volume[76364]: DEBUG oslo_concurrency.processutils [None req-576c097b-4e06-49ee-a089-596b15698f59 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:26:22 devstack sudo[76375]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 10 04:26:22 devstack sudo[76375]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:26:23 devstack sudo[76375]: pam_unix(sudo:session): session closed for user root Jul 10 04:26:23 devstack cinder-volume[76364]: DEBUG oslo_concurrency.processutils [None req-576c097b-4e06-49ee-a089-596b15698f59 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 5 in 0.635s {{(pid=76364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:26:23 devstack cinder-volume[76364]: DEBUG oslo_concurrency.processutils [None req-576c097b-4e06-49ee-a089-596b15698f59 None None] 'sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' failed. Not Retrying. {{(pid=76364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 10 04:26:23 devstack cinder-volume[76364]: INFO cinder.brick.local_dev.lvm [None req-576c097b-4e06-49ee-a089-596b15698f59 None None] Logical Volume not found when querying LVM info. (vg_name=stack-volumes-lvmdriver-1, lv_name=stack-volumes-lvmdriver-1-pool Jul 10 04:26:23 devstack cinder-volume[76364]: DEBUG oslo_concurrency.processutils [None req-576c097b-4e06-49ee-a089-596b15698f59 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:26:23 devstack cinder-volume[76364]: DEBUG oslo_concurrency.processutils [None req-576c097b-4e06-49ee-a089-596b15698f59 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.019s {{(pid=76364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:26:23 devstack cinder-volume[76364]: DEBUG oslo_concurrency.processutils [None req-576c097b-4e06-49ee-a089-596b15698f59 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:26:23 devstack sudo[76598]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 10 04:26:23 devstack sudo[76598]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:26:24 devstack sudo[76598]: pam_unix(sudo:session): session closed for user root Jul 10 04:26:24 devstack cinder-volume[76364]: DEBUG oslo_concurrency.processutils [None req-576c097b-4e06-49ee-a089-596b15698f59 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.642s {{(pid=76364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:26:24 devstack cinder-volume[76364]: DEBUG cinder.brick.local_dev.lvm [None req-576c097b-4e06-49ee-a089-596b15698f59 None None] Creating thin pool 'stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' with size 28.5g of total 30.0g {{(pid=76364) create_thin_pool /opt/stack/cinder/cinder/brick/local_dev/lvm.py:550}} Jul 10 04:26:24 devstack cinder-volume[76364]: DEBUG oslo_concurrency.processutils [None req-576c097b-4e06-49ee-a089-596b15698f59 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:26:24 devstack sudo[76806]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 10 04:26:24 devstack sudo[76806]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:26:25 devstack sudo[76806]: pam_unix(sudo:session): session closed for user root Jul 10 04:26:25 devstack cinder-volume[76364]: DEBUG oslo_concurrency.processutils [None req-576c097b-4e06-49ee-a089-596b15698f59 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 1.071s {{(pid=76364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:26:25 devstack cinder-volume[76364]: DEBUG oslo_concurrency.processutils [None req-576c097b-4e06-49ee-a089-596b15698f59 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:26:25 devstack cinder-volume[76364]: DEBUG oslo_concurrency.processutils [None req-576c097b-4e06-49ee-a089-596b15698f59 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.027s {{(pid=76364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:26:25 devstack cinder-volume[76364]: DEBUG oslo_concurrency.processutils [None req-576c097b-4e06-49ee-a089-596b15698f59 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:26:25 devstack sudo[77059]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 10 04:26:25 devstack sudo[77059]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:26:25 devstack sudo[77059]: pam_unix(sudo:session): session closed for user root Jul 10 04:26:25 devstack cinder-volume[76364]: DEBUG oslo_concurrency.processutils [None req-576c097b-4e06-49ee-a089-596b15698f59 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.733s {{(pid=76364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:26:25 devstack cinder-volume[76364]: DEBUG oslo_concurrency.processutils [None req-576c097b-4e06-49ee-a089-596b15698f59 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:26:25 devstack cinder-volume[76364]: DEBUG oslo_concurrency.processutils [None req-576c097b-4e06-49ee-a089-596b15698f59 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.020s {{(pid=76364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:26:25 devstack cinder-volume[76364]: DEBUG oslo_concurrency.processutils [None req-576c097b-4e06-49ee-a089-596b15698f59 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster {{(pid=76364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:26:26 devstack sudo[77150]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster Jul 10 04:26:26 devstack sudo[77150]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:26:26 devstack sudo[77150]: pam_unix(sudo:session): session closed for user root Jul 10 04:26:26 devstack cinder-volume[76364]: DEBUG oslo_concurrency.processutils [None req-576c097b-4e06-49ee-a089-596b15698f59 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster" returned: 0 in 0.662s {{(pid=76364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:26:26 devstack cinder-volume[76364]: DEBUG oslo_concurrency.processutils [None req-576c097b-4e06-49ee-a089-596b15698f59 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:26:26 devstack sudo[77154]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 10 04:26:26 devstack sudo[77154]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:26:27 devstack sudo[77154]: pam_unix(sudo:session): session closed for user root Jul 10 04:26:27 devstack cinder-volume[76364]: DEBUG oslo_concurrency.processutils [None req-576c097b-4e06-49ee-a089-596b15698f59 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.698s {{(pid=76364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:26:27 devstack cinder-volume[76364]: DEBUG oslo_concurrency.processutils [None req-576c097b-4e06-49ee-a089-596b15698f59 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:26:27 devstack sudo[77158]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 10 04:26:27 devstack sudo[77158]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:26:28 devstack sudo[77158]: pam_unix(sudo:session): session closed for user root Jul 10 04:26:28 devstack cinder-volume[76364]: DEBUG oslo_concurrency.processutils [None req-576c097b-4e06-49ee-a089-596b15698f59 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.896s {{(pid=76364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:26:28 devstack cinder-volume[76364]: DEBUG oslo_concurrency.processutils [None req-576c097b-4e06-49ee-a089-596b15698f59 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:26:28 devstack sudo[77170]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 10 04:26:28 devstack sudo[77170]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:26:29 devstack sudo[77170]: pam_unix(sudo:session): session closed for user root Jul 10 04:26:29 devstack cinder-volume[76364]: DEBUG oslo_concurrency.processutils [None req-576c097b-4e06-49ee-a089-596b15698f59 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.905s {{(pid=76364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:26:29 devstack cinder-volume[76364]: DEBUG oslo_concurrency.processutils [None req-576c097b-4e06-49ee-a089-596b15698f59 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:26:29 devstack sudo[77175]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 10 04:26:29 devstack sudo[77175]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:26:29 devstack sudo[77175]: pam_unix(sudo:session): session closed for user root Jul 10 04:26:29 devstack cinder-volume[76364]: DEBUG oslo_concurrency.processutils [None req-576c097b-4e06-49ee-a089-596b15698f59 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.765s {{(pid=76364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:26:29 devstack cinder-volume[76364]: DEBUG oslo_concurrency.processutils [None req-576c097b-4e06-49ee-a089-596b15698f59 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:26:29 devstack cinder-volume[76364]: DEBUG oslo_concurrency.processutils [None req-576c097b-4e06-49ee-a089-596b15698f59 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.027s {{(pid=76364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:26:29 devstack cinder-volume[76364]: DEBUG oslo_concurrency.processutils [None req-576c097b-4e06-49ee-a089-596b15698f59 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:26:29 devstack sudo[77185]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 10 04:26:29 devstack sudo[77185]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:26:30 devstack sudo[77185]: pam_unix(sudo:session): session closed for user root Jul 10 04:26:30 devstack cinder-volume[76364]: DEBUG oslo_concurrency.processutils [None req-576c097b-4e06-49ee-a089-596b15698f59 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.708s {{(pid=76364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:26:30 devstack cinder-volume[76364]: INFO cinder.volume.drivers.lvm [None req-576c097b-4e06-49ee-a089-596b15698f59 None None] Enabling LVM thin provisioning by default because a thin pool exists. Jul 10 04:26:30 devstack cinder-volume[76364]: DEBUG oslo_concurrency.processutils [None req-576c097b-4e06-49ee-a089-596b15698f59 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:26:30 devstack cinder-volume[76364]: DEBUG oslo_concurrency.processutils [None req-576c097b-4e06-49ee-a089-596b15698f59 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.018s {{(pid=76364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:26:30 devstack cinder-volume[76364]: DEBUG oslo_concurrency.processutils [None req-576c097b-4e06-49ee-a089-596b15698f59 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:26:30 devstack sudo[77189]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 10 04:26:30 devstack sudo[77189]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:26:31 devstack sudo[77189]: pam_unix(sudo:session): session closed for user root Jul 10 04:26:31 devstack cinder-volume[76364]: DEBUG oslo_concurrency.processutils [None req-576c097b-4e06-49ee-a089-596b15698f59 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.752s {{(pid=76364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:26:31 devstack cinder-volume[76364]: DEBUG cinder.volume.drivers.lvm [None req-576c097b-4e06-49ee-a089-596b15698f59 None None] Updating volume stats {{(pid=76364) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Jul 10 04:26:31 devstack cinder-volume[76364]: DEBUG oslo_concurrency.processutils [None req-576c097b-4e06-49ee-a089-596b15698f59 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:26:31 devstack sudo[77307]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 10 04:26:31 devstack sudo[77307]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:26:31 devstack cinder-volume[76164]: DEBUG dbcounter [-] [76164] Writing DB stats cinder:SELECT=8,cinder:INSERT=1,cinder:UPDATE=1 {{(pid=76164) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 10 04:26:32 devstack sudo[77307]: pam_unix(sudo:session): session closed for user root Jul 10 04:26:32 devstack cinder-volume[76364]: DEBUG oslo_concurrency.processutils [None req-576c097b-4e06-49ee-a089-596b15698f59 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.657s {{(pid=76364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:26:32 devstack cinder-volume[76364]: DEBUG oslo_concurrency.processutils [None req-576c097b-4e06-49ee-a089-596b15698f59 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:26:32 devstack sudo[77316]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 10 04:26:32 devstack sudo[77316]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:26:32 devstack sudo[77316]: pam_unix(sudo:session): session closed for user root Jul 10 04:26:32 devstack cinder-volume[76364]: DEBUG oslo_concurrency.processutils [None req-576c097b-4e06-49ee-a089-596b15698f59 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.699s {{(pid=76364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:26:32 devstack cinder-volume[76364]: DEBUG oslo_concurrency.processutils [None req-576c097b-4e06-49ee-a089-596b15698f59 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:26:32 devstack sudo[77456]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 10 04:26:32 devstack sudo[77456]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:26:33 devstack sudo[77456]: pam_unix(sudo:session): session closed for user root Jul 10 04:26:33 devstack cinder-volume[76364]: DEBUG oslo_concurrency.processutils [None req-576c097b-4e06-49ee-a089-596b15698f59 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.629s {{(pid=76364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:26:33 devstack cinder-volume[76364]: DEBUG oslo_concurrency.processutils [None req-576c097b-4e06-49ee-a089-596b15698f59 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:26:33 devstack sudo[77459]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 10 04:26:33 devstack sudo[77459]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:26:34 devstack sudo[77459]: pam_unix(sudo:session): session closed for user root Jul 10 04:26:34 devstack cinder-volume[76364]: DEBUG oslo_concurrency.processutils [None req-576c097b-4e06-49ee-a089-596b15698f59 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.634s {{(pid=76364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:26:34 devstack cinder-volume[76364]: INFO cinder.volume.driver [None req-576c097b-4e06-49ee-a089-596b15698f59 None None] Driver hasn't implemented _init_vendor_properties() Jul 10 04:26:34 devstack cinder-volume[76364]: DEBUG cinder.volume.driver [None req-576c097b-4e06-49ee-a089-596b15698f59 None None] Initialized capabilities list: {'volume_backend_name': 'lvmdriver-1', 'vendor_name': 'Open Source', 'driver_version': '3.0.0', 'storage_protocol': 'iSCSI', 'pools': [{'pool_name': 'lvmdriver-1', 'total_capacity_gb': 28.5, 'free_capacity_gb': 28.5, 'reserved_percentage': 0, 'location_info': 'LVMVolumeDriver:devstack:stack-volumes-lvmdriver-1:thin:0', 'QoS_support': False, 'provisioned_capacity_gb': 0.0, 'max_over_subscription_ratio': '20.0', 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'total_volumes': 1, 'filter_function': None, 'goodness_function': None, 'multiattach': True, 'backend_state': 'up'}], 'shared_targets': False, 'sparse_copy_volume': True, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=76364) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}} Jul 10 04:26:34 devstack cinder-volume[76364]: DEBUG oslo_db.sqlalchemy.engines [None req-576c097b-4e06-49ee-a089-596b15698f59 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=76364) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 10 04:26:34 devstack cinder-volume[76364]: DEBUG dbcounter [-] [76364] Writer thread running {{(pid=76364) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Jul 10 04:26:34 devstack cinder-volume[76364]: DEBUG cinder.db.api [None req-576c097b-4e06-49ee-a089-596b15698f59 None None] Building query based on filter {{(pid=76364) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}} Jul 10 04:26:34 devstack cinder-volume[76364]: DEBUG cinder.image.image_utils [None req-576c097b-4e06-49ee-a089-596b15698f59 None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=76364) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1331}} Jul 10 04:26:34 devstack cinder-volume[76364]: INFO cinder.keymgr.migration [None req-845e45a9-d56a-4504-a72c-e37c928bdd57 None None] Not migrating encryption keys because the ConfKeyManager is still in use. Jul 10 04:26:34 devstack cinder-volume[76364]: DEBUG cinder.volume.drivers.lvm [None req-576c097b-4e06-49ee-a089-596b15698f59 None None] Updating volume stats {{(pid=76364) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Jul 10 04:26:34 devstack cinder-volume[76364]: DEBUG oslo_concurrency.processutils [None req-576c097b-4e06-49ee-a089-596b15698f59 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:26:34 devstack sudo[77464]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 10 04:26:34 devstack sudo[77464]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:26:34 devstack sudo[77464]: pam_unix(sudo:session): session closed for user root Jul 10 04:26:34 devstack cinder-volume[76364]: DEBUG oslo_concurrency.processutils [None req-576c097b-4e06-49ee-a089-596b15698f59 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.643s {{(pid=76364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:26:34 devstack cinder-volume[76364]: DEBUG oslo_concurrency.processutils [None req-576c097b-4e06-49ee-a089-596b15698f59 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:26:34 devstack sudo[77471]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 10 04:26:34 devstack sudo[77471]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:26:35 devstack sudo[77471]: pam_unix(sudo:session): session closed for user root Jul 10 04:26:35 devstack cinder-volume[76364]: DEBUG oslo_concurrency.processutils [None req-576c097b-4e06-49ee-a089-596b15698f59 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.674s {{(pid=76364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:26:35 devstack cinder-volume[76364]: DEBUG oslo_concurrency.processutils [None req-576c097b-4e06-49ee-a089-596b15698f59 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:26:35 devstack sudo[77474]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 10 04:26:35 devstack sudo[77474]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:26:36 devstack sudo[77474]: pam_unix(sudo:session): session closed for user root Jul 10 04:26:36 devstack cinder-volume[76364]: DEBUG oslo_concurrency.processutils [None req-576c097b-4e06-49ee-a089-596b15698f59 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.674s {{(pid=76364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:26:36 devstack cinder-volume[76364]: DEBUG oslo_concurrency.processutils [None req-576c097b-4e06-49ee-a089-596b15698f59 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:26:36 devstack sudo[77477]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 10 04:26:36 devstack sudo[77477]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:26:36 devstack sudo[77477]: pam_unix(sudo:session): session closed for user root Jul 10 04:26:36 devstack cinder-volume[76364]: DEBUG oslo_concurrency.processutils [None req-576c097b-4e06-49ee-a089-596b15698f59 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.623s {{(pid=76364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:26:36 devstack cinder-volume[76364]: DEBUG cinder.manager [None req-576c097b-4e06-49ee-a089-596b15698f59 None None] Notifying Schedulers of capabilities ... {{(pid=76364) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 04:26:36 devstack cinder-volume[76364]: INFO cinder.volume.manager [None req-576c097b-4e06-49ee-a089-596b15698f59 None None] Driver initialization completed successfully. Jul 10 04:26:36 devstack cinder-volume[76364]: INFO cinder.manager [None req-576c097b-4e06-49ee-a089-596b15698f59 None None] Initiating service 2 cleanup Jul 10 04:26:36 devstack cinder-volume[76364]: INFO cinder.manager [None req-576c097b-4e06-49ee-a089-596b15698f59 None None] Service 2 cleanup completed. Jul 10 04:26:36 devstack cinder-volume[76364]: DEBUG cinder.service [None req-576c097b-4e06-49ee-a089-596b15698f59 None None] Creating RPC server for service cinder-volume {{(pid=76364) start /opt/stack/cinder/cinder/service.py:231}} Jul 10 04:26:36 devstack cinder-volume[76364]: DEBUG cinder.service [None req-576c097b-4e06-49ee-a089-596b15698f59 None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=76364) start /opt/stack/cinder/cinder/service.py:237}} Jul 10 04:26:36 devstack cinder-volume[76364]: INFO cinder.volume.manager [None req-576c097b-4e06-49ee-a089-596b15698f59 None None] Initializing RPC dependent components of volume driver LVMVolumeDriver (3.0.0) Jul 10 04:26:36 devstack cinder-volume[76364]: DEBUG cinder.volume.drivers.lvm [None req-576c097b-4e06-49ee-a089-596b15698f59 None None] Updating volume stats {{(pid=76364) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Jul 10 04:26:36 devstack cinder-volume[76364]: DEBUG oslo_concurrency.processutils [None req-576c097b-4e06-49ee-a089-596b15698f59 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:26:37 devstack sudo[77481]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 10 04:26:37 devstack sudo[77481]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:26:37 devstack sudo[77481]: pam_unix(sudo:session): session closed for user root Jul 10 04:26:37 devstack cinder-volume[76364]: DEBUG oslo_concurrency.processutils [None req-576c097b-4e06-49ee-a089-596b15698f59 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.703s {{(pid=76364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:26:37 devstack cinder-volume[76364]: DEBUG oslo_concurrency.processutils [None req-576c097b-4e06-49ee-a089-596b15698f59 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:26:37 devstack sudo[77485]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 10 04:26:37 devstack sudo[77485]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:26:38 devstack sudo[77485]: pam_unix(sudo:session): session closed for user root Jul 10 04:26:38 devstack cinder-volume[76364]: DEBUG oslo_concurrency.processutils [None req-576c097b-4e06-49ee-a089-596b15698f59 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.717s {{(pid=76364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:26:38 devstack cinder-volume[76364]: DEBUG oslo_concurrency.processutils [None req-576c097b-4e06-49ee-a089-596b15698f59 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:26:38 devstack sudo[77491]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 10 04:26:38 devstack sudo[77491]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:26:39 devstack sudo[77491]: pam_unix(sudo:session): session closed for user root Jul 10 04:26:39 devstack cinder-volume[76364]: DEBUG oslo_concurrency.processutils [None req-576c097b-4e06-49ee-a089-596b15698f59 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.705s {{(pid=76364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:26:39 devstack cinder-volume[76364]: DEBUG oslo_concurrency.processutils [None req-576c097b-4e06-49ee-a089-596b15698f59 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:26:39 devstack sudo[77548]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 10 04:26:39 devstack sudo[77548]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:26:39 devstack sudo[77548]: pam_unix(sudo:session): session closed for user root Jul 10 04:26:39 devstack cinder-volume[76364]: DEBUG oslo_concurrency.processutils [None req-576c097b-4e06-49ee-a089-596b15698f59 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.637s {{(pid=76364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:26:39 devstack cinder-volume[76364]: INFO cinder.volume.manager [None req-576c097b-4e06-49ee-a089-596b15698f59 None None] Driver post RPC initialization completed successfully. Jul 10 04:26:49 devstack cinder-volume[76364]: DEBUG dbcounter [-] [76364] Writing DB stats cinder:SELECT=5 {{(pid=76364) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 10 04:26:49 devstack cinder-volume[76364]: DEBUG dbcounter [-] [76364] Writing DB stats cinder:SELECT=9,cinder:INSERT=1,cinder:UPDATE=2 {{(pid=76364) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 10 04:27:17 devstack cinder-volume[76364]: DEBUG oslo_service.periodic_task [None req-9649b825-4230-474d-986c-bfe86eaa30cd None None] Running periodic task VolumeManager._thread_info {{(pid=76364) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 10 04:27:17 devstack cinder-volume[76364]: DEBUG cinder.volume.manager [None req-9649b825-4230-474d-986c-bfe86eaa30cd None None] thread count: 6 {{(pid=76364) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 10 04:27:17 devstack cinder-volume[76364]: DEBUG cinder.volume.manager [None req-9649b825-4230-474d-986c-bfe86eaa30cd None None] thread info: [<_MainThread(MainThread, started 129820786274432)>, , , , , ] {{(pid=76364) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 10 04:28:17 devstack cinder-volume[76364]: DEBUG oslo_service.periodic_task [None req-9649b825-4230-474d-986c-bfe86eaa30cd None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=76364) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 10 04:28:17 devstack cinder-volume[76364]: DEBUG cinder.volume.drivers.lvm [None req-9649b825-4230-474d-986c-bfe86eaa30cd None None] Updating volume stats {{(pid=76364) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Jul 10 04:28:17 devstack cinder-volume[76364]: DEBUG oslo_concurrency.processutils [None req-9649b825-4230-474d-986c-bfe86eaa30cd None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:28:17 devstack sudo[82419]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 10 04:28:17 devstack sudo[82419]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:28:18 devstack sudo[82419]: pam_unix(sudo:session): session closed for user root Jul 10 04:28:18 devstack cinder-volume[76364]: DEBUG oslo_concurrency.processutils [None req-9649b825-4230-474d-986c-bfe86eaa30cd None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.626s {{(pid=76364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:28:18 devstack cinder-volume[76364]: DEBUG oslo_concurrency.processutils [None req-9649b825-4230-474d-986c-bfe86eaa30cd None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:28:18 devstack sudo[82422]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 10 04:28:18 devstack sudo[82422]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:28:19 devstack sudo[82422]: pam_unix(sudo:session): session closed for user root Jul 10 04:28:19 devstack cinder-volume[76364]: DEBUG oslo_concurrency.processutils [None req-9649b825-4230-474d-986c-bfe86eaa30cd None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.632s {{(pid=76364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:28:19 devstack cinder-volume[76364]: DEBUG oslo_concurrency.processutils [None req-9649b825-4230-474d-986c-bfe86eaa30cd None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:28:19 devstack sudo[82425]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 10 04:28:19 devstack sudo[82425]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:28:19 devstack sudo[82425]: pam_unix(sudo:session): session closed for user root Jul 10 04:28:19 devstack cinder-volume[76364]: DEBUG oslo_concurrency.processutils [None req-9649b825-4230-474d-986c-bfe86eaa30cd None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.657s {{(pid=76364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:28:19 devstack cinder-volume[76364]: DEBUG oslo_concurrency.processutils [None req-9649b825-4230-474d-986c-bfe86eaa30cd None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:28:19 devstack sudo[82463]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 10 04:28:19 devstack sudo[82463]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:28:20 devstack sudo[82463]: pam_unix(sudo:session): session closed for user root Jul 10 04:28:20 devstack cinder-volume[76364]: DEBUG oslo_concurrency.processutils [None req-9649b825-4230-474d-986c-bfe86eaa30cd None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.639s {{(pid=76364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:28:20 devstack cinder-volume[76364]: DEBUG cinder.manager [None req-9649b825-4230-474d-986c-bfe86eaa30cd None None] Notifying Schedulers of capabilities ... {{(pid=76364) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 04:28:20 devstack cinder-volume[76364]: DEBUG oslo_service.periodic_task [None req-9649b825-4230-474d-986c-bfe86eaa30cd None None] Running periodic task VolumeManager._thread_info {{(pid=76364) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 10 04:28:20 devstack cinder-volume[76364]: DEBUG cinder.volume.manager [None req-9649b825-4230-474d-986c-bfe86eaa30cd None None] thread count: 6 {{(pid=76364) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 10 04:28:20 devstack cinder-volume[76364]: DEBUG cinder.volume.manager [None req-9649b825-4230-474d-986c-bfe86eaa30cd None None] thread info: [<_MainThread(MainThread, started 129820786274432)>, , , , , ] {{(pid=76364) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 10 04:28:49 devstack cinder-volume[76364]: DEBUG dbcounter [-] [76364] Writing DB stats cinder:SELECT=1 {{(pid=76364) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 10 04:28:49 devstack cinder-volume[76364]: DEBUG dbcounter [-] [76364] Writing DB stats cinder:UPDATE=1 {{(pid=76364) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 10 04:29:17 devstack cinder-volume[76364]: DEBUG oslo_service.periodic_task [None req-9649b825-4230-474d-986c-bfe86eaa30cd None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=76364) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 10 04:29:17 devstack cinder-volume[76364]: DEBUG cinder.volume.drivers.lvm [None req-9649b825-4230-474d-986c-bfe86eaa30cd None None] Updating volume stats {{(pid=76364) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Jul 10 04:29:17 devstack cinder-volume[76364]: DEBUG oslo_concurrency.processutils [None req-9649b825-4230-474d-986c-bfe86eaa30cd None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:29:17 devstack sudo[84065]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 10 04:29:17 devstack sudo[84065]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:29:18 devstack sudo[84065]: pam_unix(sudo:session): session closed for user root Jul 10 04:29:18 devstack cinder-volume[76364]: DEBUG oslo_concurrency.processutils [None req-9649b825-4230-474d-986c-bfe86eaa30cd None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.652s {{(pid=76364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:29:18 devstack cinder-volume[76364]: DEBUG oslo_concurrency.processutils [None req-9649b825-4230-474d-986c-bfe86eaa30cd None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:29:18 devstack sudo[84102]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 10 04:29:18 devstack sudo[84102]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:29:19 devstack sudo[84102]: pam_unix(sudo:session): session closed for user root Jul 10 04:29:19 devstack cinder-volume[76364]: DEBUG oslo_concurrency.processutils [None req-9649b825-4230-474d-986c-bfe86eaa30cd None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.690s {{(pid=76364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:29:19 devstack cinder-volume[76364]: DEBUG oslo_concurrency.processutils [None req-9649b825-4230-474d-986c-bfe86eaa30cd None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:29:19 devstack sudo[84141]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 10 04:29:19 devstack sudo[84141]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:29:19 devstack sudo[84141]: pam_unix(sudo:session): session closed for user root Jul 10 04:29:19 devstack cinder-volume[76364]: DEBUG oslo_concurrency.processutils [None req-9649b825-4230-474d-986c-bfe86eaa30cd None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.643s {{(pid=76364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:29:19 devstack cinder-volume[76364]: DEBUG oslo_concurrency.processutils [None req-9649b825-4230-474d-986c-bfe86eaa30cd None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:29:19 devstack sudo[84164]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 10 04:29:19 devstack sudo[84164]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:29:20 devstack sudo[84164]: pam_unix(sudo:session): session closed for user root Jul 10 04:29:20 devstack cinder-volume[76364]: DEBUG oslo_concurrency.processutils [None req-9649b825-4230-474d-986c-bfe86eaa30cd None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.672s {{(pid=76364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:29:20 devstack cinder-volume[76364]: DEBUG cinder.manager [None req-9649b825-4230-474d-986c-bfe86eaa30cd None None] Notifying Schedulers of capabilities ... {{(pid=76364) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 04:29:20 devstack cinder-volume[76364]: DEBUG oslo_service.periodic_task [None req-9649b825-4230-474d-986c-bfe86eaa30cd None None] Running periodic task VolumeManager._thread_info {{(pid=76364) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 10 04:29:20 devstack cinder-volume[76364]: DEBUG cinder.volume.manager [None req-9649b825-4230-474d-986c-bfe86eaa30cd None None] thread count: 6 {{(pid=76364) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 10 04:29:20 devstack cinder-volume[76364]: DEBUG cinder.volume.manager [None req-9649b825-4230-474d-986c-bfe86eaa30cd None None] thread info: [<_MainThread(MainThread, started 129820786274432)>, , , , , ] {{(pid=76364) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 10 04:30:17 devstack cinder-volume[76364]: DEBUG oslo_service.periodic_task [None req-9649b825-4230-474d-986c-bfe86eaa30cd None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=76364) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 10 04:30:17 devstack cinder-volume[76364]: DEBUG cinder.volume.drivers.lvm [None req-9649b825-4230-474d-986c-bfe86eaa30cd None None] Updating volume stats {{(pid=76364) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Jul 10 04:30:17 devstack cinder-volume[76364]: DEBUG oslo_concurrency.processutils [None req-9649b825-4230-474d-986c-bfe86eaa30cd None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:30:17 devstack sudo[85465]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 10 04:30:17 devstack sudo[85465]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:30:18 devstack sudo[85465]: pam_unix(sudo:session): session closed for user root Jul 10 04:30:18 devstack cinder-volume[76364]: DEBUG oslo_concurrency.processutils [None req-9649b825-4230-474d-986c-bfe86eaa30cd None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.656s {{(pid=76364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:30:18 devstack cinder-volume[76364]: DEBUG oslo_concurrency.processutils [None req-9649b825-4230-474d-986c-bfe86eaa30cd None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:30:18 devstack sudo[85469]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 10 04:30:18 devstack sudo[85469]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:30:19 devstack sudo[85469]: pam_unix(sudo:session): session closed for user root Jul 10 04:30:19 devstack cinder-volume[76364]: DEBUG oslo_concurrency.processutils [None req-9649b825-4230-474d-986c-bfe86eaa30cd None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.658s {{(pid=76364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:30:19 devstack cinder-volume[76364]: DEBUG oslo_concurrency.processutils [None req-9649b825-4230-474d-986c-bfe86eaa30cd None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:30:19 devstack sudo[85483]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 10 04:30:19 devstack sudo[85483]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:30:19 devstack sudo[85483]: pam_unix(sudo:session): session closed for user root Jul 10 04:30:19 devstack cinder-volume[76364]: DEBUG oslo_concurrency.processutils [None req-9649b825-4230-474d-986c-bfe86eaa30cd None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.647s {{(pid=76364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:30:19 devstack cinder-volume[76364]: DEBUG oslo_concurrency.processutils [None req-9649b825-4230-474d-986c-bfe86eaa30cd None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:30:19 devstack sudo[85509]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 10 04:30:19 devstack sudo[85509]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:30:20 devstack sudo[85509]: pam_unix(sudo:session): session closed for user root Jul 10 04:30:20 devstack cinder-volume[76364]: DEBUG oslo_concurrency.processutils [None req-9649b825-4230-474d-986c-bfe86eaa30cd None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.626s {{(pid=76364) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:30:20 devstack cinder-volume[76364]: DEBUG cinder.manager [None req-9649b825-4230-474d-986c-bfe86eaa30cd None None] Notifying Schedulers of capabilities ... {{(pid=76364) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 04:30:20 devstack cinder-volume[76364]: DEBUG oslo_service.periodic_task [None req-9649b825-4230-474d-986c-bfe86eaa30cd None None] Running periodic task VolumeManager._thread_info {{(pid=76364) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 10 04:30:20 devstack cinder-volume[76364]: DEBUG cinder.volume.manager [None req-9649b825-4230-474d-986c-bfe86eaa30cd None None] thread count: 6 {{(pid=76364) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 10 04:30:20 devstack cinder-volume[76364]: DEBUG cinder.volume.manager [None req-9649b825-4230-474d-986c-bfe86eaa30cd None None] thread info: [<_MainThread(MainThread, started 129820786274432)>, , , , , ] {{(pid=76364) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 10 04:30:49 devstack cinder-volume[76364]: DEBUG dbcounter [-] [76364] Writing DB stats cinder:SELECT=1,cinder:UPDATE=1 {{(pid=76364) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 10 04:31:00 devstack cinder-volume[76164]: INFO oslo_service.backend._eventlet.service [None req-09f55645-c366-4244-999d-a977d516da1b None None] Caught SIGTERM, stopping children Jul 10 04:31:00 devstack cinder-volume[76164]: DEBUG oslo_concurrency.lockutils [None req-09f55645-c366-4244-999d-a977d516da1b None None] Acquiring lock "singleton_lock" {{(pid=76164) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jul 10 04:31:00 devstack cinder-volume[76164]: DEBUG oslo_concurrency.lockutils [None req-09f55645-c366-4244-999d-a977d516da1b None None] Acquired lock "singleton_lock" {{(pid=76164) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jul 10 04:31:00 devstack cinder-volume[76164]: DEBUG oslo_concurrency.lockutils [None req-09f55645-c366-4244-999d-a977d516da1b None None] Releasing lock "singleton_lock" {{(pid=76164) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jul 10 04:31:00 devstack cinder-volume[76164]: DEBUG oslo_service.backend._eventlet.service [None req-09f55645-c366-4244-999d-a977d516da1b None None] Stop services. {{(pid=76164) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:611}} Jul 10 04:31:00 devstack cinder-volume[76164]: DEBUG oslo_service.backend._eventlet.service [None req-09f55645-c366-4244-999d-a977d516da1b None None] Killing children. {{(pid=76164) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:616}} Jul 10 04:31:00 devstack cinder-volume[76164]: INFO oslo_service.backend._eventlet.service [None req-09f55645-c366-4244-999d-a977d516da1b None None] Waiting on 1 children to exit Jul 10 04:31:01 devstack cinder-volume[76364]: DEBUG oslo_concurrency.lockutils [None req-09f55645-c366-4244-999d-a977d516da1b None None] Acquiring lock "singleton_lock" {{(pid=76364) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jul 10 04:31:01 devstack cinder-volume[76364]: DEBUG oslo_concurrency.lockutils [None req-09f55645-c366-4244-999d-a977d516da1b None None] Acquired lock "singleton_lock" {{(pid=76364) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jul 10 04:31:01 devstack cinder-volume[76364]: DEBUG oslo_concurrency.lockutils [None req-09f55645-c366-4244-999d-a977d516da1b None None] Releasing lock "singleton_lock" {{(pid=76364) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jul 10 04:31:01 devstack cinder-volume[76364]: WARNING amqp [None req-09f55645-c366-4244-999d-a977d516da1b None None] Received method (60, 30) during closing channel 1. This method will be ignored Jul 10 04:31:01 devstack cinder-volume[76364]: WARNING amqp [None req-09f55645-c366-4244-999d-a977d516da1b None None] Received method (60, 30) during closing channel 1. This method will be ignored Jul 10 04:31:02 devstack cinder-volume[76164]: INFO oslo_service.backend._eventlet.service [None req-09f55645-c366-4244-999d-a977d516da1b None None] Child 76364 exited with status 0 Jul 10 04:31:02 devstack cinder-volume[86450]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Jul 10 04:31:02 devstack cinder-volume[86450]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Jul 10 04:31:02 devstack cinder-volume[86450]: we strongly recommend against using it for new projects. Jul 10 04:31:02 devstack cinder-volume[86450]: If you are already using Eventlet, we recommend migrating to a different Jul 10 04:31:02 devstack cinder-volume[86450]: framework. For more detail see Jul 10 04:31:02 devstack cinder-volume[86450]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Jul 10 04:31:02 devstack cinder-volume[86450]: import eventlet # noqa Jul 10 04:31:04 devstack cinder-volume[86450]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=86450) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jul 10 04:31:04 devstack cinder-volume[86450]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=86450) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jul 10 04:31:04 devstack cinder-volume[86450]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=86450) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jul 10 04:31:05 devstack cinder-volume[86450]: INFO dbcounter [None req-b985f691-4253-4471-b7cb-75a26af5376b None None] Registered counter for database cinder Jul 10 04:31:05 devstack cinder-volume[86450]: DEBUG oslo_db.sqlalchemy.engines [None req-b985f691-4253-4471-b7cb-75a26af5376b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86450) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 10 04:31:05 devstack cinder-volume[86450]: DEBUG dbcounter [-] [86450] Writer thread running {{(pid=86450) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Jul 10 04:31:05 devstack cinder-volume[86450]: INFO cinder.rpc [None req-b985f691-4253-4471-b7cb-75a26af5376b None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Jul 10 04:31:05 devstack cinder-volume[86450]: INFO cinder.rpc [None req-b985f691-4253-4471-b7cb-75a26af5376b None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Jul 10 04:31:05 devstack cinder-volume[86450]: DEBUG oslo_db.sqlalchemy.engines [None req-b985f691-4253-4471-b7cb-75a26af5376b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86450) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 10 04:31:05 devstack cinder-volume[86450]: INFO cinder.volume.manager [None req-b985f691-4253-4471-b7cb-75a26af5376b None None] Determined volume DB was empty at startup. Jul 10 04:31:05 devstack cinder-volume[86450]: DEBUG cinder.volume.manager [None req-b985f691-4253-4471-b7cb-75a26af5376b None None] Cinder Volume DB check: vol_db_empty=True {{(pid=86450) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}} Jul 10 04:31:05 devstack cinder-volume[86450]: INFO cinder.volume.manager [None req-b985f691-4253-4471-b7cb-75a26af5376b None None] Service not found for updating active_backend_id, assuming default for driver init. Jul 10 04:31:05 devstack cinder-volume[86450]: WARNING stevedore.named [None req-b985f691-4253-4471-b7cb-75a26af5376b None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Jul 10 04:31:05 devstack cinder-volume[86450]: WARNING castellan.key_manager [None req-b985f691-4253-4471-b7cb-75a26af5376b None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jul 10 04:31:05 devstack cinder-volume[86450]: WARNING cinder.keymgr.conf_key_mgr [None req-b985f691-4253-4471-b7cb-75a26af5376b None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jul 10 04:31:05 devstack cinder-volume[86450]: INFO cinder.volume.manager [None req-b985f691-4253-4471-b7cb-75a26af5376b None None] Image-volume cache disabled for host devstack@QuobyteHD. Jul 10 04:31:05 devstack cinder-volume[86450]: DEBUG oslo_db.sqlalchemy.engines [None req-b985f691-4253-4471-b7cb-75a26af5376b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86450) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 10 04:31:05 devstack cinder-volume[86450]: INFO oslo_service.backend._eventlet.service [None req-b985f691-4253-4471-b7cb-75a26af5376b None None] Starting 1 workers Jul 10 04:31:05 devstack cinder-volume[86450]: DEBUG oslo_service.backend._eventlet.service [None req-b985f691-4253-4471-b7cb-75a26af5376b None None] Started child 86668 {{(pid=86450) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Jul 10 04:31:05 devstack cinder-volume[86450]: DEBUG oslo_service.backend._eventlet.service [None req-b985f691-4253-4471-b7cb-75a26af5376b None None] Full set of CONF: {{(pid=86450) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Jul 10 04:31:05 devstack cinder-volume[86450]: DEBUG oslo_service.backend._eventlet.service [None req-b985f691-4253-4471-b7cb-75a26af5376b None None] ******************************************************************************** {{(pid=86450) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3226}} Jul 10 04:31:05 devstack cinder-volume[86450]: DEBUG oslo_service.backend._eventlet.service [None req-b985f691-4253-4471-b7cb-75a26af5376b None None] Configuration options gathered from: {{(pid=86450) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3227}} Jul 10 04:31:05 devstack cinder-volume[86450]: DEBUG oslo_service.backend._eventlet.service [None req-b985f691-4253-4471-b7cb-75a26af5376b None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=86450) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3228}} Jul 10 04:31:05 devstack cinder-volume[86450]: DEBUG oslo_service.backend._eventlet.service [None req-b985f691-4253-4471-b7cb-75a26af5376b None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=86450) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3229}} Jul 10 04:31:05 devstack cinder-volume[86450]: DEBUG oslo_service.backend._eventlet.service [None req-b985f691-4253-4471-b7cb-75a26af5376b None None] ================================================================================ {{(pid=86450) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3234}} Jul 10 04:31:05 devstack cinder-volume[86450]: DEBUG oslo_service.backend._eventlet.service [None req-b985f691-4253-4471-b7cb-75a26af5376b None None] allow_availability_zone_fallback = False {{(pid=86450) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 04:31:05 devstack cinder-volume[86450]: DEBUG oslo_service.backend._eventlet.service [None req-b985f691-4253-4471-b7cb-75a26af5376b None None] allow_compression_on_image_upload = False {{(pid=86450) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 04:31:05 devstack cinder-volume[86450]: DEBUG oslo_service.backend._eventlet.service [None req-b985f691-4253-4471-b7cb-75a26af5376b None None] allowed_direct_url_schemes = [] {{(pid=86450) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 04:31:05 devstack cinder-volume[86450]: DEBUG oslo_service.backend._eventlet.service [None req-b985f691-4253-4471-b7cb-75a26af5376b None None] api_rate_limit = True {{(pid=86450) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 04:31:05 devstack cinder-volume[86450]: DEBUG oslo_service.backend._eventlet.service [None req-b985f691-4253-4471-b7cb-75a26af5376b None None] auth_strategy = keystone {{(pid=86450) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 04:31:05 devstack cinder-volume[86668]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0) Jul 10 04:31:05 devstack cinder-volume[86450]: DEBUG oslo_service.backend._eventlet.service [None req-b985f691-4253-4471-b7cb-75a26af5376b None None] backend_availability_zone = None {{(pid=86450) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 04:31:05 devstack cinder-volume[86450]: DEBUG oslo_service.backend._eventlet.service [None req-b985f691-4253-4471-b7cb-75a26af5376b None None] backend_host = None {{(pid=86450) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 04:31:05 devstack cinder-volume[86450]: DEBUG oslo_service.backend._eventlet.service [None req-b985f691-4253-4471-b7cb-75a26af5376b None None] backend_name = None {{(pid=86450) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 04:31:05 devstack cinder-volume[86450]: DEBUG oslo_service.backend._eventlet.service [None req-b985f691-4253-4471-b7cb-75a26af5376b None None] backend_stats_polling_interval = 60 {{(pid=86450) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 04:31:05 devstack cinder-volume[86450]: DEBUG oslo_service.backend._eventlet.service [None req-b985f691-4253-4471-b7cb-75a26af5376b None None] backup_api_class = cinder.backup.api.API {{(pid=86450) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 04:31:05 devstack cinder-volume[86450]: DEBUG oslo_service.backend._eventlet.service [None req-b985f691-4253-4471-b7cb-75a26af5376b None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=86450) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 04:31:05 devstack cinder-volume[86450]: DEBUG oslo_service.backend._eventlet.service [None req-b985f691-4253-4471-b7cb-75a26af5376b None None] backup_name_template = backup-%s {{(pid=86450) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 04:31:05 devstack cinder-volume[86450]: DEBUG oslo_service.backend._eventlet.service [None req-b985f691-4253-4471-b7cb-75a26af5376b None None] backup_use_same_host = False {{(pid=86450) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 04:31:05 devstack cinder-volume[86450]: DEBUG oslo_service.backend._eventlet.service [None req-b985f691-4253-4471-b7cb-75a26af5376b None None] backup_use_temp_snapshot = False {{(pid=86450) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 04:31:05 devstack cinder-volume[86450]: DEBUG oslo_service.backend._eventlet.service [None req-b985f691-4253-4471-b7cb-75a26af5376b None None] chap_password = **** {{(pid=86450) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 04:31:05 devstack cinder-volume[86450]: DEBUG oslo_service.backend._eventlet.service [None req-b985f691-4253-4471-b7cb-75a26af5376b None None] chap_username = {{(pid=86450) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 04:31:05 devstack cinder-volume[86450]: DEBUG oslo_service.backend._eventlet.service [None req-b985f691-4253-4471-b7cb-75a26af5376b None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=86450) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 04:31:05 devstack cinder-volume[86450]: DEBUG oslo_service.backend._eventlet.service [None req-b985f691-4253-4471-b7cb-75a26af5376b None None] cinder_internal_tenant_project_id = b0a783484f594c9ab0b54e5c67f9920d {{(pid=86450) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 04:31:05 devstack cinder-volume[86450]: DEBUG oslo_service.backend._eventlet.service [None req-b985f691-4253-4471-b7cb-75a26af5376b None None] cinder_internal_tenant_user_id = 6eec03a607de4ca6b3826ac80077e53f {{(pid=86450) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 04:31:05 devstack cinder-volume[86450]: DEBUG oslo_service.backend._eventlet.service [None req-b985f691-4253-4471-b7cb-75a26af5376b None None] cluster = None {{(pid=86450) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 04:31:05 devstack cinder-volume[86450]: DEBUG oslo_service.backend._eventlet.service [None req-b985f691-4253-4471-b7cb-75a26af5376b None None] compression_format = gzip {{(pid=86450) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 04:31:05 devstack cinder-volume[86450]: DEBUG oslo_service.backend._eventlet.service [None req-b985f691-4253-4471-b7cb-75a26af5376b None None] compute_api_class = cinder.compute.nova.API {{(pid=86450) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 04:31:05 devstack cinder-volume[86450]: DEBUG oslo_service.backend._eventlet.service [None req-b985f691-4253-4471-b7cb-75a26af5376b None None] config_dir = [] {{(pid=86450) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 04:31:05 devstack cinder-volume[86450]: DEBUG oslo_service.backend._eventlet.service [None req-b985f691-4253-4471-b7cb-75a26af5376b None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=86450) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 04:31:05 devstack cinder-volume[86450]: DEBUG oslo_service.backend._eventlet.service [None req-b985f691-4253-4471-b7cb-75a26af5376b None None] config_source = [] {{(pid=86450) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 04:31:05 devstack cinder-volume[86450]: DEBUG oslo_service.backend._eventlet.service [None req-b985f691-4253-4471-b7cb-75a26af5376b None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=86450) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 04:31:05 devstack cinder-volume[86450]: DEBUG oslo_service.backend._eventlet.service [None req-b985f691-4253-4471-b7cb-75a26af5376b None None] control_exchange = openstack {{(pid=86450) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 04:31:05 devstack cinder-volume[86450]: DEBUG oslo_service.backend._eventlet.service [None req-b985f691-4253-4471-b7cb-75a26af5376b None None] debug = True {{(pid=86450) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 04:31:05 devstack cinder-volume[86450]: DEBUG oslo_service.backend._eventlet.service [None req-b985f691-4253-4471-b7cb-75a26af5376b None None] default_availability_zone = None {{(pid=86450) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 04:31:05 devstack cinder-volume[86450]: DEBUG oslo_service.backend._eventlet.service [None req-b985f691-4253-4471-b7cb-75a26af5376b None None] default_group_type = None {{(pid=86450) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 04:31:05 devstack cinder-volume[86450]: DEBUG oslo_service.backend._eventlet.service [None req-b985f691-4253-4471-b7cb-75a26af5376b None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=86450) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 04:31:05 devstack cinder-volume[86450]: DEBUG oslo_service.backend._eventlet.service [None req-b985f691-4253-4471-b7cb-75a26af5376b None None] default_volume_type = QuobyteHD {{(pid=86450) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 04:31:05 devstack cinder-volume[86450]: DEBUG oslo_service.backend._eventlet.service [None req-b985f691-4253-4471-b7cb-75a26af5376b None None] disk_geometry = None {{(pid=86450) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 04:31:05 devstack cinder-volume[86450]: DEBUG oslo_service.backend._eventlet.service [None req-b985f691-4253-4471-b7cb-75a26af5376b None None] driver_client_cert = None {{(pid=86450) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 04:31:05 devstack cinder-volume[86450]: DEBUG oslo_service.backend._eventlet.service [None req-b985f691-4253-4471-b7cb-75a26af5376b None None] driver_client_cert_key = None {{(pid=86450) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 04:31:05 devstack cinder-volume[86450]: DEBUG oslo_service.backend._eventlet.service [None req-b985f691-4253-4471-b7cb-75a26af5376b None None] driver_data_namespace = None {{(pid=86450) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 04:31:05 devstack cinder-volume[86450]: DEBUG oslo_service.backend._eventlet.service [None req-b985f691-4253-4471-b7cb-75a26af5376b None None] driver_ssl_cert_path = None {{(pid=86450) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 04:31:05 devstack cinder-volume[86450]: DEBUG oslo_service.backend._eventlet.service [None req-b985f691-4253-4471-b7cb-75a26af5376b None None] driver_ssl_cert_verify = False {{(pid=86450) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 04:31:05 devstack cinder-volume[86450]: DEBUG oslo_service.backend._eventlet.service [None req-b985f691-4253-4471-b7cb-75a26af5376b None None] driver_use_ssl = False {{(pid=86450) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 04:31:05 devstack cinder-volume[86450]: DEBUG oslo_service.backend._eventlet.service [None req-b985f691-4253-4471-b7cb-75a26af5376b None None] enable_new_services = True {{(pid=86450) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 04:31:05 devstack cinder-volume[86450]: DEBUG oslo_service.backend._eventlet.service [None req-b985f691-4253-4471-b7cb-75a26af5376b None None] enable_unsupported_driver = False {{(pid=86450) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 04:31:05 devstack cinder-volume[86450]: DEBUG oslo_service.backend._eventlet.service [None req-b985f691-4253-4471-b7cb-75a26af5376b None None] enabled_backends = ['QuobyteHD'] {{(pid=86450) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 04:31:05 devstack cinder-volume[86450]: DEBUG oslo_service.backend._eventlet.service [None req-b985f691-4253-4471-b7cb-75a26af5376b None None] enforce_multipath_for_image_xfer = False {{(pid=86450) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 04:31:05 devstack cinder-volume[86450]: DEBUG oslo_service.backend._eventlet.service [None req-b985f691-4253-4471-b7cb-75a26af5376b None None] filter_function = None {{(pid=86450) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 04:31:05 devstack cinder-volume[86450]: DEBUG oslo_service.backend._eventlet.service [None req-b985f691-4253-4471-b7cb-75a26af5376b None None] glance_api_insecure = False {{(pid=86450) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 04:31:05 devstack cinder-volume[86450]: DEBUG oslo_service.backend._eventlet.service [None req-b985f691-4253-4471-b7cb-75a26af5376b None None] glance_api_servers = ['http://192.168.122.158/image'] {{(pid=86450) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 04:31:05 devstack cinder-volume[86450]: DEBUG oslo_service.backend._eventlet.service [None req-b985f691-4253-4471-b7cb-75a26af5376b None None] glance_api_ssl_compression = False {{(pid=86450) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 04:31:05 devstack cinder-volume[86450]: DEBUG oslo_service.backend._eventlet.service [None req-b985f691-4253-4471-b7cb-75a26af5376b None None] glance_ca_certificates_file = None {{(pid=86450) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 04:31:05 devstack cinder-volume[86450]: DEBUG oslo_service.backend._eventlet.service [None req-b985f691-4253-4471-b7cb-75a26af5376b None None] glance_catalog_info = image:glance:publicURL {{(pid=86450) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 04:31:05 devstack cinder-volume[86450]: DEBUG oslo_service.backend._eventlet.service [None req-b985f691-4253-4471-b7cb-75a26af5376b None None] glance_certfile = None {{(pid=86450) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 04:31:05 devstack cinder-volume[86450]: DEBUG oslo_service.backend._eventlet.service [None req-b985f691-4253-4471-b7cb-75a26af5376b None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=86450) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 04:31:05 devstack cinder-volume[86450]: DEBUG oslo_service.backend._eventlet.service [None req-b985f691-4253-4471-b7cb-75a26af5376b None None] glance_keyfile = None {{(pid=86450) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 04:31:05 devstack cinder-volume[86450]: DEBUG oslo_service.backend._eventlet.service [None req-b985f691-4253-4471-b7cb-75a26af5376b None None] glance_num_retries = 3 {{(pid=86450) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 04:31:05 devstack cinder-volume[86450]: DEBUG oslo_service.backend._eventlet.service [None req-b985f691-4253-4471-b7cb-75a26af5376b None None] glance_request_timeout = None {{(pid=86450) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 04:31:05 devstack cinder-volume[86450]: DEBUG oslo_service.backend._eventlet.service [None req-b985f691-4253-4471-b7cb-75a26af5376b None None] goodness_function = None {{(pid=86450) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 04:31:05 devstack cinder-volume[86450]: DEBUG oslo_service.backend._eventlet.service [None req-b985f691-4253-4471-b7cb-75a26af5376b None None] graceful_shutdown_timeout = 5 {{(pid=86450) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 04:31:05 devstack cinder-volume[86450]: DEBUG oslo_service.backend._eventlet.service [None req-b985f691-4253-4471-b7cb-75a26af5376b None None] group_api_class = cinder.group.api.API {{(pid=86450) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 04:31:05 devstack cinder-volume[86450]: DEBUG oslo_service.backend._eventlet.service [None req-b985f691-4253-4471-b7cb-75a26af5376b None None] host = devstack {{(pid=86450) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 04:31:05 devstack cinder-volume[86450]: DEBUG oslo_service.backend._eventlet.service [None req-b985f691-4253-4471-b7cb-75a26af5376b None None] image_compress_on_upload = True {{(pid=86450) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 04:31:05 devstack cinder-volume[86450]: DEBUG oslo_service.backend._eventlet.service [None req-b985f691-4253-4471-b7cb-75a26af5376b None None] image_conversion_address_space_limit = 1 {{(pid=86450) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 04:31:05 devstack cinder-volume[86450]: DEBUG oslo_service.backend._eventlet.service [None req-b985f691-4253-4471-b7cb-75a26af5376b None None] image_conversion_cpu_limit = 60 {{(pid=86450) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 04:31:05 devstack cinder-volume[86450]: DEBUG oslo_service.backend._eventlet.service [None req-b985f691-4253-4471-b7cb-75a26af5376b None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=86450) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 04:31:05 devstack cinder-volume[86450]: DEBUG oslo_service.backend._eventlet.service [None req-b985f691-4253-4471-b7cb-75a26af5376b None None] image_conversion_disable = False {{(pid=86450) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 04:31:05 devstack cinder-volume[86450]: DEBUG oslo_service.backend._eventlet.service [None req-b985f691-4253-4471-b7cb-75a26af5376b None None] image_upload_use_cinder_backend = False {{(pid=86450) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 04:31:05 devstack cinder-volume[86450]: DEBUG oslo_service.backend._eventlet.service [None req-b985f691-4253-4471-b7cb-75a26af5376b None None] image_upload_use_internal_tenant = False {{(pid=86450) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 04:31:05 devstack cinder-volume[86450]: DEBUG oslo_service.backend._eventlet.service [None req-b985f691-4253-4471-b7cb-75a26af5376b None None] image_volume_cache_enabled = False {{(pid=86450) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 04:31:05 devstack cinder-volume[86450]: DEBUG oslo_service.backend._eventlet.service [None req-b985f691-4253-4471-b7cb-75a26af5376b None None] image_volume_cache_max_count = 0 {{(pid=86450) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 04:31:05 devstack cinder-volume[86450]: DEBUG oslo_service.backend._eventlet.service [None req-b985f691-4253-4471-b7cb-75a26af5376b None None] image_volume_cache_max_size_gb = 0 {{(pid=86450) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 04:31:05 devstack cinder-volume[86450]: DEBUG oslo_service.backend._eventlet.service [None req-b985f691-4253-4471-b7cb-75a26af5376b None None] init_host_max_objects_retrieval = 0 {{(pid=86450) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 04:31:05 devstack cinder-volume[86450]: DEBUG oslo_service.backend._eventlet.service [None req-b985f691-4253-4471-b7cb-75a26af5376b None None] instance_format = [instance: %(uuid)s] {{(pid=86450) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 04:31:05 devstack cinder-volume[86450]: DEBUG oslo_service.backend._eventlet.service [None req-b985f691-4253-4471-b7cb-75a26af5376b None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=86450) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 04:31:05 devstack cinder-volume[86450]: DEBUG oslo_service.backend._eventlet.service [None req-b985f691-4253-4471-b7cb-75a26af5376b None None] iscsi_target_flags = {{(pid=86450) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 04:31:05 devstack cinder-volume[86450]: DEBUG oslo_service.backend._eventlet.service [None req-b985f691-4253-4471-b7cb-75a26af5376b None None] iscsi_write_cache = on {{(pid=86450) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 04:31:05 devstack cinder-volume[86450]: DEBUG oslo_service.backend._eventlet.service [None req-b985f691-4253-4471-b7cb-75a26af5376b None None] iser_helper = tgtadm {{(pid=86450) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 04:31:05 devstack cinder-volume[86450]: DEBUG oslo_service.backend._eventlet.service [None req-b985f691-4253-4471-b7cb-75a26af5376b None None] iser_ip_address = 192.168.122.158 {{(pid=86450) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 04:31:05 devstack cinder-volume[86450]: DEBUG oslo_service.backend._eventlet.service [None req-b985f691-4253-4471-b7cb-75a26af5376b None None] iser_port = 3260 {{(pid=86450) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 04:31:05 devstack cinder-volume[86450]: DEBUG oslo_service.backend._eventlet.service [None req-b985f691-4253-4471-b7cb-75a26af5376b None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=86450) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 04:31:05 devstack cinder-volume[86450]: DEBUG oslo_service.backend._eventlet.service [None req-b985f691-4253-4471-b7cb-75a26af5376b None None] log_color = False {{(pid=86450) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 04:31:05 devstack cinder-volume[86450]: DEBUG oslo_service.backend._eventlet.service [None req-b985f691-4253-4471-b7cb-75a26af5376b None None] log_config_append = None {{(pid=86450) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 04:31:05 devstack cinder-volume[86450]: DEBUG oslo_service.backend._eventlet.service [None req-b985f691-4253-4471-b7cb-75a26af5376b None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=86450) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 04:31:05 devstack cinder-volume[86450]: DEBUG oslo_service.backend._eventlet.service [None req-b985f691-4253-4471-b7cb-75a26af5376b None None] log_dir = None {{(pid=86450) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 04:31:05 devstack cinder-volume[86450]: DEBUG oslo_service.backend._eventlet.service [None req-b985f691-4253-4471-b7cb-75a26af5376b None None] log_file = None {{(pid=86450) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 04:31:05 devstack cinder-volume[86450]: DEBUG oslo_service.backend._eventlet.service [None req-b985f691-4253-4471-b7cb-75a26af5376b None None] log_options = True {{(pid=86450) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 04:31:05 devstack cinder-volume[86450]: DEBUG oslo_service.backend._eventlet.service [None req-b985f691-4253-4471-b7cb-75a26af5376b None None] log_rotate_interval = 1 {{(pid=86450) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 04:31:05 devstack cinder-volume[86450]: DEBUG oslo_service.backend._eventlet.service [None req-b985f691-4253-4471-b7cb-75a26af5376b None None] log_rotate_interval_type = days {{(pid=86450) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 04:31:05 devstack cinder-volume[86450]: DEBUG oslo_service.backend._eventlet.service [None req-b985f691-4253-4471-b7cb-75a26af5376b None None] log_rotation_type = none {{(pid=86450) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 04:31:05 devstack cinder-volume[86450]: DEBUG oslo_service.backend._eventlet.service [None req-b985f691-4253-4471-b7cb-75a26af5376b None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=86450) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 04:31:05 devstack cinder-volume[86450]: DEBUG oslo_service.backend._eventlet.service [None req-b985f691-4253-4471-b7cb-75a26af5376b None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=86450) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 04:31:05 devstack cinder-volume[86450]: DEBUG oslo_service.backend._eventlet.service [None req-b985f691-4253-4471-b7cb-75a26af5376b None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=86450) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 04:31:05 devstack cinder-volume[86450]: DEBUG oslo_service.backend._eventlet.service [None req-b985f691-4253-4471-b7cb-75a26af5376b None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=86450) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 04:31:05 devstack cinder-volume[86450]: DEBUG oslo_service.backend._eventlet.service [None req-b985f691-4253-4471-b7cb-75a26af5376b None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=86450) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 04:31:05 devstack cinder-volume[86450]: DEBUG oslo_service.backend._eventlet.service [None req-b985f691-4253-4471-b7cb-75a26af5376b None None] max_age = 0 {{(pid=86450) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 04:31:05 devstack cinder-volume[86450]: DEBUG oslo_service.backend._eventlet.service [None req-b985f691-4253-4471-b7cb-75a26af5376b None None] max_logfile_count = 30 {{(pid=86450) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 04:31:05 devstack cinder-volume[86450]: DEBUG oslo_service.backend._eventlet.service [None req-b985f691-4253-4471-b7cb-75a26af5376b None None] max_logfile_size_mb = 200 {{(pid=86450) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 04:31:05 devstack cinder-volume[86450]: DEBUG oslo_service.backend._eventlet.service [None req-b985f691-4253-4471-b7cb-75a26af5376b None None] max_over_subscription_ratio = 20.0 {{(pid=86450) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 04:31:05 devstack cinder-volume[86450]: DEBUG oslo_service.backend._eventlet.service [None req-b985f691-4253-4471-b7cb-75a26af5376b None None] message_reap_interval = 86400 {{(pid=86450) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 04:31:05 devstack cinder-volume[86450]: DEBUG oslo_service.backend._eventlet.service [None req-b985f691-4253-4471-b7cb-75a26af5376b None None] message_ttl = 2592000 {{(pid=86450) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 04:31:05 devstack cinder-volume[86450]: DEBUG oslo_service.backend._eventlet.service [None req-b985f691-4253-4471-b7cb-75a26af5376b None None] migration_create_volume_timeout_secs = 300 {{(pid=86450) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 04:31:05 devstack cinder-volume[86450]: DEBUG oslo_service.backend._eventlet.service [None req-b985f691-4253-4471-b7cb-75a26af5376b None None] monkey_patch = False {{(pid=86450) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 04:31:05 devstack cinder-volume[86450]: DEBUG oslo_service.backend._eventlet.service [None req-b985f691-4253-4471-b7cb-75a26af5376b None None] monkey_patch_modules = [] {{(pid=86450) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 04:31:05 devstack cinder-volume[86450]: DEBUG oslo_service.backend._eventlet.service [None req-b985f691-4253-4471-b7cb-75a26af5376b None None] my_ip = 192.168.122.158 {{(pid=86450) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 04:31:05 devstack cinder-volume[86450]: DEBUG oslo_service.backend._eventlet.service [None req-b985f691-4253-4471-b7cb-75a26af5376b None None] no_snapshot_gb_quota = False {{(pid=86450) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 04:31:05 devstack cinder-volume[86450]: DEBUG oslo_service.backend._eventlet.service [None req-b985f691-4253-4471-b7cb-75a26af5376b None None] num_iser_scan_tries = 3 {{(pid=86450) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 04:31:05 devstack cinder-volume[86450]: DEBUG oslo_service.backend._eventlet.service [None req-b985f691-4253-4471-b7cb-75a26af5376b None None] num_shell_tries = 3 {{(pid=86450) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 04:31:05 devstack cinder-volume[86450]: DEBUG oslo_service.backend._eventlet.service [None req-b985f691-4253-4471-b7cb-75a26af5376b None None] num_volume_device_scan_tries = 3 {{(pid=86450) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 04:31:05 devstack cinder-volume[86450]: DEBUG oslo_service.backend._eventlet.service [None req-b985f691-4253-4471-b7cb-75a26af5376b None None] nvmeof_conn_info_version = 1 {{(pid=86450) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 04:31:05 devstack cinder-volume[86450]: DEBUG oslo_service.backend._eventlet.service [None req-b985f691-4253-4471-b7cb-75a26af5376b None None] nvmet_ns_id = 10 {{(pid=86450) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 04:31:05 devstack cinder-volume[86450]: DEBUG oslo_service.backend._eventlet.service [None req-b985f691-4253-4471-b7cb-75a26af5376b None None] nvmet_port_id = 1 {{(pid=86450) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 04:31:05 devstack cinder-volume[86450]: DEBUG oslo_service.backend._eventlet.service [None req-b985f691-4253-4471-b7cb-75a26af5376b None None] osapi_max_limit = 1000 {{(pid=86450) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 04:31:05 devstack cinder-volume[86450]: DEBUG oslo_service.backend._eventlet.service [None req-b985f691-4253-4471-b7cb-75a26af5376b None None] osapi_volume_ext_list = [] {{(pid=86450) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 04:31:05 devstack cinder-volume[86450]: DEBUG oslo_service.backend._eventlet.service [None req-b985f691-4253-4471-b7cb-75a26af5376b None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=86450) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 04:31:05 devstack cinder-volume[86450]: DEBUG oslo_service.backend._eventlet.service [None req-b985f691-4253-4471-b7cb-75a26af5376b None None] osapi_volume_listen = 0.0.0.0 {{(pid=86450) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 04:31:05 devstack cinder-volume[86450]: DEBUG oslo_service.backend._eventlet.service [None req-b985f691-4253-4471-b7cb-75a26af5376b None None] osapi_volume_listen_port = 8776 {{(pid=86450) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 04:31:05 devstack cinder-volume[86450]: DEBUG oslo_service.backend._eventlet.service [None req-b985f691-4253-4471-b7cb-75a26af5376b None None] osapi_volume_use_ssl = False {{(pid=86450) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 04:31:05 devstack cinder-volume[86450]: DEBUG oslo_service.backend._eventlet.service [None req-b985f691-4253-4471-b7cb-75a26af5376b None None] osapi_volume_workers = None {{(pid=86450) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 04:31:05 devstack cinder-volume[86450]: DEBUG oslo_service.backend._eventlet.service [None req-b985f691-4253-4471-b7cb-75a26af5376b None None] per_volume_size_limit = -1 {{(pid=86450) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 04:31:05 devstack cinder-volume[86450]: DEBUG oslo_service.backend._eventlet.service [None req-b985f691-4253-4471-b7cb-75a26af5376b None None] periodic_fuzzy_delay = 60 {{(pid=86450) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 04:31:05 devstack cinder-volume[86450]: DEBUG oslo_service.backend._eventlet.service [None req-b985f691-4253-4471-b7cb-75a26af5376b None None] periodic_interval = 60 {{(pid=86450) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 04:31:05 devstack cinder-volume[86450]: DEBUG oslo_service.backend._eventlet.service [None req-b985f691-4253-4471-b7cb-75a26af5376b None None] project_id_regex = [0-9a-f\-]+ {{(pid=86450) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 04:31:05 devstack cinder-volume[86450]: DEBUG oslo_service.backend._eventlet.service [None req-b985f691-4253-4471-b7cb-75a26af5376b None None] public_endpoint = None {{(pid=86450) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 04:31:05 devstack cinder-volume[86450]: DEBUG oslo_service.backend._eventlet.service [None req-b985f691-4253-4471-b7cb-75a26af5376b None None] publish_errors = False {{(pid=86450) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 04:31:05 devstack cinder-volume[86450]: DEBUG oslo_service.backend._eventlet.service [None req-b985f691-4253-4471-b7cb-75a26af5376b None None] quota_backup_gigabytes = 1000 {{(pid=86450) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 04:31:05 devstack cinder-volume[86450]: DEBUG oslo_service.backend._eventlet.service [None req-b985f691-4253-4471-b7cb-75a26af5376b None None] quota_backups = 10 {{(pid=86450) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 04:31:05 devstack cinder-volume[86450]: DEBUG oslo_service.backend._eventlet.service [None req-b985f691-4253-4471-b7cb-75a26af5376b None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=86450) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 04:31:05 devstack cinder-volume[86450]: DEBUG oslo_service.backend._eventlet.service [None req-b985f691-4253-4471-b7cb-75a26af5376b None None] quota_gigabytes = 1000 {{(pid=86450) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 04:31:05 devstack cinder-volume[86450]: DEBUG oslo_service.backend._eventlet.service [None req-b985f691-4253-4471-b7cb-75a26af5376b None None] quota_groups = 10 {{(pid=86450) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 04:31:05 devstack cinder-volume[86450]: DEBUG oslo_service.backend._eventlet.service [None req-b985f691-4253-4471-b7cb-75a26af5376b None None] quota_snapshots = 10 {{(pid=86450) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 04:31:05 devstack cinder-volume[86450]: DEBUG oslo_service.backend._eventlet.service [None req-b985f691-4253-4471-b7cb-75a26af5376b None None] quota_volumes = 10 {{(pid=86450) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 04:31:05 devstack cinder-volume[86450]: DEBUG oslo_service.backend._eventlet.service [None req-b985f691-4253-4471-b7cb-75a26af5376b None None] rate_limit_burst = 0 {{(pid=86450) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 04:31:05 devstack cinder-volume[86450]: DEBUG oslo_service.backend._eventlet.service [None req-b985f691-4253-4471-b7cb-75a26af5376b None None] rate_limit_except_level = CRITICAL {{(pid=86450) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 04:31:05 devstack cinder-volume[86450]: DEBUG oslo_service.backend._eventlet.service [None req-b985f691-4253-4471-b7cb-75a26af5376b None None] rate_limit_interval = 0 {{(pid=86450) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 04:31:05 devstack cinder-volume[86450]: DEBUG oslo_service.backend._eventlet.service [None req-b985f691-4253-4471-b7cb-75a26af5376b None None] reinit_driver_count = 3 {{(pid=86450) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 04:31:05 devstack cinder-volume[86450]: DEBUG oslo_service.backend._eventlet.service [None req-b985f691-4253-4471-b7cb-75a26af5376b None None] replication_device = **** {{(pid=86450) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 04:31:05 devstack cinder-volume[86450]: DEBUG oslo_service.backend._eventlet.service [None req-b985f691-4253-4471-b7cb-75a26af5376b None None] report_discard_supported = False {{(pid=86450) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 04:31:05 devstack cinder-volume[86450]: DEBUG oslo_service.backend._eventlet.service [None req-b985f691-4253-4471-b7cb-75a26af5376b None None] report_interval = 120 {{(pid=86450) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 04:31:05 devstack cinder-volume[86450]: DEBUG oslo_service.backend._eventlet.service [None req-b985f691-4253-4471-b7cb-75a26af5376b None None] reservation_clean_interval = 86400 {{(pid=86450) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 04:31:05 devstack cinder-volume[86450]: DEBUG oslo_service.backend._eventlet.service [None req-b985f691-4253-4471-b7cb-75a26af5376b None None] reservation_expire = 86400 {{(pid=86450) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 04:31:05 devstack cinder-volume[86450]: DEBUG oslo_service.backend._eventlet.service [None req-b985f691-4253-4471-b7cb-75a26af5376b None None] reserved_image_namespaces = [] {{(pid=86450) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 04:31:05 devstack cinder-volume[86450]: DEBUG oslo_service.backend._eventlet.service [None req-b985f691-4253-4471-b7cb-75a26af5376b None None] reserved_percentage = 0 {{(pid=86450) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 04:31:05 devstack cinder-volume[86450]: DEBUG oslo_service.backend._eventlet.service [None req-b985f691-4253-4471-b7cb-75a26af5376b None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=86450) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 04:31:05 devstack cinder-volume[86450]: DEBUG oslo_service.backend._eventlet.service [None req-b985f691-4253-4471-b7cb-75a26af5376b None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=86450) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 04:31:05 devstack cinder-volume[86450]: DEBUG oslo_service.backend._eventlet.service [None req-b985f691-4253-4471-b7cb-75a26af5376b None None] rpc_response_timeout = 120 {{(pid=86450) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 04:31:05 devstack cinder-volume[86450]: DEBUG oslo_service.backend._eventlet.service [None req-b985f691-4253-4471-b7cb-75a26af5376b None None] run_external_periodic_tasks = True {{(pid=86450) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 04:31:05 devstack cinder-volume[86450]: DEBUG oslo_service.backend._eventlet.service [None req-b985f691-4253-4471-b7cb-75a26af5376b None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=86450) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 04:31:05 devstack cinder-volume[86450]: DEBUG oslo_service.backend._eventlet.service [None req-b985f691-4253-4471-b7cb-75a26af5376b None None] scst_target_driver = iscsi {{(pid=86450) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 04:31:05 devstack cinder-volume[86450]: DEBUG oslo_service.backend._eventlet.service [None req-b985f691-4253-4471-b7cb-75a26af5376b None None] scst_target_iqn_name = None {{(pid=86450) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 04:31:05 devstack cinder-volume[86450]: DEBUG oslo_service.backend._eventlet.service [None req-b985f691-4253-4471-b7cb-75a26af5376b None None] service_down_time = 720 {{(pid=86450) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 04:31:05 devstack cinder-volume[86450]: DEBUG oslo_service.backend._eventlet.service [None req-b985f691-4253-4471-b7cb-75a26af5376b None None] shell_completion = None {{(pid=86450) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 04:31:05 devstack cinder-volume[86450]: DEBUG oslo_service.backend._eventlet.service [None req-b985f691-4253-4471-b7cb-75a26af5376b None None] snapshot_name_template = snapshot-%s {{(pid=86450) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 04:31:05 devstack cinder-volume[86450]: DEBUG oslo_service.backend._eventlet.service [None req-b985f691-4253-4471-b7cb-75a26af5376b None None] split_loggers = False {{(pid=86450) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 04:31:05 devstack cinder-volume[86450]: DEBUG oslo_service.backend._eventlet.service [None req-b985f691-4253-4471-b7cb-75a26af5376b None None] state_path = /opt/stack/data/cinder {{(pid=86450) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 04:31:05 devstack cinder-volume[86450]: DEBUG oslo_service.backend._eventlet.service [None req-b985f691-4253-4471-b7cb-75a26af5376b None None] storage_availability_zone = nova {{(pid=86450) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 04:31:05 devstack cinder-volume[86450]: DEBUG oslo_service.backend._eventlet.service [None req-b985f691-4253-4471-b7cb-75a26af5376b None None] storage_protocol = iSCSI {{(pid=86450) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 04:31:05 devstack cinder-volume[86450]: DEBUG oslo_service.backend._eventlet.service [None req-b985f691-4253-4471-b7cb-75a26af5376b None None] syslog_log_facility = LOG_USER {{(pid=86450) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 04:31:05 devstack cinder-volume[86450]: DEBUG oslo_service.backend._eventlet.service [None req-b985f691-4253-4471-b7cb-75a26af5376b None None] target_helper = lioadm {{(pid=86450) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 04:31:05 devstack cinder-volume[86450]: DEBUG oslo_service.backend._eventlet.service [None req-b985f691-4253-4471-b7cb-75a26af5376b None None] target_ip_address = 192.168.122.158 {{(pid=86450) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 04:31:05 devstack cinder-volume[86450]: DEBUG oslo_service.backend._eventlet.service [None req-b985f691-4253-4471-b7cb-75a26af5376b None None] target_port = 3260 {{(pid=86450) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 04:31:05 devstack cinder-volume[86450]: DEBUG oslo_service.backend._eventlet.service [None req-b985f691-4253-4471-b7cb-75a26af5376b None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=86450) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 04:31:05 devstack cinder-volume[86450]: DEBUG oslo_service.backend._eventlet.service [None req-b985f691-4253-4471-b7cb-75a26af5376b None None] target_protocol = iscsi {{(pid=86450) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 04:31:05 devstack cinder-volume[86450]: DEBUG oslo_service.backend._eventlet.service [None req-b985f691-4253-4471-b7cb-75a26af5376b None None] target_secondary_ip_addresses = [] {{(pid=86450) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 04:31:06 devstack cinder-volume[86450]: DEBUG oslo_service.backend._eventlet.service [None req-b985f691-4253-4471-b7cb-75a26af5376b None None] trace_flags = None {{(pid=86450) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 04:31:06 devstack cinder-volume[86450]: DEBUG oslo_service.backend._eventlet.service [None req-b985f691-4253-4471-b7cb-75a26af5376b None None] transfer_api_class = cinder.transfer.api.API {{(pid=86450) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 04:31:06 devstack cinder-volume[86450]: DEBUG oslo_service.backend._eventlet.service [None req-b985f691-4253-4471-b7cb-75a26af5376b None None] transport_url = **** {{(pid=86450) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 04:31:06 devstack cinder-volume[86450]: DEBUG oslo_service.backend._eventlet.service [None req-b985f691-4253-4471-b7cb-75a26af5376b None None] until_refresh = 0 {{(pid=86450) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 04:31:06 devstack cinder-volume[86450]: DEBUG oslo_service.backend._eventlet.service [None req-b985f691-4253-4471-b7cb-75a26af5376b None None] use_chap_auth = False {{(pid=86450) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 04:31:06 devstack cinder-volume[86450]: DEBUG oslo_service.backend._eventlet.service [None req-b985f691-4253-4471-b7cb-75a26af5376b None None] use_default_quota_class = True {{(pid=86450) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 04:31:06 devstack cinder-volume[86450]: DEBUG oslo_service.backend._eventlet.service [None req-b985f691-4253-4471-b7cb-75a26af5376b None None] use_journal = False {{(pid=86450) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 04:31:06 devstack cinder-volume[86450]: DEBUG oslo_service.backend._eventlet.service [None req-b985f691-4253-4471-b7cb-75a26af5376b None None] use_json = False {{(pid=86450) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 04:31:06 devstack cinder-volume[86450]: DEBUG oslo_service.backend._eventlet.service [None req-b985f691-4253-4471-b7cb-75a26af5376b None None] use_multipath_for_image_xfer = False {{(pid=86450) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 04:31:06 devstack cinder-volume[86450]: DEBUG oslo_service.backend._eventlet.service [None req-b985f691-4253-4471-b7cb-75a26af5376b None None] use_stderr = False {{(pid=86450) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 04:31:06 devstack cinder-volume[86450]: DEBUG oslo_service.backend._eventlet.service [None req-b985f691-4253-4471-b7cb-75a26af5376b None None] use_syslog = False {{(pid=86450) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 04:31:06 devstack cinder-volume[86450]: DEBUG oslo_service.backend._eventlet.service [None req-b985f691-4253-4471-b7cb-75a26af5376b None None] verify_glance_signatures = enabled {{(pid=86450) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 04:31:06 devstack cinder-volume[86450]: DEBUG oslo_service.backend._eventlet.service [None req-b985f691-4253-4471-b7cb-75a26af5376b None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=86450) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 04:31:06 devstack cinder-volume[86450]: DEBUG oslo_service.backend._eventlet.service [None req-b985f691-4253-4471-b7cb-75a26af5376b None None] volume_api_class = cinder.volume.api.API {{(pid=86450) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 04:31:06 devstack cinder-volume[86450]: DEBUG oslo_service.backend._eventlet.service [None req-b985f691-4253-4471-b7cb-75a26af5376b None None] volume_backend_name = None {{(pid=86450) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 04:31:06 devstack cinder-volume[86450]: DEBUG oslo_service.backend._eventlet.service [None req-b985f691-4253-4471-b7cb-75a26af5376b None None] volume_clear = zero {{(pid=86450) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 04:31:06 devstack cinder-volume[86450]: DEBUG oslo_service.backend._eventlet.service [None req-b985f691-4253-4471-b7cb-75a26af5376b None None] volume_clear_ionice = None {{(pid=86450) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 04:31:06 devstack cinder-volume[86450]: DEBUG oslo_service.backend._eventlet.service [None req-b985f691-4253-4471-b7cb-75a26af5376b None None] volume_clear_size = 0 {{(pid=86450) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 04:31:06 devstack cinder-volume[86450]: DEBUG oslo_service.backend._eventlet.service [None req-b985f691-4253-4471-b7cb-75a26af5376b None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=86450) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 04:31:06 devstack cinder-volume[86450]: DEBUG oslo_service.backend._eventlet.service [None req-b985f691-4253-4471-b7cb-75a26af5376b None None] volume_copy_bps_limit = 0 {{(pid=86450) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 04:31:06 devstack cinder-volume[86450]: DEBUG oslo_service.backend._eventlet.service [None req-b985f691-4253-4471-b7cb-75a26af5376b None None] volume_dd_blocksize = 1M {{(pid=86450) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 04:31:06 devstack cinder-volume[86450]: DEBUG oslo_service.backend._eventlet.service [None req-b985f691-4253-4471-b7cb-75a26af5376b None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=86450) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 04:31:06 devstack cinder-volume[86450]: DEBUG oslo_service.backend._eventlet.service [None req-b985f691-4253-4471-b7cb-75a26af5376b None None] volume_name_template = volume-%s {{(pid=86450) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 04:31:06 devstack cinder-volume[86450]: DEBUG oslo_service.backend._eventlet.service [None req-b985f691-4253-4471-b7cb-75a26af5376b None None] volume_service_inithost_offload = False {{(pid=86450) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 04:31:06 devstack cinder-volume[86450]: DEBUG oslo_service.backend._eventlet.service [None req-b985f691-4253-4471-b7cb-75a26af5376b None None] volume_usage_audit_period = month {{(pid=86450) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 04:31:06 devstack cinder-volume[86450]: DEBUG oslo_service.backend._eventlet.service [None req-b985f691-4253-4471-b7cb-75a26af5376b None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=86450) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 04:31:06 devstack cinder-volume[86450]: DEBUG oslo_service.backend._eventlet.service [None req-b985f691-4253-4471-b7cb-75a26af5376b None None] zoning_mode = None {{(pid=86450) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 04:31:06 devstack cinder-volume[86450]: DEBUG oslo_service.backend._eventlet.service [None req-b985f691-4253-4471-b7cb-75a26af5376b None None] oslo_concurrency.disable_process_locking = False {{(pid=86450) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:06 devstack cinder-volume[86450]: DEBUG oslo_service.backend._eventlet.service [None req-b985f691-4253-4471-b7cb-75a26af5376b None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=86450) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:06 devstack cinder-volume[86450]: DEBUG oslo_service.backend._eventlet.service [None req-b985f691-4253-4471-b7cb-75a26af5376b None None] os_brick.lightos_discovery_client_address = localhost {{(pid=86450) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:06 devstack cinder-volume[86450]: DEBUG oslo_service.backend._eventlet.service [None req-b985f691-4253-4471-b7cb-75a26af5376b None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=86450) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:06 devstack cinder-volume[86450]: DEBUG oslo_service.backend._eventlet.service [None req-b985f691-4253-4471-b7cb-75a26af5376b None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=86450) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:06 devstack cinder-volume[86450]: DEBUG oslo_service.backend._eventlet.service [None req-b985f691-4253-4471-b7cb-75a26af5376b None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=86450) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:06 devstack cinder-volume[86450]: DEBUG oslo_service.backend._eventlet.service [None req-b985f691-4253-4471-b7cb-75a26af5376b None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=86450) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:06 devstack cinder-volume[86450]: DEBUG oslo_service.backend._eventlet.service [None req-b985f691-4253-4471-b7cb-75a26af5376b None None] os_brick.wait_mpath_device_interval = 1 {{(pid=86450) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:06 devstack cinder-volume[86450]: DEBUG oslo_service.backend._eventlet.service [None req-b985f691-4253-4471-b7cb-75a26af5376b None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=86450) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:06 devstack cinder-volume[86450]: DEBUG oslo_service.backend._eventlet.service [None req-b985f691-4253-4471-b7cb-75a26af5376b None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=86450) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:06 devstack cinder-volume[86450]: DEBUG oslo_service.backend._eventlet.service [None req-b985f691-4253-4471-b7cb-75a26af5376b None None] keystone_authtoken.auth_section = None {{(pid=86450) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:06 devstack cinder-volume[86450]: DEBUG oslo_service.backend._eventlet.service [None req-b985f691-4253-4471-b7cb-75a26af5376b None None] keystone_authtoken.auth_type = password {{(pid=86450) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:06 devstack cinder-volume[86668]: INFO cinder.volume.manager [None req-4e6a0dfa-70d1-4376-905f-249915a28a0b None None] Starting volume driver QuobyteDriver (1.1.14) Jul 10 04:31:06 devstack cinder-volume[86450]: DEBUG oslo_service.backend._eventlet.service [None req-b985f691-4253-4471-b7cb-75a26af5376b None None] keystone_authtoken.auth_version = None {{(pid=86450) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:06 devstack cinder-volume[86668]: DEBUG cinder.volume.drivers.remotefs [None req-4e6a0dfa-70d1-4376-905f-249915a28a0b None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=86668) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}} Jul 10 04:31:06 devstack cinder-volume[86450]: DEBUG oslo_service.backend._eventlet.service [None req-b985f691-4253-4471-b7cb-75a26af5376b None None] keystone_authtoken.cache = None {{(pid=86450) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:06 devstack cinder-volume[86450]: DEBUG oslo_service.backend._eventlet.service [None req-b985f691-4253-4471-b7cb-75a26af5376b None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=86450) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:06 devstack cinder-volume[86450]: DEBUG oslo_service.backend._eventlet.service [None req-b985f691-4253-4471-b7cb-75a26af5376b None None] keystone_authtoken.certfile = None {{(pid=86450) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:06 devstack cinder-volume[86450]: DEBUG oslo_service.backend._eventlet.service [None req-b985f691-4253-4471-b7cb-75a26af5376b None None] keystone_authtoken.delay_auth_decision = False {{(pid=86450) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:06 devstack cinder-volume[86450]: DEBUG oslo_service.backend._eventlet.service [None req-b985f691-4253-4471-b7cb-75a26af5376b None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=86450) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:06 devstack cinder-volume[86450]: DEBUG oslo_service.backend._eventlet.service [None req-b985f691-4253-4471-b7cb-75a26af5376b None None] keystone_authtoken.http_connect_timeout = None {{(pid=86450) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:06 devstack cinder-volume[86450]: DEBUG oslo_service.backend._eventlet.service [None req-b985f691-4253-4471-b7cb-75a26af5376b None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=86450) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:06 devstack cinder-volume[86450]: DEBUG oslo_service.backend._eventlet.service [None req-b985f691-4253-4471-b7cb-75a26af5376b None None] keystone_authtoken.include_service_catalog = True {{(pid=86450) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:06 devstack cinder-volume[86450]: DEBUG oslo_service.backend._eventlet.service [None req-b985f691-4253-4471-b7cb-75a26af5376b None None] keystone_authtoken.insecure = False {{(pid=86450) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:06 devstack cinder-volume[86450]: DEBUG oslo_service.backend._eventlet.service [None req-b985f691-4253-4471-b7cb-75a26af5376b None None] keystone_authtoken.interface = public {{(pid=86450) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:06 devstack cinder-volume[86450]: DEBUG oslo_service.backend._eventlet.service [None req-b985f691-4253-4471-b7cb-75a26af5376b None None] keystone_authtoken.keyfile = None {{(pid=86450) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:06 devstack cinder-volume[86450]: DEBUG oslo_service.backend._eventlet.service [None req-b985f691-4253-4471-b7cb-75a26af5376b None None] keystone_authtoken.memcache_password = {{(pid=86450) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:06 devstack cinder-volume[86450]: DEBUG oslo_service.backend._eventlet.service [None req-b985f691-4253-4471-b7cb-75a26af5376b None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=86450) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:06 devstack cinder-volume[86450]: DEBUG oslo_service.backend._eventlet.service [None req-b985f691-4253-4471-b7cb-75a26af5376b None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=86450) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:06 devstack cinder-volume[86450]: DEBUG oslo_service.backend._eventlet.service [None req-b985f691-4253-4471-b7cb-75a26af5376b None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=86450) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:06 devstack cinder-volume[86450]: DEBUG oslo_service.backend._eventlet.service [None req-b985f691-4253-4471-b7cb-75a26af5376b None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=86450) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:06 devstack cinder-volume[86450]: DEBUG oslo_service.backend._eventlet.service [None req-b985f691-4253-4471-b7cb-75a26af5376b None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=86450) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:06 devstack cinder-volume[86450]: DEBUG oslo_service.backend._eventlet.service [None req-b985f691-4253-4471-b7cb-75a26af5376b None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=86450) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:06 devstack cinder-volume[86450]: DEBUG oslo_service.backend._eventlet.service [None req-b985f691-4253-4471-b7cb-75a26af5376b None None] keystone_authtoken.memcache_secret_key = **** {{(pid=86450) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:06 devstack cinder-volume[86450]: DEBUG oslo_service.backend._eventlet.service [None req-b985f691-4253-4471-b7cb-75a26af5376b None None] keystone_authtoken.memcache_security_strategy = None {{(pid=86450) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:06 devstack cinder-volume[86450]: DEBUG oslo_service.backend._eventlet.service [None req-b985f691-4253-4471-b7cb-75a26af5376b None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=86450) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:06 devstack cinder-volume[86450]: DEBUG oslo_service.backend._eventlet.service [None req-b985f691-4253-4471-b7cb-75a26af5376b None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=86450) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:06 devstack cinder-volume[86450]: DEBUG oslo_service.backend._eventlet.service [None req-b985f691-4253-4471-b7cb-75a26af5376b None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=86450) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:06 devstack cinder-volume[86450]: DEBUG oslo_service.backend._eventlet.service [None req-b985f691-4253-4471-b7cb-75a26af5376b None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=86450) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:06 devstack cinder-volume[86450]: DEBUG oslo_service.backend._eventlet.service [None req-b985f691-4253-4471-b7cb-75a26af5376b None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=86450) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:06 devstack cinder-volume[86450]: DEBUG oslo_service.backend._eventlet.service [None req-b985f691-4253-4471-b7cb-75a26af5376b None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=86450) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:06 devstack cinder-volume[86450]: DEBUG oslo_service.backend._eventlet.service [None req-b985f691-4253-4471-b7cb-75a26af5376b None None] keystone_authtoken.memcache_username = {{(pid=86450) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:06 devstack cinder-volume[86450]: DEBUG oslo_service.backend._eventlet.service [None req-b985f691-4253-4471-b7cb-75a26af5376b None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=86450) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:06 devstack cinder-volume[86450]: DEBUG oslo_service.backend._eventlet.service [None req-b985f691-4253-4471-b7cb-75a26af5376b None None] keystone_authtoken.region_name = None {{(pid=86450) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:06 devstack cinder-volume[86450]: DEBUG oslo_service.backend._eventlet.service [None req-b985f691-4253-4471-b7cb-75a26af5376b None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=86450) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:06 devstack cinder-volume[86450]: DEBUG oslo_service.backend._eventlet.service [None req-b985f691-4253-4471-b7cb-75a26af5376b None None] keystone_authtoken.service_token_roles_required = True {{(pid=86450) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:06 devstack cinder-volume[86450]: DEBUG oslo_service.backend._eventlet.service [None req-b985f691-4253-4471-b7cb-75a26af5376b None None] keystone_authtoken.service_type = None {{(pid=86450) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:06 devstack cinder-volume[86450]: DEBUG oslo_service.backend._eventlet.service [None req-b985f691-4253-4471-b7cb-75a26af5376b None None] keystone_authtoken.token_cache_time = 300 {{(pid=86450) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:06 devstack cinder-volume[86450]: DEBUG oslo_service.backend._eventlet.service [None req-b985f691-4253-4471-b7cb-75a26af5376b None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.158/identity {{(pid=86450) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:06 devstack cinder-volume[86450]: DEBUG oslo_service.backend._eventlet.service [None req-b985f691-4253-4471-b7cb-75a26af5376b None None] cache.backend = dogpile.cache.null {{(pid=86450) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:06 devstack cinder-volume[86450]: DEBUG oslo_service.backend._eventlet.service [None req-b985f691-4253-4471-b7cb-75a26af5376b None None] cache.backend_argument = **** {{(pid=86450) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:06 devstack cinder-volume[86450]: DEBUG oslo_service.backend._eventlet.service [None req-b985f691-4253-4471-b7cb-75a26af5376b None None] cache.backend_expiration_time = None {{(pid=86450) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:06 devstack cinder-volume[86450]: DEBUG oslo_service.backend._eventlet.service [None req-b985f691-4253-4471-b7cb-75a26af5376b None None] cache.config_prefix = cache.oslo {{(pid=86450) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:06 devstack cinder-volume[86450]: DEBUG oslo_service.backend._eventlet.service [None req-b985f691-4253-4471-b7cb-75a26af5376b None None] cache.debug_cache_backend = False {{(pid=86450) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:06 devstack cinder-volume[86450]: DEBUG oslo_service.backend._eventlet.service [None req-b985f691-4253-4471-b7cb-75a26af5376b None None] cache.enable_retry_client = False {{(pid=86450) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:06 devstack cinder-volume[86450]: DEBUG oslo_service.backend._eventlet.service [None req-b985f691-4253-4471-b7cb-75a26af5376b None None] cache.enable_socket_keepalive = False {{(pid=86450) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:06 devstack cinder-volume[86450]: DEBUG oslo_service.backend._eventlet.service [None req-b985f691-4253-4471-b7cb-75a26af5376b None None] cache.enabled = False {{(pid=86450) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:06 devstack cinder-volume[86450]: DEBUG oslo_service.backend._eventlet.service [None req-b985f691-4253-4471-b7cb-75a26af5376b None None] cache.expiration_time = 600 {{(pid=86450) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:06 devstack cinder-volume[86450]: DEBUG oslo_service.backend._eventlet.service [None req-b985f691-4253-4471-b7cb-75a26af5376b None None] cache.hashclient_dead_timeout = 60.0 {{(pid=86450) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:06 devstack cinder-volume[86450]: DEBUG oslo_service.backend._eventlet.service [None req-b985f691-4253-4471-b7cb-75a26af5376b None None] cache.hashclient_retry_attempts = 2 {{(pid=86450) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:06 devstack cinder-volume[86450]: DEBUG oslo_service.backend._eventlet.service [None req-b985f691-4253-4471-b7cb-75a26af5376b None None] cache.hashclient_retry_timeout = 1.0 {{(pid=86450) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:06 devstack cinder-volume[86450]: DEBUG oslo_service.backend._eventlet.service [None req-b985f691-4253-4471-b7cb-75a26af5376b None None] cache.memcache_dead_retry = 300 {{(pid=86450) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:06 devstack cinder-volume[86450]: DEBUG oslo_service.backend._eventlet.service [None req-b985f691-4253-4471-b7cb-75a26af5376b None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=86450) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:06 devstack cinder-volume[86450]: DEBUG oslo_service.backend._eventlet.service [None req-b985f691-4253-4471-b7cb-75a26af5376b None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=86450) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:06 devstack cinder-volume[86450]: DEBUG oslo_service.backend._eventlet.service [None req-b985f691-4253-4471-b7cb-75a26af5376b None None] cache.memcache_pool_maxsize = 10 {{(pid=86450) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:06 devstack cinder-volume[86450]: DEBUG oslo_service.backend._eventlet.service [None req-b985f691-4253-4471-b7cb-75a26af5376b None None] cache.memcache_pool_unused_timeout = 60 {{(pid=86450) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:06 devstack cinder-volume[86450]: DEBUG oslo_service.backend._eventlet.service [None req-b985f691-4253-4471-b7cb-75a26af5376b None None] cache.memcache_sasl_enabled = False {{(pid=86450) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:06 devstack cinder-volume[86450]: DEBUG oslo_service.backend._eventlet.service [None req-b985f691-4253-4471-b7cb-75a26af5376b None None] cache.memcache_servers = ['localhost:11211'] {{(pid=86450) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:06 devstack cinder-volume[86450]: DEBUG oslo_service.backend._eventlet.service [None req-b985f691-4253-4471-b7cb-75a26af5376b None None] cache.password = **** {{(pid=86450) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:06 devstack cinder-volume[86450]: DEBUG oslo_service.backend._eventlet.service [None req-b985f691-4253-4471-b7cb-75a26af5376b None None] cache.proxies = [] {{(pid=86450) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:06 devstack cinder-volume[86450]: DEBUG oslo_service.backend._eventlet.service [None req-b985f691-4253-4471-b7cb-75a26af5376b None None] cache.redis_db = 0 {{(pid=86450) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:06 devstack cinder-volume[86450]: DEBUG oslo_service.backend._eventlet.service [None req-b985f691-4253-4471-b7cb-75a26af5376b None None] cache.redis_sentinel_service_name = mymaster {{(pid=86450) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:06 devstack cinder-volume[86450]: DEBUG oslo_service.backend._eventlet.service [None req-b985f691-4253-4471-b7cb-75a26af5376b None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=86450) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:06 devstack cinder-volume[86450]: DEBUG oslo_service.backend._eventlet.service [None req-b985f691-4253-4471-b7cb-75a26af5376b None None] cache.redis_server = localhost:6379 {{(pid=86450) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:06 devstack cinder-volume[86450]: DEBUG oslo_service.backend._eventlet.service [None req-b985f691-4253-4471-b7cb-75a26af5376b None None] cache.retry_attempts = 2 {{(pid=86450) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:06 devstack cinder-volume[86450]: DEBUG oslo_service.backend._eventlet.service [None req-b985f691-4253-4471-b7cb-75a26af5376b None None] cache.retry_delay = 0.0 {{(pid=86450) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:06 devstack cinder-volume[86450]: DEBUG oslo_service.backend._eventlet.service [None req-b985f691-4253-4471-b7cb-75a26af5376b None None] cache.socket_keepalive_count = 1 {{(pid=86450) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:06 devstack cinder-volume[86450]: DEBUG oslo_service.backend._eventlet.service [None req-b985f691-4253-4471-b7cb-75a26af5376b None None] cache.socket_keepalive_idle = 1 {{(pid=86450) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:06 devstack cinder-volume[86450]: DEBUG oslo_service.backend._eventlet.service [None req-b985f691-4253-4471-b7cb-75a26af5376b None None] cache.socket_keepalive_interval = 1 {{(pid=86450) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:06 devstack cinder-volume[86450]: DEBUG oslo_service.backend._eventlet.service [None req-b985f691-4253-4471-b7cb-75a26af5376b None None] cache.socket_timeout = 1.0 {{(pid=86450) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:06 devstack cinder-volume[86450]: DEBUG oslo_service.backend._eventlet.service [None req-b985f691-4253-4471-b7cb-75a26af5376b None None] cache.tls_allowed_ciphers = None {{(pid=86450) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:06 devstack cinder-volume[86450]: DEBUG oslo_service.backend._eventlet.service [None req-b985f691-4253-4471-b7cb-75a26af5376b None None] cache.tls_cafile = None {{(pid=86450) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:06 devstack cinder-volume[86450]: DEBUG oslo_service.backend._eventlet.service [None req-b985f691-4253-4471-b7cb-75a26af5376b None None] cache.tls_certfile = None {{(pid=86450) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:06 devstack cinder-volume[86450]: DEBUG oslo_service.backend._eventlet.service [None req-b985f691-4253-4471-b7cb-75a26af5376b None None] cache.tls_enabled = False {{(pid=86450) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:06 devstack cinder-volume[86450]: DEBUG oslo_service.backend._eventlet.service [None req-b985f691-4253-4471-b7cb-75a26af5376b None None] cache.tls_keyfile = None {{(pid=86450) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:06 devstack cinder-volume[86450]: DEBUG oslo_service.backend._eventlet.service [None req-b985f691-4253-4471-b7cb-75a26af5376b None None] cache.username = None {{(pid=86450) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:06 devstack cinder-volume[86450]: DEBUG oslo_service.backend._eventlet.service [None req-b985f691-4253-4471-b7cb-75a26af5376b None None] coordination.backend_url = **** {{(pid=86450) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:06 devstack cinder-volume[86450]: DEBUG oslo_service.backend._eventlet.service [None req-b985f691-4253-4471-b7cb-75a26af5376b None None] database.asyncio_connection = **** {{(pid=86450) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:06 devstack cinder-volume[86450]: DEBUG oslo_service.backend._eventlet.service [None req-b985f691-4253-4471-b7cb-75a26af5376b None None] database.asyncio_slave_connection = **** {{(pid=86450) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:06 devstack cinder-volume[86450]: DEBUG oslo_service.backend._eventlet.service [None req-b985f691-4253-4471-b7cb-75a26af5376b None None] database.backend = sqlalchemy {{(pid=86450) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:06 devstack cinder-volume[86450]: DEBUG oslo_service.backend._eventlet.service [None req-b985f691-4253-4471-b7cb-75a26af5376b None None] database.connection = **** {{(pid=86450) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:06 devstack cinder-volume[86450]: DEBUG oslo_service.backend._eventlet.service [None req-b985f691-4253-4471-b7cb-75a26af5376b None None] database.connection_debug = 0 {{(pid=86450) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:06 devstack cinder-volume[86450]: DEBUG oslo_service.backend._eventlet.service [None req-b985f691-4253-4471-b7cb-75a26af5376b None None] database.connection_parameters = {{(pid=86450) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:06 devstack cinder-volume[86450]: DEBUG oslo_service.backend._eventlet.service [None req-b985f691-4253-4471-b7cb-75a26af5376b None None] database.connection_recycle_time = 3600 {{(pid=86450) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:06 devstack cinder-volume[86450]: DEBUG oslo_service.backend._eventlet.service [None req-b985f691-4253-4471-b7cb-75a26af5376b None None] database.connection_trace = False {{(pid=86450) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:06 devstack cinder-volume[86450]: DEBUG oslo_service.backend._eventlet.service [None req-b985f691-4253-4471-b7cb-75a26af5376b None None] database.db_inc_retry_interval = True {{(pid=86450) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:06 devstack cinder-volume[86450]: DEBUG oslo_service.backend._eventlet.service [None req-b985f691-4253-4471-b7cb-75a26af5376b None None] database.db_max_retries = 20 {{(pid=86450) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:06 devstack cinder-volume[86450]: DEBUG oslo_service.backend._eventlet.service [None req-b985f691-4253-4471-b7cb-75a26af5376b None None] database.db_max_retry_interval = 10 {{(pid=86450) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:06 devstack cinder-volume[86450]: DEBUG oslo_service.backend._eventlet.service [None req-b985f691-4253-4471-b7cb-75a26af5376b None None] database.db_retry_interval = 1 {{(pid=86450) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:06 devstack cinder-volume[86450]: DEBUG oslo_service.backend._eventlet.service [None req-b985f691-4253-4471-b7cb-75a26af5376b None None] database.max_overflow = 50 {{(pid=86450) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:06 devstack cinder-volume[86450]: DEBUG oslo_service.backend._eventlet.service [None req-b985f691-4253-4471-b7cb-75a26af5376b None None] database.max_pool_size = 5 {{(pid=86450) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:06 devstack cinder-volume[86450]: DEBUG oslo_service.backend._eventlet.service [None req-b985f691-4253-4471-b7cb-75a26af5376b None None] database.max_retries = 10 {{(pid=86450) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:06 devstack cinder-volume[86450]: DEBUG oslo_service.backend._eventlet.service [None req-b985f691-4253-4471-b7cb-75a26af5376b None None] database.mysql_sql_mode = TRADITIONAL {{(pid=86450) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:06 devstack cinder-volume[86450]: DEBUG oslo_service.backend._eventlet.service [None req-b985f691-4253-4471-b7cb-75a26af5376b None None] database.mysql_wsrep_sync_wait = None {{(pid=86450) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:06 devstack cinder-volume[86450]: DEBUG oslo_service.backend._eventlet.service [None req-b985f691-4253-4471-b7cb-75a26af5376b None None] database.pool_timeout = None {{(pid=86450) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:06 devstack cinder-volume[86450]: DEBUG oslo_service.backend._eventlet.service [None req-b985f691-4253-4471-b7cb-75a26af5376b None None] database.retry_interval = 10 {{(pid=86450) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:06 devstack cinder-volume[86450]: DEBUG oslo_service.backend._eventlet.service [None req-b985f691-4253-4471-b7cb-75a26af5376b None None] database.slave_connection = **** {{(pid=86450) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:06 devstack cinder-volume[86450]: DEBUG oslo_service.backend._eventlet.service [None req-b985f691-4253-4471-b7cb-75a26af5376b None None] database.sqlite_synchronous = True {{(pid=86450) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:06 devstack cinder-volume[86450]: DEBUG oslo_service.backend._eventlet.service [None req-b985f691-4253-4471-b7cb-75a26af5376b None None] database.synchronous_reader = True {{(pid=86450) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:06 devstack cinder-volume[86450]: DEBUG oslo_service.backend._eventlet.service [None req-b985f691-4253-4471-b7cb-75a26af5376b None None] database.use_db_reconnect = False {{(pid=86450) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:06 devstack cinder-volume[86450]: DEBUG oslo_service.backend._eventlet.service [None req-b985f691-4253-4471-b7cb-75a26af5376b None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=86450) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:06 devstack cinder-volume[86450]: DEBUG oslo_service.backend._eventlet.service [None req-b985f691-4253-4471-b7cb-75a26af5376b None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=86450) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:06 devstack cinder-volume[86450]: DEBUG oslo_service.backend._eventlet.service [None req-b985f691-4253-4471-b7cb-75a26af5376b None None] oslo_messaging_metrics.metrics_process_name = {{(pid=86450) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:06 devstack cinder-volume[86450]: DEBUG oslo_service.backend._eventlet.service [None req-b985f691-4253-4471-b7cb-75a26af5376b None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=86450) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:06 devstack cinder-volume[86450]: DEBUG oslo_service.backend._eventlet.service [None req-b985f691-4253-4471-b7cb-75a26af5376b None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=86450) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:06 devstack cinder-volume[86450]: DEBUG oslo_service.backend._eventlet.service [None req-b985f691-4253-4471-b7cb-75a26af5376b None None] profiler.connection_string = messaging:// {{(pid=86450) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:06 devstack cinder-volume[86450]: DEBUG oslo_service.backend._eventlet.service [None req-b985f691-4253-4471-b7cb-75a26af5376b None None] profiler.enabled = False {{(pid=86450) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:06 devstack cinder-volume[86450]: DEBUG oslo_service.backend._eventlet.service [None req-b985f691-4253-4471-b7cb-75a26af5376b None None] profiler.es_doc_type = notification {{(pid=86450) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:06 devstack cinder-volume[86450]: DEBUG oslo_service.backend._eventlet.service [None req-b985f691-4253-4471-b7cb-75a26af5376b None None] profiler.es_scroll_size = 10000 {{(pid=86450) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:06 devstack cinder-volume[86450]: DEBUG oslo_service.backend._eventlet.service [None req-b985f691-4253-4471-b7cb-75a26af5376b None None] profiler.es_scroll_time = 2m {{(pid=86450) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:06 devstack cinder-volume[86450]: DEBUG oslo_service.backend._eventlet.service [None req-b985f691-4253-4471-b7cb-75a26af5376b None None] profiler.filter_error_trace = False {{(pid=86450) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:06 devstack cinder-volume[86450]: DEBUG oslo_service.backend._eventlet.service [None req-b985f691-4253-4471-b7cb-75a26af5376b None None] profiler.hmac_keys = **** {{(pid=86450) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:06 devstack cinder-volume[86450]: DEBUG oslo_service.backend._eventlet.service [None req-b985f691-4253-4471-b7cb-75a26af5376b None None] profiler.sentinel_service_name = mymaster {{(pid=86450) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:06 devstack cinder-volume[86450]: DEBUG oslo_service.backend._eventlet.service [None req-b985f691-4253-4471-b7cb-75a26af5376b None None] profiler.socket_timeout = 0.1 {{(pid=86450) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:06 devstack cinder-volume[86450]: DEBUG oslo_service.backend._eventlet.service [None req-b985f691-4253-4471-b7cb-75a26af5376b None None] profiler.trace_requests = False {{(pid=86450) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:06 devstack cinder-volume[86450]: DEBUG oslo_service.backend._eventlet.service [None req-b985f691-4253-4471-b7cb-75a26af5376b None None] profiler.trace_sqlalchemy = False {{(pid=86450) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:06 devstack cinder-volume[86450]: DEBUG oslo_service.backend._eventlet.service [None req-b985f691-4253-4471-b7cb-75a26af5376b None None] profiler_jaeger.process_tags = {} {{(pid=86450) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:06 devstack cinder-volume[86450]: DEBUG oslo_service.backend._eventlet.service [None req-b985f691-4253-4471-b7cb-75a26af5376b None None] profiler_jaeger.service_name_prefix = None {{(pid=86450) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:06 devstack cinder-volume[86450]: DEBUG oslo_service.backend._eventlet.service [None req-b985f691-4253-4471-b7cb-75a26af5376b None None] profiler_otlp.service_name_prefix = None {{(pid=86450) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:06 devstack cinder-volume[86450]: DEBUG oslo_service.backend._eventlet.service [None req-b985f691-4253-4471-b7cb-75a26af5376b None None] oslo_policy.enforce_new_defaults = True {{(pid=86450) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:06 devstack cinder-volume[86450]: DEBUG oslo_service.backend._eventlet.service [None req-b985f691-4253-4471-b7cb-75a26af5376b None None] oslo_policy.enforce_scope = False {{(pid=86450) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:06 devstack cinder-volume[86450]: DEBUG oslo_service.backend._eventlet.service [None req-b985f691-4253-4471-b7cb-75a26af5376b None None] oslo_policy.policy_default_rule = default {{(pid=86450) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:06 devstack cinder-volume[86450]: DEBUG oslo_service.backend._eventlet.service [None req-b985f691-4253-4471-b7cb-75a26af5376b None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=86450) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:06 devstack cinder-volume[86450]: DEBUG oslo_service.backend._eventlet.service [None req-b985f691-4253-4471-b7cb-75a26af5376b None None] oslo_policy.policy_file = policy.yaml {{(pid=86450) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:06 devstack cinder-volume[86450]: DEBUG oslo_service.backend._eventlet.service [None req-b985f691-4253-4471-b7cb-75a26af5376b None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=86450) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:06 devstack cinder-volume[86450]: DEBUG oslo_service.backend._eventlet.service [None req-b985f691-4253-4471-b7cb-75a26af5376b None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=86450) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:06 devstack cinder-volume[86450]: DEBUG oslo_service.backend._eventlet.service [None req-b985f691-4253-4471-b7cb-75a26af5376b None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=86450) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:06 devstack cinder-volume[86450]: DEBUG oslo_service.backend._eventlet.service [None req-b985f691-4253-4471-b7cb-75a26af5376b None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=86450) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:06 devstack cinder-volume[86450]: DEBUG oslo_service.backend._eventlet.service [None req-b985f691-4253-4471-b7cb-75a26af5376b None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=86450) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:06 devstack cinder-volume[86450]: DEBUG oslo_service.backend._eventlet.service [None req-b985f691-4253-4471-b7cb-75a26af5376b None None] oslo_policy.remote_timeout = 60.0 {{(pid=86450) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:06 devstack cinder-volume[86450]: DEBUG oslo_service.backend._eventlet.service [None req-b985f691-4253-4471-b7cb-75a26af5376b None None] privsep_osbrick.capabilities = [21, 2] {{(pid=86450) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:06 devstack cinder-volume[86450]: DEBUG oslo_service.backend._eventlet.service [None req-b985f691-4253-4471-b7cb-75a26af5376b None None] privsep_osbrick.group = None {{(pid=86450) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:06 devstack cinder-volume[86450]: DEBUG oslo_service.backend._eventlet.service [None req-b985f691-4253-4471-b7cb-75a26af5376b None None] privsep_osbrick.helper_command = None {{(pid=86450) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:06 devstack cinder-volume[86450]: DEBUG oslo_service.backend._eventlet.service [None req-b985f691-4253-4471-b7cb-75a26af5376b None None] privsep_osbrick.log_daemon_traceback = False {{(pid=86450) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:06 devstack cinder-volume[86450]: DEBUG oslo_service.backend._eventlet.service [None req-b985f691-4253-4471-b7cb-75a26af5376b None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=86450) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:06 devstack cinder-volume[86450]: DEBUG oslo_service.backend._eventlet.service [None req-b985f691-4253-4471-b7cb-75a26af5376b None None] privsep_osbrick.thread_pool_size = 4 {{(pid=86450) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:06 devstack cinder-volume[86450]: DEBUG oslo_service.backend._eventlet.service [None req-b985f691-4253-4471-b7cb-75a26af5376b None None] privsep_osbrick.user = None {{(pid=86450) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:06 devstack cinder-volume[86450]: DEBUG oslo_service.backend._eventlet.service [None req-b985f691-4253-4471-b7cb-75a26af5376b None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=86450) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:06 devstack cinder-volume[86450]: DEBUG oslo_service.backend._eventlet.service [None req-b985f691-4253-4471-b7cb-75a26af5376b None None] cinder_sys_admin.group = None {{(pid=86450) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:06 devstack cinder-volume[86450]: DEBUG oslo_service.backend._eventlet.service [None req-b985f691-4253-4471-b7cb-75a26af5376b None None] cinder_sys_admin.helper_command = None {{(pid=86450) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:06 devstack cinder-volume[86450]: DEBUG oslo_service.backend._eventlet.service [None req-b985f691-4253-4471-b7cb-75a26af5376b None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=86450) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:06 devstack cinder-volume[86450]: DEBUG oslo_service.backend._eventlet.service [None req-b985f691-4253-4471-b7cb-75a26af5376b None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=86450) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:06 devstack cinder-volume[86450]: DEBUG oslo_service.backend._eventlet.service [None req-b985f691-4253-4471-b7cb-75a26af5376b None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=86450) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:06 devstack cinder-volume[86450]: DEBUG oslo_service.backend._eventlet.service [None req-b985f691-4253-4471-b7cb-75a26af5376b None None] cinder_sys_admin.user = None {{(pid=86450) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:06 devstack cinder-volume[86450]: DEBUG oslo_service.backend._eventlet.service [None req-b985f691-4253-4471-b7cb-75a26af5376b None None] service_user.auth_section = None {{(pid=86450) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:06 devstack cinder-volume[86450]: DEBUG oslo_service.backend._eventlet.service [None req-b985f691-4253-4471-b7cb-75a26af5376b None None] service_user.auth_type = password {{(pid=86450) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:06 devstack cinder-volume[86450]: DEBUG oslo_service.backend._eventlet.service [None req-b985f691-4253-4471-b7cb-75a26af5376b None None] service_user.cafile = None {{(pid=86450) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:06 devstack cinder-volume[86450]: DEBUG oslo_service.backend._eventlet.service [None req-b985f691-4253-4471-b7cb-75a26af5376b None None] service_user.certfile = None {{(pid=86450) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:06 devstack cinder-volume[86450]: DEBUG oslo_service.backend._eventlet.service [None req-b985f691-4253-4471-b7cb-75a26af5376b None None] service_user.collect_timing = False {{(pid=86450) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:06 devstack cinder-volume[86450]: DEBUG oslo_service.backend._eventlet.service [None req-b985f691-4253-4471-b7cb-75a26af5376b None None] service_user.insecure = False {{(pid=86450) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:06 devstack cinder-volume[86450]: DEBUG oslo_service.backend._eventlet.service [None req-b985f691-4253-4471-b7cb-75a26af5376b None None] service_user.keyfile = None {{(pid=86450) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:06 devstack cinder-volume[86450]: DEBUG oslo_service.backend._eventlet.service [None req-b985f691-4253-4471-b7cb-75a26af5376b None None] service_user.send_service_user_token = True {{(pid=86450) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:06 devstack cinder-volume[86450]: DEBUG oslo_service.backend._eventlet.service [None req-b985f691-4253-4471-b7cb-75a26af5376b None None] service_user.split_loggers = False {{(pid=86450) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:06 devstack cinder-volume[86450]: DEBUG oslo_service.backend._eventlet.service [None req-b985f691-4253-4471-b7cb-75a26af5376b None None] service_user.timeout = None {{(pid=86450) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:06 devstack cinder-volume[86450]: DEBUG oslo_service.backend._eventlet.service [None req-b985f691-4253-4471-b7cb-75a26af5376b None None] glance.auth_section = None {{(pid=86450) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:06 devstack cinder-volume[86450]: DEBUG oslo_service.backend._eventlet.service [None req-b985f691-4253-4471-b7cb-75a26af5376b None None] glance.auth_type = password {{(pid=86450) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:06 devstack cinder-volume[86450]: DEBUG oslo_service.backend._eventlet.service [None req-b985f691-4253-4471-b7cb-75a26af5376b None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=86450) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:06 devstack cinder-volume[86450]: DEBUG oslo_service.backend._eventlet.service [None req-b985f691-4253-4471-b7cb-75a26af5376b None None] glance.certfile = None {{(pid=86450) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:06 devstack cinder-volume[86450]: DEBUG oslo_service.backend._eventlet.service [None req-b985f691-4253-4471-b7cb-75a26af5376b None None] glance.collect_timing = False {{(pid=86450) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:06 devstack cinder-volume[86450]: DEBUG oslo_service.backend._eventlet.service [None req-b985f691-4253-4471-b7cb-75a26af5376b None None] glance.insecure = False {{(pid=86450) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:06 devstack cinder-volume[86450]: DEBUG oslo_service.backend._eventlet.service [None req-b985f691-4253-4471-b7cb-75a26af5376b None None] glance.keyfile = None {{(pid=86450) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:06 devstack cinder-volume[86450]: DEBUG oslo_service.backend._eventlet.service [None req-b985f691-4253-4471-b7cb-75a26af5376b None None] glance.region_name = None {{(pid=86450) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:06 devstack cinder-volume[86450]: DEBUG oslo_service.backend._eventlet.service [None req-b985f691-4253-4471-b7cb-75a26af5376b None None] glance.split_loggers = False {{(pid=86450) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:06 devstack cinder-volume[86450]: DEBUG oslo_service.backend._eventlet.service [None req-b985f691-4253-4471-b7cb-75a26af5376b None None] glance.timeout = None {{(pid=86450) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:06 devstack cinder-volume[86450]: DEBUG oslo_service.backend._eventlet.service [None req-b985f691-4253-4471-b7cb-75a26af5376b None None] backend_defaults.backend_availability_zone = None {{(pid=86450) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:06 devstack cinder-volume[86450]: DEBUG oslo_service.backend._eventlet.service [None req-b985f691-4253-4471-b7cb-75a26af5376b None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=86450) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:06 devstack cinder-volume[86450]: DEBUG oslo_service.backend._eventlet.service [None req-b985f691-4253-4471-b7cb-75a26af5376b None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=86450) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:06 devstack cinder-volume[86450]: DEBUG oslo_service.backend._eventlet.service [None req-b985f691-4253-4471-b7cb-75a26af5376b None None] backend_defaults.chap_password = **** {{(pid=86450) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:06 devstack cinder-volume[86450]: DEBUG oslo_service.backend._eventlet.service [None req-b985f691-4253-4471-b7cb-75a26af5376b None None] backend_defaults.chap_username = {{(pid=86450) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:06 devstack cinder-volume[86450]: DEBUG oslo_service.backend._eventlet.service [None req-b985f691-4253-4471-b7cb-75a26af5376b None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=86450) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:06 devstack cinder-volume[86450]: DEBUG oslo_service.backend._eventlet.service [None req-b985f691-4253-4471-b7cb-75a26af5376b None None] backend_defaults.disk_geometry = None {{(pid=86450) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:06 devstack cinder-volume[86450]: DEBUG oslo_service.backend._eventlet.service [None req-b985f691-4253-4471-b7cb-75a26af5376b None None] backend_defaults.driver_client_cert = None {{(pid=86450) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:06 devstack cinder-volume[86450]: DEBUG oslo_service.backend._eventlet.service [None req-b985f691-4253-4471-b7cb-75a26af5376b None None] backend_defaults.driver_client_cert_key = None {{(pid=86450) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:06 devstack cinder-volume[86450]: DEBUG oslo_service.backend._eventlet.service [None req-b985f691-4253-4471-b7cb-75a26af5376b None None] backend_defaults.driver_data_namespace = None {{(pid=86450) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:06 devstack cinder-volume[86450]: DEBUG oslo_service.backend._eventlet.service [None req-b985f691-4253-4471-b7cb-75a26af5376b None None] backend_defaults.driver_ssl_cert_path = None {{(pid=86450) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:06 devstack cinder-volume[86450]: DEBUG oslo_service.backend._eventlet.service [None req-b985f691-4253-4471-b7cb-75a26af5376b None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=86450) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:06 devstack cinder-volume[86450]: DEBUG oslo_service.backend._eventlet.service [None req-b985f691-4253-4471-b7cb-75a26af5376b None None] backend_defaults.driver_use_ssl = False {{(pid=86450) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:06 devstack cinder-volume[86450]: DEBUG oslo_service.backend._eventlet.service [None req-b985f691-4253-4471-b7cb-75a26af5376b None None] backend_defaults.enable_unsupported_driver = False {{(pid=86450) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:06 devstack cinder-volume[86450]: DEBUG oslo_service.backend._eventlet.service [None req-b985f691-4253-4471-b7cb-75a26af5376b None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=86450) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:06 devstack cinder-volume[86450]: DEBUG oslo_service.backend._eventlet.service [None req-b985f691-4253-4471-b7cb-75a26af5376b None None] backend_defaults.extra_capabilities = {} {{(pid=86450) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:06 devstack cinder-volume[86450]: DEBUG oslo_service.backend._eventlet.service [None req-b985f691-4253-4471-b7cb-75a26af5376b None None] backend_defaults.filter_function = None {{(pid=86450) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:06 devstack cinder-volume[86450]: DEBUG oslo_service.backend._eventlet.service [None req-b985f691-4253-4471-b7cb-75a26af5376b None None] backend_defaults.goodness_function = None {{(pid=86450) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:06 devstack cinder-volume[86450]: DEBUG oslo_service.backend._eventlet.service [None req-b985f691-4253-4471-b7cb-75a26af5376b None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=86450) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:06 devstack cinder-volume[86450]: DEBUG oslo_service.backend._eventlet.service [None req-b985f691-4253-4471-b7cb-75a26af5376b None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=86450) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:06 devstack cinder-volume[86450]: DEBUG oslo_service.backend._eventlet.service [None req-b985f691-4253-4471-b7cb-75a26af5376b None None] backend_defaults.image_volume_cache_enabled = False {{(pid=86450) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:06 devstack cinder-volume[86450]: DEBUG oslo_service.backend._eventlet.service [None req-b985f691-4253-4471-b7cb-75a26af5376b None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=86450) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:06 devstack cinder-volume[86450]: DEBUG oslo_service.backend._eventlet.service [None req-b985f691-4253-4471-b7cb-75a26af5376b None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=86450) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:06 devstack cinder-volume[86450]: DEBUG oslo_service.backend._eventlet.service [None req-b985f691-4253-4471-b7cb-75a26af5376b None None] backend_defaults.iscsi_target_flags = {{(pid=86450) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:06 devstack cinder-volume[86450]: DEBUG oslo_service.backend._eventlet.service [None req-b985f691-4253-4471-b7cb-75a26af5376b None None] backend_defaults.iscsi_write_cache = on {{(pid=86450) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:06 devstack cinder-volume[86450]: DEBUG oslo_service.backend._eventlet.service [None req-b985f691-4253-4471-b7cb-75a26af5376b None None] backend_defaults.iser_helper = tgtadm {{(pid=86450) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:06 devstack cinder-volume[86450]: DEBUG oslo_service.backend._eventlet.service [None req-b985f691-4253-4471-b7cb-75a26af5376b None None] backend_defaults.iser_ip_address = 192.168.122.158 {{(pid=86450) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:06 devstack cinder-volume[86450]: DEBUG oslo_service.backend._eventlet.service [None req-b985f691-4253-4471-b7cb-75a26af5376b None None] backend_defaults.iser_port = 3260 {{(pid=86450) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:06 devstack cinder-volume[86450]: DEBUG oslo_service.backend._eventlet.service [None req-b985f691-4253-4471-b7cb-75a26af5376b None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=86450) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:06 devstack cinder-volume[86450]: DEBUG oslo_service.backend._eventlet.service [None req-b985f691-4253-4471-b7cb-75a26af5376b None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=86450) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:06 devstack cinder-volume[86450]: DEBUG oslo_service.backend._eventlet.service [None req-b985f691-4253-4471-b7cb-75a26af5376b None None] backend_defaults.nas_host = {{(pid=86450) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:06 devstack cinder-volume[86450]: DEBUG oslo_service.backend._eventlet.service [None req-b985f691-4253-4471-b7cb-75a26af5376b None None] backend_defaults.nas_login = admin {{(pid=86450) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:06 devstack cinder-volume[86450]: DEBUG oslo_service.backend._eventlet.service [None req-b985f691-4253-4471-b7cb-75a26af5376b None None] backend_defaults.nas_mount_options = None {{(pid=86450) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:06 devstack cinder-volume[86450]: DEBUG oslo_service.backend._eventlet.service [None req-b985f691-4253-4471-b7cb-75a26af5376b None None] backend_defaults.nas_password = **** {{(pid=86450) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:06 devstack cinder-volume[86450]: DEBUG oslo_service.backend._eventlet.service [None req-b985f691-4253-4471-b7cb-75a26af5376b None None] backend_defaults.nas_private_key = {{(pid=86450) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:06 devstack cinder-volume[86450]: DEBUG oslo_service.backend._eventlet.service [None req-b985f691-4253-4471-b7cb-75a26af5376b None None] backend_defaults.nas_secure_file_operations = auto {{(pid=86450) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:06 devstack cinder-volume[86450]: DEBUG oslo_service.backend._eventlet.service [None req-b985f691-4253-4471-b7cb-75a26af5376b None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=86450) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:06 devstack cinder-volume[86450]: DEBUG oslo_service.backend._eventlet.service [None req-b985f691-4253-4471-b7cb-75a26af5376b None None] backend_defaults.nas_share_path = {{(pid=86450) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:06 devstack cinder-volume[86450]: DEBUG oslo_service.backend._eventlet.service [None req-b985f691-4253-4471-b7cb-75a26af5376b None None] backend_defaults.nas_ssh_port = 22 {{(pid=86450) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:06 devstack cinder-volume[86450]: DEBUG oslo_service.backend._eventlet.service [None req-b985f691-4253-4471-b7cb-75a26af5376b None None] backend_defaults.nas_volume_prov_type = thin {{(pid=86450) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:06 devstack cinder-volume[86450]: DEBUG oslo_service.backend._eventlet.service [None req-b985f691-4253-4471-b7cb-75a26af5376b None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=86450) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:06 devstack cinder-volume[86450]: DEBUG oslo_service.backend._eventlet.service [None req-b985f691-4253-4471-b7cb-75a26af5376b None None] backend_defaults.num_shell_tries = 3 {{(pid=86450) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:06 devstack cinder-volume[86450]: DEBUG oslo_service.backend._eventlet.service [None req-b985f691-4253-4471-b7cb-75a26af5376b None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=86450) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:06 devstack cinder-volume[86450]: DEBUG oslo_service.backend._eventlet.service [None req-b985f691-4253-4471-b7cb-75a26af5376b None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=86450) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:06 devstack cinder-volume[86450]: DEBUG oslo_service.backend._eventlet.service [None req-b985f691-4253-4471-b7cb-75a26af5376b None None] backend_defaults.nvmet_ns_id = 10 {{(pid=86450) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:06 devstack cinder-volume[86450]: DEBUG oslo_service.backend._eventlet.service [None req-b985f691-4253-4471-b7cb-75a26af5376b None None] backend_defaults.nvmet_port_id = 1 {{(pid=86450) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:06 devstack cinder-volume[86450]: DEBUG oslo_service.backend._eventlet.service [None req-b985f691-4253-4471-b7cb-75a26af5376b None None] backend_defaults.quobyte_client_cfg = None {{(pid=86450) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:06 devstack cinder-volume[86450]: DEBUG oslo_service.backend._eventlet.service [None req-b985f691-4253-4471-b7cb-75a26af5376b None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=86450) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:06 devstack cinder-volume[86450]: DEBUG oslo_service.backend._eventlet.service [None req-b985f691-4253-4471-b7cb-75a26af5376b None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=86450) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:06 devstack cinder-volume[86450]: DEBUG oslo_service.backend._eventlet.service [None req-b985f691-4253-4471-b7cb-75a26af5376b None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=86450) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:06 devstack cinder-volume[86450]: DEBUG oslo_service.backend._eventlet.service [None req-b985f691-4253-4471-b7cb-75a26af5376b None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=86450) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:06 devstack cinder-volume[86450]: DEBUG oslo_service.backend._eventlet.service [None req-b985f691-4253-4471-b7cb-75a26af5376b None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=86450) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:06 devstack cinder-volume[86450]: DEBUG oslo_service.backend._eventlet.service [None req-b985f691-4253-4471-b7cb-75a26af5376b None None] backend_defaults.quobyte_volume_url = None {{(pid=86450) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:06 devstack cinder-volume[86450]: DEBUG oslo_service.backend._eventlet.service [None req-b985f691-4253-4471-b7cb-75a26af5376b None None] backend_defaults.replication_device = **** {{(pid=86450) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:06 devstack cinder-volume[86450]: DEBUG oslo_service.backend._eventlet.service [None req-b985f691-4253-4471-b7cb-75a26af5376b None None] backend_defaults.report_discard_supported = False {{(pid=86450) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:06 devstack cinder-volume[86450]: DEBUG oslo_service.backend._eventlet.service [None req-b985f691-4253-4471-b7cb-75a26af5376b None None] backend_defaults.reserved_percentage = 0 {{(pid=86450) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:06 devstack cinder-volume[86450]: DEBUG oslo_service.backend._eventlet.service [None req-b985f691-4253-4471-b7cb-75a26af5376b None None] backend_defaults.scst_target_driver = iscsi {{(pid=86450) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:06 devstack cinder-volume[86450]: DEBUG oslo_service.backend._eventlet.service [None req-b985f691-4253-4471-b7cb-75a26af5376b None None] backend_defaults.scst_target_iqn_name = None {{(pid=86450) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:06 devstack cinder-volume[86450]: DEBUG oslo_service.backend._eventlet.service [None req-b985f691-4253-4471-b7cb-75a26af5376b None None] backend_defaults.storage_protocol = iSCSI {{(pid=86450) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:06 devstack cinder-volume[86450]: DEBUG oslo_service.backend._eventlet.service [None req-b985f691-4253-4471-b7cb-75a26af5376b None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=86450) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:06 devstack cinder-volume[86450]: DEBUG oslo_service.backend._eventlet.service [None req-b985f691-4253-4471-b7cb-75a26af5376b None None] backend_defaults.target_helper = tgtadm {{(pid=86450) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:06 devstack cinder-volume[86450]: DEBUG oslo_service.backend._eventlet.service [None req-b985f691-4253-4471-b7cb-75a26af5376b None None] backend_defaults.target_ip_address = 192.168.122.158 {{(pid=86450) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:06 devstack cinder-volume[86450]: DEBUG oslo_service.backend._eventlet.service [None req-b985f691-4253-4471-b7cb-75a26af5376b None None] backend_defaults.target_port = 3260 {{(pid=86450) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:06 devstack cinder-volume[86450]: DEBUG oslo_service.backend._eventlet.service [None req-b985f691-4253-4471-b7cb-75a26af5376b None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=86450) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:06 devstack cinder-volume[86450]: DEBUG oslo_service.backend._eventlet.service [None req-b985f691-4253-4471-b7cb-75a26af5376b None None] backend_defaults.target_protocol = iscsi {{(pid=86450) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:06 devstack cinder-volume[86450]: DEBUG oslo_service.backend._eventlet.service [None req-b985f691-4253-4471-b7cb-75a26af5376b None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=86450) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:06 devstack cinder-volume[86450]: DEBUG oslo_service.backend._eventlet.service [None req-b985f691-4253-4471-b7cb-75a26af5376b None None] backend_defaults.trace_flags = None {{(pid=86450) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:06 devstack cinder-volume[86450]: DEBUG oslo_service.backend._eventlet.service [None req-b985f691-4253-4471-b7cb-75a26af5376b None None] backend_defaults.unique_fqdn_network = True {{(pid=86450) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:06 devstack cinder-volume[86450]: DEBUG oslo_service.backend._eventlet.service [None req-b985f691-4253-4471-b7cb-75a26af5376b None None] backend_defaults.use_chap_auth = False {{(pid=86450) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:06 devstack cinder-volume[86450]: DEBUG oslo_service.backend._eventlet.service [None req-b985f691-4253-4471-b7cb-75a26af5376b None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=86450) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:06 devstack cinder-volume[86450]: DEBUG oslo_service.backend._eventlet.service [None req-b985f691-4253-4471-b7cb-75a26af5376b None None] backend_defaults.volume_backend_name = None {{(pid=86450) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:06 devstack cinder-volume[86450]: DEBUG oslo_service.backend._eventlet.service [None req-b985f691-4253-4471-b7cb-75a26af5376b None None] backend_defaults.volume_clear = zero {{(pid=86450) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:06 devstack cinder-volume[86450]: DEBUG oslo_service.backend._eventlet.service [None req-b985f691-4253-4471-b7cb-75a26af5376b None None] backend_defaults.volume_clear_ionice = None {{(pid=86450) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:06 devstack cinder-volume[86450]: DEBUG oslo_service.backend._eventlet.service [None req-b985f691-4253-4471-b7cb-75a26af5376b None None] backend_defaults.volume_clear_size = 0 {{(pid=86450) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:06 devstack cinder-volume[86450]: DEBUG oslo_service.backend._eventlet.service [None req-b985f691-4253-4471-b7cb-75a26af5376b None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=86450) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:06 devstack cinder-volume[86450]: DEBUG oslo_service.backend._eventlet.service [None req-b985f691-4253-4471-b7cb-75a26af5376b None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=86450) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:06 devstack cinder-volume[86450]: DEBUG oslo_service.backend._eventlet.service [None req-b985f691-4253-4471-b7cb-75a26af5376b None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=86450) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:06 devstack cinder-volume[86450]: DEBUG oslo_service.backend._eventlet.service [None req-b985f691-4253-4471-b7cb-75a26af5376b None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=86450) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:06 devstack cinder-volume[86450]: DEBUG oslo_service.backend._eventlet.service [None req-b985f691-4253-4471-b7cb-75a26af5376b None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=86450) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:06 devstack cinder-volume[86450]: DEBUG oslo_service.backend._eventlet.service [None req-b985f691-4253-4471-b7cb-75a26af5376b None None] oslo_reports.file_event_handler = None {{(pid=86450) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:06 devstack cinder-volume[86450]: DEBUG oslo_service.backend._eventlet.service [None req-b985f691-4253-4471-b7cb-75a26af5376b None None] oslo_reports.file_event_handler_interval = 1 {{(pid=86450) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:06 devstack cinder-volume[86450]: DEBUG oslo_service.backend._eventlet.service [None req-b985f691-4253-4471-b7cb-75a26af5376b None None] oslo_reports.log_dir = None {{(pid=86450) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:06 devstack cinder-volume[86450]: DEBUG oslo_service.backend._eventlet.service [None req-b985f691-4253-4471-b7cb-75a26af5376b None None] QuobyteHD.backend_availability_zone = None {{(pid=86450) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:06 devstack cinder-volume[86450]: DEBUG oslo_service.backend._eventlet.service [None req-b985f691-4253-4471-b7cb-75a26af5376b None None] QuobyteHD.backend_host = None {{(pid=86450) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:06 devstack cinder-volume[86450]: DEBUG oslo_service.backend._eventlet.service [None req-b985f691-4253-4471-b7cb-75a26af5376b None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=86450) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:06 devstack cinder-volume[86450]: DEBUG oslo_service.backend._eventlet.service [None req-b985f691-4253-4471-b7cb-75a26af5376b None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=86450) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:06 devstack cinder-volume[86450]: DEBUG oslo_service.backend._eventlet.service [None req-b985f691-4253-4471-b7cb-75a26af5376b None None] QuobyteHD.chap_password = **** {{(pid=86450) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:06 devstack cinder-volume[86450]: DEBUG oslo_service.backend._eventlet.service [None req-b985f691-4253-4471-b7cb-75a26af5376b None None] QuobyteHD.chap_username = None {{(pid=86450) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:06 devstack cinder-volume[86450]: DEBUG oslo_service.backend._eventlet.service [None req-b985f691-4253-4471-b7cb-75a26af5376b None None] QuobyteHD.chiscsi_conf = None {{(pid=86450) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:06 devstack cinder-volume[86450]: DEBUG oslo_service.backend._eventlet.service [None req-b985f691-4253-4471-b7cb-75a26af5376b None None] QuobyteHD.disk_geometry = None {{(pid=86450) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:06 devstack cinder-volume[86450]: DEBUG oslo_service.backend._eventlet.service [None req-b985f691-4253-4471-b7cb-75a26af5376b None None] QuobyteHD.driver_client_cert = None {{(pid=86450) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:06 devstack cinder-volume[86450]: DEBUG oslo_service.backend._eventlet.service [None req-b985f691-4253-4471-b7cb-75a26af5376b None None] QuobyteHD.driver_client_cert_key = None {{(pid=86450) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:06 devstack cinder-volume[86450]: DEBUG oslo_service.backend._eventlet.service [None req-b985f691-4253-4471-b7cb-75a26af5376b None None] QuobyteHD.driver_data_namespace = None {{(pid=86450) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:06 devstack cinder-volume[86450]: DEBUG oslo_service.backend._eventlet.service [None req-b985f691-4253-4471-b7cb-75a26af5376b None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=86450) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:06 devstack cinder-volume[86450]: DEBUG oslo_service.backend._eventlet.service [None req-b985f691-4253-4471-b7cb-75a26af5376b None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=86450) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:06 devstack cinder-volume[86450]: DEBUG oslo_service.backend._eventlet.service [None req-b985f691-4253-4471-b7cb-75a26af5376b None None] QuobyteHD.driver_use_ssl = None {{(pid=86450) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:06 devstack cinder-volume[86450]: DEBUG oslo_service.backend._eventlet.service [None req-b985f691-4253-4471-b7cb-75a26af5376b None None] QuobyteHD.enable_unsupported_driver = True {{(pid=86450) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:06 devstack cinder-volume[86450]: DEBUG oslo_service.backend._eventlet.service [None req-b985f691-4253-4471-b7cb-75a26af5376b None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=86450) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:06 devstack cinder-volume[86450]: DEBUG oslo_service.backend._eventlet.service [None req-b985f691-4253-4471-b7cb-75a26af5376b None None] QuobyteHD.extra_capabilities = None {{(pid=86450) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:06 devstack cinder-volume[86450]: DEBUG oslo_service.backend._eventlet.service [None req-b985f691-4253-4471-b7cb-75a26af5376b None None] QuobyteHD.filter_function = None {{(pid=86450) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:06 devstack cinder-volume[86450]: DEBUG oslo_service.backend._eventlet.service [None req-b985f691-4253-4471-b7cb-75a26af5376b None None] QuobyteHD.goodness_function = None {{(pid=86450) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:06 devstack cinder-volume[86450]: DEBUG oslo_service.backend._eventlet.service [None req-b985f691-4253-4471-b7cb-75a26af5376b None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=86450) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:06 devstack cinder-volume[86450]: DEBUG oslo_service.backend._eventlet.service [None req-b985f691-4253-4471-b7cb-75a26af5376b None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=86450) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:06 devstack cinder-volume[86450]: DEBUG oslo_service.backend._eventlet.service [None req-b985f691-4253-4471-b7cb-75a26af5376b None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=86450) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:06 devstack cinder-volume[86450]: DEBUG oslo_service.backend._eventlet.service [None req-b985f691-4253-4471-b7cb-75a26af5376b None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=86450) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:06 devstack cinder-volume[86450]: DEBUG oslo_service.backend._eventlet.service [None req-b985f691-4253-4471-b7cb-75a26af5376b None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=86450) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:06 devstack cinder-volume[86450]: DEBUG oslo_service.backend._eventlet.service [None req-b985f691-4253-4471-b7cb-75a26af5376b None None] QuobyteHD.iscsi_target_flags = None {{(pid=86450) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:06 devstack cinder-volume[86450]: DEBUG oslo_service.backend._eventlet.service [None req-b985f691-4253-4471-b7cb-75a26af5376b None None] QuobyteHD.iscsi_write_cache = None {{(pid=86450) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:06 devstack cinder-volume[86450]: DEBUG oslo_service.backend._eventlet.service [None req-b985f691-4253-4471-b7cb-75a26af5376b None None] QuobyteHD.iser_helper = None {{(pid=86450) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:06 devstack cinder-volume[86450]: DEBUG oslo_service.backend._eventlet.service [None req-b985f691-4253-4471-b7cb-75a26af5376b None None] QuobyteHD.iser_ip_address = None {{(pid=86450) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:06 devstack cinder-volume[86450]: DEBUG oslo_service.backend._eventlet.service [None req-b985f691-4253-4471-b7cb-75a26af5376b None None] QuobyteHD.iser_port = None {{(pid=86450) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:06 devstack cinder-volume[86450]: DEBUG oslo_service.backend._eventlet.service [None req-b985f691-4253-4471-b7cb-75a26af5376b None None] QuobyteHD.iser_target_prefix = None {{(pid=86450) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:06 devstack cinder-volume[86450]: DEBUG oslo_service.backend._eventlet.service [None req-b985f691-4253-4471-b7cb-75a26af5376b None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=86450) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:06 devstack cinder-volume[86450]: DEBUG oslo_service.backend._eventlet.service [None req-b985f691-4253-4471-b7cb-75a26af5376b None None] QuobyteHD.nas_host = None {{(pid=86450) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:06 devstack cinder-volume[86450]: DEBUG oslo_service.backend._eventlet.service [None req-b985f691-4253-4471-b7cb-75a26af5376b None None] QuobyteHD.nas_login = None {{(pid=86450) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:06 devstack cinder-volume[86450]: DEBUG oslo_service.backend._eventlet.service [None req-b985f691-4253-4471-b7cb-75a26af5376b None None] QuobyteHD.nas_mount_options = None {{(pid=86450) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:06 devstack cinder-volume[86450]: DEBUG oslo_service.backend._eventlet.service [None req-b985f691-4253-4471-b7cb-75a26af5376b None None] QuobyteHD.nas_password = **** {{(pid=86450) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:06 devstack cinder-volume[86450]: DEBUG oslo_service.backend._eventlet.service [None req-b985f691-4253-4471-b7cb-75a26af5376b None None] QuobyteHD.nas_private_key = None {{(pid=86450) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:06 devstack cinder-volume[86450]: DEBUG oslo_service.backend._eventlet.service [None req-b985f691-4253-4471-b7cb-75a26af5376b None None] QuobyteHD.nas_secure_file_operations = false {{(pid=86450) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:06 devstack cinder-volume[86450]: DEBUG oslo_service.backend._eventlet.service [None req-b985f691-4253-4471-b7cb-75a26af5376b None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=86450) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:06 devstack cinder-volume[86450]: DEBUG oslo_service.backend._eventlet.service [None req-b985f691-4253-4471-b7cb-75a26af5376b None None] QuobyteHD.nas_share_path = None {{(pid=86450) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:06 devstack cinder-volume[86450]: DEBUG oslo_service.backend._eventlet.service [None req-b985f691-4253-4471-b7cb-75a26af5376b None None] QuobyteHD.nas_ssh_port = None {{(pid=86450) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:06 devstack cinder-volume[86450]: DEBUG oslo_service.backend._eventlet.service [None req-b985f691-4253-4471-b7cb-75a26af5376b None None] QuobyteHD.nas_volume_prov_type = None {{(pid=86450) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:06 devstack cinder-volume[86450]: DEBUG oslo_service.backend._eventlet.service [None req-b985f691-4253-4471-b7cb-75a26af5376b None None] QuobyteHD.num_iser_scan_tries = None {{(pid=86450) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:06 devstack cinder-volume[86450]: DEBUG oslo_service.backend._eventlet.service [None req-b985f691-4253-4471-b7cb-75a26af5376b None None] QuobyteHD.num_shell_tries = None {{(pid=86450) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:06 devstack cinder-volume[86450]: DEBUG oslo_service.backend._eventlet.service [None req-b985f691-4253-4471-b7cb-75a26af5376b None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=86450) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:06 devstack cinder-volume[86450]: DEBUG oslo_service.backend._eventlet.service [None req-b985f691-4253-4471-b7cb-75a26af5376b None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=86450) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:06 devstack cinder-volume[86450]: DEBUG oslo_service.backend._eventlet.service [None req-b985f691-4253-4471-b7cb-75a26af5376b None None] QuobyteHD.nvmet_ns_id = None {{(pid=86450) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:06 devstack cinder-volume[86450]: DEBUG oslo_service.backend._eventlet.service [None req-b985f691-4253-4471-b7cb-75a26af5376b None None] QuobyteHD.nvmet_port_id = None {{(pid=86450) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:06 devstack cinder-volume[86450]: DEBUG oslo_service.backend._eventlet.service [None req-b985f691-4253-4471-b7cb-75a26af5376b None None] QuobyteHD.quobyte_client_cfg = /etc/quobyte/client-cinder.cfg {{(pid=86450) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:06 devstack cinder-volume[86450]: DEBUG oslo_service.backend._eventlet.service [None req-b985f691-4253-4471-b7cb-75a26af5376b None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=86450) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:06 devstack cinder-volume[86450]: DEBUG oslo_service.backend._eventlet.service [None req-b985f691-4253-4471-b7cb-75a26af5376b None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=86450) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:06 devstack cinder-volume[86450]: DEBUG oslo_service.backend._eventlet.service [None req-b985f691-4253-4471-b7cb-75a26af5376b None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=86450) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:06 devstack cinder-volume[86450]: DEBUG oslo_service.backend._eventlet.service [None req-b985f691-4253-4471-b7cb-75a26af5376b None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=86450) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:06 devstack cinder-volume[86450]: DEBUG oslo_service.backend._eventlet.service [None req-b985f691-4253-4471-b7cb-75a26af5376b None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=86450) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:06 devstack cinder-volume[86450]: DEBUG oslo_service.backend._eventlet.service [None req-b985f691-4253-4471-b7cb-75a26af5376b None None] QuobyteHD.quobyte_volume_url = quobyte://osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922 {{(pid=86450) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:06 devstack cinder-volume[86450]: DEBUG oslo_service.backend._eventlet.service [None req-b985f691-4253-4471-b7cb-75a26af5376b None None] QuobyteHD.replication_device = **** {{(pid=86450) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:06 devstack cinder-volume[86450]: DEBUG oslo_service.backend._eventlet.service [None req-b985f691-4253-4471-b7cb-75a26af5376b None None] QuobyteHD.report_discard_supported = None {{(pid=86450) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:06 devstack cinder-volume[86450]: DEBUG oslo_service.backend._eventlet.service [None req-b985f691-4253-4471-b7cb-75a26af5376b None None] QuobyteHD.reserved_percentage = None {{(pid=86450) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:06 devstack cinder-volume[86450]: DEBUG oslo_service.backend._eventlet.service [None req-b985f691-4253-4471-b7cb-75a26af5376b None None] QuobyteHD.scst_target_driver = None {{(pid=86450) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:06 devstack cinder-volume[86450]: DEBUG oslo_service.backend._eventlet.service [None req-b985f691-4253-4471-b7cb-75a26af5376b None None] QuobyteHD.scst_target_iqn_name = None {{(pid=86450) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:06 devstack cinder-volume[86450]: DEBUG oslo_service.backend._eventlet.service [None req-b985f691-4253-4471-b7cb-75a26af5376b None None] QuobyteHD.storage_protocol = None {{(pid=86450) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:06 devstack cinder-volume[86450]: DEBUG oslo_service.backend._eventlet.service [None req-b985f691-4253-4471-b7cb-75a26af5376b None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=86450) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:06 devstack cinder-volume[86450]: DEBUG oslo_service.backend._eventlet.service [None req-b985f691-4253-4471-b7cb-75a26af5376b None None] QuobyteHD.target_helper = None {{(pid=86450) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:06 devstack cinder-volume[86450]: DEBUG oslo_service.backend._eventlet.service [None req-b985f691-4253-4471-b7cb-75a26af5376b None None] QuobyteHD.target_ip_address = None {{(pid=86450) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:06 devstack cinder-volume[86450]: DEBUG oslo_service.backend._eventlet.service [None req-b985f691-4253-4471-b7cb-75a26af5376b None None] QuobyteHD.target_port = None {{(pid=86450) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:06 devstack cinder-volume[86450]: DEBUG oslo_service.backend._eventlet.service [None req-b985f691-4253-4471-b7cb-75a26af5376b None None] QuobyteHD.target_prefix = None {{(pid=86450) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:06 devstack cinder-volume[86450]: DEBUG oslo_service.backend._eventlet.service [None req-b985f691-4253-4471-b7cb-75a26af5376b None None] QuobyteHD.target_protocol = None {{(pid=86450) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:06 devstack cinder-volume[86450]: DEBUG oslo_service.backend._eventlet.service [None req-b985f691-4253-4471-b7cb-75a26af5376b None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=86450) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:06 devstack cinder-volume[86450]: DEBUG oslo_service.backend._eventlet.service [None req-b985f691-4253-4471-b7cb-75a26af5376b None None] QuobyteHD.trace_flags = None {{(pid=86450) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:06 devstack cinder-volume[86450]: DEBUG oslo_service.backend._eventlet.service [None req-b985f691-4253-4471-b7cb-75a26af5376b None None] QuobyteHD.unique_fqdn_network = None {{(pid=86450) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:06 devstack cinder-volume[86450]: DEBUG oslo_service.backend._eventlet.service [None req-b985f691-4253-4471-b7cb-75a26af5376b None None] QuobyteHD.use_chap_auth = None {{(pid=86450) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:06 devstack cinder-volume[86450]: DEBUG oslo_service.backend._eventlet.service [None req-b985f691-4253-4471-b7cb-75a26af5376b None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=86450) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:06 devstack cinder-volume[86450]: DEBUG oslo_service.backend._eventlet.service [None req-b985f691-4253-4471-b7cb-75a26af5376b None None] QuobyteHD.volume_backend_name = QuobyteHD {{(pid=86450) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:06 devstack cinder-volume[86450]: DEBUG oslo_service.backend._eventlet.service [None req-b985f691-4253-4471-b7cb-75a26af5376b None None] QuobyteHD.volume_clear = None {{(pid=86450) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:06 devstack cinder-volume[86450]: DEBUG oslo_service.backend._eventlet.service [None req-b985f691-4253-4471-b7cb-75a26af5376b None None] QuobyteHD.volume_clear_ionice = None {{(pid=86450) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:06 devstack cinder-volume[86450]: DEBUG oslo_service.backend._eventlet.service [None req-b985f691-4253-4471-b7cb-75a26af5376b None None] QuobyteHD.volume_clear_size = None {{(pid=86450) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:06 devstack cinder-volume[86450]: DEBUG oslo_service.backend._eventlet.service [None req-b985f691-4253-4471-b7cb-75a26af5376b None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=86450) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:06 devstack cinder-volume[86450]: DEBUG oslo_service.backend._eventlet.service [None req-b985f691-4253-4471-b7cb-75a26af5376b None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=86450) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:06 devstack cinder-volume[86450]: DEBUG oslo_service.backend._eventlet.service [None req-b985f691-4253-4471-b7cb-75a26af5376b None None] QuobyteHD.volume_dd_blocksize = None {{(pid=86450) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:06 devstack cinder-volume[86450]: DEBUG oslo_service.backend._eventlet.service [None req-b985f691-4253-4471-b7cb-75a26af5376b None None] QuobyteHD.volume_driver = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=86450) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:06 devstack cinder-volume[86450]: DEBUG oslo_service.backend._eventlet.service [None req-b985f691-4253-4471-b7cb-75a26af5376b None None] QuobyteHD.volumes_dir = None {{(pid=86450) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:06 devstack cinder-volume[86450]: DEBUG oslo_service.backend._eventlet.service [None req-b985f691-4253-4471-b7cb-75a26af5376b None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=86450) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:06 devstack cinder-volume[86450]: DEBUG oslo_service.backend._eventlet.service [None req-b985f691-4253-4471-b7cb-75a26af5376b None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=86450) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:06 devstack cinder-volume[86450]: DEBUG oslo_service.backend._eventlet.service [None req-b985f691-4253-4471-b7cb-75a26af5376b None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=86450) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:06 devstack cinder-volume[86450]: DEBUG oslo_service.backend._eventlet.service [None req-b985f691-4253-4471-b7cb-75a26af5376b None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=86450) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:06 devstack cinder-volume[86450]: DEBUG oslo_service.backend._eventlet.service [None req-b985f691-4253-4471-b7cb-75a26af5376b None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=86450) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:06 devstack cinder-volume[86450]: DEBUG oslo_service.backend._eventlet.service [None req-b985f691-4253-4471-b7cb-75a26af5376b None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=86450) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:06 devstack cinder-volume[86450]: DEBUG oslo_service.backend._eventlet.service [None req-b985f691-4253-4471-b7cb-75a26af5376b None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=86450) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:06 devstack cinder-volume[86450]: DEBUG oslo_service.backend._eventlet.service [None req-b985f691-4253-4471-b7cb-75a26af5376b None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=86450) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:06 devstack cinder-volume[86450]: DEBUG oslo_service.backend._eventlet.service [None req-b985f691-4253-4471-b7cb-75a26af5376b None None] oslo_messaging_rabbit.hostname = devstack {{(pid=86450) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:06 devstack cinder-volume[86450]: DEBUG oslo_service.backend._eventlet.service [None req-b985f691-4253-4471-b7cb-75a26af5376b None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=86450) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:06 devstack cinder-volume[86450]: DEBUG oslo_service.backend._eventlet.service [None req-b985f691-4253-4471-b7cb-75a26af5376b None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=86450) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:06 devstack cinder-volume[86450]: DEBUG oslo_service.backend._eventlet.service [None req-b985f691-4253-4471-b7cb-75a26af5376b None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=86450) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:06 devstack cinder-volume[86450]: DEBUG oslo_service.backend._eventlet.service [None req-b985f691-4253-4471-b7cb-75a26af5376b None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=86450) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:06 devstack cinder-volume[86450]: DEBUG oslo_service.backend._eventlet.service [None req-b985f691-4253-4471-b7cb-75a26af5376b None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=86450) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:06 devstack cinder-volume[86450]: DEBUG oslo_service.backend._eventlet.service [None req-b985f691-4253-4471-b7cb-75a26af5376b None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=86450) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:06 devstack cinder-volume[86450]: DEBUG oslo_service.backend._eventlet.service [None req-b985f691-4253-4471-b7cb-75a26af5376b None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=86450) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:06 devstack cinder-volume[86450]: DEBUG oslo_service.backend._eventlet.service [None req-b985f691-4253-4471-b7cb-75a26af5376b None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=86450) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:06 devstack cinder-volume[86450]: DEBUG oslo_service.backend._eventlet.service [None req-b985f691-4253-4471-b7cb-75a26af5376b None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=86450) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:06 devstack cinder-volume[86450]: DEBUG oslo_service.backend._eventlet.service [None req-b985f691-4253-4471-b7cb-75a26af5376b None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=86450) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:06 devstack cinder-volume[86450]: DEBUG oslo_service.backend._eventlet.service [None req-b985f691-4253-4471-b7cb-75a26af5376b None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=86450) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:06 devstack cinder-volume[86450]: DEBUG oslo_service.backend._eventlet.service [None req-b985f691-4253-4471-b7cb-75a26af5376b None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=86450) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:06 devstack cinder-volume[86450]: DEBUG oslo_service.backend._eventlet.service [None req-b985f691-4253-4471-b7cb-75a26af5376b None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=86450) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:06 devstack cinder-volume[86450]: DEBUG oslo_service.backend._eventlet.service [None req-b985f691-4253-4471-b7cb-75a26af5376b None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=86450) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:06 devstack cinder-volume[86450]: DEBUG oslo_service.backend._eventlet.service [None req-b985f691-4253-4471-b7cb-75a26af5376b None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=86450) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:06 devstack cinder-volume[86450]: DEBUG oslo_service.backend._eventlet.service [None req-b985f691-4253-4471-b7cb-75a26af5376b None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=86450) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:06 devstack cinder-volume[86450]: DEBUG oslo_service.backend._eventlet.service [None req-b985f691-4253-4471-b7cb-75a26af5376b None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=86450) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:06 devstack cinder-volume[86450]: DEBUG oslo_service.backend._eventlet.service [None req-b985f691-4253-4471-b7cb-75a26af5376b None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=86450) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:06 devstack cinder-volume[86450]: DEBUG oslo_service.backend._eventlet.service [None req-b985f691-4253-4471-b7cb-75a26af5376b None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=86450) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:06 devstack cinder-volume[86450]: DEBUG oslo_service.backend._eventlet.service [None req-b985f691-4253-4471-b7cb-75a26af5376b None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=86450) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:06 devstack cinder-volume[86450]: DEBUG oslo_service.backend._eventlet.service [None req-b985f691-4253-4471-b7cb-75a26af5376b None None] oslo_messaging_rabbit.ssl = False {{(pid=86450) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:06 devstack cinder-volume[86450]: DEBUG oslo_service.backend._eventlet.service [None req-b985f691-4253-4471-b7cb-75a26af5376b None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=86450) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:06 devstack cinder-volume[86450]: DEBUG oslo_service.backend._eventlet.service [None req-b985f691-4253-4471-b7cb-75a26af5376b None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=86450) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:06 devstack cinder-volume[86450]: DEBUG oslo_service.backend._eventlet.service [None req-b985f691-4253-4471-b7cb-75a26af5376b None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=86450) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:06 devstack cinder-volume[86450]: DEBUG oslo_service.backend._eventlet.service [None req-b985f691-4253-4471-b7cb-75a26af5376b None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=86450) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:06 devstack cinder-volume[86450]: DEBUG oslo_service.backend._eventlet.service [None req-b985f691-4253-4471-b7cb-75a26af5376b None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=86450) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:06 devstack cinder-volume[86450]: DEBUG oslo_service.backend._eventlet.service [None req-b985f691-4253-4471-b7cb-75a26af5376b None None] oslo_messaging_rabbit.ssl_version = {{(pid=86450) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:06 devstack cinder-volume[86450]: DEBUG oslo_service.backend._eventlet.service [None req-b985f691-4253-4471-b7cb-75a26af5376b None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=86450) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:06 devstack cinder-volume[86450]: DEBUG oslo_service.backend._eventlet.service [None req-b985f691-4253-4471-b7cb-75a26af5376b None None] oslo_messaging_notifications.driver = [] {{(pid=86450) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:06 devstack cinder-volume[86450]: DEBUG oslo_service.backend._eventlet.service [None req-b985f691-4253-4471-b7cb-75a26af5376b None None] oslo_messaging_notifications.retry = -1 {{(pid=86450) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:06 devstack cinder-volume[86450]: DEBUG oslo_service.backend._eventlet.service [None req-b985f691-4253-4471-b7cb-75a26af5376b None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=86450) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:06 devstack cinder-volume[86450]: DEBUG oslo_service.backend._eventlet.service [None req-b985f691-4253-4471-b7cb-75a26af5376b None None] oslo_messaging_notifications.transport_url = **** {{(pid=86450) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:06 devstack cinder-volume[86450]: DEBUG oslo_service.backend._eventlet.service [None req-b985f691-4253-4471-b7cb-75a26af5376b None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=86450) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:06 devstack cinder-volume[86450]: DEBUG oslo_service.backend._eventlet.service [None req-b985f691-4253-4471-b7cb-75a26af5376b None None] key_manager.fixed_key = **** {{(pid=86450) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:06 devstack cinder-volume[86450]: DEBUG oslo_service.backend._eventlet.service [None req-b985f691-4253-4471-b7cb-75a26af5376b None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=86450) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:06 devstack cinder-volume[86450]: DEBUG oslo_service.backend._eventlet.service [None req-b985f691-4253-4471-b7cb-75a26af5376b None None] barbican.barbican_api_version = None {{(pid=86450) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:06 devstack cinder-volume[86450]: DEBUG oslo_service.backend._eventlet.service [None req-b985f691-4253-4471-b7cb-75a26af5376b None None] barbican.barbican_endpoint = None {{(pid=86450) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:06 devstack cinder-volume[86450]: DEBUG oslo_service.backend._eventlet.service [None req-b985f691-4253-4471-b7cb-75a26af5376b None None] barbican.barbican_endpoint_type = public {{(pid=86450) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:06 devstack cinder-volume[86450]: DEBUG oslo_service.backend._eventlet.service [None req-b985f691-4253-4471-b7cb-75a26af5376b None None] barbican.barbican_region_name = None {{(pid=86450) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:06 devstack cinder-volume[86450]: DEBUG oslo_service.backend._eventlet.service [None req-b985f691-4253-4471-b7cb-75a26af5376b None None] barbican.cafile = None {{(pid=86450) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:06 devstack cinder-volume[86450]: DEBUG oslo_service.backend._eventlet.service [None req-b985f691-4253-4471-b7cb-75a26af5376b None None] barbican.certfile = None {{(pid=86450) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:06 devstack cinder-volume[86450]: DEBUG oslo_service.backend._eventlet.service [None req-b985f691-4253-4471-b7cb-75a26af5376b None None] barbican.collect_timing = False {{(pid=86450) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:06 devstack cinder-volume[86450]: DEBUG oslo_service.backend._eventlet.service [None req-b985f691-4253-4471-b7cb-75a26af5376b None None] barbican.insecure = False {{(pid=86450) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:06 devstack cinder-volume[86668]: DEBUG cinder.volume.drivers.quobyte [None req-4e6a0dfa-70d1-4376-905f-249915a28a0b None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=86668) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:305}} Jul 10 04:31:06 devstack cinder-volume[86668]: WARNING cinder.volume.drivers.quobyte [None req-4e6a0dfa-70d1-4376-905f-249915a28a0b None None] The NAS file operations will be run as root, allowing root level access at the storage backend. Jul 10 04:31:06 devstack cinder-volume[86668]: WARNING cinder.volume.drivers.quobyte [None req-4e6a0dfa-70d1-4376-905f-249915a28a0b None None] The NAS file permissions mode will be 666 (allowing other/world read & write access). Jul 10 04:31:06 devstack cinder-volume[86450]: DEBUG oslo_service.backend._eventlet.service [None req-b985f691-4253-4471-b7cb-75a26af5376b None None] barbican.keyfile = None {{(pid=86450) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:06 devstack cinder-volume[86450]: DEBUG oslo_service.backend._eventlet.service [None req-b985f691-4253-4471-b7cb-75a26af5376b None None] barbican.number_of_retries = 60 {{(pid=86450) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:06 devstack cinder-volume[86450]: DEBUG oslo_service.backend._eventlet.service [None req-b985f691-4253-4471-b7cb-75a26af5376b None None] barbican.retry_delay = 1 {{(pid=86450) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:06 devstack cinder-volume[86450]: DEBUG oslo_service.backend._eventlet.service [None req-b985f691-4253-4471-b7cb-75a26af5376b None None] barbican.send_service_user_token = False {{(pid=86450) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:06 devstack cinder-volume[86450]: DEBUG oslo_service.backend._eventlet.service [None req-b985f691-4253-4471-b7cb-75a26af5376b None None] barbican.split_loggers = False {{(pid=86450) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:06 devstack cinder-volume[86450]: DEBUG oslo_service.backend._eventlet.service [None req-b985f691-4253-4471-b7cb-75a26af5376b None None] barbican.timeout = None {{(pid=86450) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:06 devstack cinder-volume[86668]: DEBUG oslo_concurrency.processutils [None req-4e6a0dfa-70d1-4376-905f-249915a28a0b None None] Running cmd (subprocess): mount.quobyte {{(pid=86668) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:31:06 devstack cinder-volume[86450]: DEBUG oslo_service.backend._eventlet.service [None req-b985f691-4253-4471-b7cb-75a26af5376b None None] barbican.verify_ssl = True {{(pid=86450) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:06 devstack cinder-volume[86450]: DEBUG oslo_service.backend._eventlet.service [None req-b985f691-4253-4471-b7cb-75a26af5376b None None] barbican.verify_ssl_path = None {{(pid=86450) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:06 devstack cinder-volume[86450]: DEBUG oslo_service.backend._eventlet.service [None req-b985f691-4253-4471-b7cb-75a26af5376b None None] barbican_service_user.auth_section = None {{(pid=86450) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:06 devstack cinder-volume[86450]: DEBUG oslo_service.backend._eventlet.service [None req-b985f691-4253-4471-b7cb-75a26af5376b None None] barbican_service_user.auth_type = None {{(pid=86450) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:06 devstack cinder-volume[86450]: DEBUG oslo_service.backend._eventlet.service [None req-b985f691-4253-4471-b7cb-75a26af5376b None None] barbican_service_user.cafile = None {{(pid=86450) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:06 devstack cinder-volume[86450]: DEBUG oslo_service.backend._eventlet.service [None req-b985f691-4253-4471-b7cb-75a26af5376b None None] barbican_service_user.certfile = None {{(pid=86450) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:06 devstack cinder-volume[86450]: DEBUG oslo_service.backend._eventlet.service [None req-b985f691-4253-4471-b7cb-75a26af5376b None None] barbican_service_user.collect_timing = False {{(pid=86450) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:06 devstack cinder-volume[86450]: DEBUG oslo_service.backend._eventlet.service [None req-b985f691-4253-4471-b7cb-75a26af5376b None None] barbican_service_user.insecure = False {{(pid=86450) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:06 devstack cinder-volume[86450]: DEBUG oslo_service.backend._eventlet.service [None req-b985f691-4253-4471-b7cb-75a26af5376b None None] barbican_service_user.keyfile = None {{(pid=86450) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:06 devstack cinder-volume[86450]: DEBUG oslo_service.backend._eventlet.service [None req-b985f691-4253-4471-b7cb-75a26af5376b None None] barbican_service_user.split_loggers = False {{(pid=86450) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:06 devstack cinder-volume[86450]: DEBUG oslo_service.backend._eventlet.service [None req-b985f691-4253-4471-b7cb-75a26af5376b None None] barbican_service_user.timeout = None {{(pid=86450) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:06 devstack cinder-volume[86450]: DEBUG oslo_service.backend._eventlet.service [None req-b985f691-4253-4471-b7cb-75a26af5376b None None] vault.approle_role_id = **** {{(pid=86450) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:06 devstack cinder-volume[86450]: DEBUG oslo_service.backend._eventlet.service [None req-b985f691-4253-4471-b7cb-75a26af5376b None None] vault.approle_secret_id = **** {{(pid=86450) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:06 devstack cinder-volume[86450]: DEBUG oslo_service.backend._eventlet.service [None req-b985f691-4253-4471-b7cb-75a26af5376b None None] vault.kv_mountpoint = secret {{(pid=86450) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:06 devstack cinder-volume[86450]: DEBUG oslo_service.backend._eventlet.service [None req-b985f691-4253-4471-b7cb-75a26af5376b None None] vault.kv_path = None {{(pid=86450) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:06 devstack cinder-volume[86450]: DEBUG oslo_service.backend._eventlet.service [None req-b985f691-4253-4471-b7cb-75a26af5376b None None] vault.kv_version = 2 {{(pid=86450) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:06 devstack cinder-volume[86450]: DEBUG oslo_service.backend._eventlet.service [None req-b985f691-4253-4471-b7cb-75a26af5376b None None] vault.namespace = None {{(pid=86450) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:06 devstack cinder-volume[86450]: DEBUG oslo_service.backend._eventlet.service [None req-b985f691-4253-4471-b7cb-75a26af5376b None None] vault.root_token_id = **** {{(pid=86450) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:06 devstack cinder-volume[86450]: DEBUG oslo_service.backend._eventlet.service [None req-b985f691-4253-4471-b7cb-75a26af5376b None None] vault.ssl_ca_crt_file = None {{(pid=86450) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:06 devstack cinder-volume[86450]: DEBUG oslo_service.backend._eventlet.service [None req-b985f691-4253-4471-b7cb-75a26af5376b None None] vault.timeout = 60.0 {{(pid=86450) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:06 devstack cinder-volume[86450]: DEBUG oslo_service.backend._eventlet.service [None req-b985f691-4253-4471-b7cb-75a26af5376b None None] vault.use_ssl = False {{(pid=86450) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:06 devstack cinder-volume[86450]: DEBUG oslo_service.backend._eventlet.service [None req-b985f691-4253-4471-b7cb-75a26af5376b None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=86450) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:06 devstack cinder-volume[86450]: DEBUG oslo_service.backend._eventlet.service [None req-b985f691-4253-4471-b7cb-75a26af5376b None None] ******************************************************************************** {{(pid=86450) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3260}} Jul 10 04:31:06 devstack quobyte-client[86673]: Reading configuration file: /etc/quobyte/client.cfg Jul 10 04:31:06 devstack quobyte-client[86673]: Quobyte logging to journald, you can use 'journalctl QUOBYTE_MOUNTPOINT=' to display the log. Jul 10 04:31:06 devstack cinder-volume[86668]: DEBUG oslo_concurrency.processutils [None req-4e6a0dfa-70d1-4376-905f-249915a28a0b None None] CMD "mount.quobyte" returned: 1 in 0.080s {{(pid=86668) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:31:06 devstack cinder-volume[86668]: DEBUG oslo_concurrency.lockutils [None req-4e6a0dfa-70d1-4376-905f-249915a28a0b None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86668) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 04:31:06 devstack cinder-volume[86668]: DEBUG oslo_concurrency.lockutils [None req-4e6a0dfa-70d1-4376-905f-249915a28a0b None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86668) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 04:31:06 devstack cinder-volume[86668]: DEBUG cinder.volume.drivers.quobyte [None req-4e6a0dfa-70d1-4376-905f-249915a28a0b None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922': None} {{(pid=86668) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 04:31:06 devstack cinder-volume[86668]: INFO cinder.volume.drivers.quobyte [None req-4e6a0dfa-70d1-4376-905f-249915a28a0b None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922 ... Jul 10 04:31:06 devstack cinder-volume[86668]: DEBUG oslo_concurrency.processutils [None req-4e6a0dfa-70d1-4376-905f-249915a28a0b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922 /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097 -c /etc/quobyte/client-cinder.cfg {{(pid=86668) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:31:06 devstack sudo[86674]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922 /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097 -c /etc/quobyte/client-cinder.cfg Jul 10 04:31:06 devstack sudo[86674]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:31:07 devstack sudo[86674]: pam_unix(sudo:session): session closed for user root Jul 10 04:31:07 devstack cinder-volume[86668]: DEBUG oslo_concurrency.processutils [None req-4e6a0dfa-70d1-4376-905f-249915a28a0b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922 /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097 -c /etc/quobyte/client-cinder.cfg" returned: 0 in 0.773s {{(pid=86668) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:31:07 devstack cinder-volume[86668]: INFO cinder.volume.drivers.quobyte [None req-4e6a0dfa-70d1-4376-905f-249915a28a0b None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922 succeeded Jul 10 04:31:07 devstack cinder-volume[86668]: DEBUG cinder.volume.drivers.quobyte [None req-4e6a0dfa-70d1-4376-905f-249915a28a0b None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922'] {{(pid=86668) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 04:31:07 devstack cinder-volume[86668]: DEBUG oslo_concurrency.lockutils [None req-4e6a0dfa-70d1-4376-905f-249915a28a0b None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.787s {{(pid=86668) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 04:31:07 devstack cinder-volume[86668]: DEBUG oslo_concurrency.processutils [None req-4e6a0dfa-70d1-4376-905f-249915a28a0b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097 {{(pid=86668) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:31:07 devstack sudo[86743]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097 Jul 10 04:31:07 devstack sudo[86743]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:31:07 devstack sudo[86743]: pam_unix(sudo:session): session closed for user root Jul 10 04:31:07 devstack cinder-volume[86668]: DEBUG oslo_concurrency.processutils [None req-4e6a0dfa-70d1-4376-905f-249915a28a0b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097" returned: 0 in 0.617s {{(pid=86668) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:31:07 devstack cinder-volume[86668]: INFO cinder.volume.driver [None req-4e6a0dfa-70d1-4376-905f-249915a28a0b None None] Driver hasn't implemented _init_vendor_properties() Jul 10 04:31:07 devstack cinder-volume[86668]: DEBUG cinder.volume.driver [None req-4e6a0dfa-70d1-4376-905f-249915a28a0b None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.7577743530273, 'free_capacity_gb': 1775.7577743530273, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=86668) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}} Jul 10 04:31:07 devstack cinder-volume[86668]: DEBUG oslo_db.sqlalchemy.engines [None req-4e6a0dfa-70d1-4376-905f-249915a28a0b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86668) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 10 04:31:07 devstack cinder-volume[86668]: DEBUG dbcounter [-] [86668] Writer thread running {{(pid=86668) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Jul 10 04:31:07 devstack cinder-volume[86668]: DEBUG cinder.db.api [None req-4e6a0dfa-70d1-4376-905f-249915a28a0b None None] Building query based on filter {{(pid=86668) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}} Jul 10 04:31:07 devstack cinder-volume[86668]: DEBUG cinder.image.image_utils [None req-4e6a0dfa-70d1-4376-905f-249915a28a0b None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=86668) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1331}} Jul 10 04:31:07 devstack cinder-volume[86668]: INFO cinder.keymgr.migration [None req-9a06118b-5abb-4928-ab18-2bb97dd95455 None None] Not migrating encryption keys because the ConfKeyManager is still in use. Jul 10 04:31:07 devstack cinder-volume[86668]: DEBUG oslo_concurrency.lockutils [None req-4e6a0dfa-70d1-4376-905f-249915a28a0b None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86668) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 04:31:07 devstack cinder-volume[86668]: DEBUG oslo_concurrency.lockutils [None req-4e6a0dfa-70d1-4376-905f-249915a28a0b None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86668) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 04:31:07 devstack cinder-volume[86668]: DEBUG cinder.volume.drivers.quobyte [None req-4e6a0dfa-70d1-4376-905f-249915a28a0b None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922': None} {{(pid=86668) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 04:31:07 devstack cinder-volume[86668]: DEBUG cinder.volume.drivers.quobyte [None req-4e6a0dfa-70d1-4376-905f-249915a28a0b None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922'] {{(pid=86668) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 04:31:07 devstack cinder-volume[86668]: DEBUG oslo_concurrency.lockutils [None req-4e6a0dfa-70d1-4376-905f-249915a28a0b None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86668) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 04:31:07 devstack cinder-volume[86668]: DEBUG oslo_concurrency.processutils [None req-4e6a0dfa-70d1-4376-905f-249915a28a0b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097 {{(pid=86668) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:31:07 devstack sudo[86746]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097 Jul 10 04:31:07 devstack sudo[86746]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:31:08 devstack sudo[86746]: pam_unix(sudo:session): session closed for user root Jul 10 04:31:08 devstack cinder-volume[86668]: DEBUG oslo_concurrency.processutils [None req-4e6a0dfa-70d1-4376-905f-249915a28a0b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097" returned: 0 in 0.654s {{(pid=86668) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:31:08 devstack cinder-volume[86668]: DEBUG cinder.manager [None req-4e6a0dfa-70d1-4376-905f-249915a28a0b None None] Notifying Schedulers of capabilities ... {{(pid=86668) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 04:31:08 devstack cinder-volume[86668]: INFO cinder.volume.manager [None req-4e6a0dfa-70d1-4376-905f-249915a28a0b None None] Driver initialization completed successfully. Jul 10 04:31:08 devstack cinder-volume[86668]: INFO cinder.manager [None req-4e6a0dfa-70d1-4376-905f-249915a28a0b None None] Initiating service 3 cleanup Jul 10 04:31:08 devstack cinder-volume[86668]: INFO cinder.manager [None req-4e6a0dfa-70d1-4376-905f-249915a28a0b None None] Service 3 cleanup completed. Jul 10 04:31:08 devstack cinder-volume[86668]: DEBUG cinder.service [None req-4e6a0dfa-70d1-4376-905f-249915a28a0b None None] Creating RPC server for service cinder-volume {{(pid=86668) start /opt/stack/cinder/cinder/service.py:231}} Jul 10 04:31:08 devstack cinder-volume[86668]: DEBUG cinder.service [None req-4e6a0dfa-70d1-4376-905f-249915a28a0b None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=86668) start /opt/stack/cinder/cinder/service.py:237}} Jul 10 04:31:08 devstack cinder-volume[86668]: INFO cinder.volume.manager [None req-4e6a0dfa-70d1-4376-905f-249915a28a0b None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.1.14) Jul 10 04:31:08 devstack cinder-volume[86668]: DEBUG oslo_concurrency.lockutils [None req-4e6a0dfa-70d1-4376-905f-249915a28a0b None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86668) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 04:31:08 devstack cinder-volume[86668]: DEBUG oslo_concurrency.lockutils [None req-4e6a0dfa-70d1-4376-905f-249915a28a0b None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86668) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 04:31:08 devstack cinder-volume[86668]: DEBUG cinder.volume.drivers.quobyte [None req-4e6a0dfa-70d1-4376-905f-249915a28a0b None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922': None} {{(pid=86668) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 04:31:08 devstack cinder-volume[86668]: DEBUG cinder.volume.drivers.quobyte [None req-4e6a0dfa-70d1-4376-905f-249915a28a0b None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922'] {{(pid=86668) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 04:31:08 devstack cinder-volume[86668]: DEBUG oslo_concurrency.lockutils [None req-4e6a0dfa-70d1-4376-905f-249915a28a0b None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86668) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 04:31:08 devstack cinder-volume[86668]: DEBUG oslo_concurrency.processutils [None req-4e6a0dfa-70d1-4376-905f-249915a28a0b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097 {{(pid=86668) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:31:08 devstack sudo[86754]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097 Jul 10 04:31:08 devstack sudo[86754]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:31:09 devstack sudo[86754]: pam_unix(sudo:session): session closed for user root Jul 10 04:31:09 devstack cinder-volume[86668]: DEBUG oslo_concurrency.processutils [None req-4e6a0dfa-70d1-4376-905f-249915a28a0b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097" returned: 0 in 0.868s {{(pid=86668) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:31:09 devstack cinder-volume[86668]: INFO cinder.volume.manager [None req-4e6a0dfa-70d1-4376-905f-249915a28a0b None None] Driver post RPC initialization completed successfully. Jul 10 04:31:13 devstack cinder-volume[86668]: DEBUG oslo_concurrency.lockutils [None req-c548cb63-c93e-41de-bcd8-7672ab1067a0 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86668) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 04:31:13 devstack cinder-volume[86668]: DEBUG oslo_concurrency.lockutils [None req-c548cb63-c93e-41de-bcd8-7672ab1067a0 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86668) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 04:31:13 devstack cinder-volume[86668]: DEBUG cinder.volume.drivers.quobyte [None req-c548cb63-c93e-41de-bcd8-7672ab1067a0 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922': None} {{(pid=86668) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 04:31:13 devstack cinder-volume[86668]: DEBUG cinder.volume.drivers.quobyte [None req-c548cb63-c93e-41de-bcd8-7672ab1067a0 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922'] {{(pid=86668) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 04:31:13 devstack cinder-volume[86668]: DEBUG oslo_concurrency.lockutils [None req-c548cb63-c93e-41de-bcd8-7672ab1067a0 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86668) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 04:31:13 devstack cinder-volume[86668]: DEBUG oslo_concurrency.processutils [None req-c548cb63-c93e-41de-bcd8-7672ab1067a0 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097 {{(pid=86668) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:31:13 devstack sudo[86923]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097 Jul 10 04:31:13 devstack sudo[86923]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:31:14 devstack sudo[86923]: pam_unix(sudo:session): session closed for user root Jul 10 04:31:14 devstack cinder-volume[86668]: DEBUG oslo_concurrency.processutils [None req-c548cb63-c93e-41de-bcd8-7672ab1067a0 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097" returned: 0 in 0.626s {{(pid=86668) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:31:14 devstack cinder-volume[86668]: DEBUG cinder.manager [None req-c548cb63-c93e-41de-bcd8-7672ab1067a0 None None] Notifying Schedulers of capabilities ... {{(pid=86668) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 04:31:15 devstack cinder-volume[86450]: DEBUG dbcounter [-] [86450] Writing DB stats cinder:SELECT=6,cinder:INSERT=1,cinder:UPDATE=2 {{(pid=86450) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 10 04:31:16 devstack cinder-volume[86450]: INFO oslo_service.backend._eventlet.service [None req-b985f691-4253-4471-b7cb-75a26af5376b None None] Caught SIGTERM, stopping children Jul 10 04:31:16 devstack cinder-volume[86450]: DEBUG oslo_concurrency.lockutils [None req-b985f691-4253-4471-b7cb-75a26af5376b None None] Acquiring lock "singleton_lock" {{(pid=86450) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jul 10 04:31:16 devstack cinder-volume[86450]: DEBUG oslo_concurrency.lockutils [None req-b985f691-4253-4471-b7cb-75a26af5376b None None] Acquired lock "singleton_lock" {{(pid=86450) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jul 10 04:31:16 devstack cinder-volume[86450]: DEBUG oslo_concurrency.lockutils [None req-b985f691-4253-4471-b7cb-75a26af5376b None None] Releasing lock "singleton_lock" {{(pid=86450) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jul 10 04:31:16 devstack cinder-volume[86450]: DEBUG oslo_service.backend._eventlet.service [None req-b985f691-4253-4471-b7cb-75a26af5376b None None] Stop services. {{(pid=86450) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:611}} Jul 10 04:31:16 devstack cinder-volume[86450]: DEBUG oslo_service.backend._eventlet.service [None req-b985f691-4253-4471-b7cb-75a26af5376b None None] Killing children. {{(pid=86450) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:616}} Jul 10 04:31:16 devstack cinder-volume[86450]: INFO oslo_service.backend._eventlet.service [None req-b985f691-4253-4471-b7cb-75a26af5376b None None] Waiting on 1 children to exit Jul 10 04:31:19 devstack cinder-volume[86668]: DEBUG dbcounter [-] [86668] Writing DB stats cinder:SELECT=9,cinder:INSERT=1,cinder:UPDATE=2 {{(pid=86668) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 10 04:31:19 devstack cinder-volume[86668]: DEBUG dbcounter [-] [86668] Writing DB stats cinder:SELECT=3,cinder:UPDATE=1 {{(pid=86668) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 10 04:31:21 devstack cinder-volume[86668]: INFO oslo_service.backend._eventlet.service [-] Parent process has died unexpectedly, exiting Jul 10 04:31:21 devstack cinder-volume[86668]: DEBUG oslo_service.periodic_task [None req-bfbd9d4e-e53a-4c91-9758-b97c457a54fc None None] Running periodic task VolumeManager._thread_info {{(pid=86668) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 10 04:31:21 devstack cinder-volume[86668]: DEBUG cinder.volume.manager [None req-bfbd9d4e-e53a-4c91-9758-b97c457a54fc None None] thread count: 6 {{(pid=86668) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 10 04:31:21 devstack cinder-volume[86668]: DEBUG cinder.volume.manager [None req-bfbd9d4e-e53a-4c91-9758-b97c457a54fc None None] thread info: [<_MainThread(MainThread, started 131506864746624)>, , , , , ] {{(pid=86668) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 10 04:31:21 devstack cinder-volume[87165]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Jul 10 04:31:21 devstack cinder-volume[87165]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Jul 10 04:31:21 devstack cinder-volume[87165]: we strongly recommend against using it for new projects. Jul 10 04:31:21 devstack cinder-volume[87165]: If you are already using Eventlet, we recommend migrating to a different Jul 10 04:31:21 devstack cinder-volume[87165]: framework. For more detail see Jul 10 04:31:21 devstack cinder-volume[87165]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Jul 10 04:31:21 devstack cinder-volume[87165]: import eventlet # noqa Jul 10 04:31:21 devstack cinder-volume[86668]: DEBUG oslo_concurrency.lockutils [None req-b985f691-4253-4471-b7cb-75a26af5376b None None] Acquiring lock "singleton_lock" {{(pid=86668) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jul 10 04:31:21 devstack cinder-volume[86668]: DEBUG oslo_concurrency.lockutils [None req-b985f691-4253-4471-b7cb-75a26af5376b None None] Acquired lock "singleton_lock" {{(pid=86668) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jul 10 04:31:21 devstack cinder-volume[86668]: DEBUG oslo_concurrency.lockutils [None req-b985f691-4253-4471-b7cb-75a26af5376b None None] Releasing lock "singleton_lock" {{(pid=86668) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jul 10 04:31:21 devstack cinder-volume[86668]: WARNING amqp [None req-b985f691-4253-4471-b7cb-75a26af5376b None None] Received method (60, 30) during closing channel 1. This method will be ignored Jul 10 04:31:21 devstack cinder-volume[86668]: WARNING amqp [None req-b985f691-4253-4471-b7cb-75a26af5376b None None] Received method (60, 30) during closing channel 1. This method will be ignored Jul 10 04:31:24 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=87165) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jul 10 04:31:24 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=87165) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jul 10 04:31:24 devstack cinder-volume[87165]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=87165) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jul 10 04:31:25 devstack cinder-volume[87165]: INFO dbcounter [None req-859d054a-5877-44b3-aec7-21a6428470c7 None None] Registered counter for database cinder Jul 10 04:31:25 devstack cinder-volume[87165]: DEBUG oslo_db.sqlalchemy.engines [None req-859d054a-5877-44b3-aec7-21a6428470c7 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=87165) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 10 04:31:25 devstack cinder-volume[87165]: DEBUG dbcounter [-] [87165] Writer thread running {{(pid=87165) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Jul 10 04:31:25 devstack cinder-volume[87165]: INFO cinder.rpc [None req-859d054a-5877-44b3-aec7-21a6428470c7 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Jul 10 04:31:25 devstack cinder-volume[87165]: INFO cinder.rpc [None req-859d054a-5877-44b3-aec7-21a6428470c7 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Jul 10 04:31:25 devstack cinder-volume[87165]: DEBUG oslo_db.sqlalchemy.engines [None req-859d054a-5877-44b3-aec7-21a6428470c7 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=87165) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 10 04:31:25 devstack cinder-volume[87165]: INFO cinder.volume.manager [None req-859d054a-5877-44b3-aec7-21a6428470c7 None None] Determined volume DB was empty at startup. Jul 10 04:31:25 devstack cinder-volume[87165]: DEBUG cinder.volume.manager [None req-859d054a-5877-44b3-aec7-21a6428470c7 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=87165) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}} Jul 10 04:31:25 devstack cinder-volume[87165]: WARNING stevedore.named [None req-859d054a-5877-44b3-aec7-21a6428470c7 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Jul 10 04:31:25 devstack cinder-volume[87165]: WARNING castellan.key_manager [None req-859d054a-5877-44b3-aec7-21a6428470c7 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jul 10 04:31:25 devstack cinder-volume[87165]: WARNING cinder.keymgr.conf_key_mgr [None req-859d054a-5877-44b3-aec7-21a6428470c7 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jul 10 04:31:25 devstack cinder-volume[87165]: INFO cinder.volume.manager [None req-859d054a-5877-44b3-aec7-21a6428470c7 None None] Image-volume cache disabled for host devstack@QuobyteHD. Jul 10 04:31:25 devstack cinder-volume[87165]: DEBUG oslo_db.sqlalchemy.engines [None req-859d054a-5877-44b3-aec7-21a6428470c7 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=87165) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 10 04:31:25 devstack cinder-volume[87165]: INFO oslo_service.backend._eventlet.service [None req-859d054a-5877-44b3-aec7-21a6428470c7 None None] Starting 1 workers Jul 10 04:31:25 devstack cinder-volume[87165]: DEBUG oslo_service.backend._eventlet.service [None req-859d054a-5877-44b3-aec7-21a6428470c7 None None] Started child 87444 {{(pid=87165) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Jul 10 04:31:25 devstack cinder-volume[87165]: DEBUG oslo_service.backend._eventlet.service [None req-859d054a-5877-44b3-aec7-21a6428470c7 None None] Full set of CONF: {{(pid=87165) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Jul 10 04:31:25 devstack cinder-volume[87165]: DEBUG oslo_service.backend._eventlet.service [None req-859d054a-5877-44b3-aec7-21a6428470c7 None None] ******************************************************************************** {{(pid=87165) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3226}} Jul 10 04:31:25 devstack cinder-volume[87165]: DEBUG oslo_service.backend._eventlet.service [None req-859d054a-5877-44b3-aec7-21a6428470c7 None None] Configuration options gathered from: {{(pid=87165) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3227}} Jul 10 04:31:25 devstack cinder-volume[87165]: DEBUG oslo_service.backend._eventlet.service [None req-859d054a-5877-44b3-aec7-21a6428470c7 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=87165) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3228}} Jul 10 04:31:25 devstack cinder-volume[87165]: DEBUG oslo_service.backend._eventlet.service [None req-859d054a-5877-44b3-aec7-21a6428470c7 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=87165) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3229}} Jul 10 04:31:25 devstack cinder-volume[87165]: DEBUG oslo_service.backend._eventlet.service [None req-859d054a-5877-44b3-aec7-21a6428470c7 None None] ================================================================================ {{(pid=87165) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3234}} Jul 10 04:31:25 devstack cinder-volume[87165]: DEBUG oslo_service.backend._eventlet.service [None req-859d054a-5877-44b3-aec7-21a6428470c7 None None] allow_availability_zone_fallback = False {{(pid=87165) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 04:31:25 devstack cinder-volume[87165]: DEBUG oslo_service.backend._eventlet.service [None req-859d054a-5877-44b3-aec7-21a6428470c7 None None] allow_compression_on_image_upload = False {{(pid=87165) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 04:31:25 devstack cinder-volume[87165]: DEBUG oslo_service.backend._eventlet.service [None req-859d054a-5877-44b3-aec7-21a6428470c7 None None] allowed_direct_url_schemes = [] {{(pid=87165) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 04:31:25 devstack cinder-volume[87165]: DEBUG oslo_service.backend._eventlet.service [None req-859d054a-5877-44b3-aec7-21a6428470c7 None None] api_rate_limit = True {{(pid=87165) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 04:31:25 devstack cinder-volume[87165]: DEBUG oslo_service.backend._eventlet.service [None req-859d054a-5877-44b3-aec7-21a6428470c7 None None] auth_strategy = keystone {{(pid=87165) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 04:31:25 devstack cinder-volume[87165]: DEBUG oslo_service.backend._eventlet.service [None req-859d054a-5877-44b3-aec7-21a6428470c7 None None] backend_availability_zone = None {{(pid=87165) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 04:31:25 devstack cinder-volume[87165]: DEBUG oslo_service.backend._eventlet.service [None req-859d054a-5877-44b3-aec7-21a6428470c7 None None] backend_host = None {{(pid=87165) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 04:31:25 devstack cinder-volume[87165]: DEBUG oslo_service.backend._eventlet.service [None req-859d054a-5877-44b3-aec7-21a6428470c7 None None] backend_name = None {{(pid=87165) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 04:31:25 devstack cinder-volume[87444]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0) Jul 10 04:31:25 devstack cinder-volume[87165]: DEBUG oslo_service.backend._eventlet.service [None req-859d054a-5877-44b3-aec7-21a6428470c7 None None] backend_stats_polling_interval = 60 {{(pid=87165) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 04:31:25 devstack cinder-volume[87165]: DEBUG oslo_service.backend._eventlet.service [None req-859d054a-5877-44b3-aec7-21a6428470c7 None None] backup_api_class = cinder.backup.api.API {{(pid=87165) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 04:31:25 devstack cinder-volume[87165]: DEBUG oslo_service.backend._eventlet.service [None req-859d054a-5877-44b3-aec7-21a6428470c7 None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=87165) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 04:31:25 devstack cinder-volume[87165]: DEBUG oslo_service.backend._eventlet.service [None req-859d054a-5877-44b3-aec7-21a6428470c7 None None] backup_name_template = backup-%s {{(pid=87165) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 04:31:25 devstack cinder-volume[87165]: DEBUG oslo_service.backend._eventlet.service [None req-859d054a-5877-44b3-aec7-21a6428470c7 None None] backup_use_same_host = False {{(pid=87165) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 04:31:25 devstack cinder-volume[87165]: DEBUG oslo_service.backend._eventlet.service [None req-859d054a-5877-44b3-aec7-21a6428470c7 None None] backup_use_temp_snapshot = False {{(pid=87165) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 04:31:25 devstack cinder-volume[87165]: DEBUG oslo_service.backend._eventlet.service [None req-859d054a-5877-44b3-aec7-21a6428470c7 None None] chap_password = **** {{(pid=87165) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 04:31:25 devstack cinder-volume[87165]: DEBUG oslo_service.backend._eventlet.service [None req-859d054a-5877-44b3-aec7-21a6428470c7 None None] chap_username = {{(pid=87165) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 04:31:25 devstack cinder-volume[87165]: DEBUG oslo_service.backend._eventlet.service [None req-859d054a-5877-44b3-aec7-21a6428470c7 None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=87165) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 04:31:25 devstack cinder-volume[87165]: DEBUG oslo_service.backend._eventlet.service [None req-859d054a-5877-44b3-aec7-21a6428470c7 None None] cinder_internal_tenant_project_id = b0a783484f594c9ab0b54e5c67f9920d {{(pid=87165) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 04:31:25 devstack cinder-volume[87165]: DEBUG oslo_service.backend._eventlet.service [None req-859d054a-5877-44b3-aec7-21a6428470c7 None None] cinder_internal_tenant_user_id = 6eec03a607de4ca6b3826ac80077e53f {{(pid=87165) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 04:31:25 devstack cinder-volume[87165]: DEBUG oslo_service.backend._eventlet.service [None req-859d054a-5877-44b3-aec7-21a6428470c7 None None] cluster = None {{(pid=87165) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 04:31:25 devstack cinder-volume[87165]: DEBUG oslo_service.backend._eventlet.service [None req-859d054a-5877-44b3-aec7-21a6428470c7 None None] compression_format = gzip {{(pid=87165) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 04:31:25 devstack cinder-volume[87165]: DEBUG oslo_service.backend._eventlet.service [None req-859d054a-5877-44b3-aec7-21a6428470c7 None None] compute_api_class = cinder.compute.nova.API {{(pid=87165) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 04:31:25 devstack cinder-volume[87165]: DEBUG oslo_service.backend._eventlet.service [None req-859d054a-5877-44b3-aec7-21a6428470c7 None None] config_dir = [] {{(pid=87165) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 04:31:25 devstack cinder-volume[87165]: DEBUG oslo_service.backend._eventlet.service [None req-859d054a-5877-44b3-aec7-21a6428470c7 None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=87165) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 04:31:25 devstack cinder-volume[87165]: DEBUG oslo_service.backend._eventlet.service [None req-859d054a-5877-44b3-aec7-21a6428470c7 None None] config_source = [] {{(pid=87165) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 04:31:25 devstack cinder-volume[87165]: DEBUG oslo_service.backend._eventlet.service [None req-859d054a-5877-44b3-aec7-21a6428470c7 None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=87165) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 04:31:25 devstack cinder-volume[87165]: DEBUG oslo_service.backend._eventlet.service [None req-859d054a-5877-44b3-aec7-21a6428470c7 None None] control_exchange = openstack {{(pid=87165) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 04:31:25 devstack cinder-volume[87165]: DEBUG oslo_service.backend._eventlet.service [None req-859d054a-5877-44b3-aec7-21a6428470c7 None None] debug = True {{(pid=87165) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 04:31:25 devstack cinder-volume[87165]: DEBUG oslo_service.backend._eventlet.service [None req-859d054a-5877-44b3-aec7-21a6428470c7 None None] default_availability_zone = None {{(pid=87165) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 04:31:25 devstack cinder-volume[87165]: DEBUG oslo_service.backend._eventlet.service [None req-859d054a-5877-44b3-aec7-21a6428470c7 None None] default_group_type = None {{(pid=87165) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 04:31:25 devstack cinder-volume[87165]: DEBUG oslo_service.backend._eventlet.service [None req-859d054a-5877-44b3-aec7-21a6428470c7 None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=87165) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 04:31:25 devstack cinder-volume[87165]: DEBUG oslo_service.backend._eventlet.service [None req-859d054a-5877-44b3-aec7-21a6428470c7 None None] default_volume_type = QuobyteHD {{(pid=87165) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 04:31:25 devstack cinder-volume[87165]: DEBUG oslo_service.backend._eventlet.service [None req-859d054a-5877-44b3-aec7-21a6428470c7 None None] disk_geometry = None {{(pid=87165) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 04:31:25 devstack cinder-volume[87165]: DEBUG oslo_service.backend._eventlet.service [None req-859d054a-5877-44b3-aec7-21a6428470c7 None None] driver_client_cert = None {{(pid=87165) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 04:31:25 devstack cinder-volume[87165]: DEBUG oslo_service.backend._eventlet.service [None req-859d054a-5877-44b3-aec7-21a6428470c7 None None] driver_client_cert_key = None {{(pid=87165) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 04:31:25 devstack cinder-volume[87165]: DEBUG oslo_service.backend._eventlet.service [None req-859d054a-5877-44b3-aec7-21a6428470c7 None None] driver_data_namespace = None {{(pid=87165) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 04:31:25 devstack cinder-volume[87165]: DEBUG oslo_service.backend._eventlet.service [None req-859d054a-5877-44b3-aec7-21a6428470c7 None None] driver_ssl_cert_path = None {{(pid=87165) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 04:31:25 devstack cinder-volume[87165]: DEBUG oslo_service.backend._eventlet.service [None req-859d054a-5877-44b3-aec7-21a6428470c7 None None] driver_ssl_cert_verify = False {{(pid=87165) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 04:31:25 devstack cinder-volume[87165]: DEBUG oslo_service.backend._eventlet.service [None req-859d054a-5877-44b3-aec7-21a6428470c7 None None] driver_use_ssl = False {{(pid=87165) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 04:31:25 devstack cinder-volume[87165]: DEBUG oslo_service.backend._eventlet.service [None req-859d054a-5877-44b3-aec7-21a6428470c7 None None] enable_new_services = True {{(pid=87165) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 04:31:25 devstack cinder-volume[87165]: DEBUG oslo_service.backend._eventlet.service [None req-859d054a-5877-44b3-aec7-21a6428470c7 None None] enable_unsupported_driver = False {{(pid=87165) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 04:31:25 devstack cinder-volume[87165]: DEBUG oslo_service.backend._eventlet.service [None req-859d054a-5877-44b3-aec7-21a6428470c7 None None] enabled_backends = ['QuobyteHD'] {{(pid=87165) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 04:31:25 devstack cinder-volume[87165]: DEBUG oslo_service.backend._eventlet.service [None req-859d054a-5877-44b3-aec7-21a6428470c7 None None] enforce_multipath_for_image_xfer = False {{(pid=87165) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 04:31:25 devstack cinder-volume[87165]: DEBUG oslo_service.backend._eventlet.service [None req-859d054a-5877-44b3-aec7-21a6428470c7 None None] filter_function = None {{(pid=87165) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 04:31:25 devstack cinder-volume[87165]: DEBUG oslo_service.backend._eventlet.service [None req-859d054a-5877-44b3-aec7-21a6428470c7 None None] glance_api_insecure = False {{(pid=87165) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 04:31:25 devstack cinder-volume[87165]: DEBUG oslo_service.backend._eventlet.service [None req-859d054a-5877-44b3-aec7-21a6428470c7 None None] glance_api_servers = ['http://192.168.122.158/image'] {{(pid=87165) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 04:31:25 devstack cinder-volume[87165]: DEBUG oslo_service.backend._eventlet.service [None req-859d054a-5877-44b3-aec7-21a6428470c7 None None] glance_api_ssl_compression = False {{(pid=87165) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 04:31:25 devstack cinder-volume[87165]: DEBUG oslo_service.backend._eventlet.service [None req-859d054a-5877-44b3-aec7-21a6428470c7 None None] glance_ca_certificates_file = None {{(pid=87165) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 04:31:25 devstack cinder-volume[87165]: DEBUG oslo_service.backend._eventlet.service [None req-859d054a-5877-44b3-aec7-21a6428470c7 None None] glance_catalog_info = image:glance:publicURL {{(pid=87165) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 04:31:25 devstack cinder-volume[87165]: DEBUG oslo_service.backend._eventlet.service [None req-859d054a-5877-44b3-aec7-21a6428470c7 None None] glance_certfile = None {{(pid=87165) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 04:31:25 devstack cinder-volume[87165]: DEBUG oslo_service.backend._eventlet.service [None req-859d054a-5877-44b3-aec7-21a6428470c7 None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=87165) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 04:31:25 devstack cinder-volume[87165]: DEBUG oslo_service.backend._eventlet.service [None req-859d054a-5877-44b3-aec7-21a6428470c7 None None] glance_keyfile = None {{(pid=87165) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 04:31:25 devstack cinder-volume[87165]: DEBUG oslo_service.backend._eventlet.service [None req-859d054a-5877-44b3-aec7-21a6428470c7 None None] glance_num_retries = 3 {{(pid=87165) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 04:31:25 devstack cinder-volume[87165]: DEBUG oslo_service.backend._eventlet.service [None req-859d054a-5877-44b3-aec7-21a6428470c7 None None] glance_request_timeout = None {{(pid=87165) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 04:31:25 devstack cinder-volume[87165]: DEBUG oslo_service.backend._eventlet.service [None req-859d054a-5877-44b3-aec7-21a6428470c7 None None] goodness_function = None {{(pid=87165) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 04:31:25 devstack cinder-volume[87165]: DEBUG oslo_service.backend._eventlet.service [None req-859d054a-5877-44b3-aec7-21a6428470c7 None None] graceful_shutdown_timeout = 5 {{(pid=87165) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 04:31:25 devstack cinder-volume[87165]: DEBUG oslo_service.backend._eventlet.service [None req-859d054a-5877-44b3-aec7-21a6428470c7 None None] group_api_class = cinder.group.api.API {{(pid=87165) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 04:31:25 devstack cinder-volume[87165]: DEBUG oslo_service.backend._eventlet.service [None req-859d054a-5877-44b3-aec7-21a6428470c7 None None] host = devstack {{(pid=87165) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 04:31:25 devstack cinder-volume[87165]: DEBUG oslo_service.backend._eventlet.service [None req-859d054a-5877-44b3-aec7-21a6428470c7 None None] image_compress_on_upload = True {{(pid=87165) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 04:31:25 devstack cinder-volume[87165]: DEBUG oslo_service.backend._eventlet.service [None req-859d054a-5877-44b3-aec7-21a6428470c7 None None] image_conversion_address_space_limit = 1 {{(pid=87165) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 04:31:25 devstack cinder-volume[87165]: DEBUG oslo_service.backend._eventlet.service [None req-859d054a-5877-44b3-aec7-21a6428470c7 None None] image_conversion_cpu_limit = 60 {{(pid=87165) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 04:31:25 devstack cinder-volume[87165]: DEBUG oslo_service.backend._eventlet.service [None req-859d054a-5877-44b3-aec7-21a6428470c7 None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=87165) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 04:31:25 devstack cinder-volume[87165]: DEBUG oslo_service.backend._eventlet.service [None req-859d054a-5877-44b3-aec7-21a6428470c7 None None] image_conversion_disable = False {{(pid=87165) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 04:31:25 devstack cinder-volume[87165]: DEBUG oslo_service.backend._eventlet.service [None req-859d054a-5877-44b3-aec7-21a6428470c7 None None] image_upload_use_cinder_backend = False {{(pid=87165) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 04:31:25 devstack cinder-volume[87165]: DEBUG oslo_service.backend._eventlet.service [None req-859d054a-5877-44b3-aec7-21a6428470c7 None None] image_upload_use_internal_tenant = False {{(pid=87165) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 04:31:25 devstack cinder-volume[87165]: DEBUG oslo_service.backend._eventlet.service [None req-859d054a-5877-44b3-aec7-21a6428470c7 None None] image_volume_cache_enabled = False {{(pid=87165) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 04:31:25 devstack cinder-volume[87165]: DEBUG oslo_service.backend._eventlet.service [None req-859d054a-5877-44b3-aec7-21a6428470c7 None None] image_volume_cache_max_count = 0 {{(pid=87165) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 04:31:25 devstack cinder-volume[87165]: DEBUG oslo_service.backend._eventlet.service [None req-859d054a-5877-44b3-aec7-21a6428470c7 None None] image_volume_cache_max_size_gb = 0 {{(pid=87165) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 04:31:25 devstack cinder-volume[87165]: DEBUG oslo_service.backend._eventlet.service [None req-859d054a-5877-44b3-aec7-21a6428470c7 None None] init_host_max_objects_retrieval = 0 {{(pid=87165) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 04:31:25 devstack cinder-volume[87165]: DEBUG oslo_service.backend._eventlet.service [None req-859d054a-5877-44b3-aec7-21a6428470c7 None None] instance_format = [instance: %(uuid)s] {{(pid=87165) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 04:31:25 devstack cinder-volume[87165]: DEBUG oslo_service.backend._eventlet.service [None req-859d054a-5877-44b3-aec7-21a6428470c7 None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=87165) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 04:31:25 devstack cinder-volume[87165]: DEBUG oslo_service.backend._eventlet.service [None req-859d054a-5877-44b3-aec7-21a6428470c7 None None] iscsi_target_flags = {{(pid=87165) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 04:31:25 devstack cinder-volume[87165]: DEBUG oslo_service.backend._eventlet.service [None req-859d054a-5877-44b3-aec7-21a6428470c7 None None] iscsi_write_cache = on {{(pid=87165) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 04:31:25 devstack cinder-volume[87165]: DEBUG oslo_service.backend._eventlet.service [None req-859d054a-5877-44b3-aec7-21a6428470c7 None None] iser_helper = tgtadm {{(pid=87165) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 04:31:25 devstack cinder-volume[87165]: DEBUG oslo_service.backend._eventlet.service [None req-859d054a-5877-44b3-aec7-21a6428470c7 None None] iser_ip_address = 192.168.122.158 {{(pid=87165) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 04:31:25 devstack cinder-volume[87165]: DEBUG oslo_service.backend._eventlet.service [None req-859d054a-5877-44b3-aec7-21a6428470c7 None None] iser_port = 3260 {{(pid=87165) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 04:31:25 devstack cinder-volume[87165]: DEBUG oslo_service.backend._eventlet.service [None req-859d054a-5877-44b3-aec7-21a6428470c7 None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=87165) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 04:31:25 devstack cinder-volume[87165]: DEBUG oslo_service.backend._eventlet.service [None req-859d054a-5877-44b3-aec7-21a6428470c7 None None] log_color = False {{(pid=87165) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 04:31:25 devstack cinder-volume[87165]: DEBUG oslo_service.backend._eventlet.service [None req-859d054a-5877-44b3-aec7-21a6428470c7 None None] log_config_append = None {{(pid=87165) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 04:31:25 devstack cinder-volume[87165]: DEBUG oslo_service.backend._eventlet.service [None req-859d054a-5877-44b3-aec7-21a6428470c7 None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=87165) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 04:31:25 devstack cinder-volume[87165]: DEBUG oslo_service.backend._eventlet.service [None req-859d054a-5877-44b3-aec7-21a6428470c7 None None] log_dir = None {{(pid=87165) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 04:31:25 devstack cinder-volume[87165]: DEBUG oslo_service.backend._eventlet.service [None req-859d054a-5877-44b3-aec7-21a6428470c7 None None] log_file = None {{(pid=87165) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 04:31:25 devstack cinder-volume[87165]: DEBUG oslo_service.backend._eventlet.service [None req-859d054a-5877-44b3-aec7-21a6428470c7 None None] log_options = True {{(pid=87165) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 04:31:25 devstack cinder-volume[87165]: DEBUG oslo_service.backend._eventlet.service [None req-859d054a-5877-44b3-aec7-21a6428470c7 None None] log_rotate_interval = 1 {{(pid=87165) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 04:31:25 devstack cinder-volume[87165]: DEBUG oslo_service.backend._eventlet.service [None req-859d054a-5877-44b3-aec7-21a6428470c7 None None] log_rotate_interval_type = days {{(pid=87165) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 04:31:25 devstack cinder-volume[87165]: DEBUG oslo_service.backend._eventlet.service [None req-859d054a-5877-44b3-aec7-21a6428470c7 None None] log_rotation_type = none {{(pid=87165) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 04:31:25 devstack cinder-volume[87165]: DEBUG oslo_service.backend._eventlet.service [None req-859d054a-5877-44b3-aec7-21a6428470c7 None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=87165) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 04:31:25 devstack cinder-volume[87165]: DEBUG oslo_service.backend._eventlet.service [None req-859d054a-5877-44b3-aec7-21a6428470c7 None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=87165) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 04:31:25 devstack cinder-volume[87165]: DEBUG oslo_service.backend._eventlet.service [None req-859d054a-5877-44b3-aec7-21a6428470c7 None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=87165) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 04:31:25 devstack cinder-volume[87165]: DEBUG oslo_service.backend._eventlet.service [None req-859d054a-5877-44b3-aec7-21a6428470c7 None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=87165) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 04:31:25 devstack cinder-volume[87165]: DEBUG oslo_service.backend._eventlet.service [None req-859d054a-5877-44b3-aec7-21a6428470c7 None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=87165) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 04:31:25 devstack cinder-volume[87165]: DEBUG oslo_service.backend._eventlet.service [None req-859d054a-5877-44b3-aec7-21a6428470c7 None None] max_age = 0 {{(pid=87165) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 04:31:25 devstack cinder-volume[87165]: DEBUG oslo_service.backend._eventlet.service [None req-859d054a-5877-44b3-aec7-21a6428470c7 None None] max_logfile_count = 30 {{(pid=87165) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 04:31:25 devstack cinder-volume[87165]: DEBUG oslo_service.backend._eventlet.service [None req-859d054a-5877-44b3-aec7-21a6428470c7 None None] max_logfile_size_mb = 200 {{(pid=87165) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 04:31:25 devstack cinder-volume[87444]: INFO cinder.volume.manager [None req-8761a723-6bfb-4b97-a08c-d6fecf05879e None None] Starting volume driver QuobyteDriver (1.1.14) Jul 10 04:31:25 devstack cinder-volume[87165]: DEBUG oslo_service.backend._eventlet.service [None req-859d054a-5877-44b3-aec7-21a6428470c7 None None] max_over_subscription_ratio = 20.0 {{(pid=87165) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 04:31:25 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.remotefs [None req-8761a723-6bfb-4b97-a08c-d6fecf05879e None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=87444) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}} Jul 10 04:31:25 devstack cinder-volume[87165]: DEBUG oslo_service.backend._eventlet.service [None req-859d054a-5877-44b3-aec7-21a6428470c7 None None] message_reap_interval = 86400 {{(pid=87165) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 04:31:25 devstack cinder-volume[87165]: DEBUG oslo_service.backend._eventlet.service [None req-859d054a-5877-44b3-aec7-21a6428470c7 None None] message_ttl = 2592000 {{(pid=87165) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 04:31:25 devstack cinder-volume[87165]: DEBUG oslo_service.backend._eventlet.service [None req-859d054a-5877-44b3-aec7-21a6428470c7 None None] migration_create_volume_timeout_secs = 300 {{(pid=87165) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 04:31:25 devstack cinder-volume[87165]: DEBUG oslo_service.backend._eventlet.service [None req-859d054a-5877-44b3-aec7-21a6428470c7 None None] monkey_patch = False {{(pid=87165) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 04:31:25 devstack cinder-volume[87165]: DEBUG oslo_service.backend._eventlet.service [None req-859d054a-5877-44b3-aec7-21a6428470c7 None None] monkey_patch_modules = [] {{(pid=87165) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 04:31:25 devstack cinder-volume[87165]: DEBUG oslo_service.backend._eventlet.service [None req-859d054a-5877-44b3-aec7-21a6428470c7 None None] my_ip = 192.168.122.158 {{(pid=87165) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 04:31:25 devstack cinder-volume[87165]: DEBUG oslo_service.backend._eventlet.service [None req-859d054a-5877-44b3-aec7-21a6428470c7 None None] no_snapshot_gb_quota = False {{(pid=87165) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 04:31:25 devstack cinder-volume[87165]: DEBUG oslo_service.backend._eventlet.service [None req-859d054a-5877-44b3-aec7-21a6428470c7 None None] num_iser_scan_tries = 3 {{(pid=87165) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 04:31:25 devstack cinder-volume[87165]: DEBUG oslo_service.backend._eventlet.service [None req-859d054a-5877-44b3-aec7-21a6428470c7 None None] num_shell_tries = 3 {{(pid=87165) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 04:31:25 devstack cinder-volume[87165]: DEBUG oslo_service.backend._eventlet.service [None req-859d054a-5877-44b3-aec7-21a6428470c7 None None] num_volume_device_scan_tries = 3 {{(pid=87165) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 04:31:25 devstack cinder-volume[87165]: DEBUG oslo_service.backend._eventlet.service [None req-859d054a-5877-44b3-aec7-21a6428470c7 None None] nvmeof_conn_info_version = 1 {{(pid=87165) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 04:31:25 devstack cinder-volume[87165]: DEBUG oslo_service.backend._eventlet.service [None req-859d054a-5877-44b3-aec7-21a6428470c7 None None] nvmet_ns_id = 10 {{(pid=87165) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 04:31:25 devstack cinder-volume[87165]: DEBUG oslo_service.backend._eventlet.service [None req-859d054a-5877-44b3-aec7-21a6428470c7 None None] nvmet_port_id = 1 {{(pid=87165) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 04:31:25 devstack cinder-volume[87165]: DEBUG oslo_service.backend._eventlet.service [None req-859d054a-5877-44b3-aec7-21a6428470c7 None None] osapi_max_limit = 1000 {{(pid=87165) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 04:31:25 devstack cinder-volume[87165]: DEBUG oslo_service.backend._eventlet.service [None req-859d054a-5877-44b3-aec7-21a6428470c7 None None] osapi_volume_ext_list = [] {{(pid=87165) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 04:31:25 devstack cinder-volume[87165]: DEBUG oslo_service.backend._eventlet.service [None req-859d054a-5877-44b3-aec7-21a6428470c7 None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=87165) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 04:31:25 devstack cinder-volume[87165]: DEBUG oslo_service.backend._eventlet.service [None req-859d054a-5877-44b3-aec7-21a6428470c7 None None] osapi_volume_listen = 0.0.0.0 {{(pid=87165) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 04:31:25 devstack cinder-volume[87165]: DEBUG oslo_service.backend._eventlet.service [None req-859d054a-5877-44b3-aec7-21a6428470c7 None None] osapi_volume_listen_port = 8776 {{(pid=87165) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 04:31:25 devstack cinder-volume[87165]: DEBUG oslo_service.backend._eventlet.service [None req-859d054a-5877-44b3-aec7-21a6428470c7 None None] osapi_volume_use_ssl = False {{(pid=87165) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 04:31:25 devstack cinder-volume[87165]: DEBUG oslo_service.backend._eventlet.service [None req-859d054a-5877-44b3-aec7-21a6428470c7 None None] osapi_volume_workers = None {{(pid=87165) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 04:31:25 devstack cinder-volume[87165]: DEBUG oslo_service.backend._eventlet.service [None req-859d054a-5877-44b3-aec7-21a6428470c7 None None] per_volume_size_limit = -1 {{(pid=87165) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 04:31:25 devstack cinder-volume[87165]: DEBUG oslo_service.backend._eventlet.service [None req-859d054a-5877-44b3-aec7-21a6428470c7 None None] periodic_fuzzy_delay = 60 {{(pid=87165) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 04:31:25 devstack cinder-volume[87165]: DEBUG oslo_service.backend._eventlet.service [None req-859d054a-5877-44b3-aec7-21a6428470c7 None None] periodic_interval = 60 {{(pid=87165) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 04:31:25 devstack cinder-volume[87165]: DEBUG oslo_service.backend._eventlet.service [None req-859d054a-5877-44b3-aec7-21a6428470c7 None None] project_id_regex = [0-9a-f\-]+ {{(pid=87165) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 04:31:25 devstack cinder-volume[87165]: DEBUG oslo_service.backend._eventlet.service [None req-859d054a-5877-44b3-aec7-21a6428470c7 None None] public_endpoint = None {{(pid=87165) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 04:31:25 devstack cinder-volume[87165]: DEBUG oslo_service.backend._eventlet.service [None req-859d054a-5877-44b3-aec7-21a6428470c7 None None] publish_errors = False {{(pid=87165) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 04:31:25 devstack cinder-volume[87165]: DEBUG oslo_service.backend._eventlet.service [None req-859d054a-5877-44b3-aec7-21a6428470c7 None None] quota_backup_gigabytes = 1000 {{(pid=87165) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 04:31:25 devstack cinder-volume[87165]: DEBUG oslo_service.backend._eventlet.service [None req-859d054a-5877-44b3-aec7-21a6428470c7 None None] quota_backups = 10 {{(pid=87165) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 04:31:25 devstack cinder-volume[87165]: DEBUG oslo_service.backend._eventlet.service [None req-859d054a-5877-44b3-aec7-21a6428470c7 None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=87165) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 04:31:25 devstack cinder-volume[87165]: DEBUG oslo_service.backend._eventlet.service [None req-859d054a-5877-44b3-aec7-21a6428470c7 None None] quota_gigabytes = 1000 {{(pid=87165) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 04:31:25 devstack cinder-volume[87165]: DEBUG oslo_service.backend._eventlet.service [None req-859d054a-5877-44b3-aec7-21a6428470c7 None None] quota_groups = 10 {{(pid=87165) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 04:31:25 devstack cinder-volume[87165]: DEBUG oslo_service.backend._eventlet.service [None req-859d054a-5877-44b3-aec7-21a6428470c7 None None] quota_snapshots = 10 {{(pid=87165) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 04:31:25 devstack cinder-volume[87165]: DEBUG oslo_service.backend._eventlet.service [None req-859d054a-5877-44b3-aec7-21a6428470c7 None None] quota_volumes = 10 {{(pid=87165) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 04:31:25 devstack cinder-volume[87165]: DEBUG oslo_service.backend._eventlet.service [None req-859d054a-5877-44b3-aec7-21a6428470c7 None None] rate_limit_burst = 0 {{(pid=87165) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 04:31:25 devstack cinder-volume[87165]: DEBUG oslo_service.backend._eventlet.service [None req-859d054a-5877-44b3-aec7-21a6428470c7 None None] rate_limit_except_level = CRITICAL {{(pid=87165) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 04:31:25 devstack cinder-volume[87165]: DEBUG oslo_service.backend._eventlet.service [None req-859d054a-5877-44b3-aec7-21a6428470c7 None None] rate_limit_interval = 0 {{(pid=87165) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 04:31:25 devstack cinder-volume[87165]: DEBUG oslo_service.backend._eventlet.service [None req-859d054a-5877-44b3-aec7-21a6428470c7 None None] reinit_driver_count = 3 {{(pid=87165) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 04:31:25 devstack cinder-volume[87165]: DEBUG oslo_service.backend._eventlet.service [None req-859d054a-5877-44b3-aec7-21a6428470c7 None None] replication_device = **** {{(pid=87165) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 04:31:25 devstack cinder-volume[87165]: DEBUG oslo_service.backend._eventlet.service [None req-859d054a-5877-44b3-aec7-21a6428470c7 None None] report_discard_supported = False {{(pid=87165) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 04:31:25 devstack cinder-volume[87165]: DEBUG oslo_service.backend._eventlet.service [None req-859d054a-5877-44b3-aec7-21a6428470c7 None None] report_interval = 120 {{(pid=87165) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 04:31:25 devstack cinder-volume[87165]: DEBUG oslo_service.backend._eventlet.service [None req-859d054a-5877-44b3-aec7-21a6428470c7 None None] reservation_clean_interval = 86400 {{(pid=87165) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 04:31:25 devstack cinder-volume[87165]: DEBUG oslo_service.backend._eventlet.service [None req-859d054a-5877-44b3-aec7-21a6428470c7 None None] reservation_expire = 86400 {{(pid=87165) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 04:31:25 devstack cinder-volume[87165]: DEBUG oslo_service.backend._eventlet.service [None req-859d054a-5877-44b3-aec7-21a6428470c7 None None] reserved_image_namespaces = [] {{(pid=87165) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 04:31:25 devstack cinder-volume[87165]: DEBUG oslo_service.backend._eventlet.service [None req-859d054a-5877-44b3-aec7-21a6428470c7 None None] reserved_percentage = 0 {{(pid=87165) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 04:31:25 devstack cinder-volume[87165]: DEBUG oslo_service.backend._eventlet.service [None req-859d054a-5877-44b3-aec7-21a6428470c7 None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=87165) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 04:31:25 devstack cinder-volume[87165]: DEBUG oslo_service.backend._eventlet.service [None req-859d054a-5877-44b3-aec7-21a6428470c7 None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=87165) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 04:31:25 devstack cinder-volume[87165]: DEBUG oslo_service.backend._eventlet.service [None req-859d054a-5877-44b3-aec7-21a6428470c7 None None] rpc_response_timeout = 120 {{(pid=87165) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 04:31:25 devstack cinder-volume[87165]: DEBUG oslo_service.backend._eventlet.service [None req-859d054a-5877-44b3-aec7-21a6428470c7 None None] run_external_periodic_tasks = True {{(pid=87165) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 04:31:25 devstack cinder-volume[87165]: DEBUG oslo_service.backend._eventlet.service [None req-859d054a-5877-44b3-aec7-21a6428470c7 None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=87165) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 04:31:25 devstack cinder-volume[87165]: DEBUG oslo_service.backend._eventlet.service [None req-859d054a-5877-44b3-aec7-21a6428470c7 None None] scst_target_driver = iscsi {{(pid=87165) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 04:31:25 devstack cinder-volume[87165]: DEBUG oslo_service.backend._eventlet.service [None req-859d054a-5877-44b3-aec7-21a6428470c7 None None] scst_target_iqn_name = None {{(pid=87165) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 04:31:25 devstack cinder-volume[87165]: DEBUG oslo_service.backend._eventlet.service [None req-859d054a-5877-44b3-aec7-21a6428470c7 None None] service_down_time = 720 {{(pid=87165) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 04:31:25 devstack cinder-volume[87165]: DEBUG oslo_service.backend._eventlet.service [None req-859d054a-5877-44b3-aec7-21a6428470c7 None None] shell_completion = None {{(pid=87165) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 04:31:25 devstack cinder-volume[87165]: DEBUG oslo_service.backend._eventlet.service [None req-859d054a-5877-44b3-aec7-21a6428470c7 None None] snapshot_name_template = snapshot-%s {{(pid=87165) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 04:31:25 devstack cinder-volume[87165]: DEBUG oslo_service.backend._eventlet.service [None req-859d054a-5877-44b3-aec7-21a6428470c7 None None] split_loggers = False {{(pid=87165) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 04:31:25 devstack cinder-volume[87165]: DEBUG oslo_service.backend._eventlet.service [None req-859d054a-5877-44b3-aec7-21a6428470c7 None None] state_path = /opt/stack/data/cinder {{(pid=87165) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 04:31:25 devstack cinder-volume[87165]: DEBUG oslo_service.backend._eventlet.service [None req-859d054a-5877-44b3-aec7-21a6428470c7 None None] storage_availability_zone = nova {{(pid=87165) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 04:31:25 devstack cinder-volume[87165]: DEBUG oslo_service.backend._eventlet.service [None req-859d054a-5877-44b3-aec7-21a6428470c7 None None] storage_protocol = iSCSI {{(pid=87165) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 04:31:25 devstack cinder-volume[87165]: DEBUG oslo_service.backend._eventlet.service [None req-859d054a-5877-44b3-aec7-21a6428470c7 None None] syslog_log_facility = LOG_USER {{(pid=87165) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 04:31:25 devstack cinder-volume[87165]: DEBUG oslo_service.backend._eventlet.service [None req-859d054a-5877-44b3-aec7-21a6428470c7 None None] target_helper = lioadm {{(pid=87165) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 04:31:25 devstack cinder-volume[87165]: DEBUG oslo_service.backend._eventlet.service [None req-859d054a-5877-44b3-aec7-21a6428470c7 None None] target_ip_address = 192.168.122.158 {{(pid=87165) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 04:31:25 devstack cinder-volume[87165]: DEBUG oslo_service.backend._eventlet.service [None req-859d054a-5877-44b3-aec7-21a6428470c7 None None] target_port = 3260 {{(pid=87165) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 04:31:25 devstack cinder-volume[87165]: DEBUG oslo_service.backend._eventlet.service [None req-859d054a-5877-44b3-aec7-21a6428470c7 None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=87165) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 04:31:25 devstack cinder-volume[87165]: DEBUG oslo_service.backend._eventlet.service [None req-859d054a-5877-44b3-aec7-21a6428470c7 None None] target_protocol = iscsi {{(pid=87165) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 04:31:25 devstack cinder-volume[87165]: DEBUG oslo_service.backend._eventlet.service [None req-859d054a-5877-44b3-aec7-21a6428470c7 None None] target_secondary_ip_addresses = [] {{(pid=87165) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 04:31:25 devstack cinder-volume[87165]: DEBUG oslo_service.backend._eventlet.service [None req-859d054a-5877-44b3-aec7-21a6428470c7 None None] trace_flags = None {{(pid=87165) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 04:31:25 devstack cinder-volume[87165]: DEBUG oslo_service.backend._eventlet.service [None req-859d054a-5877-44b3-aec7-21a6428470c7 None None] transfer_api_class = cinder.transfer.api.API {{(pid=87165) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 04:31:25 devstack cinder-volume[87165]: DEBUG oslo_service.backend._eventlet.service [None req-859d054a-5877-44b3-aec7-21a6428470c7 None None] transport_url = **** {{(pid=87165) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 04:31:25 devstack cinder-volume[87165]: DEBUG oslo_service.backend._eventlet.service [None req-859d054a-5877-44b3-aec7-21a6428470c7 None None] until_refresh = 0 {{(pid=87165) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 04:31:25 devstack cinder-volume[87165]: DEBUG oslo_service.backend._eventlet.service [None req-859d054a-5877-44b3-aec7-21a6428470c7 None None] use_chap_auth = False {{(pid=87165) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 04:31:25 devstack cinder-volume[87165]: DEBUG oslo_service.backend._eventlet.service [None req-859d054a-5877-44b3-aec7-21a6428470c7 None None] use_default_quota_class = True {{(pid=87165) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 04:31:25 devstack cinder-volume[87165]: DEBUG oslo_service.backend._eventlet.service [None req-859d054a-5877-44b3-aec7-21a6428470c7 None None] use_journal = False {{(pid=87165) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 04:31:25 devstack cinder-volume[87165]: DEBUG oslo_service.backend._eventlet.service [None req-859d054a-5877-44b3-aec7-21a6428470c7 None None] use_json = False {{(pid=87165) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 04:31:25 devstack cinder-volume[87165]: DEBUG oslo_service.backend._eventlet.service [None req-859d054a-5877-44b3-aec7-21a6428470c7 None None] use_multipath_for_image_xfer = False {{(pid=87165) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 04:31:25 devstack cinder-volume[87165]: DEBUG oslo_service.backend._eventlet.service [None req-859d054a-5877-44b3-aec7-21a6428470c7 None None] use_stderr = False {{(pid=87165) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 04:31:25 devstack cinder-volume[87165]: DEBUG oslo_service.backend._eventlet.service [None req-859d054a-5877-44b3-aec7-21a6428470c7 None None] use_syslog = False {{(pid=87165) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 04:31:25 devstack cinder-volume[87165]: DEBUG oslo_service.backend._eventlet.service [None req-859d054a-5877-44b3-aec7-21a6428470c7 None None] verify_glance_signatures = enabled {{(pid=87165) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 04:31:25 devstack cinder-volume[87165]: DEBUG oslo_service.backend._eventlet.service [None req-859d054a-5877-44b3-aec7-21a6428470c7 None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=87165) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 04:31:25 devstack cinder-volume[87165]: DEBUG oslo_service.backend._eventlet.service [None req-859d054a-5877-44b3-aec7-21a6428470c7 None None] volume_api_class = cinder.volume.api.API {{(pid=87165) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 04:31:25 devstack cinder-volume[87165]: DEBUG oslo_service.backend._eventlet.service [None req-859d054a-5877-44b3-aec7-21a6428470c7 None None] volume_backend_name = None {{(pid=87165) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 04:31:25 devstack cinder-volume[87165]: DEBUG oslo_service.backend._eventlet.service [None req-859d054a-5877-44b3-aec7-21a6428470c7 None None] volume_clear = zero {{(pid=87165) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 04:31:25 devstack cinder-volume[87165]: DEBUG oslo_service.backend._eventlet.service [None req-859d054a-5877-44b3-aec7-21a6428470c7 None None] volume_clear_ionice = None {{(pid=87165) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 04:31:25 devstack cinder-volume[87165]: DEBUG oslo_service.backend._eventlet.service [None req-859d054a-5877-44b3-aec7-21a6428470c7 None None] volume_clear_size = 0 {{(pid=87165) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 04:31:25 devstack cinder-volume[87165]: DEBUG oslo_service.backend._eventlet.service [None req-859d054a-5877-44b3-aec7-21a6428470c7 None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=87165) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 04:31:25 devstack cinder-volume[87165]: DEBUG oslo_service.backend._eventlet.service [None req-859d054a-5877-44b3-aec7-21a6428470c7 None None] volume_copy_bps_limit = 0 {{(pid=87165) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 04:31:25 devstack cinder-volume[87165]: DEBUG oslo_service.backend._eventlet.service [None req-859d054a-5877-44b3-aec7-21a6428470c7 None None] volume_dd_blocksize = 1M {{(pid=87165) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 04:31:25 devstack cinder-volume[87165]: DEBUG oslo_service.backend._eventlet.service [None req-859d054a-5877-44b3-aec7-21a6428470c7 None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=87165) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 04:31:25 devstack cinder-volume[87165]: DEBUG oslo_service.backend._eventlet.service [None req-859d054a-5877-44b3-aec7-21a6428470c7 None None] volume_name_template = volume-%s {{(pid=87165) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 04:31:25 devstack cinder-volume[87165]: DEBUG oslo_service.backend._eventlet.service [None req-859d054a-5877-44b3-aec7-21a6428470c7 None None] volume_service_inithost_offload = False {{(pid=87165) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 04:31:25 devstack cinder-volume[87165]: DEBUG oslo_service.backend._eventlet.service [None req-859d054a-5877-44b3-aec7-21a6428470c7 None None] volume_usage_audit_period = month {{(pid=87165) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 04:31:25 devstack cinder-volume[87165]: DEBUG oslo_service.backend._eventlet.service [None req-859d054a-5877-44b3-aec7-21a6428470c7 None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=87165) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 04:31:25 devstack cinder-volume[87165]: DEBUG oslo_service.backend._eventlet.service [None req-859d054a-5877-44b3-aec7-21a6428470c7 None None] zoning_mode = None {{(pid=87165) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 10 04:31:25 devstack cinder-volume[87165]: DEBUG oslo_service.backend._eventlet.service [None req-859d054a-5877-44b3-aec7-21a6428470c7 None None] oslo_concurrency.disable_process_locking = False {{(pid=87165) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:25 devstack cinder-volume[87165]: DEBUG oslo_service.backend._eventlet.service [None req-859d054a-5877-44b3-aec7-21a6428470c7 None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=87165) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:25 devstack cinder-volume[87165]: DEBUG oslo_service.backend._eventlet.service [None req-859d054a-5877-44b3-aec7-21a6428470c7 None None] os_brick.lightos_discovery_client_address = localhost {{(pid=87165) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:25 devstack cinder-volume[87165]: DEBUG oslo_service.backend._eventlet.service [None req-859d054a-5877-44b3-aec7-21a6428470c7 None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=87165) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:25 devstack cinder-volume[87165]: DEBUG oslo_service.backend._eventlet.service [None req-859d054a-5877-44b3-aec7-21a6428470c7 None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=87165) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:25 devstack cinder-volume[87165]: DEBUG oslo_service.backend._eventlet.service [None req-859d054a-5877-44b3-aec7-21a6428470c7 None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=87165) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:25 devstack cinder-volume[87165]: DEBUG oslo_service.backend._eventlet.service [None req-859d054a-5877-44b3-aec7-21a6428470c7 None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=87165) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:25 devstack cinder-volume[87165]: DEBUG oslo_service.backend._eventlet.service [None req-859d054a-5877-44b3-aec7-21a6428470c7 None None] os_brick.wait_mpath_device_interval = 1 {{(pid=87165) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:25 devstack cinder-volume[87165]: DEBUG oslo_service.backend._eventlet.service [None req-859d054a-5877-44b3-aec7-21a6428470c7 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=87165) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:25 devstack cinder-volume[87165]: DEBUG oslo_service.backend._eventlet.service [None req-859d054a-5877-44b3-aec7-21a6428470c7 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=87165) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:25 devstack cinder-volume[87165]: DEBUG oslo_service.backend._eventlet.service [None req-859d054a-5877-44b3-aec7-21a6428470c7 None None] keystone_authtoken.auth_section = None {{(pid=87165) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:25 devstack cinder-volume[87165]: DEBUG oslo_service.backend._eventlet.service [None req-859d054a-5877-44b3-aec7-21a6428470c7 None None] keystone_authtoken.auth_type = password {{(pid=87165) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:25 devstack cinder-volume[87165]: DEBUG oslo_service.backend._eventlet.service [None req-859d054a-5877-44b3-aec7-21a6428470c7 None None] keystone_authtoken.auth_version = None {{(pid=87165) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:25 devstack cinder-volume[87165]: DEBUG oslo_service.backend._eventlet.service [None req-859d054a-5877-44b3-aec7-21a6428470c7 None None] keystone_authtoken.cache = None {{(pid=87165) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:25 devstack cinder-volume[87165]: DEBUG oslo_service.backend._eventlet.service [None req-859d054a-5877-44b3-aec7-21a6428470c7 None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=87165) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:25 devstack cinder-volume[87165]: DEBUG oslo_service.backend._eventlet.service [None req-859d054a-5877-44b3-aec7-21a6428470c7 None None] keystone_authtoken.certfile = None {{(pid=87165) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:25 devstack cinder-volume[87165]: DEBUG oslo_service.backend._eventlet.service [None req-859d054a-5877-44b3-aec7-21a6428470c7 None None] keystone_authtoken.delay_auth_decision = False {{(pid=87165) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:25 devstack cinder-volume[87165]: DEBUG oslo_service.backend._eventlet.service [None req-859d054a-5877-44b3-aec7-21a6428470c7 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=87165) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:25 devstack cinder-volume[87165]: DEBUG oslo_service.backend._eventlet.service [None req-859d054a-5877-44b3-aec7-21a6428470c7 None None] keystone_authtoken.http_connect_timeout = None {{(pid=87165) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:25 devstack cinder-volume[87165]: DEBUG oslo_service.backend._eventlet.service [None req-859d054a-5877-44b3-aec7-21a6428470c7 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=87165) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:25 devstack cinder-volume[87165]: DEBUG oslo_service.backend._eventlet.service [None req-859d054a-5877-44b3-aec7-21a6428470c7 None None] keystone_authtoken.include_service_catalog = True {{(pid=87165) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:25 devstack cinder-volume[87165]: DEBUG oslo_service.backend._eventlet.service [None req-859d054a-5877-44b3-aec7-21a6428470c7 None None] keystone_authtoken.insecure = False {{(pid=87165) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:25 devstack cinder-volume[87165]: DEBUG oslo_service.backend._eventlet.service [None req-859d054a-5877-44b3-aec7-21a6428470c7 None None] keystone_authtoken.interface = public {{(pid=87165) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:25 devstack cinder-volume[87165]: DEBUG oslo_service.backend._eventlet.service [None req-859d054a-5877-44b3-aec7-21a6428470c7 None None] keystone_authtoken.keyfile = None {{(pid=87165) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:25 devstack cinder-volume[87165]: DEBUG oslo_service.backend._eventlet.service [None req-859d054a-5877-44b3-aec7-21a6428470c7 None None] keystone_authtoken.memcache_password = {{(pid=87165) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:25 devstack cinder-volume[87165]: DEBUG oslo_service.backend._eventlet.service [None req-859d054a-5877-44b3-aec7-21a6428470c7 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=87165) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:25 devstack cinder-volume[87165]: DEBUG oslo_service.backend._eventlet.service [None req-859d054a-5877-44b3-aec7-21a6428470c7 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=87165) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:25 devstack cinder-volume[87165]: DEBUG oslo_service.backend._eventlet.service [None req-859d054a-5877-44b3-aec7-21a6428470c7 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=87165) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:25 devstack cinder-volume[87165]: DEBUG oslo_service.backend._eventlet.service [None req-859d054a-5877-44b3-aec7-21a6428470c7 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=87165) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:25 devstack cinder-volume[87165]: DEBUG oslo_service.backend._eventlet.service [None req-859d054a-5877-44b3-aec7-21a6428470c7 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=87165) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:25 devstack cinder-volume[87165]: DEBUG oslo_service.backend._eventlet.service [None req-859d054a-5877-44b3-aec7-21a6428470c7 None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=87165) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:25 devstack cinder-volume[87165]: DEBUG oslo_service.backend._eventlet.service [None req-859d054a-5877-44b3-aec7-21a6428470c7 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=87165) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:25 devstack cinder-volume[87165]: DEBUG oslo_service.backend._eventlet.service [None req-859d054a-5877-44b3-aec7-21a6428470c7 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=87165) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:25 devstack cinder-volume[87165]: DEBUG oslo_service.backend._eventlet.service [None req-859d054a-5877-44b3-aec7-21a6428470c7 None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=87165) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:25 devstack cinder-volume[87165]: DEBUG oslo_service.backend._eventlet.service [None req-859d054a-5877-44b3-aec7-21a6428470c7 None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=87165) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:25 devstack cinder-volume[87165]: DEBUG oslo_service.backend._eventlet.service [None req-859d054a-5877-44b3-aec7-21a6428470c7 None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=87165) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:25 devstack cinder-volume[87165]: DEBUG oslo_service.backend._eventlet.service [None req-859d054a-5877-44b3-aec7-21a6428470c7 None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=87165) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:25 devstack cinder-volume[87165]: DEBUG oslo_service.backend._eventlet.service [None req-859d054a-5877-44b3-aec7-21a6428470c7 None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=87165) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:25 devstack cinder-volume[87165]: DEBUG oslo_service.backend._eventlet.service [None req-859d054a-5877-44b3-aec7-21a6428470c7 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=87165) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:25 devstack cinder-volume[87165]: DEBUG oslo_service.backend._eventlet.service [None req-859d054a-5877-44b3-aec7-21a6428470c7 None None] keystone_authtoken.memcache_username = {{(pid=87165) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:25 devstack cinder-volume[87165]: DEBUG oslo_service.backend._eventlet.service [None req-859d054a-5877-44b3-aec7-21a6428470c7 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=87165) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:25 devstack cinder-volume[87165]: DEBUG oslo_service.backend._eventlet.service [None req-859d054a-5877-44b3-aec7-21a6428470c7 None None] keystone_authtoken.region_name = None {{(pid=87165) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:25 devstack cinder-volume[87165]: DEBUG oslo_service.backend._eventlet.service [None req-859d054a-5877-44b3-aec7-21a6428470c7 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=87165) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:25 devstack cinder-volume[87165]: DEBUG oslo_service.backend._eventlet.service [None req-859d054a-5877-44b3-aec7-21a6428470c7 None None] keystone_authtoken.service_token_roles_required = True {{(pid=87165) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:25 devstack cinder-volume[87165]: DEBUG oslo_service.backend._eventlet.service [None req-859d054a-5877-44b3-aec7-21a6428470c7 None None] keystone_authtoken.service_type = None {{(pid=87165) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:25 devstack cinder-volume[87165]: DEBUG oslo_service.backend._eventlet.service [None req-859d054a-5877-44b3-aec7-21a6428470c7 None None] keystone_authtoken.token_cache_time = 300 {{(pid=87165) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:25 devstack cinder-volume[87165]: DEBUG oslo_service.backend._eventlet.service [None req-859d054a-5877-44b3-aec7-21a6428470c7 None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.158/identity {{(pid=87165) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:25 devstack cinder-volume[87165]: DEBUG oslo_service.backend._eventlet.service [None req-859d054a-5877-44b3-aec7-21a6428470c7 None None] cache.backend = dogpile.cache.null {{(pid=87165) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:25 devstack cinder-volume[87165]: DEBUG oslo_service.backend._eventlet.service [None req-859d054a-5877-44b3-aec7-21a6428470c7 None None] cache.backend_argument = **** {{(pid=87165) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:25 devstack cinder-volume[87165]: DEBUG oslo_service.backend._eventlet.service [None req-859d054a-5877-44b3-aec7-21a6428470c7 None None] cache.backend_expiration_time = None {{(pid=87165) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:25 devstack cinder-volume[87165]: DEBUG oslo_service.backend._eventlet.service [None req-859d054a-5877-44b3-aec7-21a6428470c7 None None] cache.config_prefix = cache.oslo {{(pid=87165) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:25 devstack cinder-volume[87165]: DEBUG oslo_service.backend._eventlet.service [None req-859d054a-5877-44b3-aec7-21a6428470c7 None None] cache.debug_cache_backend = False {{(pid=87165) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:25 devstack cinder-volume[87165]: DEBUG oslo_service.backend._eventlet.service [None req-859d054a-5877-44b3-aec7-21a6428470c7 None None] cache.enable_retry_client = False {{(pid=87165) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:25 devstack cinder-volume[87165]: DEBUG oslo_service.backend._eventlet.service [None req-859d054a-5877-44b3-aec7-21a6428470c7 None None] cache.enable_socket_keepalive = False {{(pid=87165) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:25 devstack cinder-volume[87165]: DEBUG oslo_service.backend._eventlet.service [None req-859d054a-5877-44b3-aec7-21a6428470c7 None None] cache.enabled = False {{(pid=87165) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:25 devstack cinder-volume[87165]: DEBUG oslo_service.backend._eventlet.service [None req-859d054a-5877-44b3-aec7-21a6428470c7 None None] cache.expiration_time = 600 {{(pid=87165) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:25 devstack cinder-volume[87165]: DEBUG oslo_service.backend._eventlet.service [None req-859d054a-5877-44b3-aec7-21a6428470c7 None None] cache.hashclient_dead_timeout = 60.0 {{(pid=87165) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:25 devstack cinder-volume[87165]: DEBUG oslo_service.backend._eventlet.service [None req-859d054a-5877-44b3-aec7-21a6428470c7 None None] cache.hashclient_retry_attempts = 2 {{(pid=87165) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:25 devstack cinder-volume[87165]: DEBUG oslo_service.backend._eventlet.service [None req-859d054a-5877-44b3-aec7-21a6428470c7 None None] cache.hashclient_retry_timeout = 1.0 {{(pid=87165) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:25 devstack cinder-volume[87165]: DEBUG oslo_service.backend._eventlet.service [None req-859d054a-5877-44b3-aec7-21a6428470c7 None None] cache.memcache_dead_retry = 300 {{(pid=87165) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:25 devstack cinder-volume[87165]: DEBUG oslo_service.backend._eventlet.service [None req-859d054a-5877-44b3-aec7-21a6428470c7 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=87165) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:25 devstack cinder-volume[87165]: DEBUG oslo_service.backend._eventlet.service [None req-859d054a-5877-44b3-aec7-21a6428470c7 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=87165) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:25 devstack cinder-volume[87165]: DEBUG oslo_service.backend._eventlet.service [None req-859d054a-5877-44b3-aec7-21a6428470c7 None None] cache.memcache_pool_maxsize = 10 {{(pid=87165) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:25 devstack cinder-volume[87165]: DEBUG oslo_service.backend._eventlet.service [None req-859d054a-5877-44b3-aec7-21a6428470c7 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=87165) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:25 devstack cinder-volume[87165]: DEBUG oslo_service.backend._eventlet.service [None req-859d054a-5877-44b3-aec7-21a6428470c7 None None] cache.memcache_sasl_enabled = False {{(pid=87165) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:25 devstack cinder-volume[87165]: DEBUG oslo_service.backend._eventlet.service [None req-859d054a-5877-44b3-aec7-21a6428470c7 None None] cache.memcache_servers = ['localhost:11211'] {{(pid=87165) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:25 devstack cinder-volume[87165]: DEBUG oslo_service.backend._eventlet.service [None req-859d054a-5877-44b3-aec7-21a6428470c7 None None] cache.password = **** {{(pid=87165) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:25 devstack cinder-volume[87165]: DEBUG oslo_service.backend._eventlet.service [None req-859d054a-5877-44b3-aec7-21a6428470c7 None None] cache.proxies = [] {{(pid=87165) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:25 devstack cinder-volume[87165]: DEBUG oslo_service.backend._eventlet.service [None req-859d054a-5877-44b3-aec7-21a6428470c7 None None] cache.redis_db = 0 {{(pid=87165) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:25 devstack cinder-volume[87165]: DEBUG oslo_service.backend._eventlet.service [None req-859d054a-5877-44b3-aec7-21a6428470c7 None None] cache.redis_sentinel_service_name = mymaster {{(pid=87165) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:25 devstack cinder-volume[87165]: DEBUG oslo_service.backend._eventlet.service [None req-859d054a-5877-44b3-aec7-21a6428470c7 None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=87165) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:25 devstack cinder-volume[87165]: DEBUG oslo_service.backend._eventlet.service [None req-859d054a-5877-44b3-aec7-21a6428470c7 None None] cache.redis_server = localhost:6379 {{(pid=87165) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:25 devstack cinder-volume[87165]: DEBUG oslo_service.backend._eventlet.service [None req-859d054a-5877-44b3-aec7-21a6428470c7 None None] cache.retry_attempts = 2 {{(pid=87165) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:25 devstack cinder-volume[87165]: DEBUG oslo_service.backend._eventlet.service [None req-859d054a-5877-44b3-aec7-21a6428470c7 None None] cache.retry_delay = 0.0 {{(pid=87165) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:25 devstack cinder-volume[87165]: DEBUG oslo_service.backend._eventlet.service [None req-859d054a-5877-44b3-aec7-21a6428470c7 None None] cache.socket_keepalive_count = 1 {{(pid=87165) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:25 devstack cinder-volume[87165]: DEBUG oslo_service.backend._eventlet.service [None req-859d054a-5877-44b3-aec7-21a6428470c7 None None] cache.socket_keepalive_idle = 1 {{(pid=87165) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:25 devstack cinder-volume[87165]: DEBUG oslo_service.backend._eventlet.service [None req-859d054a-5877-44b3-aec7-21a6428470c7 None None] cache.socket_keepalive_interval = 1 {{(pid=87165) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:25 devstack cinder-volume[87165]: DEBUG oslo_service.backend._eventlet.service [None req-859d054a-5877-44b3-aec7-21a6428470c7 None None] cache.socket_timeout = 1.0 {{(pid=87165) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:25 devstack cinder-volume[87165]: DEBUG oslo_service.backend._eventlet.service [None req-859d054a-5877-44b3-aec7-21a6428470c7 None None] cache.tls_allowed_ciphers = None {{(pid=87165) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:25 devstack cinder-volume[87165]: DEBUG oslo_service.backend._eventlet.service [None req-859d054a-5877-44b3-aec7-21a6428470c7 None None] cache.tls_cafile = None {{(pid=87165) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:25 devstack cinder-volume[87165]: DEBUG oslo_service.backend._eventlet.service [None req-859d054a-5877-44b3-aec7-21a6428470c7 None None] cache.tls_certfile = None {{(pid=87165) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:25 devstack cinder-volume[87165]: DEBUG oslo_service.backend._eventlet.service [None req-859d054a-5877-44b3-aec7-21a6428470c7 None None] cache.tls_enabled = False {{(pid=87165) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:25 devstack cinder-volume[87165]: DEBUG oslo_service.backend._eventlet.service [None req-859d054a-5877-44b3-aec7-21a6428470c7 None None] cache.tls_keyfile = None {{(pid=87165) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:25 devstack cinder-volume[87165]: DEBUG oslo_service.backend._eventlet.service [None req-859d054a-5877-44b3-aec7-21a6428470c7 None None] cache.username = None {{(pid=87165) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:25 devstack cinder-volume[87165]: DEBUG oslo_service.backend._eventlet.service [None req-859d054a-5877-44b3-aec7-21a6428470c7 None None] coordination.backend_url = **** {{(pid=87165) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:25 devstack cinder-volume[87165]: DEBUG oslo_service.backend._eventlet.service [None req-859d054a-5877-44b3-aec7-21a6428470c7 None None] database.asyncio_connection = **** {{(pid=87165) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:25 devstack cinder-volume[87165]: DEBUG oslo_service.backend._eventlet.service [None req-859d054a-5877-44b3-aec7-21a6428470c7 None None] database.asyncio_slave_connection = **** {{(pid=87165) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:25 devstack cinder-volume[87165]: DEBUG oslo_service.backend._eventlet.service [None req-859d054a-5877-44b3-aec7-21a6428470c7 None None] database.backend = sqlalchemy {{(pid=87165) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:25 devstack cinder-volume[87165]: DEBUG oslo_service.backend._eventlet.service [None req-859d054a-5877-44b3-aec7-21a6428470c7 None None] database.connection = **** {{(pid=87165) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:25 devstack cinder-volume[87165]: DEBUG oslo_service.backend._eventlet.service [None req-859d054a-5877-44b3-aec7-21a6428470c7 None None] database.connection_debug = 0 {{(pid=87165) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:25 devstack cinder-volume[87165]: DEBUG oslo_service.backend._eventlet.service [None req-859d054a-5877-44b3-aec7-21a6428470c7 None None] database.connection_parameters = {{(pid=87165) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:25 devstack cinder-volume[87165]: DEBUG oslo_service.backend._eventlet.service [None req-859d054a-5877-44b3-aec7-21a6428470c7 None None] database.connection_recycle_time = 3600 {{(pid=87165) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:25 devstack cinder-volume[87165]: DEBUG oslo_service.backend._eventlet.service [None req-859d054a-5877-44b3-aec7-21a6428470c7 None None] database.connection_trace = False {{(pid=87165) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:25 devstack cinder-volume[87165]: DEBUG oslo_service.backend._eventlet.service [None req-859d054a-5877-44b3-aec7-21a6428470c7 None None] database.db_inc_retry_interval = True {{(pid=87165) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:25 devstack cinder-volume[87165]: DEBUG oslo_service.backend._eventlet.service [None req-859d054a-5877-44b3-aec7-21a6428470c7 None None] database.db_max_retries = 20 {{(pid=87165) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:25 devstack cinder-volume[87165]: DEBUG oslo_service.backend._eventlet.service [None req-859d054a-5877-44b3-aec7-21a6428470c7 None None] database.db_max_retry_interval = 10 {{(pid=87165) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:25 devstack cinder-volume[87165]: DEBUG oslo_service.backend._eventlet.service [None req-859d054a-5877-44b3-aec7-21a6428470c7 None None] database.db_retry_interval = 1 {{(pid=87165) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:25 devstack cinder-volume[87165]: DEBUG oslo_service.backend._eventlet.service [None req-859d054a-5877-44b3-aec7-21a6428470c7 None None] database.max_overflow = 50 {{(pid=87165) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:25 devstack cinder-volume[87165]: DEBUG oslo_service.backend._eventlet.service [None req-859d054a-5877-44b3-aec7-21a6428470c7 None None] database.max_pool_size = 5 {{(pid=87165) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:25 devstack cinder-volume[87165]: DEBUG oslo_service.backend._eventlet.service [None req-859d054a-5877-44b3-aec7-21a6428470c7 None None] database.max_retries = 10 {{(pid=87165) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:25 devstack cinder-volume[87165]: DEBUG oslo_service.backend._eventlet.service [None req-859d054a-5877-44b3-aec7-21a6428470c7 None None] database.mysql_sql_mode = TRADITIONAL {{(pid=87165) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:25 devstack cinder-volume[87165]: DEBUG oslo_service.backend._eventlet.service [None req-859d054a-5877-44b3-aec7-21a6428470c7 None None] database.mysql_wsrep_sync_wait = None {{(pid=87165) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:25 devstack cinder-volume[87165]: DEBUG oslo_service.backend._eventlet.service [None req-859d054a-5877-44b3-aec7-21a6428470c7 None None] database.pool_timeout = None {{(pid=87165) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:25 devstack cinder-volume[87165]: DEBUG oslo_service.backend._eventlet.service [None req-859d054a-5877-44b3-aec7-21a6428470c7 None None] database.retry_interval = 10 {{(pid=87165) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:25 devstack cinder-volume[87165]: DEBUG oslo_service.backend._eventlet.service [None req-859d054a-5877-44b3-aec7-21a6428470c7 None None] database.slave_connection = **** {{(pid=87165) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:25 devstack cinder-volume[87165]: DEBUG oslo_service.backend._eventlet.service [None req-859d054a-5877-44b3-aec7-21a6428470c7 None None] database.sqlite_synchronous = True {{(pid=87165) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:25 devstack cinder-volume[87165]: DEBUG oslo_service.backend._eventlet.service [None req-859d054a-5877-44b3-aec7-21a6428470c7 None None] database.synchronous_reader = True {{(pid=87165) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:25 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-8761a723-6bfb-4b97-a08c-d6fecf05879e None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=87444) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:305}} Jul 10 04:31:25 devstack cinder-volume[87165]: DEBUG oslo_service.backend._eventlet.service [None req-859d054a-5877-44b3-aec7-21a6428470c7 None None] database.use_db_reconnect = False {{(pid=87165) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:25 devstack cinder-volume[87444]: WARNING cinder.volume.drivers.quobyte [None req-8761a723-6bfb-4b97-a08c-d6fecf05879e None None] The NAS file operations will be run as root, allowing root level access at the storage backend. Jul 10 04:31:25 devstack cinder-volume[87444]: WARNING cinder.volume.drivers.quobyte [None req-8761a723-6bfb-4b97-a08c-d6fecf05879e None None] The NAS file permissions mode will be 666 (allowing other/world read & write access). Jul 10 04:31:25 devstack cinder-volume[87165]: DEBUG oslo_service.backend._eventlet.service [None req-859d054a-5877-44b3-aec7-21a6428470c7 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=87165) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:25 devstack cinder-volume[87165]: DEBUG oslo_service.backend._eventlet.service [None req-859d054a-5877-44b3-aec7-21a6428470c7 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=87165) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:25 devstack cinder-volume[87165]: DEBUG oslo_service.backend._eventlet.service [None req-859d054a-5877-44b3-aec7-21a6428470c7 None None] oslo_messaging_metrics.metrics_process_name = {{(pid=87165) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:25 devstack cinder-volume[87165]: DEBUG oslo_service.backend._eventlet.service [None req-859d054a-5877-44b3-aec7-21a6428470c7 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=87165) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:25 devstack cinder-volume[87165]: DEBUG oslo_service.backend._eventlet.service [None req-859d054a-5877-44b3-aec7-21a6428470c7 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=87165) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:25 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-8761a723-6bfb-4b97-a08c-d6fecf05879e None None] Running cmd (subprocess): mount.quobyte {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:31:25 devstack cinder-volume[87165]: DEBUG oslo_service.backend._eventlet.service [None req-859d054a-5877-44b3-aec7-21a6428470c7 None None] profiler.connection_string = messaging:// {{(pid=87165) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:25 devstack cinder-volume[87165]: DEBUG oslo_service.backend._eventlet.service [None req-859d054a-5877-44b3-aec7-21a6428470c7 None None] profiler.enabled = False {{(pid=87165) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:25 devstack cinder-volume[87165]: DEBUG oslo_service.backend._eventlet.service [None req-859d054a-5877-44b3-aec7-21a6428470c7 None None] profiler.es_doc_type = notification {{(pid=87165) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:25 devstack cinder-volume[87165]: DEBUG oslo_service.backend._eventlet.service [None req-859d054a-5877-44b3-aec7-21a6428470c7 None None] profiler.es_scroll_size = 10000 {{(pid=87165) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:25 devstack cinder-volume[87165]: DEBUG oslo_service.backend._eventlet.service [None req-859d054a-5877-44b3-aec7-21a6428470c7 None None] profiler.es_scroll_time = 2m {{(pid=87165) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:25 devstack cinder-volume[87165]: DEBUG oslo_service.backend._eventlet.service [None req-859d054a-5877-44b3-aec7-21a6428470c7 None None] profiler.filter_error_trace = False {{(pid=87165) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:25 devstack cinder-volume[87165]: DEBUG oslo_service.backend._eventlet.service [None req-859d054a-5877-44b3-aec7-21a6428470c7 None None] profiler.hmac_keys = **** {{(pid=87165) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:25 devstack cinder-volume[87165]: DEBUG oslo_service.backend._eventlet.service [None req-859d054a-5877-44b3-aec7-21a6428470c7 None None] profiler.sentinel_service_name = mymaster {{(pid=87165) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:25 devstack cinder-volume[87165]: DEBUG oslo_service.backend._eventlet.service [None req-859d054a-5877-44b3-aec7-21a6428470c7 None None] profiler.socket_timeout = 0.1 {{(pid=87165) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:25 devstack cinder-volume[87165]: DEBUG oslo_service.backend._eventlet.service [None req-859d054a-5877-44b3-aec7-21a6428470c7 None None] profiler.trace_requests = False {{(pid=87165) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:25 devstack cinder-volume[87165]: DEBUG oslo_service.backend._eventlet.service [None req-859d054a-5877-44b3-aec7-21a6428470c7 None None] profiler.trace_sqlalchemy = False {{(pid=87165) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:25 devstack cinder-volume[87165]: DEBUG oslo_service.backend._eventlet.service [None req-859d054a-5877-44b3-aec7-21a6428470c7 None None] profiler_jaeger.process_tags = {} {{(pid=87165) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:25 devstack cinder-volume[87165]: DEBUG oslo_service.backend._eventlet.service [None req-859d054a-5877-44b3-aec7-21a6428470c7 None None] profiler_jaeger.service_name_prefix = None {{(pid=87165) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:25 devstack cinder-volume[87165]: DEBUG oslo_service.backend._eventlet.service [None req-859d054a-5877-44b3-aec7-21a6428470c7 None None] profiler_otlp.service_name_prefix = None {{(pid=87165) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:25 devstack cinder-volume[87165]: DEBUG oslo_service.backend._eventlet.service [None req-859d054a-5877-44b3-aec7-21a6428470c7 None None] oslo_policy.enforce_new_defaults = True {{(pid=87165) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:25 devstack cinder-volume[87165]: DEBUG oslo_service.backend._eventlet.service [None req-859d054a-5877-44b3-aec7-21a6428470c7 None None] oslo_policy.enforce_scope = False {{(pid=87165) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:25 devstack cinder-volume[87165]: DEBUG oslo_service.backend._eventlet.service [None req-859d054a-5877-44b3-aec7-21a6428470c7 None None] oslo_policy.policy_default_rule = default {{(pid=87165) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:25 devstack cinder-volume[87165]: DEBUG oslo_service.backend._eventlet.service [None req-859d054a-5877-44b3-aec7-21a6428470c7 None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=87165) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:25 devstack cinder-volume[87165]: DEBUG oslo_service.backend._eventlet.service [None req-859d054a-5877-44b3-aec7-21a6428470c7 None None] oslo_policy.policy_file = policy.yaml {{(pid=87165) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:25 devstack cinder-volume[87165]: DEBUG oslo_service.backend._eventlet.service [None req-859d054a-5877-44b3-aec7-21a6428470c7 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=87165) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:25 devstack cinder-volume[87165]: DEBUG oslo_service.backend._eventlet.service [None req-859d054a-5877-44b3-aec7-21a6428470c7 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=87165) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:25 devstack cinder-volume[87165]: DEBUG oslo_service.backend._eventlet.service [None req-859d054a-5877-44b3-aec7-21a6428470c7 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=87165) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:25 devstack cinder-volume[87165]: DEBUG oslo_service.backend._eventlet.service [None req-859d054a-5877-44b3-aec7-21a6428470c7 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=87165) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:25 devstack cinder-volume[87165]: DEBUG oslo_service.backend._eventlet.service [None req-859d054a-5877-44b3-aec7-21a6428470c7 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=87165) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:25 devstack cinder-volume[87165]: DEBUG oslo_service.backend._eventlet.service [None req-859d054a-5877-44b3-aec7-21a6428470c7 None None] oslo_policy.remote_timeout = 60.0 {{(pid=87165) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:25 devstack cinder-volume[87165]: DEBUG oslo_service.backend._eventlet.service [None req-859d054a-5877-44b3-aec7-21a6428470c7 None None] privsep_osbrick.capabilities = [21, 2] {{(pid=87165) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:25 devstack cinder-volume[87165]: DEBUG oslo_service.backend._eventlet.service [None req-859d054a-5877-44b3-aec7-21a6428470c7 None None] privsep_osbrick.group = None {{(pid=87165) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:25 devstack cinder-volume[87165]: DEBUG oslo_service.backend._eventlet.service [None req-859d054a-5877-44b3-aec7-21a6428470c7 None None] privsep_osbrick.helper_command = None {{(pid=87165) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:25 devstack cinder-volume[87165]: DEBUG oslo_service.backend._eventlet.service [None req-859d054a-5877-44b3-aec7-21a6428470c7 None None] privsep_osbrick.log_daemon_traceback = False {{(pid=87165) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:25 devstack cinder-volume[87165]: DEBUG oslo_service.backend._eventlet.service [None req-859d054a-5877-44b3-aec7-21a6428470c7 None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=87165) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:25 devstack cinder-volume[87165]: DEBUG oslo_service.backend._eventlet.service [None req-859d054a-5877-44b3-aec7-21a6428470c7 None None] privsep_osbrick.thread_pool_size = 4 {{(pid=87165) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:25 devstack cinder-volume[87165]: DEBUG oslo_service.backend._eventlet.service [None req-859d054a-5877-44b3-aec7-21a6428470c7 None None] privsep_osbrick.user = None {{(pid=87165) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:25 devstack cinder-volume[87165]: DEBUG oslo_service.backend._eventlet.service [None req-859d054a-5877-44b3-aec7-21a6428470c7 None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=87165) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:25 devstack cinder-volume[87165]: DEBUG oslo_service.backend._eventlet.service [None req-859d054a-5877-44b3-aec7-21a6428470c7 None None] cinder_sys_admin.group = None {{(pid=87165) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:25 devstack cinder-volume[87165]: DEBUG oslo_service.backend._eventlet.service [None req-859d054a-5877-44b3-aec7-21a6428470c7 None None] cinder_sys_admin.helper_command = None {{(pid=87165) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:25 devstack cinder-volume[87165]: DEBUG oslo_service.backend._eventlet.service [None req-859d054a-5877-44b3-aec7-21a6428470c7 None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=87165) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:25 devstack cinder-volume[87165]: DEBUG oslo_service.backend._eventlet.service [None req-859d054a-5877-44b3-aec7-21a6428470c7 None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=87165) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:25 devstack cinder-volume[87165]: DEBUG oslo_service.backend._eventlet.service [None req-859d054a-5877-44b3-aec7-21a6428470c7 None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=87165) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:25 devstack cinder-volume[87165]: DEBUG oslo_service.backend._eventlet.service [None req-859d054a-5877-44b3-aec7-21a6428470c7 None None] cinder_sys_admin.user = None {{(pid=87165) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:25 devstack cinder-volume[87165]: DEBUG oslo_service.backend._eventlet.service [None req-859d054a-5877-44b3-aec7-21a6428470c7 None None] service_user.auth_section = None {{(pid=87165) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:25 devstack cinder-volume[87165]: DEBUG oslo_service.backend._eventlet.service [None req-859d054a-5877-44b3-aec7-21a6428470c7 None None] service_user.auth_type = password {{(pid=87165) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:25 devstack cinder-volume[87165]: DEBUG oslo_service.backend._eventlet.service [None req-859d054a-5877-44b3-aec7-21a6428470c7 None None] service_user.cafile = None {{(pid=87165) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:25 devstack cinder-volume[87165]: DEBUG oslo_service.backend._eventlet.service [None req-859d054a-5877-44b3-aec7-21a6428470c7 None None] service_user.certfile = None {{(pid=87165) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:25 devstack cinder-volume[87165]: DEBUG oslo_service.backend._eventlet.service [None req-859d054a-5877-44b3-aec7-21a6428470c7 None None] service_user.collect_timing = False {{(pid=87165) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:25 devstack cinder-volume[87165]: DEBUG oslo_service.backend._eventlet.service [None req-859d054a-5877-44b3-aec7-21a6428470c7 None None] service_user.insecure = False {{(pid=87165) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:25 devstack cinder-volume[87165]: DEBUG oslo_service.backend._eventlet.service [None req-859d054a-5877-44b3-aec7-21a6428470c7 None None] service_user.keyfile = None {{(pid=87165) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:25 devstack cinder-volume[87165]: DEBUG oslo_service.backend._eventlet.service [None req-859d054a-5877-44b3-aec7-21a6428470c7 None None] service_user.send_service_user_token = True {{(pid=87165) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:25 devstack cinder-volume[87165]: DEBUG oslo_service.backend._eventlet.service [None req-859d054a-5877-44b3-aec7-21a6428470c7 None None] service_user.split_loggers = False {{(pid=87165) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:25 devstack cinder-volume[87165]: DEBUG oslo_service.backend._eventlet.service [None req-859d054a-5877-44b3-aec7-21a6428470c7 None None] service_user.timeout = None {{(pid=87165) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:25 devstack cinder-volume[87165]: DEBUG oslo_service.backend._eventlet.service [None req-859d054a-5877-44b3-aec7-21a6428470c7 None None] glance.auth_section = None {{(pid=87165) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:25 devstack cinder-volume[87165]: DEBUG oslo_service.backend._eventlet.service [None req-859d054a-5877-44b3-aec7-21a6428470c7 None None] glance.auth_type = password {{(pid=87165) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:25 devstack cinder-volume[87165]: DEBUG oslo_service.backend._eventlet.service [None req-859d054a-5877-44b3-aec7-21a6428470c7 None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=87165) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:25 devstack cinder-volume[87165]: DEBUG oslo_service.backend._eventlet.service [None req-859d054a-5877-44b3-aec7-21a6428470c7 None None] glance.certfile = None {{(pid=87165) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:25 devstack cinder-volume[87165]: DEBUG oslo_service.backend._eventlet.service [None req-859d054a-5877-44b3-aec7-21a6428470c7 None None] glance.collect_timing = False {{(pid=87165) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:25 devstack cinder-volume[87165]: DEBUG oslo_service.backend._eventlet.service [None req-859d054a-5877-44b3-aec7-21a6428470c7 None None] glance.insecure = False {{(pid=87165) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:25 devstack cinder-volume[87165]: DEBUG oslo_service.backend._eventlet.service [None req-859d054a-5877-44b3-aec7-21a6428470c7 None None] glance.keyfile = None {{(pid=87165) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:25 devstack cinder-volume[87165]: DEBUG oslo_service.backend._eventlet.service [None req-859d054a-5877-44b3-aec7-21a6428470c7 None None] glance.region_name = None {{(pid=87165) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:25 devstack cinder-volume[87165]: DEBUG oslo_service.backend._eventlet.service [None req-859d054a-5877-44b3-aec7-21a6428470c7 None None] glance.split_loggers = False {{(pid=87165) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:25 devstack cinder-volume[87165]: DEBUG oslo_service.backend._eventlet.service [None req-859d054a-5877-44b3-aec7-21a6428470c7 None None] glance.timeout = None {{(pid=87165) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:25 devstack cinder-volume[87165]: DEBUG oslo_service.backend._eventlet.service [None req-859d054a-5877-44b3-aec7-21a6428470c7 None None] backend_defaults.backend_availability_zone = None {{(pid=87165) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:25 devstack cinder-volume[87165]: DEBUG oslo_service.backend._eventlet.service [None req-859d054a-5877-44b3-aec7-21a6428470c7 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=87165) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:25 devstack cinder-volume[87165]: DEBUG oslo_service.backend._eventlet.service [None req-859d054a-5877-44b3-aec7-21a6428470c7 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=87165) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:25 devstack cinder-volume[87165]: DEBUG oslo_service.backend._eventlet.service [None req-859d054a-5877-44b3-aec7-21a6428470c7 None None] backend_defaults.chap_password = **** {{(pid=87165) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:25 devstack cinder-volume[87165]: DEBUG oslo_service.backend._eventlet.service [None req-859d054a-5877-44b3-aec7-21a6428470c7 None None] backend_defaults.chap_username = {{(pid=87165) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:25 devstack cinder-volume[87165]: DEBUG oslo_service.backend._eventlet.service [None req-859d054a-5877-44b3-aec7-21a6428470c7 None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=87165) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:25 devstack cinder-volume[87165]: DEBUG oslo_service.backend._eventlet.service [None req-859d054a-5877-44b3-aec7-21a6428470c7 None None] backend_defaults.disk_geometry = None {{(pid=87165) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:25 devstack cinder-volume[87165]: DEBUG oslo_service.backend._eventlet.service [None req-859d054a-5877-44b3-aec7-21a6428470c7 None None] backend_defaults.driver_client_cert = None {{(pid=87165) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:25 devstack cinder-volume[87165]: DEBUG oslo_service.backend._eventlet.service [None req-859d054a-5877-44b3-aec7-21a6428470c7 None None] backend_defaults.driver_client_cert_key = None {{(pid=87165) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:25 devstack cinder-volume[87165]: DEBUG oslo_service.backend._eventlet.service [None req-859d054a-5877-44b3-aec7-21a6428470c7 None None] backend_defaults.driver_data_namespace = None {{(pid=87165) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:25 devstack cinder-volume[87165]: DEBUG oslo_service.backend._eventlet.service [None req-859d054a-5877-44b3-aec7-21a6428470c7 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=87165) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:25 devstack cinder-volume[87165]: DEBUG oslo_service.backend._eventlet.service [None req-859d054a-5877-44b3-aec7-21a6428470c7 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=87165) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:25 devstack cinder-volume[87165]: DEBUG oslo_service.backend._eventlet.service [None req-859d054a-5877-44b3-aec7-21a6428470c7 None None] backend_defaults.driver_use_ssl = False {{(pid=87165) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:25 devstack cinder-volume[87165]: DEBUG oslo_service.backend._eventlet.service [None req-859d054a-5877-44b3-aec7-21a6428470c7 None None] backend_defaults.enable_unsupported_driver = False {{(pid=87165) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:25 devstack cinder-volume[87165]: DEBUG oslo_service.backend._eventlet.service [None req-859d054a-5877-44b3-aec7-21a6428470c7 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=87165) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:25 devstack cinder-volume[87165]: DEBUG oslo_service.backend._eventlet.service [None req-859d054a-5877-44b3-aec7-21a6428470c7 None None] backend_defaults.extra_capabilities = {} {{(pid=87165) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:25 devstack cinder-volume[87165]: DEBUG oslo_service.backend._eventlet.service [None req-859d054a-5877-44b3-aec7-21a6428470c7 None None] backend_defaults.filter_function = None {{(pid=87165) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:25 devstack cinder-volume[87165]: DEBUG oslo_service.backend._eventlet.service [None req-859d054a-5877-44b3-aec7-21a6428470c7 None None] backend_defaults.goodness_function = None {{(pid=87165) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:25 devstack cinder-volume[87165]: DEBUG oslo_service.backend._eventlet.service [None req-859d054a-5877-44b3-aec7-21a6428470c7 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=87165) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:25 devstack cinder-volume[87165]: DEBUG oslo_service.backend._eventlet.service [None req-859d054a-5877-44b3-aec7-21a6428470c7 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=87165) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:25 devstack cinder-volume[87165]: DEBUG oslo_service.backend._eventlet.service [None req-859d054a-5877-44b3-aec7-21a6428470c7 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=87165) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:25 devstack cinder-volume[87165]: DEBUG oslo_service.backend._eventlet.service [None req-859d054a-5877-44b3-aec7-21a6428470c7 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=87165) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:25 devstack cinder-volume[87165]: DEBUG oslo_service.backend._eventlet.service [None req-859d054a-5877-44b3-aec7-21a6428470c7 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=87165) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:25 devstack cinder-volume[87165]: DEBUG oslo_service.backend._eventlet.service [None req-859d054a-5877-44b3-aec7-21a6428470c7 None None] backend_defaults.iscsi_target_flags = {{(pid=87165) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:25 devstack cinder-volume[87165]: DEBUG oslo_service.backend._eventlet.service [None req-859d054a-5877-44b3-aec7-21a6428470c7 None None] backend_defaults.iscsi_write_cache = on {{(pid=87165) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:25 devstack cinder-volume[87165]: DEBUG oslo_service.backend._eventlet.service [None req-859d054a-5877-44b3-aec7-21a6428470c7 None None] backend_defaults.iser_helper = tgtadm {{(pid=87165) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:25 devstack cinder-volume[87165]: DEBUG oslo_service.backend._eventlet.service [None req-859d054a-5877-44b3-aec7-21a6428470c7 None None] backend_defaults.iser_ip_address = 192.168.122.158 {{(pid=87165) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:25 devstack cinder-volume[87165]: DEBUG oslo_service.backend._eventlet.service [None req-859d054a-5877-44b3-aec7-21a6428470c7 None None] backend_defaults.iser_port = 3260 {{(pid=87165) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:25 devstack cinder-volume[87165]: DEBUG oslo_service.backend._eventlet.service [None req-859d054a-5877-44b3-aec7-21a6428470c7 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=87165) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:25 devstack cinder-volume[87165]: DEBUG oslo_service.backend._eventlet.service [None req-859d054a-5877-44b3-aec7-21a6428470c7 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=87165) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:25 devstack cinder-volume[87165]: DEBUG oslo_service.backend._eventlet.service [None req-859d054a-5877-44b3-aec7-21a6428470c7 None None] backend_defaults.nas_host = {{(pid=87165) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:25 devstack cinder-volume[87165]: DEBUG oslo_service.backend._eventlet.service [None req-859d054a-5877-44b3-aec7-21a6428470c7 None None] backend_defaults.nas_login = admin {{(pid=87165) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:25 devstack cinder-volume[87165]: DEBUG oslo_service.backend._eventlet.service [None req-859d054a-5877-44b3-aec7-21a6428470c7 None None] backend_defaults.nas_mount_options = None {{(pid=87165) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:25 devstack cinder-volume[87165]: DEBUG oslo_service.backend._eventlet.service [None req-859d054a-5877-44b3-aec7-21a6428470c7 None None] backend_defaults.nas_password = **** {{(pid=87165) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:25 devstack cinder-volume[87165]: DEBUG oslo_service.backend._eventlet.service [None req-859d054a-5877-44b3-aec7-21a6428470c7 None None] backend_defaults.nas_private_key = {{(pid=87165) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:25 devstack cinder-volume[87165]: DEBUG oslo_service.backend._eventlet.service [None req-859d054a-5877-44b3-aec7-21a6428470c7 None None] backend_defaults.nas_secure_file_operations = auto {{(pid=87165) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:25 devstack cinder-volume[87165]: DEBUG oslo_service.backend._eventlet.service [None req-859d054a-5877-44b3-aec7-21a6428470c7 None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=87165) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:25 devstack cinder-volume[87165]: DEBUG oslo_service.backend._eventlet.service [None req-859d054a-5877-44b3-aec7-21a6428470c7 None None] backend_defaults.nas_share_path = {{(pid=87165) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:25 devstack cinder-volume[87165]: DEBUG oslo_service.backend._eventlet.service [None req-859d054a-5877-44b3-aec7-21a6428470c7 None None] backend_defaults.nas_ssh_port = 22 {{(pid=87165) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:25 devstack cinder-volume[87165]: DEBUG oslo_service.backend._eventlet.service [None req-859d054a-5877-44b3-aec7-21a6428470c7 None None] backend_defaults.nas_volume_prov_type = thin {{(pid=87165) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:25 devstack cinder-volume[87165]: DEBUG oslo_service.backend._eventlet.service [None req-859d054a-5877-44b3-aec7-21a6428470c7 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=87165) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:25 devstack cinder-volume[87165]: DEBUG oslo_service.backend._eventlet.service [None req-859d054a-5877-44b3-aec7-21a6428470c7 None None] backend_defaults.num_shell_tries = 3 {{(pid=87165) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:25 devstack cinder-volume[87165]: DEBUG oslo_service.backend._eventlet.service [None req-859d054a-5877-44b3-aec7-21a6428470c7 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=87165) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:25 devstack cinder-volume[87165]: DEBUG oslo_service.backend._eventlet.service [None req-859d054a-5877-44b3-aec7-21a6428470c7 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=87165) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:25 devstack cinder-volume[87165]: DEBUG oslo_service.backend._eventlet.service [None req-859d054a-5877-44b3-aec7-21a6428470c7 None None] backend_defaults.nvmet_ns_id = 10 {{(pid=87165) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:25 devstack cinder-volume[87165]: DEBUG oslo_service.backend._eventlet.service [None req-859d054a-5877-44b3-aec7-21a6428470c7 None None] backend_defaults.nvmet_port_id = 1 {{(pid=87165) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:25 devstack cinder-volume[87165]: DEBUG oslo_service.backend._eventlet.service [None req-859d054a-5877-44b3-aec7-21a6428470c7 None None] backend_defaults.quobyte_client_cfg = None {{(pid=87165) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:25 devstack cinder-volume[87165]: DEBUG oslo_service.backend._eventlet.service [None req-859d054a-5877-44b3-aec7-21a6428470c7 None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=87165) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:25 devstack cinder-volume[87165]: DEBUG oslo_service.backend._eventlet.service [None req-859d054a-5877-44b3-aec7-21a6428470c7 None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=87165) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:25 devstack cinder-volume[87165]: DEBUG oslo_service.backend._eventlet.service [None req-859d054a-5877-44b3-aec7-21a6428470c7 None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=87165) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:25 devstack cinder-volume[87165]: DEBUG oslo_service.backend._eventlet.service [None req-859d054a-5877-44b3-aec7-21a6428470c7 None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=87165) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:25 devstack cinder-volume[87165]: DEBUG oslo_service.backend._eventlet.service [None req-859d054a-5877-44b3-aec7-21a6428470c7 None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=87165) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:25 devstack cinder-volume[87165]: DEBUG oslo_service.backend._eventlet.service [None req-859d054a-5877-44b3-aec7-21a6428470c7 None None] backend_defaults.quobyte_volume_url = None {{(pid=87165) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:25 devstack cinder-volume[87165]: DEBUG oslo_service.backend._eventlet.service [None req-859d054a-5877-44b3-aec7-21a6428470c7 None None] backend_defaults.replication_device = **** {{(pid=87165) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:25 devstack cinder-volume[87165]: DEBUG oslo_service.backend._eventlet.service [None req-859d054a-5877-44b3-aec7-21a6428470c7 None None] backend_defaults.report_discard_supported = False {{(pid=87165) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:25 devstack cinder-volume[87165]: DEBUG oslo_service.backend._eventlet.service [None req-859d054a-5877-44b3-aec7-21a6428470c7 None None] backend_defaults.reserved_percentage = 0 {{(pid=87165) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:25 devstack cinder-volume[87165]: DEBUG oslo_service.backend._eventlet.service [None req-859d054a-5877-44b3-aec7-21a6428470c7 None None] backend_defaults.scst_target_driver = iscsi {{(pid=87165) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:25 devstack cinder-volume[87165]: DEBUG oslo_service.backend._eventlet.service [None req-859d054a-5877-44b3-aec7-21a6428470c7 None None] backend_defaults.scst_target_iqn_name = None {{(pid=87165) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:25 devstack cinder-volume[87165]: DEBUG oslo_service.backend._eventlet.service [None req-859d054a-5877-44b3-aec7-21a6428470c7 None None] backend_defaults.storage_protocol = iSCSI {{(pid=87165) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:25 devstack cinder-volume[87165]: DEBUG oslo_service.backend._eventlet.service [None req-859d054a-5877-44b3-aec7-21a6428470c7 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=87165) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:25 devstack cinder-volume[87165]: DEBUG oslo_service.backend._eventlet.service [None req-859d054a-5877-44b3-aec7-21a6428470c7 None None] backend_defaults.target_helper = tgtadm {{(pid=87165) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:25 devstack cinder-volume[87165]: DEBUG oslo_service.backend._eventlet.service [None req-859d054a-5877-44b3-aec7-21a6428470c7 None None] backend_defaults.target_ip_address = 192.168.122.158 {{(pid=87165) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:25 devstack cinder-volume[87165]: DEBUG oslo_service.backend._eventlet.service [None req-859d054a-5877-44b3-aec7-21a6428470c7 None None] backend_defaults.target_port = 3260 {{(pid=87165) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:25 devstack cinder-volume[87165]: DEBUG oslo_service.backend._eventlet.service [None req-859d054a-5877-44b3-aec7-21a6428470c7 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=87165) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:25 devstack cinder-volume[87165]: DEBUG oslo_service.backend._eventlet.service [None req-859d054a-5877-44b3-aec7-21a6428470c7 None None] backend_defaults.target_protocol = iscsi {{(pid=87165) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:25 devstack cinder-volume[87165]: DEBUG oslo_service.backend._eventlet.service [None req-859d054a-5877-44b3-aec7-21a6428470c7 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=87165) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:25 devstack cinder-volume[87165]: DEBUG oslo_service.backend._eventlet.service [None req-859d054a-5877-44b3-aec7-21a6428470c7 None None] backend_defaults.trace_flags = None {{(pid=87165) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:25 devstack cinder-volume[87165]: DEBUG oslo_service.backend._eventlet.service [None req-859d054a-5877-44b3-aec7-21a6428470c7 None None] backend_defaults.unique_fqdn_network = True {{(pid=87165) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:25 devstack cinder-volume[87165]: DEBUG oslo_service.backend._eventlet.service [None req-859d054a-5877-44b3-aec7-21a6428470c7 None None] backend_defaults.use_chap_auth = False {{(pid=87165) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:25 devstack cinder-volume[87165]: DEBUG oslo_service.backend._eventlet.service [None req-859d054a-5877-44b3-aec7-21a6428470c7 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=87165) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:25 devstack cinder-volume[87165]: DEBUG oslo_service.backend._eventlet.service [None req-859d054a-5877-44b3-aec7-21a6428470c7 None None] backend_defaults.volume_backend_name = None {{(pid=87165) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:25 devstack cinder-volume[87165]: DEBUG oslo_service.backend._eventlet.service [None req-859d054a-5877-44b3-aec7-21a6428470c7 None None] backend_defaults.volume_clear = zero {{(pid=87165) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:25 devstack cinder-volume[87165]: DEBUG oslo_service.backend._eventlet.service [None req-859d054a-5877-44b3-aec7-21a6428470c7 None None] backend_defaults.volume_clear_ionice = None {{(pid=87165) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:25 devstack cinder-volume[87165]: DEBUG oslo_service.backend._eventlet.service [None req-859d054a-5877-44b3-aec7-21a6428470c7 None None] backend_defaults.volume_clear_size = 0 {{(pid=87165) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:25 devstack cinder-volume[87165]: DEBUG oslo_service.backend._eventlet.service [None req-859d054a-5877-44b3-aec7-21a6428470c7 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=87165) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:25 devstack cinder-volume[87165]: DEBUG oslo_service.backend._eventlet.service [None req-859d054a-5877-44b3-aec7-21a6428470c7 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=87165) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:25 devstack cinder-volume[87165]: DEBUG oslo_service.backend._eventlet.service [None req-859d054a-5877-44b3-aec7-21a6428470c7 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=87165) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:25 devstack cinder-volume[87165]: DEBUG oslo_service.backend._eventlet.service [None req-859d054a-5877-44b3-aec7-21a6428470c7 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=87165) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:25 devstack cinder-volume[87165]: DEBUG oslo_service.backend._eventlet.service [None req-859d054a-5877-44b3-aec7-21a6428470c7 None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=87165) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:25 devstack cinder-volume[87165]: DEBUG oslo_service.backend._eventlet.service [None req-859d054a-5877-44b3-aec7-21a6428470c7 None None] oslo_reports.file_event_handler = None {{(pid=87165) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:25 devstack cinder-volume[87165]: DEBUG oslo_service.backend._eventlet.service [None req-859d054a-5877-44b3-aec7-21a6428470c7 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=87165) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:25 devstack cinder-volume[87165]: DEBUG oslo_service.backend._eventlet.service [None req-859d054a-5877-44b3-aec7-21a6428470c7 None None] oslo_reports.log_dir = None {{(pid=87165) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:25 devstack cinder-volume[87165]: DEBUG oslo_service.backend._eventlet.service [None req-859d054a-5877-44b3-aec7-21a6428470c7 None None] QuobyteHD.backend_availability_zone = None {{(pid=87165) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:25 devstack cinder-volume[87165]: DEBUG oslo_service.backend._eventlet.service [None req-859d054a-5877-44b3-aec7-21a6428470c7 None None] QuobyteHD.backend_host = None {{(pid=87165) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:25 devstack cinder-volume[87165]: DEBUG oslo_service.backend._eventlet.service [None req-859d054a-5877-44b3-aec7-21a6428470c7 None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=87165) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:25 devstack cinder-volume[87165]: DEBUG oslo_service.backend._eventlet.service [None req-859d054a-5877-44b3-aec7-21a6428470c7 None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=87165) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:25 devstack cinder-volume[87165]: DEBUG oslo_service.backend._eventlet.service [None req-859d054a-5877-44b3-aec7-21a6428470c7 None None] QuobyteHD.chap_password = **** {{(pid=87165) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:25 devstack cinder-volume[87165]: DEBUG oslo_service.backend._eventlet.service [None req-859d054a-5877-44b3-aec7-21a6428470c7 None None] QuobyteHD.chap_username = None {{(pid=87165) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:25 devstack cinder-volume[87165]: DEBUG oslo_service.backend._eventlet.service [None req-859d054a-5877-44b3-aec7-21a6428470c7 None None] QuobyteHD.chiscsi_conf = None {{(pid=87165) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:25 devstack cinder-volume[87165]: DEBUG oslo_service.backend._eventlet.service [None req-859d054a-5877-44b3-aec7-21a6428470c7 None None] QuobyteHD.disk_geometry = None {{(pid=87165) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:25 devstack cinder-volume[87165]: DEBUG oslo_service.backend._eventlet.service [None req-859d054a-5877-44b3-aec7-21a6428470c7 None None] QuobyteHD.driver_client_cert = None {{(pid=87165) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:25 devstack cinder-volume[87165]: DEBUG oslo_service.backend._eventlet.service [None req-859d054a-5877-44b3-aec7-21a6428470c7 None None] QuobyteHD.driver_client_cert_key = None {{(pid=87165) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:25 devstack cinder-volume[87165]: DEBUG oslo_service.backend._eventlet.service [None req-859d054a-5877-44b3-aec7-21a6428470c7 None None] QuobyteHD.driver_data_namespace = None {{(pid=87165) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:25 devstack cinder-volume[87165]: DEBUG oslo_service.backend._eventlet.service [None req-859d054a-5877-44b3-aec7-21a6428470c7 None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=87165) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:25 devstack cinder-volume[87165]: DEBUG oslo_service.backend._eventlet.service [None req-859d054a-5877-44b3-aec7-21a6428470c7 None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=87165) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:25 devstack cinder-volume[87165]: DEBUG oslo_service.backend._eventlet.service [None req-859d054a-5877-44b3-aec7-21a6428470c7 None None] QuobyteHD.driver_use_ssl = None {{(pid=87165) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:25 devstack quobyte-client[87445]: Reading configuration file: /etc/quobyte/client.cfg Jul 10 04:31:25 devstack cinder-volume[87165]: DEBUG oslo_service.backend._eventlet.service [None req-859d054a-5877-44b3-aec7-21a6428470c7 None None] QuobyteHD.enable_unsupported_driver = True {{(pid=87165) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:25 devstack cinder-volume[87165]: DEBUG oslo_service.backend._eventlet.service [None req-859d054a-5877-44b3-aec7-21a6428470c7 None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=87165) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:25 devstack cinder-volume[87165]: DEBUG oslo_service.backend._eventlet.service [None req-859d054a-5877-44b3-aec7-21a6428470c7 None None] QuobyteHD.extra_capabilities = None {{(pid=87165) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:25 devstack quobyte-client[87445]: Quobyte logging to journald, you can use 'journalctl QUOBYTE_MOUNTPOINT=' to display the log. Jul 10 04:31:25 devstack cinder-volume[87165]: DEBUG oslo_service.backend._eventlet.service [None req-859d054a-5877-44b3-aec7-21a6428470c7 None None] QuobyteHD.filter_function = None {{(pid=87165) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:25 devstack cinder-volume[87165]: DEBUG oslo_service.backend._eventlet.service [None req-859d054a-5877-44b3-aec7-21a6428470c7 None None] QuobyteHD.goodness_function = None {{(pid=87165) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:25 devstack cinder-volume[87165]: DEBUG oslo_service.backend._eventlet.service [None req-859d054a-5877-44b3-aec7-21a6428470c7 None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=87165) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:25 devstack cinder-volume[87165]: DEBUG oslo_service.backend._eventlet.service [None req-859d054a-5877-44b3-aec7-21a6428470c7 None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=87165) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:25 devstack cinder-volume[87165]: DEBUG oslo_service.backend._eventlet.service [None req-859d054a-5877-44b3-aec7-21a6428470c7 None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=87165) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:25 devstack cinder-volume[87165]: DEBUG oslo_service.backend._eventlet.service [None req-859d054a-5877-44b3-aec7-21a6428470c7 None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=87165) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:25 devstack cinder-volume[87165]: DEBUG oslo_service.backend._eventlet.service [None req-859d054a-5877-44b3-aec7-21a6428470c7 None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=87165) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:25 devstack cinder-volume[87165]: DEBUG oslo_service.backend._eventlet.service [None req-859d054a-5877-44b3-aec7-21a6428470c7 None None] QuobyteHD.iscsi_target_flags = None {{(pid=87165) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:25 devstack cinder-volume[87165]: DEBUG oslo_service.backend._eventlet.service [None req-859d054a-5877-44b3-aec7-21a6428470c7 None None] QuobyteHD.iscsi_write_cache = None {{(pid=87165) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:25 devstack cinder-volume[87165]: DEBUG oslo_service.backend._eventlet.service [None req-859d054a-5877-44b3-aec7-21a6428470c7 None None] QuobyteHD.iser_helper = None {{(pid=87165) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:25 devstack cinder-volume[87165]: DEBUG oslo_service.backend._eventlet.service [None req-859d054a-5877-44b3-aec7-21a6428470c7 None None] QuobyteHD.iser_ip_address = None {{(pid=87165) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:25 devstack cinder-volume[87165]: DEBUG oslo_service.backend._eventlet.service [None req-859d054a-5877-44b3-aec7-21a6428470c7 None None] QuobyteHD.iser_port = None {{(pid=87165) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:25 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-8761a723-6bfb-4b97-a08c-d6fecf05879e None None] CMD "mount.quobyte" returned: 1 in 0.077s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:31:25 devstack cinder-volume[87165]: DEBUG oslo_service.backend._eventlet.service [None req-859d054a-5877-44b3-aec7-21a6428470c7 None None] QuobyteHD.iser_target_prefix = None {{(pid=87165) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:25 devstack cinder-volume[87165]: DEBUG oslo_service.backend._eventlet.service [None req-859d054a-5877-44b3-aec7-21a6428470c7 None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=87165) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:25 devstack cinder-volume[87165]: DEBUG oslo_service.backend._eventlet.service [None req-859d054a-5877-44b3-aec7-21a6428470c7 None None] QuobyteHD.nas_host = None {{(pid=87165) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:25 devstack cinder-volume[87165]: DEBUG oslo_service.backend._eventlet.service [None req-859d054a-5877-44b3-aec7-21a6428470c7 None None] QuobyteHD.nas_login = None {{(pid=87165) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:25 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-8761a723-6bfb-4b97-a08c-d6fecf05879e None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 04:31:25 devstack cinder-volume[87165]: DEBUG oslo_service.backend._eventlet.service [None req-859d054a-5877-44b3-aec7-21a6428470c7 None None] QuobyteHD.nas_mount_options = None {{(pid=87165) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:25 devstack cinder-volume[87165]: DEBUG oslo_service.backend._eventlet.service [None req-859d054a-5877-44b3-aec7-21a6428470c7 None None] QuobyteHD.nas_password = **** {{(pid=87165) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:25 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-8761a723-6bfb-4b97-a08c-d6fecf05879e None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 04:31:25 devstack cinder-volume[87165]: DEBUG oslo_service.backend._eventlet.service [None req-859d054a-5877-44b3-aec7-21a6428470c7 None None] QuobyteHD.nas_private_key = None {{(pid=87165) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:25 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-8761a723-6bfb-4b97-a08c-d6fecf05879e None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922': None} {{(pid=87444) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 04:31:25 devstack cinder-volume[87165]: DEBUG oslo_service.backend._eventlet.service [None req-859d054a-5877-44b3-aec7-21a6428470c7 None None] QuobyteHD.nas_secure_file_operations = false {{(pid=87165) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:25 devstack cinder-volume[87165]: DEBUG oslo_service.backend._eventlet.service [None req-859d054a-5877-44b3-aec7-21a6428470c7 None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=87165) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:25 devstack cinder-volume[87165]: DEBUG oslo_service.backend._eventlet.service [None req-859d054a-5877-44b3-aec7-21a6428470c7 None None] QuobyteHD.nas_share_path = None {{(pid=87165) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:25 devstack cinder-volume[87165]: DEBUG oslo_service.backend._eventlet.service [None req-859d054a-5877-44b3-aec7-21a6428470c7 None None] QuobyteHD.nas_ssh_port = None {{(pid=87165) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:25 devstack cinder-volume[87165]: DEBUG oslo_service.backend._eventlet.service [None req-859d054a-5877-44b3-aec7-21a6428470c7 None None] QuobyteHD.nas_volume_prov_type = None {{(pid=87165) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:25 devstack cinder-volume[87165]: DEBUG oslo_service.backend._eventlet.service [None req-859d054a-5877-44b3-aec7-21a6428470c7 None None] QuobyteHD.num_iser_scan_tries = None {{(pid=87165) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:25 devstack cinder-volume[87165]: DEBUG oslo_service.backend._eventlet.service [None req-859d054a-5877-44b3-aec7-21a6428470c7 None None] QuobyteHD.num_shell_tries = None {{(pid=87165) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:25 devstack cinder-volume[87165]: DEBUG oslo_service.backend._eventlet.service [None req-859d054a-5877-44b3-aec7-21a6428470c7 None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=87165) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:25 devstack cinder-volume[87165]: DEBUG oslo_service.backend._eventlet.service [None req-859d054a-5877-44b3-aec7-21a6428470c7 None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=87165) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:25 devstack cinder-volume[87165]: DEBUG oslo_service.backend._eventlet.service [None req-859d054a-5877-44b3-aec7-21a6428470c7 None None] QuobyteHD.nvmet_ns_id = None {{(pid=87165) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:25 devstack cinder-volume[87165]: DEBUG oslo_service.backend._eventlet.service [None req-859d054a-5877-44b3-aec7-21a6428470c7 None None] QuobyteHD.nvmet_port_id = None {{(pid=87165) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:25 devstack cinder-volume[87165]: DEBUG oslo_service.backend._eventlet.service [None req-859d054a-5877-44b3-aec7-21a6428470c7 None None] QuobyteHD.quobyte_client_cfg = /etc/quobyte/client-cinder.cfg {{(pid=87165) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:25 devstack cinder-volume[87165]: DEBUG oslo_service.backend._eventlet.service [None req-859d054a-5877-44b3-aec7-21a6428470c7 None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=87165) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:25 devstack cinder-volume[87165]: DEBUG oslo_service.backend._eventlet.service [None req-859d054a-5877-44b3-aec7-21a6428470c7 None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=87165) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:25 devstack cinder-volume[87165]: DEBUG oslo_service.backend._eventlet.service [None req-859d054a-5877-44b3-aec7-21a6428470c7 None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=87165) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:25 devstack cinder-volume[87165]: DEBUG oslo_service.backend._eventlet.service [None req-859d054a-5877-44b3-aec7-21a6428470c7 None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=87165) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:25 devstack cinder-volume[87165]: DEBUG oslo_service.backend._eventlet.service [None req-859d054a-5877-44b3-aec7-21a6428470c7 None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=87165) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:25 devstack cinder-volume[87165]: DEBUG oslo_service.backend._eventlet.service [None req-859d054a-5877-44b3-aec7-21a6428470c7 None None] QuobyteHD.quobyte_volume_url = quobyte://osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922 {{(pid=87165) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:25 devstack cinder-volume[87165]: DEBUG oslo_service.backend._eventlet.service [None req-859d054a-5877-44b3-aec7-21a6428470c7 None None] QuobyteHD.replication_device = **** {{(pid=87165) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:25 devstack cinder-volume[87165]: DEBUG oslo_service.backend._eventlet.service [None req-859d054a-5877-44b3-aec7-21a6428470c7 None None] QuobyteHD.report_discard_supported = None {{(pid=87165) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:25 devstack cinder-volume[87165]: DEBUG oslo_service.backend._eventlet.service [None req-859d054a-5877-44b3-aec7-21a6428470c7 None None] QuobyteHD.reserved_percentage = None {{(pid=87165) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:25 devstack cinder-volume[87165]: DEBUG oslo_service.backend._eventlet.service [None req-859d054a-5877-44b3-aec7-21a6428470c7 None None] QuobyteHD.scst_target_driver = None {{(pid=87165) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:25 devstack cinder-volume[87165]: DEBUG oslo_service.backend._eventlet.service [None req-859d054a-5877-44b3-aec7-21a6428470c7 None None] QuobyteHD.scst_target_iqn_name = None {{(pid=87165) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:25 devstack cinder-volume[87165]: DEBUG oslo_service.backend._eventlet.service [None req-859d054a-5877-44b3-aec7-21a6428470c7 None None] QuobyteHD.storage_protocol = None {{(pid=87165) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:25 devstack cinder-volume[87165]: DEBUG oslo_service.backend._eventlet.service [None req-859d054a-5877-44b3-aec7-21a6428470c7 None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=87165) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:25 devstack cinder-volume[87165]: DEBUG oslo_service.backend._eventlet.service [None req-859d054a-5877-44b3-aec7-21a6428470c7 None None] QuobyteHD.target_helper = None {{(pid=87165) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:25 devstack cinder-volume[87165]: DEBUG oslo_service.backend._eventlet.service [None req-859d054a-5877-44b3-aec7-21a6428470c7 None None] QuobyteHD.target_ip_address = None {{(pid=87165) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:25 devstack cinder-volume[87165]: DEBUG oslo_service.backend._eventlet.service [None req-859d054a-5877-44b3-aec7-21a6428470c7 None None] QuobyteHD.target_port = None {{(pid=87165) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:25 devstack cinder-volume[87165]: DEBUG oslo_service.backend._eventlet.service [None req-859d054a-5877-44b3-aec7-21a6428470c7 None None] QuobyteHD.target_prefix = None {{(pid=87165) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:25 devstack cinder-volume[87165]: DEBUG oslo_service.backend._eventlet.service [None req-859d054a-5877-44b3-aec7-21a6428470c7 None None] QuobyteHD.target_protocol = None {{(pid=87165) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:25 devstack cinder-volume[87165]: DEBUG oslo_service.backend._eventlet.service [None req-859d054a-5877-44b3-aec7-21a6428470c7 None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=87165) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:25 devstack cinder-volume[87165]: DEBUG oslo_service.backend._eventlet.service [None req-859d054a-5877-44b3-aec7-21a6428470c7 None None] QuobyteHD.trace_flags = None {{(pid=87165) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:25 devstack cinder-volume[87165]: DEBUG oslo_service.backend._eventlet.service [None req-859d054a-5877-44b3-aec7-21a6428470c7 None None] QuobyteHD.unique_fqdn_network = None {{(pid=87165) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:25 devstack cinder-volume[87165]: DEBUG oslo_service.backend._eventlet.service [None req-859d054a-5877-44b3-aec7-21a6428470c7 None None] QuobyteHD.use_chap_auth = None {{(pid=87165) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:25 devstack cinder-volume[87165]: DEBUG oslo_service.backend._eventlet.service [None req-859d054a-5877-44b3-aec7-21a6428470c7 None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=87165) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:25 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-8761a723-6bfb-4b97-a08c-d6fecf05879e None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922'] {{(pid=87444) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 04:31:25 devstack cinder-volume[87165]: DEBUG oslo_service.backend._eventlet.service [None req-859d054a-5877-44b3-aec7-21a6428470c7 None None] QuobyteHD.volume_backend_name = QuobyteHD {{(pid=87165) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:25 devstack cinder-volume[87165]: DEBUG oslo_service.backend._eventlet.service [None req-859d054a-5877-44b3-aec7-21a6428470c7 None None] QuobyteHD.volume_clear = None {{(pid=87165) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:25 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-8761a723-6bfb-4b97-a08c-d6fecf05879e None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 04:31:25 devstack cinder-volume[87165]: DEBUG oslo_service.backend._eventlet.service [None req-859d054a-5877-44b3-aec7-21a6428470c7 None None] QuobyteHD.volume_clear_ionice = None {{(pid=87165) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:25 devstack cinder-volume[87165]: DEBUG oslo_service.backend._eventlet.service [None req-859d054a-5877-44b3-aec7-21a6428470c7 None None] QuobyteHD.volume_clear_size = None {{(pid=87165) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:25 devstack cinder-volume[87165]: DEBUG oslo_service.backend._eventlet.service [None req-859d054a-5877-44b3-aec7-21a6428470c7 None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=87165) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:25 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-8761a723-6bfb-4b97-a08c-d6fecf05879e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:31:25 devstack cinder-volume[87165]: DEBUG oslo_service.backend._eventlet.service [None req-859d054a-5877-44b3-aec7-21a6428470c7 None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=87165) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:25 devstack cinder-volume[87165]: DEBUG oslo_service.backend._eventlet.service [None req-859d054a-5877-44b3-aec7-21a6428470c7 None None] QuobyteHD.volume_dd_blocksize = None {{(pid=87165) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:25 devstack cinder-volume[87165]: DEBUG oslo_service.backend._eventlet.service [None req-859d054a-5877-44b3-aec7-21a6428470c7 None None] QuobyteHD.volume_driver = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=87165) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:25 devstack cinder-volume[87165]: DEBUG oslo_service.backend._eventlet.service [None req-859d054a-5877-44b3-aec7-21a6428470c7 None None] QuobyteHD.volumes_dir = None {{(pid=87165) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:25 devstack cinder-volume[87165]: DEBUG oslo_service.backend._eventlet.service [None req-859d054a-5877-44b3-aec7-21a6428470c7 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=87165) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:25 devstack cinder-volume[87165]: DEBUG oslo_service.backend._eventlet.service [None req-859d054a-5877-44b3-aec7-21a6428470c7 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=87165) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:25 devstack cinder-volume[87165]: DEBUG oslo_service.backend._eventlet.service [None req-859d054a-5877-44b3-aec7-21a6428470c7 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=87165) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:25 devstack cinder-volume[87165]: DEBUG oslo_service.backend._eventlet.service [None req-859d054a-5877-44b3-aec7-21a6428470c7 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=87165) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:25 devstack cinder-volume[87165]: DEBUG oslo_service.backend._eventlet.service [None req-859d054a-5877-44b3-aec7-21a6428470c7 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=87165) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:25 devstack cinder-volume[87165]: DEBUG oslo_service.backend._eventlet.service [None req-859d054a-5877-44b3-aec7-21a6428470c7 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=87165) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:25 devstack cinder-volume[87165]: DEBUG oslo_service.backend._eventlet.service [None req-859d054a-5877-44b3-aec7-21a6428470c7 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=87165) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:25 devstack cinder-volume[87165]: DEBUG oslo_service.backend._eventlet.service [None req-859d054a-5877-44b3-aec7-21a6428470c7 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=87165) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:25 devstack cinder-volume[87165]: DEBUG oslo_service.backend._eventlet.service [None req-859d054a-5877-44b3-aec7-21a6428470c7 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=87165) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:25 devstack cinder-volume[87165]: DEBUG oslo_service.backend._eventlet.service [None req-859d054a-5877-44b3-aec7-21a6428470c7 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=87165) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:25 devstack cinder-volume[87165]: DEBUG oslo_service.backend._eventlet.service [None req-859d054a-5877-44b3-aec7-21a6428470c7 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=87165) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:25 devstack cinder-volume[87165]: DEBUG oslo_service.backend._eventlet.service [None req-859d054a-5877-44b3-aec7-21a6428470c7 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=87165) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:25 devstack cinder-volume[87165]: DEBUG oslo_service.backend._eventlet.service [None req-859d054a-5877-44b3-aec7-21a6428470c7 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=87165) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:25 devstack cinder-volume[87165]: DEBUG oslo_service.backend._eventlet.service [None req-859d054a-5877-44b3-aec7-21a6428470c7 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=87165) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:25 devstack cinder-volume[87165]: DEBUG oslo_service.backend._eventlet.service [None req-859d054a-5877-44b3-aec7-21a6428470c7 None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=87165) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:25 devstack cinder-volume[87165]: DEBUG oslo_service.backend._eventlet.service [None req-859d054a-5877-44b3-aec7-21a6428470c7 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=87165) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:25 devstack cinder-volume[87165]: DEBUG oslo_service.backend._eventlet.service [None req-859d054a-5877-44b3-aec7-21a6428470c7 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=87165) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:25 devstack cinder-volume[87165]: DEBUG oslo_service.backend._eventlet.service [None req-859d054a-5877-44b3-aec7-21a6428470c7 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=87165) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:25 devstack cinder-volume[87165]: DEBUG oslo_service.backend._eventlet.service [None req-859d054a-5877-44b3-aec7-21a6428470c7 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=87165) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:25 devstack cinder-volume[87165]: DEBUG oslo_service.backend._eventlet.service [None req-859d054a-5877-44b3-aec7-21a6428470c7 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=87165) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:25 devstack cinder-volume[87165]: DEBUG oslo_service.backend._eventlet.service [None req-859d054a-5877-44b3-aec7-21a6428470c7 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=87165) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:25 devstack cinder-volume[87165]: DEBUG oslo_service.backend._eventlet.service [None req-859d054a-5877-44b3-aec7-21a6428470c7 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=87165) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:25 devstack cinder-volume[87165]: DEBUG oslo_service.backend._eventlet.service [None req-859d054a-5877-44b3-aec7-21a6428470c7 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=87165) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:25 devstack cinder-volume[87165]: DEBUG oslo_service.backend._eventlet.service [None req-859d054a-5877-44b3-aec7-21a6428470c7 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=87165) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:25 devstack cinder-volume[87165]: DEBUG oslo_service.backend._eventlet.service [None req-859d054a-5877-44b3-aec7-21a6428470c7 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=87165) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:25 devstack cinder-volume[87165]: DEBUG oslo_service.backend._eventlet.service [None req-859d054a-5877-44b3-aec7-21a6428470c7 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=87165) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:25 devstack cinder-volume[87165]: DEBUG oslo_service.backend._eventlet.service [None req-859d054a-5877-44b3-aec7-21a6428470c7 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=87165) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:25 devstack cinder-volume[87165]: DEBUG oslo_service.backend._eventlet.service [None req-859d054a-5877-44b3-aec7-21a6428470c7 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=87165) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:25 devstack cinder-volume[87165]: DEBUG oslo_service.backend._eventlet.service [None req-859d054a-5877-44b3-aec7-21a6428470c7 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=87165) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:25 devstack cinder-volume[87165]: DEBUG oslo_service.backend._eventlet.service [None req-859d054a-5877-44b3-aec7-21a6428470c7 None None] oslo_messaging_rabbit.ssl = False {{(pid=87165) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:25 devstack cinder-volume[87165]: DEBUG oslo_service.backend._eventlet.service [None req-859d054a-5877-44b3-aec7-21a6428470c7 None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=87165) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:25 devstack cinder-volume[87165]: DEBUG oslo_service.backend._eventlet.service [None req-859d054a-5877-44b3-aec7-21a6428470c7 None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=87165) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:25 devstack cinder-volume[87165]: DEBUG oslo_service.backend._eventlet.service [None req-859d054a-5877-44b3-aec7-21a6428470c7 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=87165) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:25 devstack cinder-volume[87165]: DEBUG oslo_service.backend._eventlet.service [None req-859d054a-5877-44b3-aec7-21a6428470c7 None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=87165) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:25 devstack cinder-volume[87165]: DEBUG oslo_service.backend._eventlet.service [None req-859d054a-5877-44b3-aec7-21a6428470c7 None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=87165) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:25 devstack cinder-volume[87165]: DEBUG oslo_service.backend._eventlet.service [None req-859d054a-5877-44b3-aec7-21a6428470c7 None None] oslo_messaging_rabbit.ssl_version = {{(pid=87165) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:25 devstack cinder-volume[87165]: DEBUG oslo_service.backend._eventlet.service [None req-859d054a-5877-44b3-aec7-21a6428470c7 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=87165) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:25 devstack cinder-volume[87165]: DEBUG oslo_service.backend._eventlet.service [None req-859d054a-5877-44b3-aec7-21a6428470c7 None None] oslo_messaging_notifications.driver = [] {{(pid=87165) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:25 devstack cinder-volume[87165]: DEBUG oslo_service.backend._eventlet.service [None req-859d054a-5877-44b3-aec7-21a6428470c7 None None] oslo_messaging_notifications.retry = -1 {{(pid=87165) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:25 devstack cinder-volume[87165]: DEBUG oslo_service.backend._eventlet.service [None req-859d054a-5877-44b3-aec7-21a6428470c7 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=87165) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:25 devstack cinder-volume[87165]: DEBUG oslo_service.backend._eventlet.service [None req-859d054a-5877-44b3-aec7-21a6428470c7 None None] oslo_messaging_notifications.transport_url = **** {{(pid=87165) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:25 devstack cinder-volume[87165]: DEBUG oslo_service.backend._eventlet.service [None req-859d054a-5877-44b3-aec7-21a6428470c7 None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=87165) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:25 devstack cinder-volume[87165]: DEBUG oslo_service.backend._eventlet.service [None req-859d054a-5877-44b3-aec7-21a6428470c7 None None] key_manager.fixed_key = **** {{(pid=87165) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:25 devstack cinder-volume[87165]: DEBUG oslo_service.backend._eventlet.service [None req-859d054a-5877-44b3-aec7-21a6428470c7 None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=87165) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:25 devstack cinder-volume[87165]: DEBUG oslo_service.backend._eventlet.service [None req-859d054a-5877-44b3-aec7-21a6428470c7 None None] barbican.barbican_api_version = None {{(pid=87165) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:25 devstack cinder-volume[87165]: DEBUG oslo_service.backend._eventlet.service [None req-859d054a-5877-44b3-aec7-21a6428470c7 None None] barbican.barbican_endpoint = None {{(pid=87165) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:25 devstack cinder-volume[87165]: DEBUG oslo_service.backend._eventlet.service [None req-859d054a-5877-44b3-aec7-21a6428470c7 None None] barbican.barbican_endpoint_type = public {{(pid=87165) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:25 devstack cinder-volume[87165]: DEBUG oslo_service.backend._eventlet.service [None req-859d054a-5877-44b3-aec7-21a6428470c7 None None] barbican.barbican_region_name = None {{(pid=87165) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:25 devstack cinder-volume[87165]: DEBUG oslo_service.backend._eventlet.service [None req-859d054a-5877-44b3-aec7-21a6428470c7 None None] barbican.cafile = None {{(pid=87165) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:25 devstack cinder-volume[87165]: DEBUG oslo_service.backend._eventlet.service [None req-859d054a-5877-44b3-aec7-21a6428470c7 None None] barbican.certfile = None {{(pid=87165) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:25 devstack cinder-volume[87165]: DEBUG oslo_service.backend._eventlet.service [None req-859d054a-5877-44b3-aec7-21a6428470c7 None None] barbican.collect_timing = False {{(pid=87165) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:25 devstack cinder-volume[87165]: DEBUG oslo_service.backend._eventlet.service [None req-859d054a-5877-44b3-aec7-21a6428470c7 None None] barbican.insecure = False {{(pid=87165) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:25 devstack cinder-volume[87165]: DEBUG oslo_service.backend._eventlet.service [None req-859d054a-5877-44b3-aec7-21a6428470c7 None None] barbican.keyfile = None {{(pid=87165) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:25 devstack cinder-volume[87165]: DEBUG oslo_service.backend._eventlet.service [None req-859d054a-5877-44b3-aec7-21a6428470c7 None None] barbican.number_of_retries = 60 {{(pid=87165) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:25 devstack cinder-volume[87165]: DEBUG oslo_service.backend._eventlet.service [None req-859d054a-5877-44b3-aec7-21a6428470c7 None None] barbican.retry_delay = 1 {{(pid=87165) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:25 devstack cinder-volume[87165]: DEBUG oslo_service.backend._eventlet.service [None req-859d054a-5877-44b3-aec7-21a6428470c7 None None] barbican.send_service_user_token = False {{(pid=87165) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:25 devstack cinder-volume[87165]: DEBUG oslo_service.backend._eventlet.service [None req-859d054a-5877-44b3-aec7-21a6428470c7 None None] barbican.split_loggers = False {{(pid=87165) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:25 devstack cinder-volume[87165]: DEBUG oslo_service.backend._eventlet.service [None req-859d054a-5877-44b3-aec7-21a6428470c7 None None] barbican.timeout = None {{(pid=87165) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:25 devstack cinder-volume[87165]: DEBUG oslo_service.backend._eventlet.service [None req-859d054a-5877-44b3-aec7-21a6428470c7 None None] barbican.verify_ssl = True {{(pid=87165) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:25 devstack cinder-volume[87165]: DEBUG oslo_service.backend._eventlet.service [None req-859d054a-5877-44b3-aec7-21a6428470c7 None None] barbican.verify_ssl_path = None {{(pid=87165) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:25 devstack cinder-volume[87165]: DEBUG oslo_service.backend._eventlet.service [None req-859d054a-5877-44b3-aec7-21a6428470c7 None None] barbican_service_user.auth_section = None {{(pid=87165) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:25 devstack cinder-volume[87165]: DEBUG oslo_service.backend._eventlet.service [None req-859d054a-5877-44b3-aec7-21a6428470c7 None None] barbican_service_user.auth_type = None {{(pid=87165) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:25 devstack cinder-volume[87165]: DEBUG oslo_service.backend._eventlet.service [None req-859d054a-5877-44b3-aec7-21a6428470c7 None None] barbican_service_user.cafile = None {{(pid=87165) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:25 devstack cinder-volume[87165]: DEBUG oslo_service.backend._eventlet.service [None req-859d054a-5877-44b3-aec7-21a6428470c7 None None] barbican_service_user.certfile = None {{(pid=87165) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:25 devstack cinder-volume[87165]: DEBUG oslo_service.backend._eventlet.service [None req-859d054a-5877-44b3-aec7-21a6428470c7 None None] barbican_service_user.collect_timing = False {{(pid=87165) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:25 devstack cinder-volume[87165]: DEBUG oslo_service.backend._eventlet.service [None req-859d054a-5877-44b3-aec7-21a6428470c7 None None] barbican_service_user.insecure = False {{(pid=87165) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:25 devstack cinder-volume[87165]: DEBUG oslo_service.backend._eventlet.service [None req-859d054a-5877-44b3-aec7-21a6428470c7 None None] barbican_service_user.keyfile = None {{(pid=87165) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:25 devstack cinder-volume[87165]: DEBUG oslo_service.backend._eventlet.service [None req-859d054a-5877-44b3-aec7-21a6428470c7 None None] barbican_service_user.split_loggers = False {{(pid=87165) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:25 devstack cinder-volume[87165]: DEBUG oslo_service.backend._eventlet.service [None req-859d054a-5877-44b3-aec7-21a6428470c7 None None] barbican_service_user.timeout = None {{(pid=87165) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:25 devstack cinder-volume[87165]: DEBUG oslo_service.backend._eventlet.service [None req-859d054a-5877-44b3-aec7-21a6428470c7 None None] vault.approle_role_id = **** {{(pid=87165) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:25 devstack cinder-volume[87165]: DEBUG oslo_service.backend._eventlet.service [None req-859d054a-5877-44b3-aec7-21a6428470c7 None None] vault.approle_secret_id = **** {{(pid=87165) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:25 devstack cinder-volume[87165]: DEBUG oslo_service.backend._eventlet.service [None req-859d054a-5877-44b3-aec7-21a6428470c7 None None] vault.kv_mountpoint = secret {{(pid=87165) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:25 devstack cinder-volume[87165]: DEBUG oslo_service.backend._eventlet.service [None req-859d054a-5877-44b3-aec7-21a6428470c7 None None] vault.kv_path = None {{(pid=87165) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:25 devstack cinder-volume[87165]: DEBUG oslo_service.backend._eventlet.service [None req-859d054a-5877-44b3-aec7-21a6428470c7 None None] vault.kv_version = 2 {{(pid=87165) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:25 devstack cinder-volume[87165]: DEBUG oslo_service.backend._eventlet.service [None req-859d054a-5877-44b3-aec7-21a6428470c7 None None] vault.namespace = None {{(pid=87165) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:25 devstack cinder-volume[87165]: DEBUG oslo_service.backend._eventlet.service [None req-859d054a-5877-44b3-aec7-21a6428470c7 None None] vault.root_token_id = **** {{(pid=87165) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:25 devstack cinder-volume[87165]: DEBUG oslo_service.backend._eventlet.service [None req-859d054a-5877-44b3-aec7-21a6428470c7 None None] vault.ssl_ca_crt_file = None {{(pid=87165) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:25 devstack cinder-volume[87165]: DEBUG oslo_service.backend._eventlet.service [None req-859d054a-5877-44b3-aec7-21a6428470c7 None None] vault.timeout = 60.0 {{(pid=87165) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:25 devstack cinder-volume[87165]: DEBUG oslo_service.backend._eventlet.service [None req-859d054a-5877-44b3-aec7-21a6428470c7 None None] vault.use_ssl = False {{(pid=87165) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:25 devstack cinder-volume[87165]: DEBUG oslo_service.backend._eventlet.service [None req-859d054a-5877-44b3-aec7-21a6428470c7 None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=87165) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 10 04:31:25 devstack cinder-volume[87165]: DEBUG oslo_service.backend._eventlet.service [None req-859d054a-5877-44b3-aec7-21a6428470c7 None None] ******************************************************************************** {{(pid=87165) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3260}} Jul 10 04:31:25 devstack sudo[87446]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097 Jul 10 04:31:25 devstack sudo[87446]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:31:26 devstack sudo[87446]: pam_unix(sudo:session): session closed for user root Jul 10 04:31:26 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-8761a723-6bfb-4b97-a08c-d6fecf05879e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097" returned: 0 in 0.626s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:31:26 devstack cinder-volume[87444]: INFO cinder.volume.driver [None req-8761a723-6bfb-4b97-a08c-d6fecf05879e None None] Driver hasn't implemented _init_vendor_properties() Jul 10 04:31:26 devstack cinder-volume[87444]: DEBUG cinder.volume.driver [None req-8761a723-6bfb-4b97-a08c-d6fecf05879e None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.7577743530273, 'free_capacity_gb': 1775.7577743530273, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=87444) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}} Jul 10 04:31:26 devstack cinder-volume[87444]: DEBUG oslo_db.sqlalchemy.engines [None req-8761a723-6bfb-4b97-a08c-d6fecf05879e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=87444) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 10 04:31:26 devstack cinder-volume[87444]: DEBUG dbcounter [-] [87444] Writer thread running {{(pid=87444) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Jul 10 04:31:26 devstack cinder-volume[87444]: DEBUG cinder.db.api [None req-8761a723-6bfb-4b97-a08c-d6fecf05879e None None] Building query based on filter {{(pid=87444) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}} Jul 10 04:31:26 devstack cinder-volume[87444]: DEBUG cinder.image.image_utils [None req-8761a723-6bfb-4b97-a08c-d6fecf05879e None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=87444) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1331}} Jul 10 04:31:26 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-8761a723-6bfb-4b97-a08c-d6fecf05879e None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 04:31:26 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-8761a723-6bfb-4b97-a08c-d6fecf05879e None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 04:31:26 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-8761a723-6bfb-4b97-a08c-d6fecf05879e None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922': None} {{(pid=87444) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 04:31:26 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-8761a723-6bfb-4b97-a08c-d6fecf05879e None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922'] {{(pid=87444) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 04:31:26 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-8761a723-6bfb-4b97-a08c-d6fecf05879e None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 04:31:26 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-8761a723-6bfb-4b97-a08c-d6fecf05879e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:31:26 devstack cinder-volume[87444]: INFO cinder.keymgr.migration [None req-222f3f9d-51f8-4784-8cde-7b1b1b80c270 None None] Not migrating encryption keys because the ConfKeyManager is still in use. Jul 10 04:31:26 devstack sudo[87452]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097 Jul 10 04:31:26 devstack sudo[87452]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:31:27 devstack sudo[87452]: pam_unix(sudo:session): session closed for user root Jul 10 04:31:27 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-8761a723-6bfb-4b97-a08c-d6fecf05879e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097" returned: 0 in 0.617s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:31:27 devstack cinder-volume[87444]: DEBUG cinder.manager [None req-8761a723-6bfb-4b97-a08c-d6fecf05879e None None] Notifying Schedulers of capabilities ... {{(pid=87444) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 04:31:27 devstack cinder-volume[87444]: INFO cinder.volume.manager [None req-8761a723-6bfb-4b97-a08c-d6fecf05879e None None] Driver initialization completed successfully. Jul 10 04:31:27 devstack cinder-volume[87444]: INFO cinder.manager [None req-8761a723-6bfb-4b97-a08c-d6fecf05879e None None] Initiating service 3 cleanup Jul 10 04:31:27 devstack cinder-volume[87444]: INFO cinder.manager [None req-8761a723-6bfb-4b97-a08c-d6fecf05879e None None] Service 3 cleanup completed. Jul 10 04:31:27 devstack cinder-volume[87444]: DEBUG cinder.service [None req-8761a723-6bfb-4b97-a08c-d6fecf05879e None None] Creating RPC server for service cinder-volume {{(pid=87444) start /opt/stack/cinder/cinder/service.py:231}} Jul 10 04:31:27 devstack cinder-volume[87444]: DEBUG cinder.service [None req-8761a723-6bfb-4b97-a08c-d6fecf05879e None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=87444) start /opt/stack/cinder/cinder/service.py:237}} Jul 10 04:31:27 devstack cinder-volume[87444]: INFO cinder.volume.manager [None req-8761a723-6bfb-4b97-a08c-d6fecf05879e None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.1.14) Jul 10 04:31:27 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-8761a723-6bfb-4b97-a08c-d6fecf05879e None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 04:31:27 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-8761a723-6bfb-4b97-a08c-d6fecf05879e None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 04:31:27 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-8761a723-6bfb-4b97-a08c-d6fecf05879e None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922': None} {{(pid=87444) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 04:31:27 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-8761a723-6bfb-4b97-a08c-d6fecf05879e None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922'] {{(pid=87444) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 04:31:27 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-8761a723-6bfb-4b97-a08c-d6fecf05879e None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 04:31:27 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-8761a723-6bfb-4b97-a08c-d6fecf05879e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:31:27 devstack sudo[87485]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097 Jul 10 04:31:27 devstack sudo[87485]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:31:27 devstack sudo[87485]: pam_unix(sudo:session): session closed for user root Jul 10 04:31:27 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-8761a723-6bfb-4b97-a08c-d6fecf05879e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097" returned: 0 in 0.633s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:31:27 devstack cinder-volume[87444]: INFO cinder.volume.manager [None req-8761a723-6bfb-4b97-a08c-d6fecf05879e None None] Driver post RPC initialization completed successfully. Jul 10 04:31:32 devstack cinder-volume[87444]: DEBUG oslo_service.periodic_task [None req-01f0ce3e-6850-4e14-881d-e40d3c4ad6e5 None None] Running periodic task VolumeManager._thread_info {{(pid=87444) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 10 04:31:32 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-01f0ce3e-6850-4e14-881d-e40d3c4ad6e5 None None] thread count: 6 {{(pid=87444) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 10 04:31:32 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-01f0ce3e-6850-4e14-881d-e40d3c4ad6e5 None None] thread info: [<_MainThread(MainThread, started 126839257915520)>, , , , , ] {{(pid=87444) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 10 04:31:35 devstack cinder-volume[87165]: DEBUG dbcounter [-] [87165] Writing DB stats cinder:SELECT=5,cinder:UPDATE=1 {{(pid=87165) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 10 04:31:37 devstack cinder-volume[87444]: DEBUG dbcounter [-] [87444] Writing DB stats cinder:SELECT=3 {{(pid=87444) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 10 04:31:37 devstack cinder-volume[87444]: DEBUG dbcounter [-] [87444] Writing DB stats cinder:SELECT=7,cinder:UPDATE=1 {{(pid=87444) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 10 04:32:24 devstack cinder-volume[87444]: DEBUG cinder.volume.flows.manager.create_volume [None req-c4dc9322-d842-4110-a02b-9f35b7510141 tempest-TaggedAttachmentsTest-1032224018 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87444) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 04:32:24 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-c4dc9322-d842-4110-a02b-9f35b7510141 tempest-TaggedAttachmentsTest-1032224018 None] Flow 'volume_create_manager' (c513b327-ec6c-4ed2-80f9-87a99ea56329) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 04:32:24 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-c4dc9322-d842-4110-a02b-9f35b7510141 tempest-TaggedAttachmentsTest-1032224018 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d37d5f69-3e5e-439d-a3b1-4fbd44e3291b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:32:24 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-c4dc9322-d842-4110-a02b-9f35b7510141 tempest-TaggedAttachmentsTest-1032224018 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d37d5f69-3e5e-439d-a3b1-4fbd44e3291b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T02:32:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedAttachmentsTest-volume-882349974',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=006aa19d-4fd9-4582-b557-35187c1b3b53,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='92b68c7b57ae4ee4aca095609e13344f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T02:32:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T02:32:25Z,use_quota=True,user_id='309b41f7eaa041e6a9374765cce9b83d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(317e369e-1e06-434d-ae95-a335f0e6c903),volume_type_id=317e369e-1e06-434d-ae95-a335f0e6c903)' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:32:24 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-c4dc9322-d842-4110-a02b-9f35b7510141 tempest-TaggedAttachmentsTest-1032224018 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1c79c8c9-a2be-4a40-a7f0-5193ff055868) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:32:24 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-c4dc9322-d842-4110-a02b-9f35b7510141 tempest-TaggedAttachmentsTest-1032224018 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1c79c8c9-a2be-4a40-a7f0-5193ff055868) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:32:24 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-c4dc9322-d842-4110-a02b-9f35b7510141 tempest-TaggedAttachmentsTest-1032224018 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (db2f88cf-61a2-4c84-8c1b-675e328740d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:32:24 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-c4dc9322-d842-4110-a02b-9f35b7510141 tempest-TaggedAttachmentsTest-1032224018 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (db2f88cf-61a2-4c84-8c1b-675e328740d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '006aa19d-4fd9-4582-b557-35187c1b3b53', 'volume_name': 'volume-006aa19d-4fd9-4582-b557-35187c1b3b53', 'volume_size': 1}' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:32:24 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-c4dc9322-d842-4110-a02b-9f35b7510141 tempest-TaggedAttachmentsTest-1032224018 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5ddd315f-ad88-4e14-8899-113962b571a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:32:24 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-c4dc9322-d842-4110-a02b-9f35b7510141 tempest-TaggedAttachmentsTest-1032224018 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5ddd315f-ad88-4e14-8899-113962b571a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:32:24 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-c4dc9322-d842-4110-a02b-9f35b7510141 tempest-TaggedAttachmentsTest-1032224018 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (53ab8918-65e6-4276-a84d-c0dfcc7f91cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:32:24 devstack cinder-volume[87444]: INFO cinder.volume.flows.manager.create_volume [None req-c4dc9322-d842-4110-a02b-9f35b7510141 tempest-TaggedAttachmentsTest-1032224018 None] Volume 006aa19d-4fd9-4582-b557-35187c1b3b53: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-006aa19d-4fd9-4582-b557-35187c1b3b53', 'volume_size': 1} Jul 10 04:32:24 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-c4dc9322-d842-4110-a02b-9f35b7510141 tempest-TaggedAttachmentsTest-1032224018 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 04:32:24 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-c4dc9322-d842-4110-a02b-9f35b7510141 tempest-TaggedAttachmentsTest-1032224018 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 04:32:24 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-c4dc9322-d842-4110-a02b-9f35b7510141 tempest-TaggedAttachmentsTest-1032224018 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T02:32:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedAttachmentsTest-volume-882349974',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=006aa19d-4fd9-4582-b557-35187c1b3b53,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='92b68c7b57ae4ee4aca095609e13344f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T02:32:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T02:32:25Z,use_quota=True,user_id='309b41f7eaa041e6a9374765cce9b83d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(317e369e-1e06-434d-ae95-a335f0e6c903),volume_type_id=317e369e-1e06-434d-ae95-a335f0e6c903)}" {{(pid=87444) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 04:32:24 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.remotefs [None req-c4dc9322-d842-4110-a02b-9f35b7510141 tempest-TaggedAttachmentsTest-1032224018 None] Creating volume 006aa19d-4fd9-4582-b557-35187c1b3b53 {{(pid=87444) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 04:32:24 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-c4dc9322-d842-4110-a02b-9f35b7510141 tempest-TaggedAttachmentsTest-1032224018 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 04:32:24 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-c4dc9322-d842-4110-a02b-9f35b7510141 tempest-TaggedAttachmentsTest-1032224018 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 04:32:24 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-c4dc9322-d842-4110-a02b-9f35b7510141 tempest-TaggedAttachmentsTest-1032224018 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922': None} {{(pid=87444) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 04:32:24 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-c4dc9322-d842-4110-a02b-9f35b7510141 tempest-TaggedAttachmentsTest-1032224018 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922'] {{(pid=87444) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 04:32:24 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-c4dc9322-d842-4110-a02b-9f35b7510141 tempest-TaggedAttachmentsTest-1032224018 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 04:32:24 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-c4dc9322-d842-4110-a02b-9f35b7510141 tempest-TaggedAttachmentsTest-1032224018 None] Selected osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922 as target Quobyte volume. {{(pid=87444) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 04:32:24 devstack cinder-volume[87444]: INFO cinder.volume.drivers.remotefs [None req-c4dc9322-d842-4110-a02b-9f35b7510141 tempest-TaggedAttachmentsTest-1032224018 None] casted to osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922 Jul 10 04:32:24 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-c4dc9322-d842-4110-a02b-9f35b7510141 tempest-TaggedAttachmentsTest-1032224018 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-006aa19d-4fd9-4582-b557-35187c1b3b53 1073741824 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:32:24 devstack sudo[87672]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-006aa19d-4fd9-4582-b557-35187c1b3b53 1073741824 Jul 10 04:32:24 devstack sudo[87672]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:32:25 devstack sudo[87672]: pam_unix(sudo:session): session closed for user root Jul 10 04:32:25 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-c4dc9322-d842-4110-a02b-9f35b7510141 tempest-TaggedAttachmentsTest-1032224018 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-006aa19d-4fd9-4582-b557-35187c1b3b53 1073741824" returned: 0 in 1.076s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:32:25 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-c4dc9322-d842-4110-a02b-9f35b7510141 tempest-TaggedAttachmentsTest-1032224018 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-006aa19d-4fd9-4582-b557-35187c1b3b53 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:32:25 devstack sudo[87990]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-006aa19d-4fd9-4582-b557-35187c1b3b53 Jul 10 04:32:25 devstack sudo[87990]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:32:26 devstack sudo[87990]: pam_unix(sudo:session): session closed for user root Jul 10 04:32:26 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-c4dc9322-d842-4110-a02b-9f35b7510141 tempest-TaggedAttachmentsTest-1032224018 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-006aa19d-4fd9-4582-b557-35187c1b3b53" returned: 0 in 0.850s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:32:26 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-c4dc9322-d842-4110-a02b-9f35b7510141 tempest-TaggedAttachmentsTest-1032224018 None] <== create_volume: return (1994ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922'} {{(pid=87444) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 04:32:26 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-c4dc9322-d842-4110-a02b-9f35b7510141 tempest-TaggedAttachmentsTest-1032224018 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.998s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 04:32:26 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-c4dc9322-d842-4110-a02b-9f35b7510141 tempest-TaggedAttachmentsTest-1032224018 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (53ab8918-65e6-4276-a84d-c0dfcc7f91cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-006aa19d-4fd9-4582-b557-35187c1b3b53', 'volume_size': 1}' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:32:26 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-c4dc9322-d842-4110-a02b-9f35b7510141 tempest-TaggedAttachmentsTest-1032224018 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e70d16d0-ce09-4ca2-b6a3-c6d599c6b190) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:32:26 devstack cinder-volume[87444]: INFO cinder.volume.flows.manager.create_volume [None req-c4dc9322-d842-4110-a02b-9f35b7510141 tempest-TaggedAttachmentsTest-1032224018 None] Volume volume-006aa19d-4fd9-4582-b557-35187c1b3b53 (006aa19d-4fd9-4582-b557-35187c1b3b53): created successfully Jul 10 04:32:26 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-c4dc9322-d842-4110-a02b-9f35b7510141 tempest-TaggedAttachmentsTest-1032224018 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e70d16d0-ce09-4ca2-b6a3-c6d599c6b190) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:32:26 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-c4dc9322-d842-4110-a02b-9f35b7510141 tempest-TaggedAttachmentsTest-1032224018 None] Flow 'volume_create_manager' (c513b327-ec6c-4ed2-80f9-87a99ea56329) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87444) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 04:32:26 devstack cinder-volume[87444]: INFO cinder.volume.manager [None req-c4dc9322-d842-4110-a02b-9f35b7510141 tempest-TaggedAttachmentsTest-1032224018 None] Created volume successfully. Jul 10 04:32:32 devstack cinder-volume[87444]: DEBUG oslo_service.periodic_task [None req-01f0ce3e-6850-4e14-881d-e40d3c4ad6e5 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87444) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 10 04:32:32 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-01f0ce3e-6850-4e14-881d-e40d3c4ad6e5 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 04:32:32 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-01f0ce3e-6850-4e14-881d-e40d3c4ad6e5 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 04:32:32 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-01f0ce3e-6850-4e14-881d-e40d3c4ad6e5 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922': None} {{(pid=87444) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 04:32:33 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-01f0ce3e-6850-4e14-881d-e40d3c4ad6e5 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922'] {{(pid=87444) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 04:32:33 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-01f0ce3e-6850-4e14-881d-e40d3c4ad6e5 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 04:32:33 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-01f0ce3e-6850-4e14-881d-e40d3c4ad6e5 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:32:33 devstack sudo[88044]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097 Jul 10 04:32:33 devstack sudo[88044]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:32:34 devstack sudo[88044]: pam_unix(sudo:session): session closed for user root Jul 10 04:32:34 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-01f0ce3e-6850-4e14-881d-e40d3c4ad6e5 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097" returned: 0 in 1.240s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:32:34 devstack cinder-volume[87444]: DEBUG cinder.manager [None req-01f0ce3e-6850-4e14-881d-e40d3c4ad6e5 None None] Notifying Schedulers of capabilities ... {{(pid=87444) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 04:32:34 devstack cinder-volume[87444]: DEBUG oslo_service.periodic_task [None req-01f0ce3e-6850-4e14-881d-e40d3c4ad6e5 None None] Running periodic task VolumeManager._thread_info {{(pid=87444) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 10 04:32:34 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-01f0ce3e-6850-4e14-881d-e40d3c4ad6e5 None None] thread count: 6 {{(pid=87444) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 10 04:32:34 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-01f0ce3e-6850-4e14-881d-e40d3c4ad6e5 None None] thread info: [<_MainThread(MainThread, started 126839257915520)>, , , , , ] {{(pid=87444) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 10 04:32:36 devstack cinder-volume[87444]: DEBUG dbcounter [-] [87444] Writing DB stats cinder:SELECT=4,cinder:UPDATE=3 {{(pid=87444) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 10 04:32:36 devstack cinder-volume[87444]: DEBUG dbcounter [-] [87444] Writing DB stats cinder:UPDATE=3,cinder:INSERT=1,cinder:DELETE=1 {{(pid=87444) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 10 04:32:56 devstack cinder-volume[87444]: DEBUG cinder.volume.flows.manager.create_volume [None req-f3963265-6691-4798-a081-d4098cb2fe4a tempest-VolumesAdminNegativeTest-1924235173 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87444) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 04:32:56 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-f3963265-6691-4798-a081-d4098cb2fe4a tempest-VolumesAdminNegativeTest-1924235173 None] Flow 'volume_create_manager' (12da1b24-421b-453f-8c18-da5ba08e16c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 04:32:56 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-f3963265-6691-4798-a081-d4098cb2fe4a tempest-VolumesAdminNegativeTest-1924235173 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dd88b05e-d61b-4d93-bcdf-95836ba093be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:32:56 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-f3963265-6691-4798-a081-d4098cb2fe4a tempest-VolumesAdminNegativeTest-1924235173 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dd88b05e-d61b-4d93-bcdf-95836ba093be) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T02:32:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-87540132',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5672d466-0e9c-41b0-9557-f120c4ffdc7d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='96c122c8aef247f3b524f329d3e47420',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T02:32:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T02:32:56Z,use_quota=True,user_id='e62dfdae502f4515a89142e3d42a9bf0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(317e369e-1e06-434d-ae95-a335f0e6c903),volume_type_id=317e369e-1e06-434d-ae95-a335f0e6c903)' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:32:56 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-f3963265-6691-4798-a081-d4098cb2fe4a tempest-VolumesAdminNegativeTest-1924235173 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0c27037b-d246-4128-adc6-7286addc95f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:32:56 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-f3963265-6691-4798-a081-d4098cb2fe4a tempest-VolumesAdminNegativeTest-1924235173 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0c27037b-d246-4128-adc6-7286addc95f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:32:56 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-f3963265-6691-4798-a081-d4098cb2fe4a tempest-VolumesAdminNegativeTest-1924235173 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (014b3696-921e-4512-bff9-7dcfb1ae126c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:32:56 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-f3963265-6691-4798-a081-d4098cb2fe4a tempest-VolumesAdminNegativeTest-1924235173 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (014b3696-921e-4512-bff9-7dcfb1ae126c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5672d466-0e9c-41b0-9557-f120c4ffdc7d', 'volume_name': 'volume-5672d466-0e9c-41b0-9557-f120c4ffdc7d', 'volume_size': 1}' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:32:56 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-f3963265-6691-4798-a081-d4098cb2fe4a tempest-VolumesAdminNegativeTest-1924235173 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fb77f5e4-438a-4e26-9cc5-39ae57864226) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:32:56 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-f3963265-6691-4798-a081-d4098cb2fe4a tempest-VolumesAdminNegativeTest-1924235173 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fb77f5e4-438a-4e26-9cc5-39ae57864226) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:32:56 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-f3963265-6691-4798-a081-d4098cb2fe4a tempest-VolumesAdminNegativeTest-1924235173 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (11c7b34f-8866-4f07-9ed5-2c812081843d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:32:56 devstack cinder-volume[87444]: INFO cinder.volume.flows.manager.create_volume [None req-f3963265-6691-4798-a081-d4098cb2fe4a tempest-VolumesAdminNegativeTest-1924235173 None] Volume 5672d466-0e9c-41b0-9557-f120c4ffdc7d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5672d466-0e9c-41b0-9557-f120c4ffdc7d', 'volume_size': 1} Jul 10 04:32:56 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-f3963265-6691-4798-a081-d4098cb2fe4a tempest-VolumesAdminNegativeTest-1924235173 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 04:32:56 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-f3963265-6691-4798-a081-d4098cb2fe4a tempest-VolumesAdminNegativeTest-1924235173 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 04:32:56 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-f3963265-6691-4798-a081-d4098cb2fe4a tempest-VolumesAdminNegativeTest-1924235173 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T02:32:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-87540132',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5672d466-0e9c-41b0-9557-f120c4ffdc7d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='96c122c8aef247f3b524f329d3e47420',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T02:32:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T02:32:56Z,use_quota=True,user_id='e62dfdae502f4515a89142e3d42a9bf0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(317e369e-1e06-434d-ae95-a335f0e6c903),volume_type_id=317e369e-1e06-434d-ae95-a335f0e6c903)}" {{(pid=87444) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 04:32:56 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.remotefs [None req-f3963265-6691-4798-a081-d4098cb2fe4a tempest-VolumesAdminNegativeTest-1924235173 None] Creating volume 5672d466-0e9c-41b0-9557-f120c4ffdc7d {{(pid=87444) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 04:32:56 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-f3963265-6691-4798-a081-d4098cb2fe4a tempest-VolumesAdminNegativeTest-1924235173 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 04:32:56 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-f3963265-6691-4798-a081-d4098cb2fe4a tempest-VolumesAdminNegativeTest-1924235173 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 04:32:56 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-f3963265-6691-4798-a081-d4098cb2fe4a tempest-VolumesAdminNegativeTest-1924235173 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922': None} {{(pid=87444) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 04:32:56 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-f3963265-6691-4798-a081-d4098cb2fe4a tempest-VolumesAdminNegativeTest-1924235173 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922'] {{(pid=87444) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 04:32:56 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-f3963265-6691-4798-a081-d4098cb2fe4a tempest-VolumesAdminNegativeTest-1924235173 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 04:32:56 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-f3963265-6691-4798-a081-d4098cb2fe4a tempest-VolumesAdminNegativeTest-1924235173 None] Selected osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922 as target Quobyte volume. {{(pid=87444) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 04:32:56 devstack cinder-volume[87444]: INFO cinder.volume.drivers.remotefs [None req-f3963265-6691-4798-a081-d4098cb2fe4a tempest-VolumesAdminNegativeTest-1924235173 None] casted to osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922 Jul 10 04:32:56 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-f3963265-6691-4798-a081-d4098cb2fe4a tempest-VolumesAdminNegativeTest-1924235173 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-5672d466-0e9c-41b0-9557-f120c4ffdc7d 1073741824 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:32:56 devstack sudo[88432]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-5672d466-0e9c-41b0-9557-f120c4ffdc7d 1073741824 Jul 10 04:32:56 devstack sudo[88432]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:32:58 devstack sudo[88432]: pam_unix(sudo:session): session closed for user root Jul 10 04:32:58 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-f3963265-6691-4798-a081-d4098cb2fe4a tempest-VolumesAdminNegativeTest-1924235173 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-5672d466-0e9c-41b0-9557-f120c4ffdc7d 1073741824" returned: 0 in 2.287s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:32:58 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-f3963265-6691-4798-a081-d4098cb2fe4a tempest-VolumesAdminNegativeTest-1924235173 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-5672d466-0e9c-41b0-9557-f120c4ffdc7d {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:32:58 devstack sudo[88459]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-5672d466-0e9c-41b0-9557-f120c4ffdc7d Jul 10 04:32:58 devstack sudo[88459]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:33:00 devstack sudo[88459]: pam_unix(sudo:session): session closed for user root Jul 10 04:33:00 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-f3963265-6691-4798-a081-d4098cb2fe4a tempest-VolumesAdminNegativeTest-1924235173 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-5672d466-0e9c-41b0-9557-f120c4ffdc7d" returned: 0 in 1.221s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:33:00 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-f3963265-6691-4798-a081-d4098cb2fe4a tempest-VolumesAdminNegativeTest-1924235173 None] <== create_volume: return (3621ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922'} {{(pid=87444) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 04:33:00 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-f3963265-6691-4798-a081-d4098cb2fe4a tempest-VolumesAdminNegativeTest-1924235173 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 3.625s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 04:33:00 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-f3963265-6691-4798-a081-d4098cb2fe4a tempest-VolumesAdminNegativeTest-1924235173 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (11c7b34f-8866-4f07-9ed5-2c812081843d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5672d466-0e9c-41b0-9557-f120c4ffdc7d', 'volume_size': 1}' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:33:00 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-f3963265-6691-4798-a081-d4098cb2fe4a tempest-VolumesAdminNegativeTest-1924235173 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a96ed894-96e0-4277-a9c8-b2195e7002f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:33:00 devstack cinder-volume[87444]: INFO cinder.volume.flows.manager.create_volume [None req-f3963265-6691-4798-a081-d4098cb2fe4a tempest-VolumesAdminNegativeTest-1924235173 None] Volume volume-5672d466-0e9c-41b0-9557-f120c4ffdc7d (5672d466-0e9c-41b0-9557-f120c4ffdc7d): created successfully Jul 10 04:33:00 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-f3963265-6691-4798-a081-d4098cb2fe4a tempest-VolumesAdminNegativeTest-1924235173 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a96ed894-96e0-4277-a9c8-b2195e7002f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:33:00 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-f3963265-6691-4798-a081-d4098cb2fe4a tempest-VolumesAdminNegativeTest-1924235173 None] Flow 'volume_create_manager' (12da1b24-421b-453f-8c18-da5ba08e16c6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87444) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 04:33:00 devstack cinder-volume[87444]: INFO cinder.volume.manager [None req-f3963265-6691-4798-a081-d4098cb2fe4a tempest-VolumesAdminNegativeTest-1924235173 None] Created volume successfully. Jul 10 04:33:01 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-e8a573fa-4cc2-4ef8-89b9-16fd9b4fe1cf tempest-VolumesAdminNegativeTest-1924235173 None] Acquiring lock "cinder-5672d466-0e9c-41b0-9557-f120c4ffdc7d-delete_volume" by "delete_volume" {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 04:33:01 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-e8a573fa-4cc2-4ef8-89b9-16fd9b4fe1cf tempest-VolumesAdminNegativeTest-1924235173 None] Lock "cinder-5672d466-0e9c-41b0-9557-f120c4ffdc7d-delete_volume" acquired by "delete_volume" :: waited 0.065s {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 04:33:02 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-e8a573fa-4cc2-4ef8-89b9-16fd9b4fe1cf tempest-VolumesAdminNegativeTest-1924235173 None] Acquiring lock "cinder-quobyte-5672d466-0e9c-41b0-9557-f120c4ffdc7d" by "delete_volume" {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 04:33:02 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-e8a573fa-4cc2-4ef8-89b9-16fd9b4fe1cf tempest-VolumesAdminNegativeTest-1924235173 None] Lock "cinder-quobyte-5672d466-0e9c-41b0-9557-f120c4ffdc7d" acquired by "delete_volume" :: waited 0.072s {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 04:33:02 devstack cinder-volume[87444]: INFO oslo.privsep.daemon [None req-e8a573fa-4cc2-4ef8-89b9-16fd9b4fe1cf tempest-VolumesAdminNegativeTest-1924235173 None] Running privsep helper: ['sudo', 'cinder-rootwrap', '/etc/cinder/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/cinder/cinder.conf', '--privsep_context', 'cinder.privsep.sys_admin_pctxt', '--privsep_sock_path', '/tmp/tmp9ocnt0py/privsep.sock'] Jul 10 04:33:02 devstack sudo[88490]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf privsep-helper --config-file /etc/cinder/cinder.conf --privsep_context cinder.privsep.sys_admin_pctxt --privsep_sock_path /tmp/tmp9ocnt0py/privsep.sock Jul 10 04:33:02 devstack sudo[88490]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:33:03 devstack cinder-volume[87444]: WARNING oslo.privsep.daemon [-] privsep log: /opt/stack/data/venv/lib/python3.12/site-packages/oslo_rootwrap/__init__.py:25: EventletDeprecationWarning: Jul 10 04:33:03 devstack cinder-volume[87444]: WARNING oslo.privsep.daemon [-] privsep log: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Jul 10 04:33:03 devstack cinder-volume[87444]: WARNING oslo.privsep.daemon [-] privsep log: we strongly recommend against using it for new projects. Jul 10 04:33:03 devstack cinder-volume[87444]: WARNING oslo.privsep.daemon [-] privsep log: Jul 10 04:33:03 devstack cinder-volume[87444]: WARNING oslo.privsep.daemon [-] privsep log: If you are already using Eventlet, we recommend migrating to a different Jul 10 04:33:03 devstack cinder-volume[87444]: WARNING oslo.privsep.daemon [-] privsep log: framework. For more detail see Jul 10 04:33:03 devstack cinder-volume[87444]: WARNING oslo.privsep.daemon [-] privsep log: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Jul 10 04:33:03 devstack cinder-volume[87444]: WARNING oslo.privsep.daemon [-] privsep log: Jul 10 04:33:03 devstack cinder-volume[87444]: WARNING oslo.privsep.daemon [-] privsep log: import eventlet.patcher Jul 10 04:33:04 devstack cinder-volume[87444]: WARNING oslo.privsep.daemon [-] privsep log: /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/importutils.py:77: EventletDeprecationWarning: Jul 10 04:33:04 devstack cinder-volume[87444]: WARNING oslo.privsep.daemon [-] privsep log: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Jul 10 04:33:04 devstack cinder-volume[87444]: WARNING oslo.privsep.daemon [-] privsep log: we strongly recommend against using it for new projects. Jul 10 04:33:04 devstack cinder-volume[87444]: WARNING oslo.privsep.daemon [-] privsep log: Jul 10 04:33:04 devstack cinder-volume[87444]: WARNING oslo.privsep.daemon [-] privsep log: If you are already using Eventlet, we recommend migrating to a different Jul 10 04:33:04 devstack cinder-volume[87444]: WARNING oslo.privsep.daemon [-] privsep log: framework. For more detail see Jul 10 04:33:04 devstack cinder-volume[87444]: WARNING oslo.privsep.daemon [-] privsep log: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Jul 10 04:33:04 devstack cinder-volume[87444]: WARNING oslo.privsep.daemon [-] privsep log: Jul 10 04:33:04 devstack cinder-volume[87444]: WARNING oslo.privsep.daemon [-] privsep log: __import__(import_str) Jul 10 04:33:05 devstack sudo[88490]: pam_unix(sudo:session): session closed for user root Jul 10 04:33:05 devstack cinder-volume[87444]: INFO oslo.privsep.daemon [None req-e8a573fa-4cc2-4ef8-89b9-16fd9b4fe1cf tempest-VolumesAdminNegativeTest-1924235173 None] Spawned new privsep daemon via rootwrap Jul 10 04:33:05 devstack cinder-volume[87444]: DEBUG oslo.privsep.daemon [None req-e8a573fa-4cc2-4ef8-89b9-16fd9b4fe1cf tempest-VolumesAdminNegativeTest-1924235173 None] Accepted privsep connection to /tmp/tmp9ocnt0py/privsep.sock {{(pid=87444) __init__ /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:425}} Jul 10 04:33:05 devstack cinder-volume[87444]: INFO oslo.privsep.daemon [-] privsep daemon starting Jul 10 04:33:05 devstack cinder-volume[87444]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0 Jul 10 04:33:05 devstack cinder-volume[87444]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/none Jul 10 04:33:05 devstack cinder-volume[87444]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 88499 Jul 10 04:33:05 devstack cinder-volume[87444]: DEBUG oslo.privsep.daemon [-] privsep: reply[82af359a-0010-46f3-ae15-be4ce1465bdf]: (2,) {{(pid=88499) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 04:33:05 devstack cinder-volume[87444]: DEBUG oslo.privsep.daemon [-] privsep: reply[333b080f-5bcd-46d2-8ded-81ba30ad61d1]: (4, 'qcow2') {{(pid=88499) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 04:33:05 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-e8a573fa-4cc2-4ef8-89b9-16fd9b4fe1cf tempest-VolumesAdminNegativeTest-1924235173 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-5672d466-0e9c-41b0-9557-f120c4ffdc7d {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:33:05 devstack sudo[88501]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-5672d466-0e9c-41b0-9557-f120c4ffdc7d Jul 10 04:33:05 devstack sudo[88501]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:33:07 devstack sudo[88501]: pam_unix(sudo:session): session closed for user root Jul 10 04:33:07 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-e8a573fa-4cc2-4ef8-89b9-16fd9b4fe1cf tempest-VolumesAdminNegativeTest-1924235173 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-5672d466-0e9c-41b0-9557-f120c4ffdc7d" returned: 0 in 1.744s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:33:07 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-e8a573fa-4cc2-4ef8-89b9-16fd9b4fe1cf tempest-VolumesAdminNegativeTest-1924235173 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-5672d466-0e9c-41b0-9557-f120c4ffdc7d {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:33:07 devstack sudo[88507]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-5672d466-0e9c-41b0-9557-f120c4ffdc7d Jul 10 04:33:07 devstack sudo[88507]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:33:08 devstack sudo[88507]: pam_unix(sudo:session): session closed for user root Jul 10 04:33:08 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-e8a573fa-4cc2-4ef8-89b9-16fd9b4fe1cf tempest-VolumesAdminNegativeTest-1924235173 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-5672d466-0e9c-41b0-9557-f120c4ffdc7d" returned: 0 in 1.087s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:33:08 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-e8a573fa-4cc2-4ef8-89b9-16fd9b4fe1cf tempest-VolumesAdminNegativeTest-1924235173 None] Lock "cinder-quobyte-5672d466-0e9c-41b0-9557-f120c4ffdc7d" released by "delete_volume" :: held 6.311s {{(pid=87444) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 04:33:08 devstack cinder-volume[87444]: WARNING cinder.quota [None req-e8a573fa-4cc2-4ef8-89b9-16fd9b4fe1cf tempest-VolumesAdminNegativeTest-1924235173 None] Deprecated: Default quota for resource: volumes_QuobyteHD is set by the default quota flag: quota_volumes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Jul 10 04:33:08 devstack cinder-volume[87444]: WARNING cinder.quota [None req-e8a573fa-4cc2-4ef8-89b9-16fd9b4fe1cf tempest-VolumesAdminNegativeTest-1924235173 None] Deprecated: Default quota for resource: gigabytes_QuobyteHD is set by the default quota flag: quota_gigabytes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Jul 10 04:33:08 devstack cinder-volume[87444]: DEBUG cinder.quota [None req-e8a573fa-4cc2-4ef8-89b9-16fd9b4fe1cf tempest-VolumesAdminNegativeTest-1924235173 None] Created reservations ['60c82cad-98b8-4b9e-a39f-713c39e4d5af', '6b17c1bb-65c9-4fe3-b93b-1fa7460e5bde', '7d74a68a-4ce4-4239-a95d-f5ddff7c3a8c', 'cab7208e-8735-4aad-b0ed-66fcd802d0f9'] {{(pid=87444) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 04:33:08 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-e8a573fa-4cc2-4ef8-89b9-16fd9b4fe1cf tempest-VolumesAdminNegativeTest-1924235173 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 04:33:08 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-e8a573fa-4cc2-4ef8-89b9-16fd9b4fe1cf tempest-VolumesAdminNegativeTest-1924235173 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 04:33:08 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-e8a573fa-4cc2-4ef8-89b9-16fd9b4fe1cf tempest-VolumesAdminNegativeTest-1924235173 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922': None} {{(pid=87444) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 04:33:08 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-e8a573fa-4cc2-4ef8-89b9-16fd9b4fe1cf tempest-VolumesAdminNegativeTest-1924235173 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922'] {{(pid=87444) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 04:33:08 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-e8a573fa-4cc2-4ef8-89b9-16fd9b4fe1cf tempest-VolumesAdminNegativeTest-1924235173 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.029s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 04:33:08 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-e8a573fa-4cc2-4ef8-89b9-16fd9b4fe1cf tempest-VolumesAdminNegativeTest-1924235173 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:33:08 devstack sudo[88530]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097 Jul 10 04:33:08 devstack sudo[88530]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:33:10 devstack sudo[88530]: pam_unix(sudo:session): session closed for user root Jul 10 04:33:10 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-e8a573fa-4cc2-4ef8-89b9-16fd9b4fe1cf tempest-VolumesAdminNegativeTest-1924235173 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097" returned: 0 in 1.912s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:33:10 devstack cinder-volume[87444]: DEBUG cinder.manager [None req-e8a573fa-4cc2-4ef8-89b9-16fd9b4fe1cf tempest-VolumesAdminNegativeTest-1924235173 None] Notifying Schedulers of capabilities ... {{(pid=87444) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 04:33:10 devstack cinder-volume[87444]: INFO cinder.volume.manager [None req-e8a573fa-4cc2-4ef8-89b9-16fd9b4fe1cf tempest-VolumesAdminNegativeTest-1924235173 None] Deleted volume successfully. Jul 10 04:33:10 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-e8a573fa-4cc2-4ef8-89b9-16fd9b4fe1cf tempest-VolumesAdminNegativeTest-1924235173 None] Lock "cinder-5672d466-0e9c-41b0-9557-f120c4ffdc7d-delete_volume" released by "delete_volume" :: held 8.927s {{(pid=87444) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 04:33:16 devstack cinder-volume[87444]: DEBUG cinder.volume.flows.manager.create_volume [None req-4d9cf249-5ef2-4841-af61-83d01356b14a tempest-ServersNegativeTestJSON-1088789983 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87444) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 04:33:16 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-4d9cf249-5ef2-4841-af61-83d01356b14a tempest-ServersNegativeTestJSON-1088789983 None] Flow 'volume_create_manager' (fbd0b8b6-e822-4804-8712-2756f8f3a9f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 04:33:16 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-4d9cf249-5ef2-4841-af61-83d01356b14a tempest-ServersNegativeTestJSON-1088789983 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5d992876-8409-4f4e-bdfd-851773dda413) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:33:16 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-4d9cf249-5ef2-4841-af61-83d01356b14a tempest-ServersNegativeTestJSON-1088789983 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5d992876-8409-4f4e-bdfd-851773dda413) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T02:33:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-649035086',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e1d773a0-c52e-49d3-9601-1d41cdeaf389,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='904e6480485843a2ae4c0b118e71d36a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T02:33:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T02:33:16Z,use_quota=True,user_id='a5d76a8a16c54fbf883e8a49fa3c01a5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(317e369e-1e06-434d-ae95-a335f0e6c903),volume_type_id=317e369e-1e06-434d-ae95-a335f0e6c903)' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:33:16 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-4d9cf249-5ef2-4841-af61-83d01356b14a tempest-ServersNegativeTestJSON-1088789983 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1119e3a8-aa33-4b6f-ad3c-41e1d1a28916) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:33:16 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-4d9cf249-5ef2-4841-af61-83d01356b14a tempest-ServersNegativeTestJSON-1088789983 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1119e3a8-aa33-4b6f-ad3c-41e1d1a28916) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:33:16 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-4d9cf249-5ef2-4841-af61-83d01356b14a tempest-ServersNegativeTestJSON-1088789983 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (24458243-760b-4d93-bd72-e599c883fb16) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:33:16 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-4d9cf249-5ef2-4841-af61-83d01356b14a tempest-ServersNegativeTestJSON-1088789983 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (24458243-760b-4d93-bd72-e599c883fb16) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e1d773a0-c52e-49d3-9601-1d41cdeaf389', 'volume_name': 'volume-e1d773a0-c52e-49d3-9601-1d41cdeaf389', 'volume_size': 1}' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:33:16 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-4d9cf249-5ef2-4841-af61-83d01356b14a tempest-ServersNegativeTestJSON-1088789983 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (04fa4f59-e1c1-402e-81ab-fb80561fa2c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:33:16 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-4d9cf249-5ef2-4841-af61-83d01356b14a tempest-ServersNegativeTestJSON-1088789983 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (04fa4f59-e1c1-402e-81ab-fb80561fa2c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:33:16 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-4d9cf249-5ef2-4841-af61-83d01356b14a tempest-ServersNegativeTestJSON-1088789983 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f7292dc1-7618-4f98-8abb-02a7bc6ef977) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:33:16 devstack cinder-volume[87444]: INFO cinder.volume.flows.manager.create_volume [None req-4d9cf249-5ef2-4841-af61-83d01356b14a tempest-ServersNegativeTestJSON-1088789983 None] Volume e1d773a0-c52e-49d3-9601-1d41cdeaf389: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e1d773a0-c52e-49d3-9601-1d41cdeaf389', 'volume_size': 1} Jul 10 04:33:16 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-4d9cf249-5ef2-4841-af61-83d01356b14a tempest-ServersNegativeTestJSON-1088789983 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 04:33:16 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-4d9cf249-5ef2-4841-af61-83d01356b14a tempest-ServersNegativeTestJSON-1088789983 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 04:33:16 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-4d9cf249-5ef2-4841-af61-83d01356b14a tempest-ServersNegativeTestJSON-1088789983 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T02:33:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-649035086',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e1d773a0-c52e-49d3-9601-1d41cdeaf389,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='904e6480485843a2ae4c0b118e71d36a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T02:33:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T02:33:16Z,use_quota=True,user_id='a5d76a8a16c54fbf883e8a49fa3c01a5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(317e369e-1e06-434d-ae95-a335f0e6c903),volume_type_id=317e369e-1e06-434d-ae95-a335f0e6c903)}" {{(pid=87444) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 04:33:16 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.remotefs [None req-4d9cf249-5ef2-4841-af61-83d01356b14a tempest-ServersNegativeTestJSON-1088789983 None] Creating volume e1d773a0-c52e-49d3-9601-1d41cdeaf389 {{(pid=87444) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 04:33:16 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-4d9cf249-5ef2-4841-af61-83d01356b14a tempest-ServersNegativeTestJSON-1088789983 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 04:33:16 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-4d9cf249-5ef2-4841-af61-83d01356b14a tempest-ServersNegativeTestJSON-1088789983 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 04:33:16 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-4d9cf249-5ef2-4841-af61-83d01356b14a tempest-ServersNegativeTestJSON-1088789983 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922': None} {{(pid=87444) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 04:33:16 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-4d9cf249-5ef2-4841-af61-83d01356b14a tempest-ServersNegativeTestJSON-1088789983 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922'] {{(pid=87444) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 04:33:16 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-4d9cf249-5ef2-4841-af61-83d01356b14a tempest-ServersNegativeTestJSON-1088789983 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 04:33:16 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-4d9cf249-5ef2-4841-af61-83d01356b14a tempest-ServersNegativeTestJSON-1088789983 None] Selected osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922 as target Quobyte volume. {{(pid=87444) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 04:33:16 devstack cinder-volume[87444]: INFO cinder.volume.drivers.remotefs [None req-4d9cf249-5ef2-4841-af61-83d01356b14a tempest-ServersNegativeTestJSON-1088789983 None] casted to osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922 Jul 10 04:33:16 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-4d9cf249-5ef2-4841-af61-83d01356b14a tempest-ServersNegativeTestJSON-1088789983 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-e1d773a0-c52e-49d3-9601-1d41cdeaf389 1073741824 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:33:16 devstack sudo[88646]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-e1d773a0-c52e-49d3-9601-1d41cdeaf389 1073741824 Jul 10 04:33:16 devstack sudo[88646]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:33:17 devstack sudo[88646]: pam_unix(sudo:session): session closed for user root Jul 10 04:33:17 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-4d9cf249-5ef2-4841-af61-83d01356b14a tempest-ServersNegativeTestJSON-1088789983 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-e1d773a0-c52e-49d3-9601-1d41cdeaf389 1073741824" returned: 0 in 1.052s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:33:17 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-4d9cf249-5ef2-4841-af61-83d01356b14a tempest-ServersNegativeTestJSON-1088789983 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-e1d773a0-c52e-49d3-9601-1d41cdeaf389 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:33:17 devstack sudo[88652]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-e1d773a0-c52e-49d3-9601-1d41cdeaf389 Jul 10 04:33:17 devstack sudo[88652]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:33:18 devstack sudo[88652]: pam_unix(sudo:session): session closed for user root Jul 10 04:33:18 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-4d9cf249-5ef2-4841-af61-83d01356b14a tempest-ServersNegativeTestJSON-1088789983 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-e1d773a0-c52e-49d3-9601-1d41cdeaf389" returned: 0 in 0.684s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:33:18 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-4d9cf249-5ef2-4841-af61-83d01356b14a tempest-ServersNegativeTestJSON-1088789983 None] <== create_volume: return (1784ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922'} {{(pid=87444) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 04:33:18 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-4d9cf249-5ef2-4841-af61-83d01356b14a tempest-ServersNegativeTestJSON-1088789983 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.787s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 04:33:18 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-4d9cf249-5ef2-4841-af61-83d01356b14a tempest-ServersNegativeTestJSON-1088789983 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f7292dc1-7618-4f98-8abb-02a7bc6ef977) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e1d773a0-c52e-49d3-9601-1d41cdeaf389', 'volume_size': 1}' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:33:18 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-4d9cf249-5ef2-4841-af61-83d01356b14a tempest-ServersNegativeTestJSON-1088789983 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9c2509fe-31d8-4025-b14c-8a0d89c265d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:33:18 devstack cinder-volume[87444]: INFO cinder.volume.flows.manager.create_volume [None req-4d9cf249-5ef2-4841-af61-83d01356b14a tempest-ServersNegativeTestJSON-1088789983 None] Volume volume-e1d773a0-c52e-49d3-9601-1d41cdeaf389 (e1d773a0-c52e-49d3-9601-1d41cdeaf389): created successfully Jul 10 04:33:18 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-4d9cf249-5ef2-4841-af61-83d01356b14a tempest-ServersNegativeTestJSON-1088789983 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9c2509fe-31d8-4025-b14c-8a0d89c265d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:33:18 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-4d9cf249-5ef2-4841-af61-83d01356b14a tempest-ServersNegativeTestJSON-1088789983 None] Flow 'volume_create_manager' (fbd0b8b6-e822-4804-8712-2756f8f3a9f9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87444) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 04:33:18 devstack cinder-volume[87444]: INFO cinder.volume.manager [None req-4d9cf249-5ef2-4841-af61-83d01356b14a tempest-ServersNegativeTestJSON-1088789983 None] Created volume successfully. Jul 10 04:33:21 devstack cinder-volume[87444]: DEBUG cinder.volume.flows.manager.create_volume [None req-d09332d5-892f-4edb-bdd3-e4ec4604075c tempest-ServersNegativeTestJSON-1088789983 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87444) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 04:33:21 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-d09332d5-892f-4edb-bdd3-e4ec4604075c tempest-ServersNegativeTestJSON-1088789983 None] Flow 'volume_create_manager' (4da6183e-32e6-4423-ac2c-81f634b2d06f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 04:33:21 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-d09332d5-892f-4edb-bdd3-e4ec4604075c tempest-ServersNegativeTestJSON-1088789983 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (18beac63-14b9-4041-a904-2ef74e3f14da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:33:21 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-d09332d5-892f-4edb-bdd3-e4ec4604075c tempest-ServersNegativeTestJSON-1088789983 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (18beac63-14b9-4041-a904-2ef74e3f14da) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T02:33:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1777400266',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a349ba07-f903-414f-82b6-07f4eb9fc53d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='904e6480485843a2ae4c0b118e71d36a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T02:33:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T02:33:21Z,use_quota=True,user_id='a5d76a8a16c54fbf883e8a49fa3c01a5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(317e369e-1e06-434d-ae95-a335f0e6c903),volume_type_id=317e369e-1e06-434d-ae95-a335f0e6c903)' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:33:21 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-d09332d5-892f-4edb-bdd3-e4ec4604075c tempest-ServersNegativeTestJSON-1088789983 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f3363015-8dda-4a74-b9d0-7637db9bac60) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:33:21 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-d09332d5-892f-4edb-bdd3-e4ec4604075c tempest-ServersNegativeTestJSON-1088789983 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f3363015-8dda-4a74-b9d0-7637db9bac60) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:33:21 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-d09332d5-892f-4edb-bdd3-e4ec4604075c tempest-ServersNegativeTestJSON-1088789983 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (14e28656-90fc-49a1-a15a-3ca994e46aa5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:33:21 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-d09332d5-892f-4edb-bdd3-e4ec4604075c tempest-ServersNegativeTestJSON-1088789983 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (14e28656-90fc-49a1-a15a-3ca994e46aa5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a349ba07-f903-414f-82b6-07f4eb9fc53d', 'volume_name': 'volume-a349ba07-f903-414f-82b6-07f4eb9fc53d', 'volume_size': 1}' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:33:21 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-d09332d5-892f-4edb-bdd3-e4ec4604075c tempest-ServersNegativeTestJSON-1088789983 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (69313d84-f116-4131-9bf1-665fa40b5dd8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:33:21 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-d09332d5-892f-4edb-bdd3-e4ec4604075c tempest-ServersNegativeTestJSON-1088789983 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (69313d84-f116-4131-9bf1-665fa40b5dd8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:33:21 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-d09332d5-892f-4edb-bdd3-e4ec4604075c tempest-ServersNegativeTestJSON-1088789983 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f4e7e1e7-710e-4938-8ab2-8cb28d02e540) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:33:21 devstack cinder-volume[87444]: INFO cinder.volume.flows.manager.create_volume [None req-d09332d5-892f-4edb-bdd3-e4ec4604075c tempest-ServersNegativeTestJSON-1088789983 None] Volume a349ba07-f903-414f-82b6-07f4eb9fc53d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a349ba07-f903-414f-82b6-07f4eb9fc53d', 'volume_size': 1} Jul 10 04:33:21 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-d09332d5-892f-4edb-bdd3-e4ec4604075c tempest-ServersNegativeTestJSON-1088789983 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 04:33:21 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-d09332d5-892f-4edb-bdd3-e4ec4604075c tempest-ServersNegativeTestJSON-1088789983 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 04:33:21 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-d09332d5-892f-4edb-bdd3-e4ec4604075c tempest-ServersNegativeTestJSON-1088789983 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T02:33:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1777400266',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a349ba07-f903-414f-82b6-07f4eb9fc53d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='904e6480485843a2ae4c0b118e71d36a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T02:33:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T02:33:21Z,use_quota=True,user_id='a5d76a8a16c54fbf883e8a49fa3c01a5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(317e369e-1e06-434d-ae95-a335f0e6c903),volume_type_id=317e369e-1e06-434d-ae95-a335f0e6c903)}" {{(pid=87444) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 04:33:21 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.remotefs [None req-d09332d5-892f-4edb-bdd3-e4ec4604075c tempest-ServersNegativeTestJSON-1088789983 None] Creating volume a349ba07-f903-414f-82b6-07f4eb9fc53d {{(pid=87444) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 04:33:21 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-d09332d5-892f-4edb-bdd3-e4ec4604075c tempest-ServersNegativeTestJSON-1088789983 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 04:33:21 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-d09332d5-892f-4edb-bdd3-e4ec4604075c tempest-ServersNegativeTestJSON-1088789983 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 04:33:21 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-d09332d5-892f-4edb-bdd3-e4ec4604075c tempest-ServersNegativeTestJSON-1088789983 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922': None} {{(pid=87444) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 04:33:21 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-d09332d5-892f-4edb-bdd3-e4ec4604075c tempest-ServersNegativeTestJSON-1088789983 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922'] {{(pid=87444) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 04:33:21 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-d09332d5-892f-4edb-bdd3-e4ec4604075c tempest-ServersNegativeTestJSON-1088789983 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 04:33:21 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-d09332d5-892f-4edb-bdd3-e4ec4604075c tempest-ServersNegativeTestJSON-1088789983 None] Selected osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922 as target Quobyte volume. {{(pid=87444) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 04:33:21 devstack cinder-volume[87444]: INFO cinder.volume.drivers.remotefs [None req-d09332d5-892f-4edb-bdd3-e4ec4604075c tempest-ServersNegativeTestJSON-1088789983 None] casted to osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922 Jul 10 04:33:21 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-d09332d5-892f-4edb-bdd3-e4ec4604075c tempest-ServersNegativeTestJSON-1088789983 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-a349ba07-f903-414f-82b6-07f4eb9fc53d 1073741824 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:33:21 devstack sudo[88656]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-a349ba07-f903-414f-82b6-07f4eb9fc53d 1073741824 Jul 10 04:33:21 devstack sudo[88656]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:33:22 devstack sudo[88656]: pam_unix(sudo:session): session closed for user root Jul 10 04:33:22 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-d09332d5-892f-4edb-bdd3-e4ec4604075c tempest-ServersNegativeTestJSON-1088789983 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-a349ba07-f903-414f-82b6-07f4eb9fc53d 1073741824" returned: 0 in 1.179s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:33:22 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-d09332d5-892f-4edb-bdd3-e4ec4604075c tempest-ServersNegativeTestJSON-1088789983 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-a349ba07-f903-414f-82b6-07f4eb9fc53d {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:33:22 devstack sudo[88705]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-a349ba07-f903-414f-82b6-07f4eb9fc53d Jul 10 04:33:22 devstack sudo[88705]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:33:23 devstack sudo[88705]: pam_unix(sudo:session): session closed for user root Jul 10 04:33:23 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-d09332d5-892f-4edb-bdd3-e4ec4604075c tempest-ServersNegativeTestJSON-1088789983 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-a349ba07-f903-414f-82b6-07f4eb9fc53d" returned: 0 in 0.774s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:33:23 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-d09332d5-892f-4edb-bdd3-e4ec4604075c tempest-ServersNegativeTestJSON-1088789983 None] <== create_volume: return (2035ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922'} {{(pid=87444) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 04:33:23 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-d09332d5-892f-4edb-bdd3-e4ec4604075c tempest-ServersNegativeTestJSON-1088789983 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.038s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 04:33:23 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-d09332d5-892f-4edb-bdd3-e4ec4604075c tempest-ServersNegativeTestJSON-1088789983 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f4e7e1e7-710e-4938-8ab2-8cb28d02e540) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a349ba07-f903-414f-82b6-07f4eb9fc53d', 'volume_size': 1}' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:33:23 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-d09332d5-892f-4edb-bdd3-e4ec4604075c tempest-ServersNegativeTestJSON-1088789983 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e9476ea2-b554-4291-80a8-c6327b6d7622) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:33:23 devstack cinder-volume[87444]: INFO cinder.volume.flows.manager.create_volume [None req-d09332d5-892f-4edb-bdd3-e4ec4604075c tempest-ServersNegativeTestJSON-1088789983 None] Volume volume-a349ba07-f903-414f-82b6-07f4eb9fc53d (a349ba07-f903-414f-82b6-07f4eb9fc53d): created successfully Jul 10 04:33:23 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-d09332d5-892f-4edb-bdd3-e4ec4604075c tempest-ServersNegativeTestJSON-1088789983 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e9476ea2-b554-4291-80a8-c6327b6d7622) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:33:23 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-d09332d5-892f-4edb-bdd3-e4ec4604075c tempest-ServersNegativeTestJSON-1088789983 None] Flow 'volume_create_manager' (4da6183e-32e6-4423-ac2c-81f634b2d06f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87444) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 04:33:23 devstack cinder-volume[87444]: INFO cinder.volume.manager [None req-d09332d5-892f-4edb-bdd3-e4ec4604075c tempest-ServersNegativeTestJSON-1088789983 None] Created volume successfully. Jul 10 04:33:25 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-09220dfe-8269-4aab-a82f-4fb8db2bd882 tempest-ServersNegativeTestJSON-1088789983 None] Acquiring lock "cinder-a349ba07-f903-414f-82b6-07f4eb9fc53d-delete_volume" by "delete_volume" {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 04:33:25 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-09220dfe-8269-4aab-a82f-4fb8db2bd882 tempest-ServersNegativeTestJSON-1088789983 None] Lock "cinder-a349ba07-f903-414f-82b6-07f4eb9fc53d-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 04:33:25 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-09220dfe-8269-4aab-a82f-4fb8db2bd882 tempest-ServersNegativeTestJSON-1088789983 None] Acquiring lock "cinder-quobyte-a349ba07-f903-414f-82b6-07f4eb9fc53d" by "delete_volume" {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 04:33:25 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-09220dfe-8269-4aab-a82f-4fb8db2bd882 tempest-ServersNegativeTestJSON-1088789983 None] Lock "cinder-quobyte-a349ba07-f903-414f-82b6-07f4eb9fc53d" acquired by "delete_volume" :: waited 0.018s {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 04:33:25 devstack cinder-volume[87444]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b2faff4-368d-497e-b759-3ade23aa0d73]: (4, 'qcow2') {{(pid=88499) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 04:33:25 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-09220dfe-8269-4aab-a82f-4fb8db2bd882 tempest-ServersNegativeTestJSON-1088789983 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-a349ba07-f903-414f-82b6-07f4eb9fc53d {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:33:25 devstack sudo[88733]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-a349ba07-f903-414f-82b6-07f4eb9fc53d Jul 10 04:33:25 devstack sudo[88733]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:33:26 devstack sudo[88733]: pam_unix(sudo:session): session closed for user root Jul 10 04:33:26 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-09220dfe-8269-4aab-a82f-4fb8db2bd882 tempest-ServersNegativeTestJSON-1088789983 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-a349ba07-f903-414f-82b6-07f4eb9fc53d" returned: 0 in 0.941s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:33:26 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-09220dfe-8269-4aab-a82f-4fb8db2bd882 tempest-ServersNegativeTestJSON-1088789983 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-a349ba07-f903-414f-82b6-07f4eb9fc53d {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:33:26 devstack sudo[88739]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-a349ba07-f903-414f-82b6-07f4eb9fc53d Jul 10 04:33:26 devstack sudo[88739]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:33:27 devstack sudo[88739]: pam_unix(sudo:session): session closed for user root Jul 10 04:33:27 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-09220dfe-8269-4aab-a82f-4fb8db2bd882 tempest-ServersNegativeTestJSON-1088789983 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-a349ba07-f903-414f-82b6-07f4eb9fc53d" returned: 0 in 0.736s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:33:27 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-09220dfe-8269-4aab-a82f-4fb8db2bd882 tempest-ServersNegativeTestJSON-1088789983 None] Lock "cinder-quobyte-a349ba07-f903-414f-82b6-07f4eb9fc53d" released by "delete_volume" :: held 1.724s {{(pid=87444) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 04:33:27 devstack cinder-volume[87444]: DEBUG cinder.quota [None req-09220dfe-8269-4aab-a82f-4fb8db2bd882 tempest-ServersNegativeTestJSON-1088789983 None] Created reservations ['d06d8a58-295f-400b-b4c1-904a5680be5c', '163bd1b1-e499-40f4-9063-5d04371f19bc', '6f8aa5a9-a949-4bfe-baae-25b5964d1db0', 'efebd95a-2cab-4638-b4dc-3e9193c99dae'] {{(pid=87444) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 04:33:27 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-09220dfe-8269-4aab-a82f-4fb8db2bd882 tempest-ServersNegativeTestJSON-1088789983 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 04:33:27 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-09220dfe-8269-4aab-a82f-4fb8db2bd882 tempest-ServersNegativeTestJSON-1088789983 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 04:33:27 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-09220dfe-8269-4aab-a82f-4fb8db2bd882 tempest-ServersNegativeTestJSON-1088789983 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922': None} {{(pid=87444) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 04:33:27 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-09220dfe-8269-4aab-a82f-4fb8db2bd882 tempest-ServersNegativeTestJSON-1088789983 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922'] {{(pid=87444) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 04:33:27 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-09220dfe-8269-4aab-a82f-4fb8db2bd882 tempest-ServersNegativeTestJSON-1088789983 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 04:33:27 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-09220dfe-8269-4aab-a82f-4fb8db2bd882 tempest-ServersNegativeTestJSON-1088789983 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:33:27 devstack sudo[88744]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097 Jul 10 04:33:27 devstack sudo[88744]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:33:27 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-8d7bcbc0-78b0-42a2-85d3-b4d18cf7d4af tempest-ServersNegativeTestJSON-1088789983 None] Acquiring lock "cinder-e1d773a0-c52e-49d3-9601-1d41cdeaf389-delete_volume" by "delete_volume" {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 04:33:27 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-8d7bcbc0-78b0-42a2-85d3-b4d18cf7d4af tempest-ServersNegativeTestJSON-1088789983 None] Lock "cinder-e1d773a0-c52e-49d3-9601-1d41cdeaf389-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 04:33:27 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-8d7bcbc0-78b0-42a2-85d3-b4d18cf7d4af tempest-ServersNegativeTestJSON-1088789983 None] Acquiring lock "cinder-quobyte-e1d773a0-c52e-49d3-9601-1d41cdeaf389" by "delete_volume" {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 04:33:27 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-8d7bcbc0-78b0-42a2-85d3-b4d18cf7d4af tempest-ServersNegativeTestJSON-1088789983 None] Lock "cinder-quobyte-e1d773a0-c52e-49d3-9601-1d41cdeaf389" acquired by "delete_volume" :: waited 0.030s {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 04:33:27 devstack cinder-volume[87444]: DEBUG oslo.privsep.daemon [-] privsep: reply[44896ac2-ef58-4fa8-a72f-70b12a452777]: (4, 'qcow2') {{(pid=88499) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 04:33:27 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-8d7bcbc0-78b0-42a2-85d3-b4d18cf7d4af tempest-ServersNegativeTestJSON-1088789983 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-e1d773a0-c52e-49d3-9601-1d41cdeaf389 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:33:27 devstack sudo[88748]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-e1d773a0-c52e-49d3-9601-1d41cdeaf389 Jul 10 04:33:27 devstack sudo[88748]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:33:28 devstack sudo[88744]: pam_unix(sudo:session): session closed for user root Jul 10 04:33:28 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-09220dfe-8269-4aab-a82f-4fb8db2bd882 tempest-ServersNegativeTestJSON-1088789983 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097" returned: 0 in 0.821s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:33:28 devstack cinder-volume[87444]: DEBUG cinder.manager [None req-09220dfe-8269-4aab-a82f-4fb8db2bd882 tempest-ServersNegativeTestJSON-1088789983 None] Notifying Schedulers of capabilities ... {{(pid=87444) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 04:33:28 devstack cinder-volume[87444]: INFO cinder.volume.manager [None req-09220dfe-8269-4aab-a82f-4fb8db2bd882 tempest-ServersNegativeTestJSON-1088789983 None] Deleted volume successfully. Jul 10 04:33:28 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-09220dfe-8269-4aab-a82f-4fb8db2bd882 tempest-ServersNegativeTestJSON-1088789983 None] Lock "cinder-a349ba07-f903-414f-82b6-07f4eb9fc53d-delete_volume" released by "delete_volume" :: held 2.875s {{(pid=87444) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 04:33:28 devstack sudo[88748]: pam_unix(sudo:session): session closed for user root Jul 10 04:33:28 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-8d7bcbc0-78b0-42a2-85d3-b4d18cf7d4af tempest-ServersNegativeTestJSON-1088789983 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-e1d773a0-c52e-49d3-9601-1d41cdeaf389" returned: 0 in 1.116s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:33:28 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-8d7bcbc0-78b0-42a2-85d3-b4d18cf7d4af tempest-ServersNegativeTestJSON-1088789983 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-e1d773a0-c52e-49d3-9601-1d41cdeaf389 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:33:28 devstack sudo[88754]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-e1d773a0-c52e-49d3-9601-1d41cdeaf389 Jul 10 04:33:28 devstack sudo[88754]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:33:29 devstack sudo[88754]: pam_unix(sudo:session): session closed for user root Jul 10 04:33:29 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-8d7bcbc0-78b0-42a2-85d3-b4d18cf7d4af tempest-ServersNegativeTestJSON-1088789983 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-e1d773a0-c52e-49d3-9601-1d41cdeaf389" returned: 0 in 0.826s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:33:29 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-8d7bcbc0-78b0-42a2-85d3-b4d18cf7d4af tempest-ServersNegativeTestJSON-1088789983 None] Lock "cinder-quobyte-e1d773a0-c52e-49d3-9601-1d41cdeaf389" released by "delete_volume" :: held 2.043s {{(pid=87444) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 04:33:29 devstack cinder-volume[87444]: DEBUG cinder.quota [None req-8d7bcbc0-78b0-42a2-85d3-b4d18cf7d4af tempest-ServersNegativeTestJSON-1088789983 None] Created reservations ['69164697-bd61-47b7-9f9a-82647883a1c7', '56c0f9c1-cf9b-43fa-a559-458a34b392af', '5cf0b46f-7a68-46cb-9faa-5926adcc8fe1', '35907cd3-9bf8-450a-87cf-2c5eb747c033'] {{(pid=87444) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 04:33:29 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-8d7bcbc0-78b0-42a2-85d3-b4d18cf7d4af tempest-ServersNegativeTestJSON-1088789983 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 04:33:29 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-8d7bcbc0-78b0-42a2-85d3-b4d18cf7d4af tempest-ServersNegativeTestJSON-1088789983 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 04:33:29 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-8d7bcbc0-78b0-42a2-85d3-b4d18cf7d4af tempest-ServersNegativeTestJSON-1088789983 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922': None} {{(pid=87444) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 04:33:29 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-8d7bcbc0-78b0-42a2-85d3-b4d18cf7d4af tempest-ServersNegativeTestJSON-1088789983 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922'] {{(pid=87444) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 04:33:29 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-8d7bcbc0-78b0-42a2-85d3-b4d18cf7d4af tempest-ServersNegativeTestJSON-1088789983 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 04:33:29 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-8d7bcbc0-78b0-42a2-85d3-b4d18cf7d4af tempest-ServersNegativeTestJSON-1088789983 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:33:30 devstack sudo[88758]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097 Jul 10 04:33:30 devstack sudo[88758]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:33:31 devstack sudo[88758]: pam_unix(sudo:session): session closed for user root Jul 10 04:33:31 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-8d7bcbc0-78b0-42a2-85d3-b4d18cf7d4af tempest-ServersNegativeTestJSON-1088789983 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097" returned: 0 in 1.076s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:33:31 devstack cinder-volume[87444]: DEBUG cinder.manager [None req-8d7bcbc0-78b0-42a2-85d3-b4d18cf7d4af tempest-ServersNegativeTestJSON-1088789983 None] Notifying Schedulers of capabilities ... {{(pid=87444) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 04:33:31 devstack cinder-volume[87444]: INFO cinder.volume.manager [None req-8d7bcbc0-78b0-42a2-85d3-b4d18cf7d4af tempest-ServersNegativeTestJSON-1088789983 None] Deleted volume successfully. Jul 10 04:33:31 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-8d7bcbc0-78b0-42a2-85d3-b4d18cf7d4af tempest-ServersNegativeTestJSON-1088789983 None] Lock "cinder-e1d773a0-c52e-49d3-9601-1d41cdeaf389-delete_volume" released by "delete_volume" :: held 3.439s {{(pid=87444) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 04:33:32 devstack cinder-volume[87444]: DEBUG oslo_service.periodic_task [None req-01f0ce3e-6850-4e14-881d-e40d3c4ad6e5 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87444) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 10 04:33:32 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-01f0ce3e-6850-4e14-881d-e40d3c4ad6e5 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 04:33:32 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-01f0ce3e-6850-4e14-881d-e40d3c4ad6e5 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 04:33:32 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-01f0ce3e-6850-4e14-881d-e40d3c4ad6e5 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922': None} {{(pid=87444) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 04:33:32 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-01f0ce3e-6850-4e14-881d-e40d3c4ad6e5 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922'] {{(pid=87444) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 04:33:32 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-01f0ce3e-6850-4e14-881d-e40d3c4ad6e5 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 04:33:32 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-01f0ce3e-6850-4e14-881d-e40d3c4ad6e5 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:33:33 devstack sudo[88804]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097 Jul 10 04:33:33 devstack sudo[88804]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:33:33 devstack sudo[88804]: pam_unix(sudo:session): session closed for user root Jul 10 04:33:33 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-01f0ce3e-6850-4e14-881d-e40d3c4ad6e5 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097" returned: 0 in 0.738s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:33:33 devstack cinder-volume[87444]: DEBUG cinder.manager [None req-01f0ce3e-6850-4e14-881d-e40d3c4ad6e5 None None] Notifying Schedulers of capabilities ... {{(pid=87444) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 04:33:39 devstack cinder-volume[87444]: DEBUG dbcounter [-] [87444] Writing DB stats cinder:SELECT=20,cinder:UPDATE=41,cinder:INSERT=7,cinder:DELETE=2 {{(pid=87444) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 10 04:33:41 devstack cinder-volume[87444]: DEBUG dbcounter [-] [87444] Writing DB stats cinder:UPDATE=26,cinder:SELECT=23,cinder:INSERT=8,cinder:DELETE=4 {{(pid=87444) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 10 04:33:41 devstack cinder-volume[87444]: DEBUG cinder.volume.flows.manager.create_volume [None req-1367343a-e646-4e13-af76-8be1a813c0a7 tempest-DeleteServersTestJSON-624270783 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87444) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 04:33:41 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-1367343a-e646-4e13-af76-8be1a813c0a7 tempest-DeleteServersTestJSON-624270783 None] Flow 'volume_create_manager' (143dc865-3b68-41e7-9c22-d92634888632) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 04:33:41 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-1367343a-e646-4e13-af76-8be1a813c0a7 tempest-DeleteServersTestJSON-624270783 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (44fd893b-7b7b-4f62-9f5b-af8be7563a17) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:33:41 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-1367343a-e646-4e13-af76-8be1a813c0a7 tempest-DeleteServersTestJSON-624270783 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (44fd893b-7b7b-4f62-9f5b-af8be7563a17) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T02:33:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-1034318681',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4a585577-9f1e-46a8-b388-36d782178b02,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='26b4ac9e479f4437a68cec85b501c889',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T02:33:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T02:33:41Z,use_quota=True,user_id='2e6947c9fb314033ab487c9fd9e3083f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(317e369e-1e06-434d-ae95-a335f0e6c903),volume_type_id=317e369e-1e06-434d-ae95-a335f0e6c903)' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:33:41 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-1367343a-e646-4e13-af76-8be1a813c0a7 tempest-DeleteServersTestJSON-624270783 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e995066e-ec97-418e-a0cd-f5f9cfcfc9ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:33:41 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-1367343a-e646-4e13-af76-8be1a813c0a7 tempest-DeleteServersTestJSON-624270783 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e995066e-ec97-418e-a0cd-f5f9cfcfc9ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:33:41 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-1367343a-e646-4e13-af76-8be1a813c0a7 tempest-DeleteServersTestJSON-624270783 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5c38123b-3a36-4cca-a625-0ec8986255a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:33:41 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-1367343a-e646-4e13-af76-8be1a813c0a7 tempest-DeleteServersTestJSON-624270783 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5c38123b-3a36-4cca-a625-0ec8986255a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4a585577-9f1e-46a8-b388-36d782178b02', 'volume_name': 'volume-4a585577-9f1e-46a8-b388-36d782178b02', 'volume_size': 1}' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:33:41 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-1367343a-e646-4e13-af76-8be1a813c0a7 tempest-DeleteServersTestJSON-624270783 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (22361975-0ecf-4098-9950-bb174083e082) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:33:41 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-1367343a-e646-4e13-af76-8be1a813c0a7 tempest-DeleteServersTestJSON-624270783 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (22361975-0ecf-4098-9950-bb174083e082) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:33:41 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-1367343a-e646-4e13-af76-8be1a813c0a7 tempest-DeleteServersTestJSON-624270783 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (af2abe22-9d0c-4535-a2a0-6a10b00060b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:33:41 devstack cinder-volume[87444]: INFO cinder.volume.flows.manager.create_volume [None req-1367343a-e646-4e13-af76-8be1a813c0a7 tempest-DeleteServersTestJSON-624270783 None] Volume 4a585577-9f1e-46a8-b388-36d782178b02: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4a585577-9f1e-46a8-b388-36d782178b02', 'volume_size': 1} Jul 10 04:33:41 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-1367343a-e646-4e13-af76-8be1a813c0a7 tempest-DeleteServersTestJSON-624270783 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 04:33:41 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-1367343a-e646-4e13-af76-8be1a813c0a7 tempest-DeleteServersTestJSON-624270783 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 04:33:41 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-1367343a-e646-4e13-af76-8be1a813c0a7 tempest-DeleteServersTestJSON-624270783 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T02:33:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-1034318681',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4a585577-9f1e-46a8-b388-36d782178b02,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='26b4ac9e479f4437a68cec85b501c889',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T02:33:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T02:33:41Z,use_quota=True,user_id='2e6947c9fb314033ab487c9fd9e3083f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(317e369e-1e06-434d-ae95-a335f0e6c903),volume_type_id=317e369e-1e06-434d-ae95-a335f0e6c903)}" {{(pid=87444) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 04:33:41 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.remotefs [None req-1367343a-e646-4e13-af76-8be1a813c0a7 tempest-DeleteServersTestJSON-624270783 None] Creating volume 4a585577-9f1e-46a8-b388-36d782178b02 {{(pid=87444) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 04:33:41 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-1367343a-e646-4e13-af76-8be1a813c0a7 tempest-DeleteServersTestJSON-624270783 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 04:33:41 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-1367343a-e646-4e13-af76-8be1a813c0a7 tempest-DeleteServersTestJSON-624270783 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 04:33:41 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-1367343a-e646-4e13-af76-8be1a813c0a7 tempest-DeleteServersTestJSON-624270783 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922': None} {{(pid=87444) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 04:33:41 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-1367343a-e646-4e13-af76-8be1a813c0a7 tempest-DeleteServersTestJSON-624270783 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922'] {{(pid=87444) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 04:33:41 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-1367343a-e646-4e13-af76-8be1a813c0a7 tempest-DeleteServersTestJSON-624270783 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 04:33:41 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-1367343a-e646-4e13-af76-8be1a813c0a7 tempest-DeleteServersTestJSON-624270783 None] Selected osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922 as target Quobyte volume. {{(pid=87444) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 04:33:41 devstack cinder-volume[87444]: INFO cinder.volume.drivers.remotefs [None req-1367343a-e646-4e13-af76-8be1a813c0a7 tempest-DeleteServersTestJSON-624270783 None] casted to osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922 Jul 10 04:33:41 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-1367343a-e646-4e13-af76-8be1a813c0a7 tempest-DeleteServersTestJSON-624270783 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-4a585577-9f1e-46a8-b388-36d782178b02 1073741824 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:33:41 devstack sudo[88925]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-4a585577-9f1e-46a8-b388-36d782178b02 1073741824 Jul 10 04:33:41 devstack sudo[88925]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:33:42 devstack sudo[88925]: pam_unix(sudo:session): session closed for user root Jul 10 04:33:42 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-1367343a-e646-4e13-af76-8be1a813c0a7 tempest-DeleteServersTestJSON-624270783 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-4a585577-9f1e-46a8-b388-36d782178b02 1073741824" returned: 0 in 1.496s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:33:42 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-1367343a-e646-4e13-af76-8be1a813c0a7 tempest-DeleteServersTestJSON-624270783 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-4a585577-9f1e-46a8-b388-36d782178b02 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:33:42 devstack sudo[88932]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-4a585577-9f1e-46a8-b388-36d782178b02 Jul 10 04:33:42 devstack sudo[88932]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:33:43 devstack sudo[88932]: pam_unix(sudo:session): session closed for user root Jul 10 04:33:43 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-1367343a-e646-4e13-af76-8be1a813c0a7 tempest-DeleteServersTestJSON-624270783 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-4a585577-9f1e-46a8-b388-36d782178b02" returned: 0 in 1.042s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:33:43 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-1367343a-e646-4e13-af76-8be1a813c0a7 tempest-DeleteServersTestJSON-624270783 None] <== create_volume: return (2610ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922'} {{(pid=87444) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 04:33:43 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-1367343a-e646-4e13-af76-8be1a813c0a7 tempest-DeleteServersTestJSON-624270783 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.613s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 04:33:43 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-1367343a-e646-4e13-af76-8be1a813c0a7 tempest-DeleteServersTestJSON-624270783 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (af2abe22-9d0c-4535-a2a0-6a10b00060b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4a585577-9f1e-46a8-b388-36d782178b02', 'volume_size': 1}' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:33:43 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-1367343a-e646-4e13-af76-8be1a813c0a7 tempest-DeleteServersTestJSON-624270783 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (01395a36-fb96-4ec1-bcc1-878199de9642) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:33:43 devstack cinder-volume[87444]: INFO cinder.volume.flows.manager.create_volume [None req-1367343a-e646-4e13-af76-8be1a813c0a7 tempest-DeleteServersTestJSON-624270783 None] Volume volume-4a585577-9f1e-46a8-b388-36d782178b02 (4a585577-9f1e-46a8-b388-36d782178b02): created successfully Jul 10 04:33:43 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-1367343a-e646-4e13-af76-8be1a813c0a7 tempest-DeleteServersTestJSON-624270783 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (01395a36-fb96-4ec1-bcc1-878199de9642) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:33:43 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-1367343a-e646-4e13-af76-8be1a813c0a7 tempest-DeleteServersTestJSON-624270783 None] Flow 'volume_create_manager' (143dc865-3b68-41e7-9c22-d92634888632) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87444) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 04:33:43 devstack cinder-volume[87444]: INFO cinder.volume.manager [None req-1367343a-e646-4e13-af76-8be1a813c0a7 tempest-DeleteServersTestJSON-624270783 None] Created volume successfully. Jul 10 04:33:46 devstack cinder-volume[87444]: WARNING py.warnings [req-487e2da3-743d-4d28-a7bd-6ea2976827cc req-5c13e221-1038-4884-ba22-bb962f94c436 tempest-TaggedAttachmentsTest-1032224018 None] /opt/stack/cinder/cinder/db/api.py:2468: SAWarning: SELECT statement has a cartesian product between FROM element(s) "volumes" and FROM element "volumes_1". Apply join condition(s) between each element to resolve. Jul 10 04:33:46 devstack cinder-volume[87444]: .first() Jul 10 04:33:46 devstack cinder-volume[87444]: Jul 10 04:33:46 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [req-487e2da3-743d-4d28-a7bd-6ea2976827cc req-5c13e221-1038-4884-ba22-bb962f94c436 tempest-TaggedAttachmentsTest-1032224018 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 04:33:46 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [req-487e2da3-743d-4d28-a7bd-6ea2976827cc req-5c13e221-1038-4884-ba22-bb962f94c436 tempest-TaggedAttachmentsTest-1032224018 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 04:33:46 devstack cinder-volume[87444]: DEBUG oslo.privsep.daemon [-] privsep: reply[1cbef32c-e67a-4155-9c27-cd83e5156a88]: (4, 'qcow2') {{(pid=88499) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 04:33:46 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [req-487e2da3-743d-4d28-a7bd-6ea2976827cc req-5c13e221-1038-4884-ba22-bb962f94c436 tempest-TaggedAttachmentsTest-1032224018 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-006aa19d-4fd9-4582-b557-35187c1b3b53 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:33:46 devstack sudo[88964]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-006aa19d-4fd9-4582-b557-35187c1b3b53 Jul 10 04:33:46 devstack sudo[88964]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:33:47 devstack sudo[88964]: pam_unix(sudo:session): session closed for user root Jul 10 04:33:47 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [req-487e2da3-743d-4d28-a7bd-6ea2976827cc req-5c13e221-1038-4884-ba22-bb962f94c436 tempest-TaggedAttachmentsTest-1032224018 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-006aa19d-4fd9-4582-b557-35187c1b3b53" returned: 0 in 1.288s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:33:47 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [req-487e2da3-743d-4d28-a7bd-6ea2976827cc req-5c13e221-1038-4884-ba22-bb962f94c436 tempest-TaggedAttachmentsTest-1032224018 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.317s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 04:33:47 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [req-487e2da3-743d-4d28-a7bd-6ea2976827cc req-5c13e221-1038-4884-ba22-bb962f94c436 tempest-TaggedAttachmentsTest-1032224018 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922', 'name': 'volume-006aa19d-4fd9-4582-b557-35187c1b3b53', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '35cbd81a-ab75-4c6e-b5fa-047d12af4ed9', 'enforce_multipath': True} {{(pid=87444) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 10 04:33:48 devstack cinder-volume[87444]: INFO cinder.volume.manager [req-487e2da3-743d-4d28-a7bd-6ea2976827cc req-5c13e221-1038-4884-ba22-bb962f94c436 tempest-TaggedAttachmentsTest-1032224018 None] attachment_update completed successfully. Jul 10 04:33:48 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [req-33a37258-5cb2-4f62-b00d-399a6fb56d87 req-3758dccb-87f5-42ab-ab48-a7f9cda93ca0 tempest-DeleteServersTestJSON-624270783 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 04:33:48 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [req-33a37258-5cb2-4f62-b00d-399a6fb56d87 req-3758dccb-87f5-42ab-ab48-a7f9cda93ca0 tempest-DeleteServersTestJSON-624270783 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 04:33:48 devstack cinder-volume[87444]: DEBUG oslo.privsep.daemon [-] privsep: reply[3061fb00-0b7c-499d-9346-43e6b7d5642b]: (4, 'qcow2') {{(pid=88499) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 04:33:48 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [req-33a37258-5cb2-4f62-b00d-399a6fb56d87 req-3758dccb-87f5-42ab-ab48-a7f9cda93ca0 tempest-DeleteServersTestJSON-624270783 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-4a585577-9f1e-46a8-b388-36d782178b02 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:33:49 devstack sudo[88983]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-4a585577-9f1e-46a8-b388-36d782178b02 Jul 10 04:33:49 devstack sudo[88983]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:33:50 devstack sudo[88983]: pam_unix(sudo:session): session closed for user root Jul 10 04:33:50 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [req-33a37258-5cb2-4f62-b00d-399a6fb56d87 req-3758dccb-87f5-42ab-ab48-a7f9cda93ca0 tempest-DeleteServersTestJSON-624270783 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-4a585577-9f1e-46a8-b388-36d782178b02" returned: 0 in 1.429s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:33:50 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [req-33a37258-5cb2-4f62-b00d-399a6fb56d87 req-3758dccb-87f5-42ab-ab48-a7f9cda93ca0 tempest-DeleteServersTestJSON-624270783 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.460s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 04:33:50 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [req-33a37258-5cb2-4f62-b00d-399a6fb56d87 req-3758dccb-87f5-42ab-ab48-a7f9cda93ca0 tempest-DeleteServersTestJSON-624270783 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922', 'name': 'volume-4a585577-9f1e-46a8-b388-36d782178b02', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '39ebfb89-2211-429c-a40f-0c38bb596f6f', 'enforce_multipath': True} {{(pid=87444) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 10 04:33:50 devstack cinder-volume[87444]: INFO cinder.volume.manager [req-33a37258-5cb2-4f62-b00d-399a6fb56d87 req-3758dccb-87f5-42ab-ab48-a7f9cda93ca0 tempest-DeleteServersTestJSON-624270783 None] attachment_update completed successfully. Jul 10 04:33:57 devstack cinder-volume[87444]: INFO cinder.volume.manager [req-b199e916-fb59-4c3d-bb26-e97a191b6a0e req-bcb1687e-06df-49af-b351-7b9c0d5398ff tempest-TaggedAttachmentsTest-1032224018 None] Terminate volume connection completed successfully. Jul 10 04:33:57 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [req-b199e916-fb59-4c3d-bb26-e97a191b6a0e req-bcb1687e-06df-49af-b351-7b9c0d5398ff tempest-TaggedAttachmentsTest-1032224018 None] Deleting attachment 35cbd81a-ab75-4c6e-b5fa-047d12af4ed9. {{(pid=87444) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 10 04:34:03 devstack cinder-volume[87444]: INFO cinder.volume.manager [req-74307f2e-67de-48ee-8b00-4a143317beb8 req-d20c3980-af56-45e3-ba24-a4bfc9f418f9 tempest-DeleteServersTestJSON-624270783 None] Terminate volume connection completed successfully. Jul 10 04:34:03 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [req-74307f2e-67de-48ee-8b00-4a143317beb8 req-d20c3980-af56-45e3-ba24-a4bfc9f418f9 tempest-DeleteServersTestJSON-624270783 None] Deleting attachment 39ebfb89-2211-429c-a40f-0c38bb596f6f. {{(pid=87444) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 10 04:34:07 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-0f3a5b4d-310d-4f8d-bf56-d18de3002076 tempest-DeleteServersTestJSON-624270783 None] Acquiring lock "cinder-4a585577-9f1e-46a8-b388-36d782178b02-delete_volume" by "delete_volume" {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 04:34:07 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-0f3a5b4d-310d-4f8d-bf56-d18de3002076 tempest-DeleteServersTestJSON-624270783 None] Lock "cinder-4a585577-9f1e-46a8-b388-36d782178b02-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 04:34:07 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-0f3a5b4d-310d-4f8d-bf56-d18de3002076 tempest-DeleteServersTestJSON-624270783 None] Acquiring lock "cinder-quobyte-4a585577-9f1e-46a8-b388-36d782178b02" by "delete_volume" {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 04:34:07 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-0f3a5b4d-310d-4f8d-bf56-d18de3002076 tempest-DeleteServersTestJSON-624270783 None] Lock "cinder-quobyte-4a585577-9f1e-46a8-b388-36d782178b02" acquired by "delete_volume" :: waited 0.016s {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 04:34:07 devstack cinder-volume[87444]: DEBUG oslo.privsep.daemon [-] privsep: reply[38ef311a-26f9-4838-8a74-0167359855ae]: (4, 'qcow2') {{(pid=88499) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 04:34:07 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-0f3a5b4d-310d-4f8d-bf56-d18de3002076 tempest-DeleteServersTestJSON-624270783 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-4a585577-9f1e-46a8-b388-36d782178b02 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:34:07 devstack sudo[89487]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-4a585577-9f1e-46a8-b388-36d782178b02 Jul 10 04:34:07 devstack sudo[89487]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:34:08 devstack sudo[89487]: pam_unix(sudo:session): session closed for user root Jul 10 04:34:08 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-0f3a5b4d-310d-4f8d-bf56-d18de3002076 tempest-DeleteServersTestJSON-624270783 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-4a585577-9f1e-46a8-b388-36d782178b02" returned: 0 in 1.061s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:34:08 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-0f3a5b4d-310d-4f8d-bf56-d18de3002076 tempest-DeleteServersTestJSON-624270783 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-4a585577-9f1e-46a8-b388-36d782178b02 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:34:08 devstack sudo[89509]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-4a585577-9f1e-46a8-b388-36d782178b02 Jul 10 04:34:08 devstack sudo[89509]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:34:09 devstack sudo[89509]: pam_unix(sudo:session): session closed for user root Jul 10 04:34:09 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-0f3a5b4d-310d-4f8d-bf56-d18de3002076 tempest-DeleteServersTestJSON-624270783 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-4a585577-9f1e-46a8-b388-36d782178b02" returned: 0 in 0.756s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:34:09 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-0f3a5b4d-310d-4f8d-bf56-d18de3002076 tempest-DeleteServersTestJSON-624270783 None] Lock "cinder-quobyte-4a585577-9f1e-46a8-b388-36d782178b02" released by "delete_volume" :: held 1.869s {{(pid=87444) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 04:34:09 devstack cinder-volume[87444]: DEBUG cinder.quota [None req-0f3a5b4d-310d-4f8d-bf56-d18de3002076 tempest-DeleteServersTestJSON-624270783 None] Created reservations ['233ebd22-4424-4aa3-8a2e-bed757a979c3', '07ff01dd-a529-419a-8f34-89c1820a0d26', 'd202b293-0d0e-4741-a0a2-90403e730d81', '93bf9a2f-1c38-4d24-92b3-e21392989cff'] {{(pid=87444) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 04:34:09 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-0f3a5b4d-310d-4f8d-bf56-d18de3002076 tempest-DeleteServersTestJSON-624270783 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 04:34:09 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-0f3a5b4d-310d-4f8d-bf56-d18de3002076 tempest-DeleteServersTestJSON-624270783 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 04:34:09 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-0f3a5b4d-310d-4f8d-bf56-d18de3002076 tempest-DeleteServersTestJSON-624270783 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922': None} {{(pid=87444) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 04:34:09 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-0f3a5b4d-310d-4f8d-bf56-d18de3002076 tempest-DeleteServersTestJSON-624270783 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922'] {{(pid=87444) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 04:34:09 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-0f3a5b4d-310d-4f8d-bf56-d18de3002076 tempest-DeleteServersTestJSON-624270783 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 04:34:09 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-0f3a5b4d-310d-4f8d-bf56-d18de3002076 tempest-DeleteServersTestJSON-624270783 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:34:09 devstack sudo[89514]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097 Jul 10 04:34:09 devstack sudo[89514]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:34:10 devstack sudo[89514]: pam_unix(sudo:session): session closed for user root Jul 10 04:34:10 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-0f3a5b4d-310d-4f8d-bf56-d18de3002076 tempest-DeleteServersTestJSON-624270783 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097" returned: 0 in 0.760s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:34:10 devstack cinder-volume[87444]: DEBUG cinder.manager [None req-0f3a5b4d-310d-4f8d-bf56-d18de3002076 tempest-DeleteServersTestJSON-624270783 None] Notifying Schedulers of capabilities ... {{(pid=87444) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 04:34:10 devstack cinder-volume[87444]: INFO cinder.volume.manager [None req-0f3a5b4d-310d-4f8d-bf56-d18de3002076 tempest-DeleteServersTestJSON-624270783 None] Deleted volume successfully. Jul 10 04:34:10 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-0f3a5b4d-310d-4f8d-bf56-d18de3002076 tempest-DeleteServersTestJSON-624270783 None] Lock "cinder-4a585577-9f1e-46a8-b388-36d782178b02-delete_volume" released by "delete_volume" :: held 2.961s {{(pid=87444) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 04:34:19 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-d2565002-8e88-41fc-b4ce-fd75283c9475 tempest-TaggedAttachmentsTest-1032224018 None] Acquiring lock "cinder-006aa19d-4fd9-4582-b557-35187c1b3b53-delete_volume" by "delete_volume" {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 04:34:19 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-d2565002-8e88-41fc-b4ce-fd75283c9475 tempest-TaggedAttachmentsTest-1032224018 None] Lock "cinder-006aa19d-4fd9-4582-b557-35187c1b3b53-delete_volume" acquired by "delete_volume" :: waited 0.049s {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 04:34:19 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-d2565002-8e88-41fc-b4ce-fd75283c9475 tempest-TaggedAttachmentsTest-1032224018 None] Acquiring lock "cinder-quobyte-006aa19d-4fd9-4582-b557-35187c1b3b53" by "delete_volume" {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 04:34:19 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-d2565002-8e88-41fc-b4ce-fd75283c9475 tempest-TaggedAttachmentsTest-1032224018 None] Lock "cinder-quobyte-006aa19d-4fd9-4582-b557-35187c1b3b53" acquired by "delete_volume" :: waited 0.075s {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 04:34:19 devstack cinder-volume[87444]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d042c8c-8013-45ef-8d2d-68d3bb1d5f2b]: (4, 'qcow2') {{(pid=88499) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 04:34:19 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-d2565002-8e88-41fc-b4ce-fd75283c9475 tempest-TaggedAttachmentsTest-1032224018 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-006aa19d-4fd9-4582-b557-35187c1b3b53 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:34:19 devstack sudo[89698]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-006aa19d-4fd9-4582-b557-35187c1b3b53 Jul 10 04:34:19 devstack sudo[89698]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:34:21 devstack sudo[89698]: pam_unix(sudo:session): session closed for user root Jul 10 04:34:21 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-d2565002-8e88-41fc-b4ce-fd75283c9475 tempest-TaggedAttachmentsTest-1032224018 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-006aa19d-4fd9-4582-b557-35187c1b3b53" returned: 0 in 1.521s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:34:21 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-d2565002-8e88-41fc-b4ce-fd75283c9475 tempest-TaggedAttachmentsTest-1032224018 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-006aa19d-4fd9-4582-b557-35187c1b3b53 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:34:21 devstack sudo[89705]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-006aa19d-4fd9-4582-b557-35187c1b3b53 Jul 10 04:34:21 devstack sudo[89705]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:34:22 devstack sudo[89705]: pam_unix(sudo:session): session closed for user root Jul 10 04:34:22 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-d2565002-8e88-41fc-b4ce-fd75283c9475 tempest-TaggedAttachmentsTest-1032224018 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-006aa19d-4fd9-4582-b557-35187c1b3b53" returned: 0 in 1.281s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:34:22 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-d2565002-8e88-41fc-b4ce-fd75283c9475 tempest-TaggedAttachmentsTest-1032224018 None] Lock "cinder-quobyte-006aa19d-4fd9-4582-b557-35187c1b3b53" released by "delete_volume" :: held 2.936s {{(pid=87444) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 04:34:22 devstack cinder-volume[87444]: DEBUG cinder.quota [None req-d2565002-8e88-41fc-b4ce-fd75283c9475 tempest-TaggedAttachmentsTest-1032224018 None] Created reservations ['71fee235-e806-46bc-a8ff-139d87e4083b', '922ccb5b-cccf-4e69-aa2f-5a67f8985b03', 'ed12defa-2a48-47de-8aa8-90cdc366bbf7', '4601281e-5b68-496e-b938-c3820fc7cc06'] {{(pid=87444) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 04:34:22 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-d2565002-8e88-41fc-b4ce-fd75283c9475 tempest-TaggedAttachmentsTest-1032224018 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 04:34:22 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-d2565002-8e88-41fc-b4ce-fd75283c9475 tempest-TaggedAttachmentsTest-1032224018 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 04:34:22 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-d2565002-8e88-41fc-b4ce-fd75283c9475 tempest-TaggedAttachmentsTest-1032224018 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922': None} {{(pid=87444) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 04:34:22 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-d2565002-8e88-41fc-b4ce-fd75283c9475 tempest-TaggedAttachmentsTest-1032224018 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922'] {{(pid=87444) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 04:34:22 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-d2565002-8e88-41fc-b4ce-fd75283c9475 tempest-TaggedAttachmentsTest-1032224018 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.034s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 04:34:22 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-d2565002-8e88-41fc-b4ce-fd75283c9475 tempest-TaggedAttachmentsTest-1032224018 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:34:22 devstack sudo[89710]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097 Jul 10 04:34:22 devstack sudo[89710]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:34:24 devstack sudo[89710]: pam_unix(sudo:session): session closed for user root Jul 10 04:34:24 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-d2565002-8e88-41fc-b4ce-fd75283c9475 tempest-TaggedAttachmentsTest-1032224018 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097" returned: 0 in 1.481s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:34:24 devstack cinder-volume[87444]: DEBUG cinder.manager [None req-d2565002-8e88-41fc-b4ce-fd75283c9475 tempest-TaggedAttachmentsTest-1032224018 None] Notifying Schedulers of capabilities ... {{(pid=87444) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 04:34:24 devstack cinder-volume[87444]: INFO cinder.volume.manager [None req-d2565002-8e88-41fc-b4ce-fd75283c9475 tempest-TaggedAttachmentsTest-1032224018 None] Deleted volume successfully. Jul 10 04:34:24 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-d2565002-8e88-41fc-b4ce-fd75283c9475 tempest-TaggedAttachmentsTest-1032224018 None] Lock "cinder-006aa19d-4fd9-4582-b557-35187c1b3b53-delete_volume" released by "delete_volume" :: held 4.894s {{(pid=87444) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 04:34:32 devstack cinder-volume[87444]: DEBUG dbcounter [-] [87444] Writing DB stats cinder:UPDATE=20,cinder:SELECT=26,cinder:DELETE=2,cinder:INSERT=3 {{(pid=87444) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 10 04:34:32 devstack cinder-volume[87444]: DEBUG oslo_service.periodic_task [None req-01f0ce3e-6850-4e14-881d-e40d3c4ad6e5 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87444) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 10 04:34:32 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-01f0ce3e-6850-4e14-881d-e40d3c4ad6e5 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 04:34:32 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-01f0ce3e-6850-4e14-881d-e40d3c4ad6e5 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 04:34:32 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-01f0ce3e-6850-4e14-881d-e40d3c4ad6e5 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922': None} {{(pid=87444) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 04:34:33 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-01f0ce3e-6850-4e14-881d-e40d3c4ad6e5 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922'] {{(pid=87444) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 04:34:33 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-01f0ce3e-6850-4e14-881d-e40d3c4ad6e5 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 04:34:33 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-01f0ce3e-6850-4e14-881d-e40d3c4ad6e5 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:34:33 devstack sudo[89773]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097 Jul 10 04:34:33 devstack sudo[89773]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:34:34 devstack cinder-volume[87444]: DEBUG dbcounter [-] [87444] Writing DB stats cinder:SELECT=24,cinder:UPDATE=24,cinder:INSERT=6,cinder:DELETE=1 {{(pid=87444) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 10 04:34:34 devstack sudo[89773]: pam_unix(sudo:session): session closed for user root Jul 10 04:34:34 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-01f0ce3e-6850-4e14-881d-e40d3c4ad6e5 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097" returned: 0 in 1.323s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:34:34 devstack cinder-volume[87444]: DEBUG cinder.manager [None req-01f0ce3e-6850-4e14-881d-e40d3c4ad6e5 None None] Notifying Schedulers of capabilities ... {{(pid=87444) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 04:34:34 devstack cinder-volume[87444]: DEBUG oslo_service.periodic_task [None req-01f0ce3e-6850-4e14-881d-e40d3c4ad6e5 None None] Running periodic task VolumeManager._thread_info {{(pid=87444) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 10 04:34:34 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-01f0ce3e-6850-4e14-881d-e40d3c4ad6e5 None None] thread count: 8 {{(pid=87444) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 10 04:34:34 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-01f0ce3e-6850-4e14-881d-e40d3c4ad6e5 None None] thread info: [<_MainThread(MainThread, started 126839257915520)>, , , , , , , ] {{(pid=87444) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 10 04:34:45 devstack cinder-volume[87444]: DEBUG cinder.volume.flows.manager.create_volume [None req-bf0756b7-57d2-496b-9dc5-bb45a7fdb3e4 tempest-AttachVolumeNegativeTest-538483290 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87444) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 04:34:45 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-bf0756b7-57d2-496b-9dc5-bb45a7fdb3e4 tempest-AttachVolumeNegativeTest-538483290 None] Flow 'volume_create_manager' (78e3bf9c-32d1-4b1a-a91a-3750ee0b0184) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 04:34:45 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-bf0756b7-57d2-496b-9dc5-bb45a7fdb3e4 tempest-AttachVolumeNegativeTest-538483290 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (22af23ce-07b7-414a-90d7-503cf23d7924) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:34:45 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-bf0756b7-57d2-496b-9dc5-bb45a7fdb3e4 tempest-AttachVolumeNegativeTest-538483290 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (22af23ce-07b7-414a-90d7-503cf23d7924) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T02:34:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-130727183',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4462598e-fc33-4db1-884b-d68b9fce2f26,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='29fcd8a4a5154aac8d732f7c646222a9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T02:34:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T02:34:46Z,use_quota=True,user_id='cef39b8882e44f7181e1d9bd61d176a3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(317e369e-1e06-434d-ae95-a335f0e6c903),volume_type_id=317e369e-1e06-434d-ae95-a335f0e6c903)' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:34:45 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-bf0756b7-57d2-496b-9dc5-bb45a7fdb3e4 tempest-AttachVolumeNegativeTest-538483290 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ffb0dd3b-6e2e-44c9-a5e0-6bb882504a3f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:34:45 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-bf0756b7-57d2-496b-9dc5-bb45a7fdb3e4 tempest-AttachVolumeNegativeTest-538483290 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ffb0dd3b-6e2e-44c9-a5e0-6bb882504a3f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:34:45 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-bf0756b7-57d2-496b-9dc5-bb45a7fdb3e4 tempest-AttachVolumeNegativeTest-538483290 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (77cd744b-e08c-4af2-b0d8-8b9e91023b41) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:34:45 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-bf0756b7-57d2-496b-9dc5-bb45a7fdb3e4 tempest-AttachVolumeNegativeTest-538483290 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (77cd744b-e08c-4af2-b0d8-8b9e91023b41) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4462598e-fc33-4db1-884b-d68b9fce2f26', 'volume_name': 'volume-4462598e-fc33-4db1-884b-d68b9fce2f26', 'volume_size': 1}' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:34:45 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-bf0756b7-57d2-496b-9dc5-bb45a7fdb3e4 tempest-AttachVolumeNegativeTest-538483290 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5b6bc94c-a4da-48af-a392-184413cf093e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:34:45 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-bf0756b7-57d2-496b-9dc5-bb45a7fdb3e4 tempest-AttachVolumeNegativeTest-538483290 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5b6bc94c-a4da-48af-a392-184413cf093e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:34:45 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-bf0756b7-57d2-496b-9dc5-bb45a7fdb3e4 tempest-AttachVolumeNegativeTest-538483290 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (19230576-7bd1-4309-8120-617645d76a7e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:34:45 devstack cinder-volume[87444]: INFO cinder.volume.flows.manager.create_volume [None req-bf0756b7-57d2-496b-9dc5-bb45a7fdb3e4 tempest-AttachVolumeNegativeTest-538483290 None] Volume 4462598e-fc33-4db1-884b-d68b9fce2f26: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4462598e-fc33-4db1-884b-d68b9fce2f26', 'volume_size': 1} Jul 10 04:34:45 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-bf0756b7-57d2-496b-9dc5-bb45a7fdb3e4 tempest-AttachVolumeNegativeTest-538483290 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 04:34:45 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-bf0756b7-57d2-496b-9dc5-bb45a7fdb3e4 tempest-AttachVolumeNegativeTest-538483290 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 04:34:45 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-bf0756b7-57d2-496b-9dc5-bb45a7fdb3e4 tempest-AttachVolumeNegativeTest-538483290 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T02:34:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-130727183',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4462598e-fc33-4db1-884b-d68b9fce2f26,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='29fcd8a4a5154aac8d732f7c646222a9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T02:34:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T02:34:46Z,use_quota=True,user_id='cef39b8882e44f7181e1d9bd61d176a3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(317e369e-1e06-434d-ae95-a335f0e6c903),volume_type_id=317e369e-1e06-434d-ae95-a335f0e6c903)}" {{(pid=87444) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 04:34:45 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.remotefs [None req-bf0756b7-57d2-496b-9dc5-bb45a7fdb3e4 tempest-AttachVolumeNegativeTest-538483290 None] Creating volume 4462598e-fc33-4db1-884b-d68b9fce2f26 {{(pid=87444) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 04:34:45 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-bf0756b7-57d2-496b-9dc5-bb45a7fdb3e4 tempest-AttachVolumeNegativeTest-538483290 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 04:34:45 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-bf0756b7-57d2-496b-9dc5-bb45a7fdb3e4 tempest-AttachVolumeNegativeTest-538483290 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 04:34:45 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-bf0756b7-57d2-496b-9dc5-bb45a7fdb3e4 tempest-AttachVolumeNegativeTest-538483290 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922': None} {{(pid=87444) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 04:34:45 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-bf0756b7-57d2-496b-9dc5-bb45a7fdb3e4 tempest-AttachVolumeNegativeTest-538483290 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922'] {{(pid=87444) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 04:34:45 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-bf0756b7-57d2-496b-9dc5-bb45a7fdb3e4 tempest-AttachVolumeNegativeTest-538483290 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 04:34:45 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-bf0756b7-57d2-496b-9dc5-bb45a7fdb3e4 tempest-AttachVolumeNegativeTest-538483290 None] Selected osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922 as target Quobyte volume. {{(pid=87444) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 04:34:45 devstack cinder-volume[87444]: INFO cinder.volume.drivers.remotefs [None req-bf0756b7-57d2-496b-9dc5-bb45a7fdb3e4 tempest-AttachVolumeNegativeTest-538483290 None] casted to osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922 Jul 10 04:34:45 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-bf0756b7-57d2-496b-9dc5-bb45a7fdb3e4 tempest-AttachVolumeNegativeTest-538483290 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-4462598e-fc33-4db1-884b-d68b9fce2f26 1073741824 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:34:45 devstack sudo[89853]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-4462598e-fc33-4db1-884b-d68b9fce2f26 1073741824 Jul 10 04:34:45 devstack sudo[89853]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:34:47 devstack sudo[89853]: pam_unix(sudo:session): session closed for user root Jul 10 04:34:47 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-bf0756b7-57d2-496b-9dc5-bb45a7fdb3e4 tempest-AttachVolumeNegativeTest-538483290 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-4462598e-fc33-4db1-884b-d68b9fce2f26 1073741824" returned: 0 in 1.540s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:34:47 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-bf0756b7-57d2-496b-9dc5-bb45a7fdb3e4 tempest-AttachVolumeNegativeTest-538483290 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-4462598e-fc33-4db1-884b-d68b9fce2f26 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:34:47 devstack sudo[89871]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-4462598e-fc33-4db1-884b-d68b9fce2f26 Jul 10 04:34:47 devstack sudo[89871]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:34:47 devstack cinder-volume[87444]: DEBUG cinder.volume.flows.manager.create_volume [None req-e3405039-9d66-43d9-b3c4-9042daad346a tempest-AttachVolumeTestJSON-83712851 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87444) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 04:34:47 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-e3405039-9d66-43d9-b3c4-9042daad346a tempest-AttachVolumeTestJSON-83712851 None] Flow 'volume_create_manager' (4ab4ce03-56fc-4b3f-bd24-393dad0e2670) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 04:34:47 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-e3405039-9d66-43d9-b3c4-9042daad346a tempest-AttachVolumeTestJSON-83712851 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2e9cd488-922c-4f89-b3fe-f85f649f101a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:34:47 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-e3405039-9d66-43d9-b3c4-9042daad346a tempest-AttachVolumeTestJSON-83712851 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2e9cd488-922c-4f89-b3fe-f85f649f101a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T02:34:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1301864509',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9dcd111d-4c76-4047-8756-77a57720f402,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='09cffa6d710e4979be4a1aa7d69e8d1f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T02:34:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T02:34:47Z,use_quota=True,user_id='37611270de3f4371b8c876167fa097ec',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(317e369e-1e06-434d-ae95-a335f0e6c903),volume_type_id=317e369e-1e06-434d-ae95-a335f0e6c903)' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:34:47 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-e3405039-9d66-43d9-b3c4-9042daad346a tempest-AttachVolumeTestJSON-83712851 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (374885ae-fb2f-4e67-bbe2-bde5de4b5647) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:34:47 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-e3405039-9d66-43d9-b3c4-9042daad346a tempest-AttachVolumeTestJSON-83712851 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (374885ae-fb2f-4e67-bbe2-bde5de4b5647) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:34:47 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-e3405039-9d66-43d9-b3c4-9042daad346a tempest-AttachVolumeTestJSON-83712851 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6cb03c55-6d5c-4f75-aa18-bc1a2c35ed23) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:34:47 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-e3405039-9d66-43d9-b3c4-9042daad346a tempest-AttachVolumeTestJSON-83712851 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6cb03c55-6d5c-4f75-aa18-bc1a2c35ed23) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9dcd111d-4c76-4047-8756-77a57720f402', 'volume_name': 'volume-9dcd111d-4c76-4047-8756-77a57720f402', 'volume_size': 1}' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:34:47 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-e3405039-9d66-43d9-b3c4-9042daad346a tempest-AttachVolumeTestJSON-83712851 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3eb87699-2721-4892-be7f-b92faea93b1f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:34:47 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-e3405039-9d66-43d9-b3c4-9042daad346a tempest-AttachVolumeTestJSON-83712851 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3eb87699-2721-4892-be7f-b92faea93b1f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:34:47 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-e3405039-9d66-43d9-b3c4-9042daad346a tempest-AttachVolumeTestJSON-83712851 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b17b4e2a-d470-4913-a1f7-6ae38d902e2e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:34:47 devstack cinder-volume[87444]: INFO cinder.volume.flows.manager.create_volume [None req-e3405039-9d66-43d9-b3c4-9042daad346a tempest-AttachVolumeTestJSON-83712851 None] Volume 9dcd111d-4c76-4047-8756-77a57720f402: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9dcd111d-4c76-4047-8756-77a57720f402', 'volume_size': 1} Jul 10 04:34:47 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-e3405039-9d66-43d9-b3c4-9042daad346a tempest-AttachVolumeTestJSON-83712851 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 04:34:48 devstack sudo[89871]: pam_unix(sudo:session): session closed for user root Jul 10 04:34:48 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-bf0756b7-57d2-496b-9dc5-bb45a7fdb3e4 tempest-AttachVolumeNegativeTest-538483290 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-4462598e-fc33-4db1-884b-d68b9fce2f26" returned: 0 in 1.030s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:34:48 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-bf0756b7-57d2-496b-9dc5-bb45a7fdb3e4 tempest-AttachVolumeNegativeTest-538483290 None] <== create_volume: return (2640ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922'} {{(pid=87444) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 04:34:48 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-bf0756b7-57d2-496b-9dc5-bb45a7fdb3e4 tempest-AttachVolumeNegativeTest-538483290 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.642s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 04:34:48 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-e3405039-9d66-43d9-b3c4-9042daad346a tempest-AttachVolumeTestJSON-83712851 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.568s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 04:34:48 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-e3405039-9d66-43d9-b3c4-9042daad346a tempest-AttachVolumeTestJSON-83712851 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T02:34:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1301864509',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9dcd111d-4c76-4047-8756-77a57720f402,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='09cffa6d710e4979be4a1aa7d69e8d1f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T02:34:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T02:34:47Z,use_quota=True,user_id='37611270de3f4371b8c876167fa097ec',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(317e369e-1e06-434d-ae95-a335f0e6c903),volume_type_id=317e369e-1e06-434d-ae95-a335f0e6c903)}" {{(pid=87444) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 04:34:48 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.remotefs [None req-e3405039-9d66-43d9-b3c4-9042daad346a tempest-AttachVolumeTestJSON-83712851 None] Creating volume 9dcd111d-4c76-4047-8756-77a57720f402 {{(pid=87444) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 04:34:48 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-e3405039-9d66-43d9-b3c4-9042daad346a tempest-AttachVolumeTestJSON-83712851 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 04:34:48 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-e3405039-9d66-43d9-b3c4-9042daad346a tempest-AttachVolumeTestJSON-83712851 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 04:34:48 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-e3405039-9d66-43d9-b3c4-9042daad346a tempest-AttachVolumeTestJSON-83712851 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922': None} {{(pid=87444) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 04:34:48 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-e3405039-9d66-43d9-b3c4-9042daad346a tempest-AttachVolumeTestJSON-83712851 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922'] {{(pid=87444) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 04:34:48 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-e3405039-9d66-43d9-b3c4-9042daad346a tempest-AttachVolumeTestJSON-83712851 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 04:34:48 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-e3405039-9d66-43d9-b3c4-9042daad346a tempest-AttachVolumeTestJSON-83712851 None] Selected osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922 as target Quobyte volume. {{(pid=87444) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 04:34:48 devstack cinder-volume[87444]: INFO cinder.volume.drivers.remotefs [None req-e3405039-9d66-43d9-b3c4-9042daad346a tempest-AttachVolumeTestJSON-83712851 None] casted to osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922 Jul 10 04:34:48 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-e3405039-9d66-43d9-b3c4-9042daad346a tempest-AttachVolumeTestJSON-83712851 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-9dcd111d-4c76-4047-8756-77a57720f402 1073741824 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:34:48 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-bf0756b7-57d2-496b-9dc5-bb45a7fdb3e4 tempest-AttachVolumeNegativeTest-538483290 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (19230576-7bd1-4309-8120-617645d76a7e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4462598e-fc33-4db1-884b-d68b9fce2f26', 'volume_size': 1}' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:34:48 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-bf0756b7-57d2-496b-9dc5-bb45a7fdb3e4 tempest-AttachVolumeNegativeTest-538483290 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c4fee32d-8244-4b23-bed2-bfbd083d011a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:34:48 devstack sudo[89884]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-9dcd111d-4c76-4047-8756-77a57720f402 1073741824 Jul 10 04:34:48 devstack sudo[89884]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:34:48 devstack cinder-volume[87444]: INFO cinder.volume.flows.manager.create_volume [None req-bf0756b7-57d2-496b-9dc5-bb45a7fdb3e4 tempest-AttachVolumeNegativeTest-538483290 None] Volume volume-4462598e-fc33-4db1-884b-d68b9fce2f26 (4462598e-fc33-4db1-884b-d68b9fce2f26): created successfully Jul 10 04:34:48 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-bf0756b7-57d2-496b-9dc5-bb45a7fdb3e4 tempest-AttachVolumeNegativeTest-538483290 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c4fee32d-8244-4b23-bed2-bfbd083d011a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:34:48 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-bf0756b7-57d2-496b-9dc5-bb45a7fdb3e4 tempest-AttachVolumeNegativeTest-538483290 None] Flow 'volume_create_manager' (78e3bf9c-32d1-4b1a-a91a-3750ee0b0184) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87444) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 04:34:48 devstack cinder-volume[87444]: INFO cinder.volume.manager [None req-bf0756b7-57d2-496b-9dc5-bb45a7fdb3e4 tempest-AttachVolumeNegativeTest-538483290 None] Created volume successfully. Jul 10 04:34:49 devstack sudo[89884]: pam_unix(sudo:session): session closed for user root Jul 10 04:34:49 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-e3405039-9d66-43d9-b3c4-9042daad346a tempest-AttachVolumeTestJSON-83712851 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-9dcd111d-4c76-4047-8756-77a57720f402 1073741824" returned: 0 in 1.066s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:34:49 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-e3405039-9d66-43d9-b3c4-9042daad346a tempest-AttachVolumeTestJSON-83712851 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-9dcd111d-4c76-4047-8756-77a57720f402 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:34:49 devstack sudo[89896]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-9dcd111d-4c76-4047-8756-77a57720f402 Jul 10 04:34:49 devstack sudo[89896]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:34:50 devstack sudo[89896]: pam_unix(sudo:session): session closed for user root Jul 10 04:34:50 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-e3405039-9d66-43d9-b3c4-9042daad346a tempest-AttachVolumeTestJSON-83712851 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-9dcd111d-4c76-4047-8756-77a57720f402" returned: 0 in 0.810s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:34:50 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-e3405039-9d66-43d9-b3c4-9042daad346a tempest-AttachVolumeTestJSON-83712851 None] <== create_volume: return (1946ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922'} {{(pid=87444) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 04:34:50 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-e3405039-9d66-43d9-b3c4-9042daad346a tempest-AttachVolumeTestJSON-83712851 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.949s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 04:34:50 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-e3405039-9d66-43d9-b3c4-9042daad346a tempest-AttachVolumeTestJSON-83712851 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b17b4e2a-d470-4913-a1f7-6ae38d902e2e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9dcd111d-4c76-4047-8756-77a57720f402', 'volume_size': 1}' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:34:50 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-e3405039-9d66-43d9-b3c4-9042daad346a tempest-AttachVolumeTestJSON-83712851 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2bef8d4f-0078-4cf8-81a4-c851b8c43530) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:34:50 devstack cinder-volume[87444]: INFO cinder.volume.flows.manager.create_volume [None req-e3405039-9d66-43d9-b3c4-9042daad346a tempest-AttachVolumeTestJSON-83712851 None] Volume volume-9dcd111d-4c76-4047-8756-77a57720f402 (9dcd111d-4c76-4047-8756-77a57720f402): created successfully Jul 10 04:34:50 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-e3405039-9d66-43d9-b3c4-9042daad346a tempest-AttachVolumeTestJSON-83712851 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2bef8d4f-0078-4cf8-81a4-c851b8c43530) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:34:50 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-e3405039-9d66-43d9-b3c4-9042daad346a tempest-AttachVolumeTestJSON-83712851 None] Flow 'volume_create_manager' (4ab4ce03-56fc-4b3f-bd24-393dad0e2670) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87444) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 04:34:50 devstack cinder-volume[87444]: INFO cinder.volume.manager [None req-e3405039-9d66-43d9-b3c4-9042daad346a tempest-AttachVolumeTestJSON-83712851 None] Created volume successfully. Jul 10 04:34:52 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [req-58b199a7-faa9-4f8c-a9c7-0ccfcb109e5c req-08b2d784-dbfa-458c-a939-f175f7ab0118 tempest-AttachVolumeNegativeTest-538483290 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 04:34:52 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [req-58b199a7-faa9-4f8c-a9c7-0ccfcb109e5c req-08b2d784-dbfa-458c-a939-f175f7ab0118 tempest-AttachVolumeNegativeTest-538483290 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 04:34:52 devstack cinder-volume[87444]: DEBUG oslo.privsep.daemon [-] privsep: reply[8740e6a2-966d-4be2-a332-8e13bb304759]: (4, 'qcow2') {{(pid=88499) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 04:34:52 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [req-58b199a7-faa9-4f8c-a9c7-0ccfcb109e5c req-08b2d784-dbfa-458c-a939-f175f7ab0118 tempest-AttachVolumeNegativeTest-538483290 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-4462598e-fc33-4db1-884b-d68b9fce2f26 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:34:52 devstack sudo[89912]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-4462598e-fc33-4db1-884b-d68b9fce2f26 Jul 10 04:34:52 devstack sudo[89912]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:34:53 devstack sudo[89912]: pam_unix(sudo:session): session closed for user root Jul 10 04:34:53 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [req-58b199a7-faa9-4f8c-a9c7-0ccfcb109e5c req-08b2d784-dbfa-458c-a939-f175f7ab0118 tempest-AttachVolumeNegativeTest-538483290 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-4462598e-fc33-4db1-884b-d68b9fce2f26" returned: 0 in 1.125s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:34:53 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [req-58b199a7-faa9-4f8c-a9c7-0ccfcb109e5c req-08b2d784-dbfa-458c-a939-f175f7ab0118 tempest-AttachVolumeNegativeTest-538483290 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.145s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 04:34:53 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [req-58b199a7-faa9-4f8c-a9c7-0ccfcb109e5c req-08b2d784-dbfa-458c-a939-f175f7ab0118 tempest-AttachVolumeNegativeTest-538483290 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922', 'name': 'volume-4462598e-fc33-4db1-884b-d68b9fce2f26', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'ec116af1-1ae3-4735-ab47-37a987be5170', 'enforce_multipath': True} {{(pid=87444) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 10 04:34:53 devstack cinder-volume[87444]: INFO cinder.volume.manager [req-58b199a7-faa9-4f8c-a9c7-0ccfcb109e5c req-08b2d784-dbfa-458c-a939-f175f7ab0118 tempest-AttachVolumeNegativeTest-538483290 None] attachment_update completed successfully. Jul 10 04:34:53 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [req-425a4cad-c0da-4a20-b9be-93f0117d4221 req-e44b4ac3-3674-4b04-b685-be691e456b03 tempest-AttachVolumeTestJSON-83712851 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 04:34:53 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [req-425a4cad-c0da-4a20-b9be-93f0117d4221 req-e44b4ac3-3674-4b04-b685-be691e456b03 tempest-AttachVolumeTestJSON-83712851 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 04:34:53 devstack cinder-volume[87444]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1988b89-5697-457a-9f5e-877464945c16]: (4, 'qcow2') {{(pid=88499) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 04:34:53 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [req-425a4cad-c0da-4a20-b9be-93f0117d4221 req-e44b4ac3-3674-4b04-b685-be691e456b03 tempest-AttachVolumeTestJSON-83712851 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-9dcd111d-4c76-4047-8756-77a57720f402 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:34:54 devstack sudo[90041]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-9dcd111d-4c76-4047-8756-77a57720f402 Jul 10 04:34:54 devstack sudo[90041]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:34:54 devstack sudo[90041]: pam_unix(sudo:session): session closed for user root Jul 10 04:34:54 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [req-425a4cad-c0da-4a20-b9be-93f0117d4221 req-e44b4ac3-3674-4b04-b685-be691e456b03 tempest-AttachVolumeTestJSON-83712851 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-9dcd111d-4c76-4047-8756-77a57720f402" returned: 0 in 0.894s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:34:54 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [req-425a4cad-c0da-4a20-b9be-93f0117d4221 req-e44b4ac3-3674-4b04-b685-be691e456b03 tempest-AttachVolumeTestJSON-83712851 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.912s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 04:34:54 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [req-425a4cad-c0da-4a20-b9be-93f0117d4221 req-e44b4ac3-3674-4b04-b685-be691e456b03 tempest-AttachVolumeTestJSON-83712851 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922', 'name': 'volume-9dcd111d-4c76-4047-8756-77a57720f402', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '214d0ad0-99d1-4018-9a1e-f97b2b3de261', 'enforce_multipath': True} {{(pid=87444) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 10 04:34:54 devstack cinder-volume[87444]: INFO cinder.volume.manager [req-425a4cad-c0da-4a20-b9be-93f0117d4221 req-e44b4ac3-3674-4b04-b685-be691e456b03 tempest-AttachVolumeTestJSON-83712851 None] attachment_update completed successfully. Jul 10 04:35:04 devstack cinder-volume[87444]: DEBUG dbcounter [-] [87444] Writing DB stats cinder:SELECT=17,cinder:UPDATE=10,cinder:DELETE=1,cinder:INSERT=1 {{(pid=87444) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 10 04:35:04 devstack cinder-volume[87444]: DEBUG dbcounter [-] [87444] Writing DB stats cinder:SELECT=13,cinder:INSERT=1,cinder:UPDATE=8,cinder:DELETE=1 {{(pid=87444) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 10 04:35:19 devstack cinder-volume[87444]: DEBUG cinder.volume.flows.manager.create_volume [None req-ad419907-4cd0-425b-ade0-f5ccd6c09a8c tempest-ServerActionsTestOtherA-567324480 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87444) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 04:35:19 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-ad419907-4cd0-425b-ade0-f5ccd6c09a8c tempest-ServerActionsTestOtherA-567324480 None] Flow 'volume_create_manager' (aa9cc78f-ec85-49fa-9aec-300169ef0fd1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 04:35:19 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-ad419907-4cd0-425b-ade0-f5ccd6c09a8c tempest-ServerActionsTestOtherA-567324480 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b420f288-9096-4311-b976-b659b2a22c7b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:35:19 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-ad419907-4cd0-425b-ade0-f5ccd6c09a8c tempest-ServerActionsTestOtherA-567324480 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b420f288-9096-4311-b976-b659b2a22c7b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T02:35:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerActionsTestOtherA-volume-426161664',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=830f5883-6561-417c-9a3d-a7ace3c34623,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='109f45dcb95549f1bb0592f54c27455c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T02:35:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T02:35:20Z,use_quota=True,user_id='3d0700a78fec41ffb0df8c4ac1253fda',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(317e369e-1e06-434d-ae95-a335f0e6c903),volume_type_id=317e369e-1e06-434d-ae95-a335f0e6c903)' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:35:19 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-ad419907-4cd0-425b-ade0-f5ccd6c09a8c tempest-ServerActionsTestOtherA-567324480 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b7f0dbed-61f3-4a6d-8f4f-15ffdd51f653) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:35:19 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-ad419907-4cd0-425b-ade0-f5ccd6c09a8c tempest-ServerActionsTestOtherA-567324480 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b7f0dbed-61f3-4a6d-8f4f-15ffdd51f653) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:35:19 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-ad419907-4cd0-425b-ade0-f5ccd6c09a8c tempest-ServerActionsTestOtherA-567324480 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7ce953bf-3fc0-4feb-ad5d-09479eb1c909) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:35:19 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-ad419907-4cd0-425b-ade0-f5ccd6c09a8c tempest-ServerActionsTestOtherA-567324480 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7ce953bf-3fc0-4feb-ad5d-09479eb1c909) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '830f5883-6561-417c-9a3d-a7ace3c34623', 'volume_name': 'volume-830f5883-6561-417c-9a3d-a7ace3c34623', 'volume_size': 1}' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:35:19 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-ad419907-4cd0-425b-ade0-f5ccd6c09a8c tempest-ServerActionsTestOtherA-567324480 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (524e2ab1-c951-4a74-8cdf-0b28655f3703) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:35:19 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-ad419907-4cd0-425b-ade0-f5ccd6c09a8c tempest-ServerActionsTestOtherA-567324480 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (524e2ab1-c951-4a74-8cdf-0b28655f3703) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:35:19 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-ad419907-4cd0-425b-ade0-f5ccd6c09a8c tempest-ServerActionsTestOtherA-567324480 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cc01091d-0ea4-4cd5-b845-7b7bb73c8600) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:35:19 devstack cinder-volume[87444]: INFO cinder.volume.flows.manager.create_volume [None req-ad419907-4cd0-425b-ade0-f5ccd6c09a8c tempest-ServerActionsTestOtherA-567324480 None] Volume 830f5883-6561-417c-9a3d-a7ace3c34623: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-830f5883-6561-417c-9a3d-a7ace3c34623', 'volume_size': 1} Jul 10 04:35:19 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-ad419907-4cd0-425b-ade0-f5ccd6c09a8c tempest-ServerActionsTestOtherA-567324480 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 04:35:19 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-ad419907-4cd0-425b-ade0-f5ccd6c09a8c tempest-ServerActionsTestOtherA-567324480 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 04:35:19 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-ad419907-4cd0-425b-ade0-f5ccd6c09a8c tempest-ServerActionsTestOtherA-567324480 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T02:35:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerActionsTestOtherA-volume-426161664',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=830f5883-6561-417c-9a3d-a7ace3c34623,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='109f45dcb95549f1bb0592f54c27455c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T02:35:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T02:35:20Z,use_quota=True,user_id='3d0700a78fec41ffb0df8c4ac1253fda',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(317e369e-1e06-434d-ae95-a335f0e6c903),volume_type_id=317e369e-1e06-434d-ae95-a335f0e6c903)}" {{(pid=87444) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 04:35:19 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.remotefs [None req-ad419907-4cd0-425b-ade0-f5ccd6c09a8c tempest-ServerActionsTestOtherA-567324480 None] Creating volume 830f5883-6561-417c-9a3d-a7ace3c34623 {{(pid=87444) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 04:35:19 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-ad419907-4cd0-425b-ade0-f5ccd6c09a8c tempest-ServerActionsTestOtherA-567324480 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 04:35:19 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-ad419907-4cd0-425b-ade0-f5ccd6c09a8c tempest-ServerActionsTestOtherA-567324480 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 04:35:19 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-ad419907-4cd0-425b-ade0-f5ccd6c09a8c tempest-ServerActionsTestOtherA-567324480 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922': None} {{(pid=87444) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 04:35:19 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-ad419907-4cd0-425b-ade0-f5ccd6c09a8c tempest-ServerActionsTestOtherA-567324480 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922'] {{(pid=87444) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 04:35:19 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-ad419907-4cd0-425b-ade0-f5ccd6c09a8c tempest-ServerActionsTestOtherA-567324480 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 04:35:19 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-ad419907-4cd0-425b-ade0-f5ccd6c09a8c tempest-ServerActionsTestOtherA-567324480 None] Selected osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922 as target Quobyte volume. {{(pid=87444) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 04:35:19 devstack cinder-volume[87444]: INFO cinder.volume.drivers.remotefs [None req-ad419907-4cd0-425b-ade0-f5ccd6c09a8c tempest-ServerActionsTestOtherA-567324480 None] casted to osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922 Jul 10 04:35:19 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-ad419907-4cd0-425b-ade0-f5ccd6c09a8c tempest-ServerActionsTestOtherA-567324480 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-830f5883-6561-417c-9a3d-a7ace3c34623 1073741824 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:35:19 devstack sudo[90725]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-830f5883-6561-417c-9a3d-a7ace3c34623 1073741824 Jul 10 04:35:19 devstack sudo[90725]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:35:21 devstack sudo[90725]: pam_unix(sudo:session): session closed for user root Jul 10 04:35:21 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-ad419907-4cd0-425b-ade0-f5ccd6c09a8c tempest-ServerActionsTestOtherA-567324480 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-830f5883-6561-417c-9a3d-a7ace3c34623 1073741824" returned: 0 in 1.718s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:35:21 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-ad419907-4cd0-425b-ade0-f5ccd6c09a8c tempest-ServerActionsTestOtherA-567324480 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-830f5883-6561-417c-9a3d-a7ace3c34623 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:35:21 devstack sudo[90731]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-830f5883-6561-417c-9a3d-a7ace3c34623 Jul 10 04:35:21 devstack sudo[90731]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:35:23 devstack sudo[90731]: pam_unix(sudo:session): session closed for user root Jul 10 04:35:23 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-ad419907-4cd0-425b-ade0-f5ccd6c09a8c tempest-ServerActionsTestOtherA-567324480 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-830f5883-6561-417c-9a3d-a7ace3c34623" returned: 0 in 1.772s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:35:23 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-ad419907-4cd0-425b-ade0-f5ccd6c09a8c tempest-ServerActionsTestOtherA-567324480 None] <== create_volume: return (3603ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922'} {{(pid=87444) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 04:35:23 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-ad419907-4cd0-425b-ade0-f5ccd6c09a8c tempest-ServerActionsTestOtherA-567324480 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 3.606s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 04:35:23 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-ad419907-4cd0-425b-ade0-f5ccd6c09a8c tempest-ServerActionsTestOtherA-567324480 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cc01091d-0ea4-4cd5-b845-7b7bb73c8600) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-830f5883-6561-417c-9a3d-a7ace3c34623', 'volume_size': 1}' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:35:23 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-ad419907-4cd0-425b-ade0-f5ccd6c09a8c tempest-ServerActionsTestOtherA-567324480 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (52a403f8-13d3-4912-b33c-b10ae04d3396) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:35:23 devstack cinder-volume[87444]: INFO cinder.volume.flows.manager.create_volume [None req-ad419907-4cd0-425b-ade0-f5ccd6c09a8c tempest-ServerActionsTestOtherA-567324480 None] Volume volume-830f5883-6561-417c-9a3d-a7ace3c34623 (830f5883-6561-417c-9a3d-a7ace3c34623): created successfully Jul 10 04:35:23 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-ad419907-4cd0-425b-ade0-f5ccd6c09a8c tempest-ServerActionsTestOtherA-567324480 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (52a403f8-13d3-4912-b33c-b10ae04d3396) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:35:23 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-ad419907-4cd0-425b-ade0-f5ccd6c09a8c tempest-ServerActionsTestOtherA-567324480 None] Flow 'volume_create_manager' (aa9cc78f-ec85-49fa-9aec-300169ef0fd1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87444) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 04:35:23 devstack cinder-volume[87444]: INFO cinder.volume.manager [None req-ad419907-4cd0-425b-ade0-f5ccd6c09a8c tempest-ServerActionsTestOtherA-567324480 None] Created volume successfully. Jul 10 04:35:32 devstack cinder-volume[87444]: DEBUG oslo_service.periodic_task [None req-01f0ce3e-6850-4e14-881d-e40d3c4ad6e5 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87444) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 10 04:35:32 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-01f0ce3e-6850-4e14-881d-e40d3c4ad6e5 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 04:35:32 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-01f0ce3e-6850-4e14-881d-e40d3c4ad6e5 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 04:35:32 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-01f0ce3e-6850-4e14-881d-e40d3c4ad6e5 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922': None} {{(pid=87444) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 04:35:33 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-01f0ce3e-6850-4e14-881d-e40d3c4ad6e5 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922'] {{(pid=87444) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 04:35:33 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-01f0ce3e-6850-4e14-881d-e40d3c4ad6e5 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.033s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 04:35:33 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-01f0ce3e-6850-4e14-881d-e40d3c4ad6e5 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:35:33 devstack sudo[90881]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097 Jul 10 04:35:33 devstack sudo[90881]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:35:33 devstack sudo[90881]: pam_unix(sudo:session): session closed for user root Jul 10 04:35:33 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-01f0ce3e-6850-4e14-881d-e40d3c4ad6e5 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097" returned: 0 in 0.884s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:35:33 devstack cinder-volume[87444]: DEBUG cinder.manager [None req-01f0ce3e-6850-4e14-881d-e40d3c4ad6e5 None None] Notifying Schedulers of capabilities ... {{(pid=87444) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 04:35:33 devstack cinder-volume[87444]: DEBUG oslo_service.periodic_task [None req-01f0ce3e-6850-4e14-881d-e40d3c4ad6e5 None None] Running periodic task VolumeManager._thread_info {{(pid=87444) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 10 04:35:33 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-01f0ce3e-6850-4e14-881d-e40d3c4ad6e5 None None] thread count: 8 {{(pid=87444) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 10 04:35:33 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-01f0ce3e-6850-4e14-881d-e40d3c4ad6e5 None None] thread info: [<_MainThread(MainThread, started 126839257915520)>, , , , , , , ] {{(pid=87444) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 10 04:35:37 devstack cinder-volume[87444]: DEBUG cinder.volume.flows.manager.create_volume [None req-cba2c717-8686-4e7b-b0ab-d674e463942d tempest-AttachVolumeShelveTestJSON-610949690 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87444) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 04:35:37 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-cba2c717-8686-4e7b-b0ab-d674e463942d tempest-AttachVolumeShelveTestJSON-610949690 None] Flow 'volume_create_manager' (c728fd63-7827-4a56-b3ae-c35c5f9175e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 04:35:37 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-cba2c717-8686-4e7b-b0ab-d674e463942d tempest-AttachVolumeShelveTestJSON-610949690 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e7d95063-5879-40cb-90d0-7da3075a417b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:35:37 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-cba2c717-8686-4e7b-b0ab-d674e463942d tempest-AttachVolumeShelveTestJSON-610949690 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e7d95063-5879-40cb-90d0-7da3075a417b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T02:35:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-1765976880',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=41913b89-a2cf-4de9-b232-dd11f78c154c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='79269628b30640e884c37643df218637',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T02:35:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T02:35:37Z,use_quota=True,user_id='2069c372fda14110a12ecb1fb652c6d6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(317e369e-1e06-434d-ae95-a335f0e6c903),volume_type_id=317e369e-1e06-434d-ae95-a335f0e6c903)' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:35:37 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-cba2c717-8686-4e7b-b0ab-d674e463942d tempest-AttachVolumeShelveTestJSON-610949690 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e73d680e-88a3-46c2-91dc-f5e060c933db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:35:37 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-cba2c717-8686-4e7b-b0ab-d674e463942d tempest-AttachVolumeShelveTestJSON-610949690 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e73d680e-88a3-46c2-91dc-f5e060c933db) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:35:37 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-cba2c717-8686-4e7b-b0ab-d674e463942d tempest-AttachVolumeShelveTestJSON-610949690 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (28014953-ec22-49d4-b2f9-3687b885e5b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:35:37 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-cba2c717-8686-4e7b-b0ab-d674e463942d tempest-AttachVolumeShelveTestJSON-610949690 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (28014953-ec22-49d4-b2f9-3687b885e5b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '41913b89-a2cf-4de9-b232-dd11f78c154c', 'volume_name': 'volume-41913b89-a2cf-4de9-b232-dd11f78c154c', 'volume_size': 1}' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:35:37 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-cba2c717-8686-4e7b-b0ab-d674e463942d tempest-AttachVolumeShelveTestJSON-610949690 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (13e5973f-9979-457d-8ea5-a755374927ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:35:37 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-cba2c717-8686-4e7b-b0ab-d674e463942d tempest-AttachVolumeShelveTestJSON-610949690 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (13e5973f-9979-457d-8ea5-a755374927ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:35:37 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-cba2c717-8686-4e7b-b0ab-d674e463942d tempest-AttachVolumeShelveTestJSON-610949690 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a7c3edef-0047-4b04-a182-213a00c3044f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:35:37 devstack cinder-volume[87444]: INFO cinder.volume.flows.manager.create_volume [None req-cba2c717-8686-4e7b-b0ab-d674e463942d tempest-AttachVolumeShelveTestJSON-610949690 None] Volume 41913b89-a2cf-4de9-b232-dd11f78c154c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-41913b89-a2cf-4de9-b232-dd11f78c154c', 'volume_size': 1} Jul 10 04:35:37 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-cba2c717-8686-4e7b-b0ab-d674e463942d tempest-AttachVolumeShelveTestJSON-610949690 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 04:35:37 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-cba2c717-8686-4e7b-b0ab-d674e463942d tempest-AttachVolumeShelveTestJSON-610949690 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 04:35:37 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-cba2c717-8686-4e7b-b0ab-d674e463942d tempest-AttachVolumeShelveTestJSON-610949690 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T02:35:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-1765976880',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=41913b89-a2cf-4de9-b232-dd11f78c154c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='79269628b30640e884c37643df218637',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T02:35:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T02:35:37Z,use_quota=True,user_id='2069c372fda14110a12ecb1fb652c6d6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(317e369e-1e06-434d-ae95-a335f0e6c903),volume_type_id=317e369e-1e06-434d-ae95-a335f0e6c903)}" {{(pid=87444) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 04:35:37 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.remotefs [None req-cba2c717-8686-4e7b-b0ab-d674e463942d tempest-AttachVolumeShelveTestJSON-610949690 None] Creating volume 41913b89-a2cf-4de9-b232-dd11f78c154c {{(pid=87444) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 04:35:37 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-cba2c717-8686-4e7b-b0ab-d674e463942d tempest-AttachVolumeShelveTestJSON-610949690 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 04:35:37 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-cba2c717-8686-4e7b-b0ab-d674e463942d tempest-AttachVolumeShelveTestJSON-610949690 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 04:35:37 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-cba2c717-8686-4e7b-b0ab-d674e463942d tempest-AttachVolumeShelveTestJSON-610949690 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922': None} {{(pid=87444) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 04:35:37 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-cba2c717-8686-4e7b-b0ab-d674e463942d tempest-AttachVolumeShelveTestJSON-610949690 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922'] {{(pid=87444) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 04:35:37 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-cba2c717-8686-4e7b-b0ab-d674e463942d tempest-AttachVolumeShelveTestJSON-610949690 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 04:35:37 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-cba2c717-8686-4e7b-b0ab-d674e463942d tempest-AttachVolumeShelveTestJSON-610949690 None] Selected osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922 as target Quobyte volume. {{(pid=87444) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 04:35:37 devstack cinder-volume[87444]: INFO cinder.volume.drivers.remotefs [None req-cba2c717-8686-4e7b-b0ab-d674e463942d tempest-AttachVolumeShelveTestJSON-610949690 None] casted to osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922 Jul 10 04:35:37 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-cba2c717-8686-4e7b-b0ab-d674e463942d tempest-AttachVolumeShelveTestJSON-610949690 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-41913b89-a2cf-4de9-b232-dd11f78c154c 1073741824 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:35:37 devstack sudo[90925]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-41913b89-a2cf-4de9-b232-dd11f78c154c 1073741824 Jul 10 04:35:37 devstack sudo[90925]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:35:38 devstack sudo[90925]: pam_unix(sudo:session): session closed for user root Jul 10 04:35:38 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-cba2c717-8686-4e7b-b0ab-d674e463942d tempest-AttachVolumeShelveTestJSON-610949690 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-41913b89-a2cf-4de9-b232-dd11f78c154c 1073741824" returned: 0 in 0.850s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:35:38 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-cba2c717-8686-4e7b-b0ab-d674e463942d tempest-AttachVolumeShelveTestJSON-610949690 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-41913b89-a2cf-4de9-b232-dd11f78c154c {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:35:38 devstack sudo[90932]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-41913b89-a2cf-4de9-b232-dd11f78c154c Jul 10 04:35:38 devstack sudo[90932]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:35:39 devstack sudo[90932]: pam_unix(sudo:session): session closed for user root Jul 10 04:35:39 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-cba2c717-8686-4e7b-b0ab-d674e463942d tempest-AttachVolumeShelveTestJSON-610949690 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-41913b89-a2cf-4de9-b232-dd11f78c154c" returned: 0 in 0.748s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:35:39 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-cba2c717-8686-4e7b-b0ab-d674e463942d tempest-AttachVolumeShelveTestJSON-610949690 None] <== create_volume: return (1652ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922'} {{(pid=87444) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 04:35:39 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-cba2c717-8686-4e7b-b0ab-d674e463942d tempest-AttachVolumeShelveTestJSON-610949690 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.655s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 04:35:39 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-cba2c717-8686-4e7b-b0ab-d674e463942d tempest-AttachVolumeShelveTestJSON-610949690 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a7c3edef-0047-4b04-a182-213a00c3044f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-41913b89-a2cf-4de9-b232-dd11f78c154c', 'volume_size': 1}' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:35:39 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-cba2c717-8686-4e7b-b0ab-d674e463942d tempest-AttachVolumeShelveTestJSON-610949690 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d1c28294-3a09-4801-915d-b4419a1b97d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:35:39 devstack cinder-volume[87444]: INFO cinder.volume.flows.manager.create_volume [None req-cba2c717-8686-4e7b-b0ab-d674e463942d tempest-AttachVolumeShelveTestJSON-610949690 None] Volume volume-41913b89-a2cf-4de9-b232-dd11f78c154c (41913b89-a2cf-4de9-b232-dd11f78c154c): created successfully Jul 10 04:35:39 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-cba2c717-8686-4e7b-b0ab-d674e463942d tempest-AttachVolumeShelveTestJSON-610949690 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d1c28294-3a09-4801-915d-b4419a1b97d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:35:39 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-cba2c717-8686-4e7b-b0ab-d674e463942d tempest-AttachVolumeShelveTestJSON-610949690 None] Flow 'volume_create_manager' (c728fd63-7827-4a56-b3ae-c35c5f9175e6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87444) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 04:35:39 devstack cinder-volume[87444]: INFO cinder.volume.manager [None req-cba2c717-8686-4e7b-b0ab-d674e463942d tempest-AttachVolumeShelveTestJSON-610949690 None] Created volume successfully. Jul 10 04:35:49 devstack cinder-volume[87444]: DEBUG dbcounter [-] [87444] Writing DB stats cinder:UPDATE=8,cinder:DELETE=1,cinder:SELECT=1 {{(pid=87444) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 10 04:35:49 devstack cinder-volume[87444]: DEBUG dbcounter [-] [87444] Writing DB stats cinder:SELECT=8,cinder:INSERT=2,cinder:UPDATE=5,cinder:DELETE=1 {{(pid=87444) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 10 04:35:53 devstack cinder-volume[87444]: INFO cinder.volume.manager [req-58a57842-ff73-4e57-b205-21d78dc9bb17 req-e910dac0-2ff3-4072-99d6-879506ef6960 tempest-AttachVolumeNegativeTest-538483290 None] Terminate volume connection completed successfully. Jul 10 04:35:53 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [req-58a57842-ff73-4e57-b205-21d78dc9bb17 req-e910dac0-2ff3-4072-99d6-879506ef6960 tempest-AttachVolumeNegativeTest-538483290 None] Deleting attachment ec116af1-1ae3-4735-ab47-37a987be5170. {{(pid=87444) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 10 04:35:55 devstack cinder-volume[87444]: INFO cinder.volume.manager [req-f4d4f4ce-362b-4f1c-8e39-628175b3ddaf req-d2a03926-8b81-46f9-bd94-ea663cac807f tempest-AttachVolumeTestJSON-83712851 None] Terminate volume connection completed successfully. Jul 10 04:35:55 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [req-f4d4f4ce-362b-4f1c-8e39-628175b3ddaf req-d2a03926-8b81-46f9-bd94-ea663cac807f tempest-AttachVolumeTestJSON-83712851 None] Deleting attachment 214d0ad0-99d1-4018-9a1e-f97b2b3de261. {{(pid=87444) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 10 04:35:55 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [req-86386981-0f25-4d00-99a2-65981164a2f1 req-f353c451-7203-450d-b43b-f577a8ec091d tempest-AttachVolumeShelveTestJSON-610949690 None] No connector for attachment 60ba4312-78c8-4480-a90c-d176fa9a7654; skipping storage backend terminate_connection call. {{(pid=87444) _connection_terminate /opt/stack/cinder/cinder/volume/manager.py:5010}} Jul 10 04:35:55 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [req-86386981-0f25-4d00-99a2-65981164a2f1 req-f353c451-7203-450d-b43b-f577a8ec091d tempest-AttachVolumeShelveTestJSON-610949690 None] Deleting attachment 60ba4312-78c8-4480-a90c-d176fa9a7654. {{(pid=87444) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 10 04:36:05 devstack cinder-volume[87444]: DEBUG dbcounter [-] [87444] Writing DB stats cinder:SELECT=3 {{(pid=87444) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 10 04:36:05 devstack cinder-volume[87444]: DEBUG dbcounter [-] [87444] Writing DB stats cinder:SELECT=3 {{(pid=87444) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 10 04:36:07 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [req-03eca283-890c-409a-9cbf-0fedac475a8f req-1d4cd750-94f0-4549-863b-cc9c72cd3f0a tempest-ServerActionsTestOtherA-567324480 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 04:36:07 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [req-03eca283-890c-409a-9cbf-0fedac475a8f req-1d4cd750-94f0-4549-863b-cc9c72cd3f0a tempest-ServerActionsTestOtherA-567324480 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 04:36:07 devstack cinder-volume[87444]: DEBUG oslo.privsep.daemon [-] privsep: reply[bffcd56c-ffc9-4ef5-866e-9f5408c04088]: (4, 'qcow2') {{(pid=88499) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 04:36:07 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [req-03eca283-890c-409a-9cbf-0fedac475a8f req-1d4cd750-94f0-4549-863b-cc9c72cd3f0a tempest-ServerActionsTestOtherA-567324480 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-830f5883-6561-417c-9a3d-a7ace3c34623 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:36:07 devstack sudo[91203]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-830f5883-6561-417c-9a3d-a7ace3c34623 Jul 10 04:36:07 devstack sudo[91203]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:36:08 devstack sudo[91203]: pam_unix(sudo:session): session closed for user root Jul 10 04:36:08 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [req-03eca283-890c-409a-9cbf-0fedac475a8f req-1d4cd750-94f0-4549-863b-cc9c72cd3f0a tempest-ServerActionsTestOtherA-567324480 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-830f5883-6561-417c-9a3d-a7ace3c34623" returned: 0 in 1.456s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:36:08 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [req-03eca283-890c-409a-9cbf-0fedac475a8f req-1d4cd750-94f0-4549-863b-cc9c72cd3f0a tempest-ServerActionsTestOtherA-567324480 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.508s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 04:36:08 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [req-03eca283-890c-409a-9cbf-0fedac475a8f req-1d4cd750-94f0-4549-863b-cc9c72cd3f0a tempest-ServerActionsTestOtherA-567324480 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922', 'name': 'volume-830f5883-6561-417c-9a3d-a7ace3c34623', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '064244f8-bc1e-4225-86ff-21b262ba3964', 'enforce_multipath': True} {{(pid=87444) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 10 04:36:08 devstack cinder-volume[87444]: INFO cinder.volume.manager [req-03eca283-890c-409a-9cbf-0fedac475a8f req-1d4cd750-94f0-4549-863b-cc9c72cd3f0a tempest-ServerActionsTestOtherA-567324480 None] attachment_update completed successfully. Jul 10 04:36:17 devstack cinder-volume[87444]: INFO cinder.volume.manager [req-000fbdaf-955f-424c-aafe-60078ab12e56 req-ed176d7b-a26a-451c-ab62-d8fa42bfbe16 tempest-ServerActionsTestOtherA-567324480 None] Terminate volume connection completed successfully. Jul 10 04:36:17 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [req-000fbdaf-955f-424c-aafe-60078ab12e56 req-ed176d7b-a26a-451c-ab62-d8fa42bfbe16 tempest-ServerActionsTestOtherA-567324480 None] Deleting attachment 064244f8-bc1e-4225-86ff-21b262ba3964. {{(pid=87444) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 10 04:36:21 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [req-000fbdaf-955f-424c-aafe-60078ab12e56 req-8cc15e8b-8d2a-4a7b-820d-b4a0d20903f4 tempest-ServerActionsTestOtherA-567324480 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 04:36:21 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [req-000fbdaf-955f-424c-aafe-60078ab12e56 req-8cc15e8b-8d2a-4a7b-820d-b4a0d20903f4 tempest-ServerActionsTestOtherA-567324480 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 04:36:21 devstack cinder-volume[87444]: DEBUG oslo.privsep.daemon [-] privsep: reply[49248cd9-0d02-4e26-b64e-fb71634655db]: (4, 'qcow2') {{(pid=88499) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 04:36:21 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [req-000fbdaf-955f-424c-aafe-60078ab12e56 req-8cc15e8b-8d2a-4a7b-820d-b4a0d20903f4 tempest-ServerActionsTestOtherA-567324480 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-830f5883-6561-417c-9a3d-a7ace3c34623 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:36:21 devstack sudo[91827]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-830f5883-6561-417c-9a3d-a7ace3c34623 Jul 10 04:36:21 devstack sudo[91827]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:36:22 devstack sudo[91827]: pam_unix(sudo:session): session closed for user root Jul 10 04:36:22 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [req-000fbdaf-955f-424c-aafe-60078ab12e56 req-8cc15e8b-8d2a-4a7b-820d-b4a0d20903f4 tempest-ServerActionsTestOtherA-567324480 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-830f5883-6561-417c-9a3d-a7ace3c34623" returned: 0 in 1.349s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:36:22 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [req-000fbdaf-955f-424c-aafe-60078ab12e56 req-8cc15e8b-8d2a-4a7b-820d-b4a0d20903f4 tempest-ServerActionsTestOtherA-567324480 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.391s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 04:36:22 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [req-000fbdaf-955f-424c-aafe-60078ab12e56 req-8cc15e8b-8d2a-4a7b-820d-b4a0d20903f4 tempest-ServerActionsTestOtherA-567324480 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922', 'name': 'volume-830f5883-6561-417c-9a3d-a7ace3c34623', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'e240ff03-9e4b-4084-9070-b18af3d22177', 'enforce_multipath': True} {{(pid=87444) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 10 04:36:22 devstack cinder-volume[87444]: INFO cinder.volume.manager [req-000fbdaf-955f-424c-aafe-60078ab12e56 req-8cc15e8b-8d2a-4a7b-820d-b4a0d20903f4 tempest-ServerActionsTestOtherA-567324480 None] attachment_update completed successfully. Jul 10 04:36:32 devstack cinder-volume[87444]: DEBUG dbcounter [-] [87444] Writing DB stats cinder:SELECT=12,cinder:UPDATE=6 {{(pid=87444) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 10 04:36:32 devstack cinder-volume[87444]: DEBUG dbcounter [-] [87444] Writing DB stats cinder:SELECT=12 {{(pid=87444) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 10 04:36:32 devstack cinder-volume[87444]: DEBUG oslo_service.periodic_task [None req-01f0ce3e-6850-4e14-881d-e40d3c4ad6e5 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87444) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 10 04:36:32 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-01f0ce3e-6850-4e14-881d-e40d3c4ad6e5 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 04:36:32 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-01f0ce3e-6850-4e14-881d-e40d3c4ad6e5 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 04:36:32 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-01f0ce3e-6850-4e14-881d-e40d3c4ad6e5 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922': None} {{(pid=87444) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 04:36:33 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-01f0ce3e-6850-4e14-881d-e40d3c4ad6e5 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922'] {{(pid=87444) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 04:36:33 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-01f0ce3e-6850-4e14-881d-e40d3c4ad6e5 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 04:36:33 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-01f0ce3e-6850-4e14-881d-e40d3c4ad6e5 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:36:33 devstack sudo[92433]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097 Jul 10 04:36:33 devstack sudo[92433]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:36:34 devstack sudo[92433]: pam_unix(sudo:session): session closed for user root Jul 10 04:36:34 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-01f0ce3e-6850-4e14-881d-e40d3c4ad6e5 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097" returned: 0 in 1.116s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:36:34 devstack cinder-volume[87444]: DEBUG cinder.manager [None req-01f0ce3e-6850-4e14-881d-e40d3c4ad6e5 None None] Notifying Schedulers of capabilities ... {{(pid=87444) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 04:36:34 devstack cinder-volume[87444]: DEBUG oslo_service.periodic_task [None req-01f0ce3e-6850-4e14-881d-e40d3c4ad6e5 None None] Running periodic task VolumeManager._thread_info {{(pid=87444) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 10 04:36:34 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-01f0ce3e-6850-4e14-881d-e40d3c4ad6e5 None None] thread count: 8 {{(pid=87444) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 10 04:36:34 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-01f0ce3e-6850-4e14-881d-e40d3c4ad6e5 None None] thread info: [<_MainThread(MainThread, started 126839257915520)>, , , , , , , ] {{(pid=87444) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 10 04:36:49 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-d7ff600b-d8dd-4382-a5e7-b1889aa7df79 tempest-AttachVolumeShelveTestJSON-610949690 None] Acquiring lock "cinder-41913b89-a2cf-4de9-b232-dd11f78c154c-delete_volume" by "delete_volume" {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 04:36:49 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-d7ff600b-d8dd-4382-a5e7-b1889aa7df79 tempest-AttachVolumeShelveTestJSON-610949690 None] Lock "cinder-41913b89-a2cf-4de9-b232-dd11f78c154c-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 04:36:49 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-d7ff600b-d8dd-4382-a5e7-b1889aa7df79 tempest-AttachVolumeShelveTestJSON-610949690 None] Acquiring lock "cinder-quobyte-41913b89-a2cf-4de9-b232-dd11f78c154c" by "delete_volume" {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 04:36:49 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-d7ff600b-d8dd-4382-a5e7-b1889aa7df79 tempest-AttachVolumeShelveTestJSON-610949690 None] Lock "cinder-quobyte-41913b89-a2cf-4de9-b232-dd11f78c154c" acquired by "delete_volume" :: waited 0.018s {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 04:36:50 devstack cinder-volume[87444]: DEBUG oslo.privsep.daemon [-] privsep: reply[9108c999-e02b-417a-b7cc-29b87df6cf4b]: (4, 'qcow2') {{(pid=88499) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 04:36:50 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-d7ff600b-d8dd-4382-a5e7-b1889aa7df79 tempest-AttachVolumeShelveTestJSON-610949690 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-41913b89-a2cf-4de9-b232-dd11f78c154c {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:36:50 devstack sudo[92564]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-41913b89-a2cf-4de9-b232-dd11f78c154c Jul 10 04:36:50 devstack sudo[92564]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:36:50 devstack sudo[92564]: pam_unix(sudo:session): session closed for user root Jul 10 04:36:50 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-d7ff600b-d8dd-4382-a5e7-b1889aa7df79 tempest-AttachVolumeShelveTestJSON-610949690 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-41913b89-a2cf-4de9-b232-dd11f78c154c" returned: 0 in 0.769s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:36:50 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-d7ff600b-d8dd-4382-a5e7-b1889aa7df79 tempest-AttachVolumeShelveTestJSON-610949690 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-41913b89-a2cf-4de9-b232-dd11f78c154c {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:36:50 devstack sudo[92569]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-41913b89-a2cf-4de9-b232-dd11f78c154c Jul 10 04:36:50 devstack sudo[92569]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:36:51 devstack sudo[92569]: pam_unix(sudo:session): session closed for user root Jul 10 04:36:51 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-d7ff600b-d8dd-4382-a5e7-b1889aa7df79 tempest-AttachVolumeShelveTestJSON-610949690 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-41913b89-a2cf-4de9-b232-dd11f78c154c" returned: 0 in 0.683s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:36:51 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-d7ff600b-d8dd-4382-a5e7-b1889aa7df79 tempest-AttachVolumeShelveTestJSON-610949690 None] Lock "cinder-quobyte-41913b89-a2cf-4de9-b232-dd11f78c154c" released by "delete_volume" :: held 1.505s {{(pid=87444) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 04:36:51 devstack cinder-volume[87444]: DEBUG cinder.quota [None req-d7ff600b-d8dd-4382-a5e7-b1889aa7df79 tempest-AttachVolumeShelveTestJSON-610949690 None] Created reservations ['cc2cb733-5651-4779-88a0-0a9788f1556a', '5b1c1c9f-bc65-4568-a94f-5b1d396f3e3a', '61817241-6685-494d-a683-a8d24be9b630', '94c23a21-8983-4399-bf80-29b6ba69e7e3'] {{(pid=87444) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 04:36:51 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-d7ff600b-d8dd-4382-a5e7-b1889aa7df79 tempest-AttachVolumeShelveTestJSON-610949690 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 04:36:51 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-d7ff600b-d8dd-4382-a5e7-b1889aa7df79 tempest-AttachVolumeShelveTestJSON-610949690 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 04:36:51 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-d7ff600b-d8dd-4382-a5e7-b1889aa7df79 tempest-AttachVolumeShelveTestJSON-610949690 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922': None} {{(pid=87444) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 04:36:51 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-d7ff600b-d8dd-4382-a5e7-b1889aa7df79 tempest-AttachVolumeShelveTestJSON-610949690 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922'] {{(pid=87444) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 04:36:51 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-d7ff600b-d8dd-4382-a5e7-b1889aa7df79 tempest-AttachVolumeShelveTestJSON-610949690 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 04:36:51 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-d7ff600b-d8dd-4382-a5e7-b1889aa7df79 tempest-AttachVolumeShelveTestJSON-610949690 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:36:51 devstack sudo[92572]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097 Jul 10 04:36:51 devstack sudo[92572]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:36:52 devstack sudo[92572]: pam_unix(sudo:session): session closed for user root Jul 10 04:36:52 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-d7ff600b-d8dd-4382-a5e7-b1889aa7df79 tempest-AttachVolumeShelveTestJSON-610949690 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097" returned: 0 in 0.896s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:36:52 devstack cinder-volume[87444]: DEBUG cinder.manager [None req-d7ff600b-d8dd-4382-a5e7-b1889aa7df79 tempest-AttachVolumeShelveTestJSON-610949690 None] Notifying Schedulers of capabilities ... {{(pid=87444) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 04:36:52 devstack cinder-volume[87444]: INFO cinder.volume.manager [None req-d7ff600b-d8dd-4382-a5e7-b1889aa7df79 tempest-AttachVolumeShelveTestJSON-610949690 None] Deleted volume successfully. Jul 10 04:36:52 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-d7ff600b-d8dd-4382-a5e7-b1889aa7df79 tempest-AttachVolumeShelveTestJSON-610949690 None] Lock "cinder-41913b89-a2cf-4de9-b232-dd11f78c154c-delete_volume" released by "delete_volume" :: held 2.661s {{(pid=87444) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 04:36:54 devstack cinder-volume[87444]: DEBUG cinder.volume.flows.manager.create_volume [None req-0794623c-3b7a-4ddd-b4e3-897d3b76868b tempest-AttachVolumeNegativeTest-538483290 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87444) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 04:36:54 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-0794623c-3b7a-4ddd-b4e3-897d3b76868b tempest-AttachVolumeNegativeTest-538483290 None] Flow 'volume_create_manager' (629967a8-d246-4911-a87c-05e876187ea0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 04:36:54 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-0794623c-3b7a-4ddd-b4e3-897d3b76868b tempest-AttachVolumeNegativeTest-538483290 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (853efeaf-7c0a-4319-95f6-c0d8c9a00e21) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:36:54 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-0794623c-3b7a-4ddd-b4e3-897d3b76868b tempest-AttachVolumeNegativeTest-538483290 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (853efeaf-7c0a-4319-95f6-c0d8c9a00e21) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T02:36:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1555181728',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=984497cd-0a44-4b53-abf9-1c2c4ed73d8c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='29fcd8a4a5154aac8d732f7c646222a9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T02:36:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T02:36:54Z,use_quota=True,user_id='cef39b8882e44f7181e1d9bd61d176a3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(317e369e-1e06-434d-ae95-a335f0e6c903),volume_type_id=317e369e-1e06-434d-ae95-a335f0e6c903)' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:36:54 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-0794623c-3b7a-4ddd-b4e3-897d3b76868b tempest-AttachVolumeNegativeTest-538483290 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2cc6c611-b401-4661-b181-6844f029c0e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:36:54 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-0794623c-3b7a-4ddd-b4e3-897d3b76868b tempest-AttachVolumeNegativeTest-538483290 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2cc6c611-b401-4661-b181-6844f029c0e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:36:54 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-0794623c-3b7a-4ddd-b4e3-897d3b76868b tempest-AttachVolumeNegativeTest-538483290 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (825deaa8-4777-41e5-b507-70495f42a778) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:36:54 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-0794623c-3b7a-4ddd-b4e3-897d3b76868b tempest-AttachVolumeNegativeTest-538483290 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (825deaa8-4777-41e5-b507-70495f42a778) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '984497cd-0a44-4b53-abf9-1c2c4ed73d8c', 'volume_name': 'volume-984497cd-0a44-4b53-abf9-1c2c4ed73d8c', 'volume_size': 1}' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:36:54 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-0794623c-3b7a-4ddd-b4e3-897d3b76868b tempest-AttachVolumeNegativeTest-538483290 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0778da49-48b6-47ec-b192-a8dd94c6da6e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:36:54 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-0794623c-3b7a-4ddd-b4e3-897d3b76868b tempest-AttachVolumeNegativeTest-538483290 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0778da49-48b6-47ec-b192-a8dd94c6da6e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:36:54 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-0794623c-3b7a-4ddd-b4e3-897d3b76868b tempest-AttachVolumeNegativeTest-538483290 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1ffce98c-3094-41c9-b7fe-a27b345e284b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:36:54 devstack cinder-volume[87444]: INFO cinder.volume.flows.manager.create_volume [None req-0794623c-3b7a-4ddd-b4e3-897d3b76868b tempest-AttachVolumeNegativeTest-538483290 None] Volume 984497cd-0a44-4b53-abf9-1c2c4ed73d8c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-984497cd-0a44-4b53-abf9-1c2c4ed73d8c', 'volume_size': 1} Jul 10 04:36:54 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-0794623c-3b7a-4ddd-b4e3-897d3b76868b tempest-AttachVolumeNegativeTest-538483290 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 04:36:54 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-0794623c-3b7a-4ddd-b4e3-897d3b76868b tempest-AttachVolumeNegativeTest-538483290 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 04:36:54 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-0794623c-3b7a-4ddd-b4e3-897d3b76868b tempest-AttachVolumeNegativeTest-538483290 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T02:36:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1555181728',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=984497cd-0a44-4b53-abf9-1c2c4ed73d8c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='29fcd8a4a5154aac8d732f7c646222a9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T02:36:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T02:36:54Z,use_quota=True,user_id='cef39b8882e44f7181e1d9bd61d176a3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(317e369e-1e06-434d-ae95-a335f0e6c903),volume_type_id=317e369e-1e06-434d-ae95-a335f0e6c903)}" {{(pid=87444) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 04:36:54 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.remotefs [None req-0794623c-3b7a-4ddd-b4e3-897d3b76868b tempest-AttachVolumeNegativeTest-538483290 None] Creating volume 984497cd-0a44-4b53-abf9-1c2c4ed73d8c {{(pid=87444) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 04:36:54 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-0794623c-3b7a-4ddd-b4e3-897d3b76868b tempest-AttachVolumeNegativeTest-538483290 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 04:36:54 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-0794623c-3b7a-4ddd-b4e3-897d3b76868b tempest-AttachVolumeNegativeTest-538483290 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 04:36:54 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-0794623c-3b7a-4ddd-b4e3-897d3b76868b tempest-AttachVolumeNegativeTest-538483290 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922': None} {{(pid=87444) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 04:36:54 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-0794623c-3b7a-4ddd-b4e3-897d3b76868b tempest-AttachVolumeNegativeTest-538483290 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922'] {{(pid=87444) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 04:36:54 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-0794623c-3b7a-4ddd-b4e3-897d3b76868b tempest-AttachVolumeNegativeTest-538483290 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 04:36:54 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-0794623c-3b7a-4ddd-b4e3-897d3b76868b tempest-AttachVolumeNegativeTest-538483290 None] Selected osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922 as target Quobyte volume. {{(pid=87444) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 04:36:54 devstack cinder-volume[87444]: INFO cinder.volume.drivers.remotefs [None req-0794623c-3b7a-4ddd-b4e3-897d3b76868b tempest-AttachVolumeNegativeTest-538483290 None] casted to osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922 Jul 10 04:36:54 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-0794623c-3b7a-4ddd-b4e3-897d3b76868b tempest-AttachVolumeNegativeTest-538483290 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-984497cd-0a44-4b53-abf9-1c2c4ed73d8c 1073741824 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:36:54 devstack sudo[92600]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-984497cd-0a44-4b53-abf9-1c2c4ed73d8c 1073741824 Jul 10 04:36:54 devstack sudo[92600]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:36:55 devstack sudo[92600]: pam_unix(sudo:session): session closed for user root Jul 10 04:36:55 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-0794623c-3b7a-4ddd-b4e3-897d3b76868b tempest-AttachVolumeNegativeTest-538483290 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-984497cd-0a44-4b53-abf9-1c2c4ed73d8c 1073741824" returned: 0 in 0.953s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:36:55 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-0794623c-3b7a-4ddd-b4e3-897d3b76868b tempest-AttachVolumeNegativeTest-538483290 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-984497cd-0a44-4b53-abf9-1c2c4ed73d8c {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:36:55 devstack sudo[92606]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-984497cd-0a44-4b53-abf9-1c2c4ed73d8c Jul 10 04:36:55 devstack sudo[92606]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:36:56 devstack sudo[92606]: pam_unix(sudo:session): session closed for user root Jul 10 04:36:56 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-0794623c-3b7a-4ddd-b4e3-897d3b76868b tempest-AttachVolumeNegativeTest-538483290 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-984497cd-0a44-4b53-abf9-1c2c4ed73d8c" returned: 0 in 0.920s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:36:56 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-0794623c-3b7a-4ddd-b4e3-897d3b76868b tempest-AttachVolumeNegativeTest-538483290 None] <== create_volume: return (1938ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922'} {{(pid=87444) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 04:36:56 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-0794623c-3b7a-4ddd-b4e3-897d3b76868b tempest-AttachVolumeNegativeTest-538483290 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.940s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 04:36:56 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-0794623c-3b7a-4ddd-b4e3-897d3b76868b tempest-AttachVolumeNegativeTest-538483290 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1ffce98c-3094-41c9-b7fe-a27b345e284b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-984497cd-0a44-4b53-abf9-1c2c4ed73d8c', 'volume_size': 1}' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:36:56 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-0794623c-3b7a-4ddd-b4e3-897d3b76868b tempest-AttachVolumeNegativeTest-538483290 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e76c7a8a-b6c7-4f9c-a6f9-a5379e87e13b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:36:56 devstack cinder-volume[87444]: INFO cinder.volume.flows.manager.create_volume [None req-0794623c-3b7a-4ddd-b4e3-897d3b76868b tempest-AttachVolumeNegativeTest-538483290 None] Volume volume-984497cd-0a44-4b53-abf9-1c2c4ed73d8c (984497cd-0a44-4b53-abf9-1c2c4ed73d8c): created successfully Jul 10 04:36:56 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-0794623c-3b7a-4ddd-b4e3-897d3b76868b tempest-AttachVolumeNegativeTest-538483290 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e76c7a8a-b6c7-4f9c-a6f9-a5379e87e13b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:36:56 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-0794623c-3b7a-4ddd-b4e3-897d3b76868b tempest-AttachVolumeNegativeTest-538483290 None] Flow 'volume_create_manager' (629967a8-d246-4911-a87c-05e876187ea0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87444) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 04:36:56 devstack cinder-volume[87444]: INFO cinder.volume.manager [None req-0794623c-3b7a-4ddd-b4e3-897d3b76868b tempest-AttachVolumeNegativeTest-538483290 None] Created volume successfully. Jul 10 04:36:58 devstack cinder-volume[87444]: INFO cinder.volume.manager [req-bfb56368-f9b3-4095-a9f6-48d315eea3f3 req-0c3361f6-45cd-4f8b-9f69-508826155f1e tempest-ServerActionsTestOtherA-567324480 None] Terminate volume connection completed successfully. Jul 10 04:36:58 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [req-bfb56368-f9b3-4095-a9f6-48d315eea3f3 req-0c3361f6-45cd-4f8b-9f69-508826155f1e tempest-ServerActionsTestOtherA-567324480 None] Deleting attachment e240ff03-9e4b-4084-9070-b18af3d22177. {{(pid=87444) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 10 04:37:00 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [req-0f18073e-9ee8-40e8-b87e-b83fa555f994 req-8684d19e-0c8a-40d6-acb8-79a6385ec78b tempest-AttachVolumeNegativeTest-538483290 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 04:37:00 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [req-0f18073e-9ee8-40e8-b87e-b83fa555f994 req-8684d19e-0c8a-40d6-acb8-79a6385ec78b tempest-AttachVolumeNegativeTest-538483290 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 04:37:00 devstack cinder-volume[87444]: DEBUG oslo.privsep.daemon [-] privsep: reply[a60c8bf7-42c8-4bce-a92e-0cb409c53e13]: (4, 'qcow2') {{(pid=88499) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 04:37:00 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [req-0f18073e-9ee8-40e8-b87e-b83fa555f994 req-8684d19e-0c8a-40d6-acb8-79a6385ec78b tempest-AttachVolumeNegativeTest-538483290 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-984497cd-0a44-4b53-abf9-1c2c4ed73d8c {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:37:00 devstack cinder-volume[87444]: DEBUG cinder.volume.flows.manager.create_volume [req-badcf568-3a90-47f1-a0db-d4c2329fc75e req-f819e4ab-1254-4317-9cb2-15b74e3eb3ae tempest-VolumesSnapshotsTestJSON-876490581 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87444) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 04:37:00 devstack sudo[92698]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-984497cd-0a44-4b53-abf9-1c2c4ed73d8c Jul 10 04:37:00 devstack sudo[92698]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:37:01 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [req-badcf568-3a90-47f1-a0db-d4c2329fc75e req-f819e4ab-1254-4317-9cb2-15b74e3eb3ae tempest-VolumesSnapshotsTestJSON-876490581 None] Flow 'volume_create_manager' (d973c4a2-ff3e-42f6-b4e5-52f7fc3f4d67) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 04:37:01 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [req-badcf568-3a90-47f1-a0db-d4c2329fc75e req-f819e4ab-1254-4317-9cb2-15b74e3eb3ae tempest-VolumesSnapshotsTestJSON-876490581 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (32df6936-b278-41e9-9b61-86703a9c9b96) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:37:01 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [req-badcf568-3a90-47f1-a0db-d4c2329fc75e req-f819e4ab-1254-4317-9cb2-15b74e3eb3ae tempest-VolumesSnapshotsTestJSON-876490581 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (32df6936-b278-41e9-9b61-86703a9c9b96) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T02:37:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-1907072558',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1815a5d6-c706-40b8-af4d-9dd8eeada199,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='48f0b2834e224195a1f6c56d8d079a3e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T02:37:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T02:37:01Z,use_quota=True,user_id='4625175dcebe4f1f875606c17660223e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(317e369e-1e06-434d-ae95-a335f0e6c903),volume_type_id=317e369e-1e06-434d-ae95-a335f0e6c903)' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:37:01 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [req-badcf568-3a90-47f1-a0db-d4c2329fc75e req-f819e4ab-1254-4317-9cb2-15b74e3eb3ae tempest-VolumesSnapshotsTestJSON-876490581 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d3853657-08bc-4d64-abfe-abfbdf6f9404) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:37:01 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [req-badcf568-3a90-47f1-a0db-d4c2329fc75e req-f819e4ab-1254-4317-9cb2-15b74e3eb3ae tempest-VolumesSnapshotsTestJSON-876490581 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d3853657-08bc-4d64-abfe-abfbdf6f9404) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:37:01 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [req-badcf568-3a90-47f1-a0db-d4c2329fc75e req-f819e4ab-1254-4317-9cb2-15b74e3eb3ae tempest-VolumesSnapshotsTestJSON-876490581 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0cacad1e-ecac-4613-bf09-96a8d93cc807) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:37:01 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [req-badcf568-3a90-47f1-a0db-d4c2329fc75e req-f819e4ab-1254-4317-9cb2-15b74e3eb3ae tempest-VolumesSnapshotsTestJSON-876490581 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0cacad1e-ecac-4613-bf09-96a8d93cc807) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1815a5d6-c706-40b8-af4d-9dd8eeada199', 'volume_name': 'volume-1815a5d6-c706-40b8-af4d-9dd8eeada199', 'volume_size': 1}' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:37:01 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [req-badcf568-3a90-47f1-a0db-d4c2329fc75e req-f819e4ab-1254-4317-9cb2-15b74e3eb3ae tempest-VolumesSnapshotsTestJSON-876490581 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9524b3e9-756c-4324-bf5f-e6a7dd3e2ff6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:37:01 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [req-badcf568-3a90-47f1-a0db-d4c2329fc75e req-f819e4ab-1254-4317-9cb2-15b74e3eb3ae tempest-VolumesSnapshotsTestJSON-876490581 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9524b3e9-756c-4324-bf5f-e6a7dd3e2ff6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:37:01 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [req-badcf568-3a90-47f1-a0db-d4c2329fc75e req-f819e4ab-1254-4317-9cb2-15b74e3eb3ae tempest-VolumesSnapshotsTestJSON-876490581 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ca61a776-ac92-4b58-9337-610e3d8c3efa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:37:01 devstack cinder-volume[87444]: INFO cinder.volume.flows.manager.create_volume [req-badcf568-3a90-47f1-a0db-d4c2329fc75e req-f819e4ab-1254-4317-9cb2-15b74e3eb3ae tempest-VolumesSnapshotsTestJSON-876490581 None] Volume 1815a5d6-c706-40b8-af4d-9dd8eeada199: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1815a5d6-c706-40b8-af4d-9dd8eeada199', 'volume_size': 1} Jul 10 04:37:01 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [req-badcf568-3a90-47f1-a0db-d4c2329fc75e req-f819e4ab-1254-4317-9cb2-15b74e3eb3ae tempest-VolumesSnapshotsTestJSON-876490581 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 04:37:01 devstack sudo[92698]: pam_unix(sudo:session): session closed for user root Jul 10 04:37:01 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [req-0f18073e-9ee8-40e8-b87e-b83fa555f994 req-8684d19e-0c8a-40d6-acb8-79a6385ec78b tempest-AttachVolumeNegativeTest-538483290 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-984497cd-0a44-4b53-abf9-1c2c4ed73d8c" returned: 0 in 1.098s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:37:01 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [req-0f18073e-9ee8-40e8-b87e-b83fa555f994 req-8684d19e-0c8a-40d6-acb8-79a6385ec78b tempest-AttachVolumeNegativeTest-538483290 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.141s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 04:37:01 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [req-badcf568-3a90-47f1-a0db-d4c2329fc75e req-f819e4ab-1254-4317-9cb2-15b74e3eb3ae tempest-VolumesSnapshotsTestJSON-876490581 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.771s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 04:37:01 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [req-badcf568-3a90-47f1-a0db-d4c2329fc75e req-f819e4ab-1254-4317-9cb2-15b74e3eb3ae tempest-VolumesSnapshotsTestJSON-876490581 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T02:37:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-1907072558',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1815a5d6-c706-40b8-af4d-9dd8eeada199,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='48f0b2834e224195a1f6c56d8d079a3e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T02:37:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T02:37:01Z,use_quota=True,user_id='4625175dcebe4f1f875606c17660223e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(317e369e-1e06-434d-ae95-a335f0e6c903),volume_type_id=317e369e-1e06-434d-ae95-a335f0e6c903)}" {{(pid=87444) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 04:37:01 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.remotefs [req-badcf568-3a90-47f1-a0db-d4c2329fc75e req-f819e4ab-1254-4317-9cb2-15b74e3eb3ae tempest-VolumesSnapshotsTestJSON-876490581 None] Creating volume 1815a5d6-c706-40b8-af4d-9dd8eeada199 {{(pid=87444) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 04:37:01 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [req-badcf568-3a90-47f1-a0db-d4c2329fc75e req-f819e4ab-1254-4317-9cb2-15b74e3eb3ae tempest-VolumesSnapshotsTestJSON-876490581 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 04:37:01 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [req-badcf568-3a90-47f1-a0db-d4c2329fc75e req-f819e4ab-1254-4317-9cb2-15b74e3eb3ae tempest-VolumesSnapshotsTestJSON-876490581 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 04:37:01 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [req-badcf568-3a90-47f1-a0db-d4c2329fc75e req-f819e4ab-1254-4317-9cb2-15b74e3eb3ae tempest-VolumesSnapshotsTestJSON-876490581 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922': None} {{(pid=87444) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 04:37:01 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [req-badcf568-3a90-47f1-a0db-d4c2329fc75e req-f819e4ab-1254-4317-9cb2-15b74e3eb3ae tempest-VolumesSnapshotsTestJSON-876490581 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922'] {{(pid=87444) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 04:37:01 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [req-badcf568-3a90-47f1-a0db-d4c2329fc75e req-f819e4ab-1254-4317-9cb2-15b74e3eb3ae tempest-VolumesSnapshotsTestJSON-876490581 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 04:37:01 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [req-badcf568-3a90-47f1-a0db-d4c2329fc75e req-f819e4ab-1254-4317-9cb2-15b74e3eb3ae tempest-VolumesSnapshotsTestJSON-876490581 None] Selected osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922 as target Quobyte volume. {{(pid=87444) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 04:37:01 devstack cinder-volume[87444]: INFO cinder.volume.drivers.remotefs [req-badcf568-3a90-47f1-a0db-d4c2329fc75e req-f819e4ab-1254-4317-9cb2-15b74e3eb3ae tempest-VolumesSnapshotsTestJSON-876490581 None] casted to osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922 Jul 10 04:37:01 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [req-badcf568-3a90-47f1-a0db-d4c2329fc75e req-f819e4ab-1254-4317-9cb2-15b74e3eb3ae tempest-VolumesSnapshotsTestJSON-876490581 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-1815a5d6-c706-40b8-af4d-9dd8eeada199 1073741824 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:37:01 devstack sudo[92704]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-1815a5d6-c706-40b8-af4d-9dd8eeada199 1073741824 Jul 10 04:37:01 devstack sudo[92704]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:37:01 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [req-0f18073e-9ee8-40e8-b87e-b83fa555f994 req-8684d19e-0c8a-40d6-acb8-79a6385ec78b tempest-AttachVolumeNegativeTest-538483290 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922', 'name': 'volume-984497cd-0a44-4b53-abf9-1c2c4ed73d8c', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'd7dcdcb2-856f-4d19-9681-0f98a4c8c111', 'enforce_multipath': True} {{(pid=87444) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 10 04:37:01 devstack cinder-volume[87444]: INFO cinder.volume.manager [req-0f18073e-9ee8-40e8-b87e-b83fa555f994 req-8684d19e-0c8a-40d6-acb8-79a6385ec78b tempest-AttachVolumeNegativeTest-538483290 None] attachment_update completed successfully. Jul 10 04:37:03 devstack sudo[92704]: pam_unix(sudo:session): session closed for user root Jul 10 04:37:03 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [req-badcf568-3a90-47f1-a0db-d4c2329fc75e req-f819e4ab-1254-4317-9cb2-15b74e3eb3ae tempest-VolumesSnapshotsTestJSON-876490581 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-1815a5d6-c706-40b8-af4d-9dd8eeada199 1073741824" returned: 0 in 1.254s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:37:03 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [req-badcf568-3a90-47f1-a0db-d4c2329fc75e req-f819e4ab-1254-4317-9cb2-15b74e3eb3ae tempest-VolumesSnapshotsTestJSON-876490581 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-1815a5d6-c706-40b8-af4d-9dd8eeada199 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:37:03 devstack sudo[92926]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-1815a5d6-c706-40b8-af4d-9dd8eeada199 Jul 10 04:37:03 devstack sudo[92926]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:37:04 devstack sudo[92926]: pam_unix(sudo:session): session closed for user root Jul 10 04:37:04 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [req-badcf568-3a90-47f1-a0db-d4c2329fc75e req-f819e4ab-1254-4317-9cb2-15b74e3eb3ae tempest-VolumesSnapshotsTestJSON-876490581 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-1815a5d6-c706-40b8-af4d-9dd8eeada199" returned: 0 in 1.189s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:37:04 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [req-badcf568-3a90-47f1-a0db-d4c2329fc75e req-f819e4ab-1254-4317-9cb2-15b74e3eb3ae tempest-VolumesSnapshotsTestJSON-876490581 None] <== create_volume: return (2513ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922'} {{(pid=87444) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 04:37:04 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [req-badcf568-3a90-47f1-a0db-d4c2329fc75e req-f819e4ab-1254-4317-9cb2-15b74e3eb3ae tempest-VolumesSnapshotsTestJSON-876490581 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.515s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 04:37:04 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [req-badcf568-3a90-47f1-a0db-d4c2329fc75e req-f819e4ab-1254-4317-9cb2-15b74e3eb3ae tempest-VolumesSnapshotsTestJSON-876490581 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ca61a776-ac92-4b58-9337-610e3d8c3efa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1815a5d6-c706-40b8-af4d-9dd8eeada199', 'volume_size': 1}' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:37:04 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [req-badcf568-3a90-47f1-a0db-d4c2329fc75e req-f819e4ab-1254-4317-9cb2-15b74e3eb3ae tempest-VolumesSnapshotsTestJSON-876490581 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c897a069-1859-429c-89c4-ca4122f04e7d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:37:04 devstack cinder-volume[87444]: INFO cinder.volume.flows.manager.create_volume [req-badcf568-3a90-47f1-a0db-d4c2329fc75e req-f819e4ab-1254-4317-9cb2-15b74e3eb3ae tempest-VolumesSnapshotsTestJSON-876490581 None] Volume volume-1815a5d6-c706-40b8-af4d-9dd8eeada199 (1815a5d6-c706-40b8-af4d-9dd8eeada199): created successfully Jul 10 04:37:04 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [req-badcf568-3a90-47f1-a0db-d4c2329fc75e req-f819e4ab-1254-4317-9cb2-15b74e3eb3ae tempest-VolumesSnapshotsTestJSON-876490581 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c897a069-1859-429c-89c4-ca4122f04e7d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:37:04 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [req-badcf568-3a90-47f1-a0db-d4c2329fc75e req-f819e4ab-1254-4317-9cb2-15b74e3eb3ae tempest-VolumesSnapshotsTestJSON-876490581 None] Flow 'volume_create_manager' (d973c4a2-ff3e-42f6-b4e5-52f7fc3f4d67) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87444) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 04:37:04 devstack cinder-volume[87444]: INFO cinder.volume.manager [req-badcf568-3a90-47f1-a0db-d4c2329fc75e req-f819e4ab-1254-4317-9cb2-15b74e3eb3ae tempest-VolumesSnapshotsTestJSON-876490581 None] Created volume successfully. Jul 10 04:37:05 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [req-b5aa969e-4124-4fb9-be51-30a691fe0ca1 req-25dd2f3e-8c95-4fd4-9802-1f7656679d95 tempest-VolumesSnapshotsTestJSON-876490581 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 04:37:05 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [req-b5aa969e-4124-4fb9-be51-30a691fe0ca1 req-25dd2f3e-8c95-4fd4-9802-1f7656679d95 tempest-VolumesSnapshotsTestJSON-876490581 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 04:37:05 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.remotefs [req-b5aa969e-4124-4fb9-be51-30a691fe0ca1 req-25dd2f3e-8c95-4fd4-9802-1f7656679d95 tempest-VolumesSnapshotsTestJSON-876490581 None] Creating offline snapshot e21d48c6-1dfe-476f-9273-136c6bfab167 of volume 1815a5d6-c706-40b8-af4d-9dd8eeada199 {{(pid=87444) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 10 04:37:05 devstack cinder-volume[87444]: DEBUG oslo.privsep.daemon [-] privsep: reply[63dabaf4-d2de-45b8-98c1-7086575004de]: (4, 'qcow2') {{(pid=88499) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 04:37:05 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [req-b5aa969e-4124-4fb9-be51-30a691fe0ca1 req-25dd2f3e-8c95-4fd4-9802-1f7656679d95 tempest-VolumesSnapshotsTestJSON-876490581 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-1815a5d6-c706-40b8-af4d-9dd8eeada199 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:37:05 devstack sudo[93125]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-1815a5d6-c706-40b8-af4d-9dd8eeada199 Jul 10 04:37:05 devstack sudo[93125]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:37:06 devstack sudo[93125]: pam_unix(sudo:session): session closed for user root Jul 10 04:37:06 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [req-b5aa969e-4124-4fb9-be51-30a691fe0ca1 req-25dd2f3e-8c95-4fd4-9802-1f7656679d95 tempest-VolumesSnapshotsTestJSON-876490581 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-1815a5d6-c706-40b8-af4d-9dd8eeada199" returned: 0 in 1.012s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:37:06 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [req-b5aa969e-4124-4fb9-be51-30a691fe0ca1 req-25dd2f3e-8c95-4fd4-9802-1f7656679d95 tempest-VolumesSnapshotsTestJSON-876490581 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-1815a5d6-c706-40b8-af4d-9dd8eeada199,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-1815a5d6-c706-40b8-af4d-9dd8eeada199.e21d48c6-1dfe-476f-9273-136c6bfab167 1G {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:37:06 devstack sudo[93132]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-1815a5d6-c706-40b8-af4d-9dd8eeada199,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-1815a5d6-c706-40b8-af4d-9dd8eeada199.e21d48c6-1dfe-476f-9273-136c6bfab167 1G Jul 10 04:37:06 devstack sudo[93132]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:37:07 devstack sudo[93132]: pam_unix(sudo:session): session closed for user root Jul 10 04:37:07 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [req-b5aa969e-4124-4fb9-be51-30a691fe0ca1 req-25dd2f3e-8c95-4fd4-9802-1f7656679d95 tempest-VolumesSnapshotsTestJSON-876490581 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-1815a5d6-c706-40b8-af4d-9dd8eeada199,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-1815a5d6-c706-40b8-af4d-9dd8eeada199.e21d48c6-1dfe-476f-9273-136c6bfab167 1G" returned: 0 in 1.077s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:37:07 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [req-b5aa969e-4124-4fb9-be51-30a691fe0ca1 req-25dd2f3e-8c95-4fd4-9802-1f7656679d95 tempest-VolumesSnapshotsTestJSON-876490581 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1815a5d6-c706-40b8-af4d-9dd8eeada199 -F qcow2 /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-1815a5d6-c706-40b8-af4d-9dd8eeada199.e21d48c6-1dfe-476f-9273-136c6bfab167 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:37:07 devstack sudo[93138]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1815a5d6-c706-40b8-af4d-9dd8eeada199 -F qcow2 /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-1815a5d6-c706-40b8-af4d-9dd8eeada199.e21d48c6-1dfe-476f-9273-136c6bfab167 Jul 10 04:37:07 devstack sudo[93138]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:37:08 devstack sudo[93138]: pam_unix(sudo:session): session closed for user root Jul 10 04:37:08 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [req-b5aa969e-4124-4fb9-be51-30a691fe0ca1 req-25dd2f3e-8c95-4fd4-9802-1f7656679d95 tempest-VolumesSnapshotsTestJSON-876490581 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1815a5d6-c706-40b8-af4d-9dd8eeada199 -F qcow2 /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-1815a5d6-c706-40b8-af4d-9dd8eeada199.e21d48c6-1dfe-476f-9273-136c6bfab167" returned: 0 in 0.780s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:37:08 devstack cinder-volume[87444]: WARNING cinder.volume.drivers.remotefs [req-b5aa969e-4124-4fb9-be51-30a691fe0ca1 req-25dd2f3e-8c95-4fd4-9802-1f7656679d95 tempest-VolumesSnapshotsTestJSON-876490581 None] /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-1815a5d6-c706-40b8-af4d-9dd8eeada199.e21d48c6-1dfe-476f-9273-136c6bfab167 is being set with open permissions: ugo+rw Jul 10 04:37:08 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [req-b5aa969e-4124-4fb9-be51-30a691fe0ca1 req-25dd2f3e-8c95-4fd4-9802-1f7656679d95 tempest-VolumesSnapshotsTestJSON-876490581 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-1815a5d6-c706-40b8-af4d-9dd8eeada199.e21d48c6-1dfe-476f-9273-136c6bfab167 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:37:08 devstack sudo[93144]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-1815a5d6-c706-40b8-af4d-9dd8eeada199.e21d48c6-1dfe-476f-9273-136c6bfab167 Jul 10 04:37:08 devstack sudo[93144]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:37:08 devstack sudo[93144]: pam_unix(sudo:session): session closed for user root Jul 10 04:37:08 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [req-b5aa969e-4124-4fb9-be51-30a691fe0ca1 req-25dd2f3e-8c95-4fd4-9802-1f7656679d95 tempest-VolumesSnapshotsTestJSON-876490581 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-1815a5d6-c706-40b8-af4d-9dd8eeada199.e21d48c6-1dfe-476f-9273-136c6bfab167" returned: 0 in 0.796s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:37:08 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [req-b5aa969e-4124-4fb9-be51-30a691fe0ca1 req-25dd2f3e-8c95-4fd4-9802-1f7656679d95 tempest-VolumesSnapshotsTestJSON-876490581 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-1815a5d6-c706-40b8-af4d-9dd8eeada199.info {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:37:08 devstack sudo[93147]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-1815a5d6-c706-40b8-af4d-9dd8eeada199.info Jul 10 04:37:08 devstack sudo[93147]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:37:09 devstack cinder-volume[87444]: INFO cinder.volume.manager [req-c52785dd-e6ad-476c-a252-a89593add0a7 req-726b2db2-7ecc-4dd0-adae-177b4b94e399 tempest-AttachVolumeNegativeTest-538483290 None] Terminate volume connection completed successfully. Jul 10 04:37:09 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [req-c52785dd-e6ad-476c-a252-a89593add0a7 req-726b2db2-7ecc-4dd0-adae-177b4b94e399 tempest-AttachVolumeNegativeTest-538483290 None] Deleting attachment d7dcdcb2-856f-4d19-9681-0f98a4c8c111. {{(pid=87444) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 10 04:37:09 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [req-b5aa969e-4124-4fb9-be51-30a691fe0ca1 req-25dd2f3e-8c95-4fd4-9802-1f7656679d95 tempest-VolumesSnapshotsTestJSON-876490581 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-1815a5d6-c706-40b8-af4d-9dd8eeada199.info" returned: 0 in 0.762s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:37:09 devstack cinder-volume[87444]: WARNING cinder.volume.drivers.remotefs [req-b5aa969e-4124-4fb9-be51-30a691fe0ca1 req-25dd2f3e-8c95-4fd4-9802-1f7656679d95 tempest-VolumesSnapshotsTestJSON-876490581 None] /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-1815a5d6-c706-40b8-af4d-9dd8eeada199.info is being set with open permissions: ugo+rw Jul 10 04:37:09 devstack sudo[93147]: pam_unix(sudo:session): session closed for user root Jul 10 04:37:09 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [req-b5aa969e-4124-4fb9-be51-30a691fe0ca1 req-25dd2f3e-8c95-4fd4-9802-1f7656679d95 tempest-VolumesSnapshotsTestJSON-876490581 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-1815a5d6-c706-40b8-af4d-9dd8eeada199.info {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:37:09 devstack sudo[93177]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-1815a5d6-c706-40b8-af4d-9dd8eeada199.info Jul 10 04:37:09 devstack sudo[93177]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:37:10 devstack sudo[93177]: pam_unix(sudo:session): session closed for user root Jul 10 04:37:10 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [req-b5aa969e-4124-4fb9-be51-30a691fe0ca1 req-25dd2f3e-8c95-4fd4-9802-1f7656679d95 tempest-VolumesSnapshotsTestJSON-876490581 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-1815a5d6-c706-40b8-af4d-9dd8eeada199.info" returned: 0 in 0.781s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:37:10 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [req-b5aa969e-4124-4fb9-be51-30a691fe0ca1 req-25dd2f3e-8c95-4fd4-9802-1f7656679d95 tempest-VolumesSnapshotsTestJSON-876490581 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.345s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 04:37:10 devstack cinder-volume[87444]: INFO cinder.volume.manager [req-b5aa969e-4124-4fb9-be51-30a691fe0ca1 req-25dd2f3e-8c95-4fd4-9802-1f7656679d95 tempest-VolumesSnapshotsTestJSON-876490581 None] Create snapshot completed successfully Jul 10 04:37:10 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-9c6c3b34-1d5c-4548-89bf-49afafa5b47e tempest-ServerActionsTestOtherA-567324480 None] Acquiring lock "cinder-830f5883-6561-417c-9a3d-a7ace3c34623-delete_volume" by "delete_volume" {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 04:37:10 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-9c6c3b34-1d5c-4548-89bf-49afafa5b47e tempest-ServerActionsTestOtherA-567324480 None] Lock "cinder-830f5883-6561-417c-9a3d-a7ace3c34623-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 04:37:10 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-9c6c3b34-1d5c-4548-89bf-49afafa5b47e tempest-ServerActionsTestOtherA-567324480 None] Acquiring lock "cinder-quobyte-830f5883-6561-417c-9a3d-a7ace3c34623" by "delete_volume" {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 04:37:10 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-9c6c3b34-1d5c-4548-89bf-49afafa5b47e tempest-ServerActionsTestOtherA-567324480 None] Lock "cinder-quobyte-830f5883-6561-417c-9a3d-a7ace3c34623" acquired by "delete_volume" :: waited 0.022s {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 04:37:10 devstack cinder-volume[87444]: DEBUG oslo.privsep.daemon [-] privsep: reply[a316e50a-c43f-48b1-817f-840109f6fc59]: (4, 'qcow2') {{(pid=88499) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 04:37:10 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-9c6c3b34-1d5c-4548-89bf-49afafa5b47e tempest-ServerActionsTestOtherA-567324480 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-830f5883-6561-417c-9a3d-a7ace3c34623 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:37:10 devstack cinder-volume[87444]: DEBUG cinder.coordination [req-284289a5-8833-47f4-a13c-6e1fd543fcd2 req-a7213962-67db-4376-b4a4-531a9ae8154c tempest-VolumesSnapshotsTestJSON-876490581 None] Acquiring lock "cinder-e21d48c6-1dfe-476f-9273-136c6bfab167-delete_snapshot" by "delete_snapshot" {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 04:37:10 devstack cinder-volume[87444]: DEBUG cinder.coordination [req-284289a5-8833-47f4-a13c-6e1fd543fcd2 req-a7213962-67db-4376-b4a4-531a9ae8154c tempest-VolumesSnapshotsTestJSON-876490581 None] Lock "cinder-e21d48c6-1dfe-476f-9273-136c6bfab167-delete_snapshot" acquired by "delete_snapshot" :: waited 0.033s {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 04:37:10 devstack cinder-volume[87444]: DEBUG cinder.coordination [req-284289a5-8833-47f4-a13c-6e1fd543fcd2 req-a7213962-67db-4376-b4a4-531a9ae8154c tempest-VolumesSnapshotsTestJSON-876490581 None] Acquiring lock "cinder-quobyte-1815a5d6-c706-40b8-af4d-9dd8eeada199" by "delete_snapshot" {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 04:37:10 devstack sudo[93180]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-830f5883-6561-417c-9a3d-a7ace3c34623 Jul 10 04:37:10 devstack sudo[93180]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:37:10 devstack cinder-volume[87444]: DEBUG cinder.coordination [req-284289a5-8833-47f4-a13c-6e1fd543fcd2 req-a7213962-67db-4376-b4a4-531a9ae8154c tempest-VolumesSnapshotsTestJSON-876490581 None] Lock "cinder-quobyte-1815a5d6-c706-40b8-af4d-9dd8eeada199" acquired by "delete_snapshot" :: waited 0.023s {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 04:37:10 devstack cinder-volume[87444]: DEBUG cinder.coordination [req-284289a5-8833-47f4-a13c-6e1fd543fcd2 req-a7213962-67db-4376-b4a4-531a9ae8154c tempest-VolumesSnapshotsTestJSON-876490581 None] Acquiring lock "cinder-quobyte-e21d48c6-1dfe-476f-9273-136c6bfab167" by "_delete_snapshot" {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 04:37:10 devstack cinder-volume[87444]: DEBUG cinder.coordination [req-284289a5-8833-47f4-a13c-6e1fd543fcd2 req-a7213962-67db-4376-b4a4-531a9ae8154c tempest-VolumesSnapshotsTestJSON-876490581 None] Lock "cinder-quobyte-e21d48c6-1dfe-476f-9273-136c6bfab167" acquired by "_delete_snapshot" :: waited 0.032s {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 04:37:10 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.remotefs [req-284289a5-8833-47f4-a13c-6e1fd543fcd2 req-a7213962-67db-4376-b4a4-531a9ae8154c tempest-VolumesSnapshotsTestJSON-876490581 None] Deleting offline snapshot e21d48c6-1dfe-476f-9273-136c6bfab167 of volume 1815a5d6-c706-40b8-af4d-9dd8eeada199 {{(pid=87444) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 10 04:37:10 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.remotefs [req-284289a5-8833-47f4-a13c-6e1fd543fcd2 req-a7213962-67db-4376-b4a4-531a9ae8154c tempest-VolumesSnapshotsTestJSON-876490581 None] snapshot_file for this snap is: volume-1815a5d6-c706-40b8-af4d-9dd8eeada199.e21d48c6-1dfe-476f-9273-136c6bfab167 {{(pid=87444) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 10 04:37:10 devstack cinder-volume[87444]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2baa46f-1674-4aa9-b2bd-567bcf22c39d]: (4, 'qcow2') {{(pid=88499) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 04:37:10 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [req-284289a5-8833-47f4-a13c-6e1fd543fcd2 req-a7213962-67db-4376-b4a4-531a9ae8154c tempest-VolumesSnapshotsTestJSON-876490581 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-1815a5d6-c706-40b8-af4d-9dd8eeada199.e21d48c6-1dfe-476f-9273-136c6bfab167 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:37:11 devstack sudo[93182]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-1815a5d6-c706-40b8-af4d-9dd8eeada199.e21d48c6-1dfe-476f-9273-136c6bfab167 Jul 10 04:37:11 devstack sudo[93182]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:37:11 devstack sudo[93180]: pam_unix(sudo:session): session closed for user root Jul 10 04:37:11 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-9c6c3b34-1d5c-4548-89bf-49afafa5b47e tempest-ServerActionsTestOtherA-567324480 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-830f5883-6561-417c-9a3d-a7ace3c34623" returned: 0 in 1.022s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:37:11 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-9c6c3b34-1d5c-4548-89bf-49afafa5b47e tempest-ServerActionsTestOtherA-567324480 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-830f5883-6561-417c-9a3d-a7ace3c34623 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:37:11 devstack sudo[93188]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-830f5883-6561-417c-9a3d-a7ace3c34623 Jul 10 04:37:11 devstack sudo[93188]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:37:12 devstack sudo[93182]: pam_unix(sudo:session): session closed for user root Jul 10 04:37:12 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [req-284289a5-8833-47f4-a13c-6e1fd543fcd2 req-a7213962-67db-4376-b4a4-531a9ae8154c tempest-VolumesSnapshotsTestJSON-876490581 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-1815a5d6-c706-40b8-af4d-9dd8eeada199.e21d48c6-1dfe-476f-9273-136c6bfab167" returned: 0 in 1.031s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:37:12 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.remotefs [req-284289a5-8833-47f4-a13c-6e1fd543fcd2 req-a7213962-67db-4376-b4a4-531a9ae8154c tempest-VolumesSnapshotsTestJSON-876490581 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1815a5d6-c706-40b8-af4d-9dd8eeada199(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87444) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 10 04:37:12 devstack cinder-volume[87444]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d9762ed-65aa-455e-9746-2b2e79f621ad]: (4, 'qcow2') {{(pid=88499) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 04:37:12 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [req-284289a5-8833-47f4-a13c-6e1fd543fcd2 req-a7213962-67db-4376-b4a4-531a9ae8154c tempest-VolumesSnapshotsTestJSON-876490581 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-1815a5d6-c706-40b8-af4d-9dd8eeada199 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:37:12 devstack sudo[93193]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-1815a5d6-c706-40b8-af4d-9dd8eeada199 Jul 10 04:37:12 devstack sudo[93193]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:37:12 devstack sudo[93188]: pam_unix(sudo:session): session closed for user root Jul 10 04:37:12 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-9c6c3b34-1d5c-4548-89bf-49afafa5b47e tempest-ServerActionsTestOtherA-567324480 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-830f5883-6561-417c-9a3d-a7ace3c34623" returned: 0 in 0.722s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:37:12 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-9c6c3b34-1d5c-4548-89bf-49afafa5b47e tempest-ServerActionsTestOtherA-567324480 None] Lock "cinder-quobyte-830f5883-6561-417c-9a3d-a7ace3c34623" released by "delete_volume" :: held 1.788s {{(pid=87444) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 04:37:12 devstack cinder-volume[87444]: DEBUG cinder.quota [None req-9c6c3b34-1d5c-4548-89bf-49afafa5b47e tempest-ServerActionsTestOtherA-567324480 None] Created reservations ['9b837bf0-8b8a-4cb6-9a25-1610e53a86e3', '67598467-b92c-44ab-9c86-aa822762c8d6', 'bd80ef28-0d4d-4fec-a96f-768b233b4b63', 'ed0f34d6-3e51-4e2d-9272-2b1781e75969'] {{(pid=87444) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 04:37:12 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-9c6c3b34-1d5c-4548-89bf-49afafa5b47e tempest-ServerActionsTestOtherA-567324480 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 04:37:12 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-9c6c3b34-1d5c-4548-89bf-49afafa5b47e tempest-ServerActionsTestOtherA-567324480 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 04:37:12 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-9c6c3b34-1d5c-4548-89bf-49afafa5b47e tempest-ServerActionsTestOtherA-567324480 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922': None} {{(pid=87444) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 04:37:12 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-9c6c3b34-1d5c-4548-89bf-49afafa5b47e tempest-ServerActionsTestOtherA-567324480 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922'] {{(pid=87444) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 04:37:12 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-9c6c3b34-1d5c-4548-89bf-49afafa5b47e tempest-ServerActionsTestOtherA-567324480 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 04:37:12 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-9c6c3b34-1d5c-4548-89bf-49afafa5b47e tempest-ServerActionsTestOtherA-567324480 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:37:12 devstack sudo[93220]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097 Jul 10 04:37:12 devstack sudo[93220]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:37:12 devstack sudo[93193]: pam_unix(sudo:session): session closed for user root Jul 10 04:37:12 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [req-284289a5-8833-47f4-a13c-6e1fd543fcd2 req-a7213962-67db-4376-b4a4-531a9ae8154c tempest-VolumesSnapshotsTestJSON-876490581 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-1815a5d6-c706-40b8-af4d-9dd8eeada199" returned: 0 in 0.941s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:37:12 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [req-284289a5-8833-47f4-a13c-6e1fd543fcd2 req-a7213962-67db-4376-b4a4-531a9ae8154c tempest-VolumesSnapshotsTestJSON-876490581 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-1815a5d6-c706-40b8-af4d-9dd8eeada199.e21d48c6-1dfe-476f-9273-136c6bfab167 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:37:13 devstack sudo[93227]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-1815a5d6-c706-40b8-af4d-9dd8eeada199.e21d48c6-1dfe-476f-9273-136c6bfab167 Jul 10 04:37:13 devstack sudo[93227]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:37:13 devstack sudo[93220]: pam_unix(sudo:session): session closed for user root Jul 10 04:37:13 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-9c6c3b34-1d5c-4548-89bf-49afafa5b47e tempest-ServerActionsTestOtherA-567324480 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097" returned: 0 in 0.857s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:37:13 devstack cinder-volume[87444]: DEBUG cinder.manager [None req-9c6c3b34-1d5c-4548-89bf-49afafa5b47e tempest-ServerActionsTestOtherA-567324480 None] Notifying Schedulers of capabilities ... {{(pid=87444) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 04:37:13 devstack cinder-volume[87444]: INFO cinder.volume.manager [None req-9c6c3b34-1d5c-4548-89bf-49afafa5b47e tempest-ServerActionsTestOtherA-567324480 None] Deleted volume successfully. Jul 10 04:37:13 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-9c6c3b34-1d5c-4548-89bf-49afafa5b47e tempest-ServerActionsTestOtherA-567324480 None] Lock "cinder-830f5883-6561-417c-9a3d-a7ace3c34623-delete_volume" released by "delete_volume" :: held 2.925s {{(pid=87444) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 04:37:14 devstack sudo[93227]: pam_unix(sudo:session): session closed for user root Jul 10 04:37:14 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [req-284289a5-8833-47f4-a13c-6e1fd543fcd2 req-a7213962-67db-4376-b4a4-531a9ae8154c tempest-VolumesSnapshotsTestJSON-876490581 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-1815a5d6-c706-40b8-af4d-9dd8eeada199.e21d48c6-1dfe-476f-9273-136c6bfab167" returned: 0 in 1.116s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:37:14 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [req-284289a5-8833-47f4-a13c-6e1fd543fcd2 req-a7213962-67db-4376-b4a4-531a9ae8154c tempest-VolumesSnapshotsTestJSON-876490581 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-1815a5d6-c706-40b8-af4d-9dd8eeada199.e21d48c6-1dfe-476f-9273-136c6bfab167 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:37:14 devstack sudo[93253]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-1815a5d6-c706-40b8-af4d-9dd8eeada199.e21d48c6-1dfe-476f-9273-136c6bfab167 Jul 10 04:37:14 devstack sudo[93253]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:37:15 devstack sudo[93253]: pam_unix(sudo:session): session closed for user root Jul 10 04:37:15 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [req-284289a5-8833-47f4-a13c-6e1fd543fcd2 req-a7213962-67db-4376-b4a4-531a9ae8154c tempest-VolumesSnapshotsTestJSON-876490581 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-1815a5d6-c706-40b8-af4d-9dd8eeada199.e21d48c6-1dfe-476f-9273-136c6bfab167" returned: 0 in 0.935s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:37:15 devstack cinder-volume[87444]: DEBUG cinder.coordination [req-284289a5-8833-47f4-a13c-6e1fd543fcd2 req-a7213962-67db-4376-b4a4-531a9ae8154c tempest-VolumesSnapshotsTestJSON-876490581 None] Lock "cinder-quobyte-e21d48c6-1dfe-476f-9273-136c6bfab167" released by "_delete_snapshot" :: held 4.157s {{(pid=87444) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 04:37:15 devstack cinder-volume[87444]: DEBUG cinder.coordination [req-284289a5-8833-47f4-a13c-6e1fd543fcd2 req-a7213962-67db-4376-b4a4-531a9ae8154c tempest-VolumesSnapshotsTestJSON-876490581 None] Lock "cinder-quobyte-1815a5d6-c706-40b8-af4d-9dd8eeada199" released by "delete_snapshot" :: held 4.201s {{(pid=87444) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 04:37:15 devstack cinder-volume[87444]: WARNING cinder.quota [req-284289a5-8833-47f4-a13c-6e1fd543fcd2 req-a7213962-67db-4376-b4a4-531a9ae8154c tempest-VolumesSnapshotsTestJSON-876490581 None] Deprecated: Default quota for resource: snapshots_QuobyteHD is set by the default quota flag: quota_snapshots_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Jul 10 04:37:15 devstack cinder-volume[87444]: DEBUG cinder.quota [req-284289a5-8833-47f4-a13c-6e1fd543fcd2 req-a7213962-67db-4376-b4a4-531a9ae8154c tempest-VolumesSnapshotsTestJSON-876490581 None] Created reservations ['22f5e2b9-79df-487f-a51c-5f86c0ac54c3', '6eeb64b6-ba04-46ec-b5e2-7523c3ba7a09', '861ddd45-80ed-482d-8583-658455053004', '0d323975-a316-4779-bf3f-3436551fbf1c'] {{(pid=87444) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 04:37:15 devstack cinder-volume[87444]: INFO cinder.volume.manager [req-284289a5-8833-47f4-a13c-6e1fd543fcd2 req-a7213962-67db-4376-b4a4-531a9ae8154c tempest-VolumesSnapshotsTestJSON-876490581 None] Delete snapshot completed successfully. Jul 10 04:37:15 devstack cinder-volume[87444]: DEBUG cinder.coordination [req-284289a5-8833-47f4-a13c-6e1fd543fcd2 req-a7213962-67db-4376-b4a4-531a9ae8154c tempest-VolumesSnapshotsTestJSON-876490581 None] Lock "cinder-e21d48c6-1dfe-476f-9273-136c6bfab167-delete_snapshot" released by "delete_snapshot" :: held 4.359s {{(pid=87444) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 04:37:15 devstack cinder-volume[87444]: DEBUG cinder.coordination [req-3f11c6e8-ace0-49f9-a75e-b4830ccda4ac req-07e6eda2-9d89-4c11-b23b-ca3e1d707b4e tempest-VolumesSnapshotsTestJSON-876490581 None] Acquiring lock "cinder-1815a5d6-c706-40b8-af4d-9dd8eeada199-delete_volume" by "delete_volume" {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 04:37:15 devstack cinder-volume[87444]: DEBUG cinder.coordination [req-3f11c6e8-ace0-49f9-a75e-b4830ccda4ac req-07e6eda2-9d89-4c11-b23b-ca3e1d707b4e tempest-VolumesSnapshotsTestJSON-876490581 None] Lock "cinder-1815a5d6-c706-40b8-af4d-9dd8eeada199-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 04:37:15 devstack cinder-volume[87444]: DEBUG cinder.coordination [req-3f11c6e8-ace0-49f9-a75e-b4830ccda4ac req-07e6eda2-9d89-4c11-b23b-ca3e1d707b4e tempest-VolumesSnapshotsTestJSON-876490581 None] Acquiring lock "cinder-quobyte-1815a5d6-c706-40b8-af4d-9dd8eeada199" by "delete_volume" {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 04:37:15 devstack cinder-volume[87444]: DEBUG cinder.coordination [req-3f11c6e8-ace0-49f9-a75e-b4830ccda4ac req-07e6eda2-9d89-4c11-b23b-ca3e1d707b4e tempest-VolumesSnapshotsTestJSON-876490581 None] Lock "cinder-quobyte-1815a5d6-c706-40b8-af4d-9dd8eeada199" acquired by "delete_volume" :: waited 0.025s {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 04:37:15 devstack cinder-volume[87444]: DEBUG oslo.privsep.daemon [-] privsep: reply[92a93ec7-0ad3-45bd-a373-a619926ea8ce]: (4, 'qcow2') {{(pid=88499) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 04:37:15 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [req-3f11c6e8-ace0-49f9-a75e-b4830ccda4ac req-07e6eda2-9d89-4c11-b23b-ca3e1d707b4e tempest-VolumesSnapshotsTestJSON-876490581 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-1815a5d6-c706-40b8-af4d-9dd8eeada199 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:37:15 devstack sudo[93278]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-1815a5d6-c706-40b8-af4d-9dd8eeada199 Jul 10 04:37:15 devstack sudo[93278]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:37:16 devstack sudo[93278]: pam_unix(sudo:session): session closed for user root Jul 10 04:37:16 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [req-3f11c6e8-ace0-49f9-a75e-b4830ccda4ac req-07e6eda2-9d89-4c11-b23b-ca3e1d707b4e tempest-VolumesSnapshotsTestJSON-876490581 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-1815a5d6-c706-40b8-af4d-9dd8eeada199" returned: 0 in 0.926s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:37:16 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [req-3f11c6e8-ace0-49f9-a75e-b4830ccda4ac req-07e6eda2-9d89-4c11-b23b-ca3e1d707b4e tempest-VolumesSnapshotsTestJSON-876490581 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-1815a5d6-c706-40b8-af4d-9dd8eeada199 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:37:16 devstack sudo[93286]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-1815a5d6-c706-40b8-af4d-9dd8eeada199 Jul 10 04:37:16 devstack sudo[93286]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:37:17 devstack sudo[93286]: pam_unix(sudo:session): session closed for user root Jul 10 04:37:17 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [req-3f11c6e8-ace0-49f9-a75e-b4830ccda4ac req-07e6eda2-9d89-4c11-b23b-ca3e1d707b4e tempest-VolumesSnapshotsTestJSON-876490581 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-1815a5d6-c706-40b8-af4d-9dd8eeada199" returned: 0 in 0.656s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:37:17 devstack cinder-volume[87444]: DEBUG cinder.coordination [req-3f11c6e8-ace0-49f9-a75e-b4830ccda4ac req-07e6eda2-9d89-4c11-b23b-ca3e1d707b4e tempest-VolumesSnapshotsTestJSON-876490581 None] Lock "cinder-quobyte-1815a5d6-c706-40b8-af4d-9dd8eeada199" released by "delete_volume" :: held 1.652s {{(pid=87444) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 04:37:17 devstack cinder-volume[87444]: DEBUG cinder.quota [req-3f11c6e8-ace0-49f9-a75e-b4830ccda4ac req-07e6eda2-9d89-4c11-b23b-ca3e1d707b4e tempest-VolumesSnapshotsTestJSON-876490581 None] Created reservations ['8eef67c2-32d2-47e4-827d-bf482af8634c', 'c24c1e83-0c8c-4c21-a957-b1bd6f3b4f8e', 'adcbc324-0ac5-4d37-854b-e9e5b6d67e30', 'daebc513-d09d-4b67-b917-52c464f828ef'] {{(pid=87444) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 04:37:17 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [req-3f11c6e8-ace0-49f9-a75e-b4830ccda4ac req-07e6eda2-9d89-4c11-b23b-ca3e1d707b4e tempest-VolumesSnapshotsTestJSON-876490581 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 04:37:17 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [req-3f11c6e8-ace0-49f9-a75e-b4830ccda4ac req-07e6eda2-9d89-4c11-b23b-ca3e1d707b4e tempest-VolumesSnapshotsTestJSON-876490581 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 04:37:17 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [req-3f11c6e8-ace0-49f9-a75e-b4830ccda4ac req-07e6eda2-9d89-4c11-b23b-ca3e1d707b4e tempest-VolumesSnapshotsTestJSON-876490581 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922': None} {{(pid=87444) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 04:37:17 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [req-3f11c6e8-ace0-49f9-a75e-b4830ccda4ac req-07e6eda2-9d89-4c11-b23b-ca3e1d707b4e tempest-VolumesSnapshotsTestJSON-876490581 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922'] {{(pid=87444) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 04:37:17 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [req-3f11c6e8-ace0-49f9-a75e-b4830ccda4ac req-07e6eda2-9d89-4c11-b23b-ca3e1d707b4e tempest-VolumesSnapshotsTestJSON-876490581 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 04:37:17 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [req-3f11c6e8-ace0-49f9-a75e-b4830ccda4ac req-07e6eda2-9d89-4c11-b23b-ca3e1d707b4e tempest-VolumesSnapshotsTestJSON-876490581 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:37:17 devstack sudo[93289]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097 Jul 10 04:37:17 devstack sudo[93289]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:37:18 devstack sudo[93289]: pam_unix(sudo:session): session closed for user root Jul 10 04:37:18 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [req-3f11c6e8-ace0-49f9-a75e-b4830ccda4ac req-07e6eda2-9d89-4c11-b23b-ca3e1d707b4e tempest-VolumesSnapshotsTestJSON-876490581 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097" returned: 0 in 0.708s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:37:18 devstack cinder-volume[87444]: DEBUG cinder.manager [req-3f11c6e8-ace0-49f9-a75e-b4830ccda4ac req-07e6eda2-9d89-4c11-b23b-ca3e1d707b4e tempest-VolumesSnapshotsTestJSON-876490581 None] Notifying Schedulers of capabilities ... {{(pid=87444) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 04:37:18 devstack cinder-volume[87444]: INFO cinder.volume.manager [req-3f11c6e8-ace0-49f9-a75e-b4830ccda4ac req-07e6eda2-9d89-4c11-b23b-ca3e1d707b4e tempest-VolumesSnapshotsTestJSON-876490581 None] Deleted volume successfully. Jul 10 04:37:18 devstack cinder-volume[87444]: DEBUG cinder.coordination [req-3f11c6e8-ace0-49f9-a75e-b4830ccda4ac req-07e6eda2-9d89-4c11-b23b-ca3e1d707b4e tempest-VolumesSnapshotsTestJSON-876490581 None] Lock "cinder-1815a5d6-c706-40b8-af4d-9dd8eeada199-delete_volume" released by "delete_volume" :: held 2.592s {{(pid=87444) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 04:37:22 devstack cinder-volume[87444]: DEBUG cinder.volume.flows.manager.create_volume [req-1ec6c905-13b6-4e55-9353-bc5c1b6546a5 req-66f06646-2611-4fa2-810f-501442c6f063 tempest-VolumesGetTestJSON-530398830 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87444) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 04:37:22 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [req-1ec6c905-13b6-4e55-9353-bc5c1b6546a5 req-66f06646-2611-4fa2-810f-501442c6f063 tempest-VolumesGetTestJSON-530398830 None] Flow 'volume_create_manager' (104ee945-d864-496e-98ec-684183981136) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 04:37:22 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [req-1ec6c905-13b6-4e55-9353-bc5c1b6546a5 req-66f06646-2611-4fa2-810f-501442c6f063 tempest-VolumesGetTestJSON-530398830 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ee763715-adc7-4400-ae76-3913c3420229) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:37:22 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [req-1ec6c905-13b6-4e55-9353-bc5c1b6546a5 req-66f06646-2611-4fa2-810f-501442c6f063 tempest-VolumesGetTestJSON-530398830 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ee763715-adc7-4400-ae76-3913c3420229) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T02:37:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-1473170965',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=042fb102-fea2-4989-90e1-69a01514e6bb,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='27b4ae0c5fa9434fa2fe359f4a37b09a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T02:37:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T02:37:22Z,use_quota=True,user_id='c2943a0e147744889258bde378a26d75',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(317e369e-1e06-434d-ae95-a335f0e6c903),volume_type_id=317e369e-1e06-434d-ae95-a335f0e6c903)' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:37:22 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [req-1ec6c905-13b6-4e55-9353-bc5c1b6546a5 req-66f06646-2611-4fa2-810f-501442c6f063 tempest-VolumesGetTestJSON-530398830 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5075374b-6739-44b4-b031-83f4e41945ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:37:22 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [req-1ec6c905-13b6-4e55-9353-bc5c1b6546a5 req-66f06646-2611-4fa2-810f-501442c6f063 tempest-VolumesGetTestJSON-530398830 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5075374b-6739-44b4-b031-83f4e41945ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:37:22 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [req-1ec6c905-13b6-4e55-9353-bc5c1b6546a5 req-66f06646-2611-4fa2-810f-501442c6f063 tempest-VolumesGetTestJSON-530398830 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (db3ddecd-d38a-41aa-874f-dde6a79321ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:37:22 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [req-1ec6c905-13b6-4e55-9353-bc5c1b6546a5 req-66f06646-2611-4fa2-810f-501442c6f063 tempest-VolumesGetTestJSON-530398830 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (db3ddecd-d38a-41aa-874f-dde6a79321ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '042fb102-fea2-4989-90e1-69a01514e6bb', 'volume_name': 'volume-042fb102-fea2-4989-90e1-69a01514e6bb', 'volume_size': 1}' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:37:22 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [req-1ec6c905-13b6-4e55-9353-bc5c1b6546a5 req-66f06646-2611-4fa2-810f-501442c6f063 tempest-VolumesGetTestJSON-530398830 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (55493689-10b4-4df7-8e95-0b21fa790f6e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:37:22 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [req-1ec6c905-13b6-4e55-9353-bc5c1b6546a5 req-66f06646-2611-4fa2-810f-501442c6f063 tempest-VolumesGetTestJSON-530398830 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (55493689-10b4-4df7-8e95-0b21fa790f6e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:37:22 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [req-1ec6c905-13b6-4e55-9353-bc5c1b6546a5 req-66f06646-2611-4fa2-810f-501442c6f063 tempest-VolumesGetTestJSON-530398830 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (06b04887-5331-4483-97e9-2acece559c06) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:37:22 devstack cinder-volume[87444]: INFO cinder.volume.flows.manager.create_volume [req-1ec6c905-13b6-4e55-9353-bc5c1b6546a5 req-66f06646-2611-4fa2-810f-501442c6f063 tempest-VolumesGetTestJSON-530398830 None] Volume 042fb102-fea2-4989-90e1-69a01514e6bb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-042fb102-fea2-4989-90e1-69a01514e6bb', 'volume_size': 1} Jul 10 04:37:22 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [req-1ec6c905-13b6-4e55-9353-bc5c1b6546a5 req-66f06646-2611-4fa2-810f-501442c6f063 tempest-VolumesGetTestJSON-530398830 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 04:37:22 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [req-1ec6c905-13b6-4e55-9353-bc5c1b6546a5 req-66f06646-2611-4fa2-810f-501442c6f063 tempest-VolumesGetTestJSON-530398830 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 04:37:22 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [req-1ec6c905-13b6-4e55-9353-bc5c1b6546a5 req-66f06646-2611-4fa2-810f-501442c6f063 tempest-VolumesGetTestJSON-530398830 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T02:37:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-1473170965',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=042fb102-fea2-4989-90e1-69a01514e6bb,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='27b4ae0c5fa9434fa2fe359f4a37b09a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T02:37:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T02:37:22Z,use_quota=True,user_id='c2943a0e147744889258bde378a26d75',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(317e369e-1e06-434d-ae95-a335f0e6c903),volume_type_id=317e369e-1e06-434d-ae95-a335f0e6c903)}" {{(pid=87444) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 04:37:22 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.remotefs [req-1ec6c905-13b6-4e55-9353-bc5c1b6546a5 req-66f06646-2611-4fa2-810f-501442c6f063 tempest-VolumesGetTestJSON-530398830 None] Creating volume 042fb102-fea2-4989-90e1-69a01514e6bb {{(pid=87444) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 04:37:22 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [req-1ec6c905-13b6-4e55-9353-bc5c1b6546a5 req-66f06646-2611-4fa2-810f-501442c6f063 tempest-VolumesGetTestJSON-530398830 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 04:37:22 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [req-1ec6c905-13b6-4e55-9353-bc5c1b6546a5 req-66f06646-2611-4fa2-810f-501442c6f063 tempest-VolumesGetTestJSON-530398830 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 04:37:22 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [req-1ec6c905-13b6-4e55-9353-bc5c1b6546a5 req-66f06646-2611-4fa2-810f-501442c6f063 tempest-VolumesGetTestJSON-530398830 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922': None} {{(pid=87444) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 04:37:22 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [req-1ec6c905-13b6-4e55-9353-bc5c1b6546a5 req-66f06646-2611-4fa2-810f-501442c6f063 tempest-VolumesGetTestJSON-530398830 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922'] {{(pid=87444) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 04:37:22 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [req-1ec6c905-13b6-4e55-9353-bc5c1b6546a5 req-66f06646-2611-4fa2-810f-501442c6f063 tempest-VolumesGetTestJSON-530398830 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 04:37:22 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [req-1ec6c905-13b6-4e55-9353-bc5c1b6546a5 req-66f06646-2611-4fa2-810f-501442c6f063 tempest-VolumesGetTestJSON-530398830 None] Selected osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922 as target Quobyte volume. {{(pid=87444) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 04:37:22 devstack cinder-volume[87444]: INFO cinder.volume.drivers.remotefs [req-1ec6c905-13b6-4e55-9353-bc5c1b6546a5 req-66f06646-2611-4fa2-810f-501442c6f063 tempest-VolumesGetTestJSON-530398830 None] casted to osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922 Jul 10 04:37:22 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [req-1ec6c905-13b6-4e55-9353-bc5c1b6546a5 req-66f06646-2611-4fa2-810f-501442c6f063 tempest-VolumesGetTestJSON-530398830 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-042fb102-fea2-4989-90e1-69a01514e6bb 1073741824 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:37:22 devstack sudo[93293]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-042fb102-fea2-4989-90e1-69a01514e6bb 1073741824 Jul 10 04:37:22 devstack sudo[93293]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:37:23 devstack sudo[93293]: pam_unix(sudo:session): session closed for user root Jul 10 04:37:23 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [req-1ec6c905-13b6-4e55-9353-bc5c1b6546a5 req-66f06646-2611-4fa2-810f-501442c6f063 tempest-VolumesGetTestJSON-530398830 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-042fb102-fea2-4989-90e1-69a01514e6bb 1073741824" returned: 0 in 1.108s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:37:23 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [req-1ec6c905-13b6-4e55-9353-bc5c1b6546a5 req-66f06646-2611-4fa2-810f-501442c6f063 tempest-VolumesGetTestJSON-530398830 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-042fb102-fea2-4989-90e1-69a01514e6bb {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:37:23 devstack sudo[93305]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-042fb102-fea2-4989-90e1-69a01514e6bb Jul 10 04:37:23 devstack sudo[93305]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:37:24 devstack cinder-volume[87444]: DEBUG cinder.volume.flows.manager.create_volume [None req-c29900d0-e254-41fc-959b-17fafdc3b239 tempest-AttachVolumeTestJSON-83712851 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87444) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 04:37:24 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-c29900d0-e254-41fc-959b-17fafdc3b239 tempest-AttachVolumeTestJSON-83712851 None] Flow 'volume_create_manager' (55629395-b59b-4a2a-8973-4be3c45cf8f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 04:37:24 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-c29900d0-e254-41fc-959b-17fafdc3b239 tempest-AttachVolumeTestJSON-83712851 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3a139b55-a306-4b03-b2d6-e5180bb18766) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:37:24 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-c29900d0-e254-41fc-959b-17fafdc3b239 tempest-AttachVolumeTestJSON-83712851 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3a139b55-a306-4b03-b2d6-e5180bb18766) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T02:37:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1510218562',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f0d6ebdd-da52-4fd1-8a77-761449439557,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='09cffa6d710e4979be4a1aa7d69e8d1f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T02:37:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T02:37:24Z,use_quota=True,user_id='37611270de3f4371b8c876167fa097ec',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(317e369e-1e06-434d-ae95-a335f0e6c903),volume_type_id=317e369e-1e06-434d-ae95-a335f0e6c903)' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:37:24 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-c29900d0-e254-41fc-959b-17fafdc3b239 tempest-AttachVolumeTestJSON-83712851 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a4dc8843-f0a6-44a7-9472-0eddf66f8865) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:37:24 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-c29900d0-e254-41fc-959b-17fafdc3b239 tempest-AttachVolumeTestJSON-83712851 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a4dc8843-f0a6-44a7-9472-0eddf66f8865) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:37:24 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-c29900d0-e254-41fc-959b-17fafdc3b239 tempest-AttachVolumeTestJSON-83712851 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (675bd61a-eac0-4906-9a7d-5a04668669f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:37:24 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-c29900d0-e254-41fc-959b-17fafdc3b239 tempest-AttachVolumeTestJSON-83712851 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (675bd61a-eac0-4906-9a7d-5a04668669f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f0d6ebdd-da52-4fd1-8a77-761449439557', 'volume_name': 'volume-f0d6ebdd-da52-4fd1-8a77-761449439557', 'volume_size': 1}' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:37:24 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-c29900d0-e254-41fc-959b-17fafdc3b239 tempest-AttachVolumeTestJSON-83712851 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (45f1e666-edd7-4c1f-a72d-c7fdb89cbbbc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:37:24 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-c29900d0-e254-41fc-959b-17fafdc3b239 tempest-AttachVolumeTestJSON-83712851 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (45f1e666-edd7-4c1f-a72d-c7fdb89cbbbc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:37:24 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-c29900d0-e254-41fc-959b-17fafdc3b239 tempest-AttachVolumeTestJSON-83712851 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3498f0f0-a963-460b-96d6-54133c3b8357) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:37:24 devstack cinder-volume[87444]: INFO cinder.volume.flows.manager.create_volume [None req-c29900d0-e254-41fc-959b-17fafdc3b239 tempest-AttachVolumeTestJSON-83712851 None] Volume f0d6ebdd-da52-4fd1-8a77-761449439557: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f0d6ebdd-da52-4fd1-8a77-761449439557', 'volume_size': 1} Jul 10 04:37:24 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-c29900d0-e254-41fc-959b-17fafdc3b239 tempest-AttachVolumeTestJSON-83712851 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 04:37:24 devstack sudo[93305]: pam_unix(sudo:session): session closed for user root Jul 10 04:37:24 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [req-1ec6c905-13b6-4e55-9353-bc5c1b6546a5 req-66f06646-2611-4fa2-810f-501442c6f063 tempest-VolumesGetTestJSON-530398830 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-042fb102-fea2-4989-90e1-69a01514e6bb" returned: 0 in 0.724s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:37:24 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [req-1ec6c905-13b6-4e55-9353-bc5c1b6546a5 req-66f06646-2611-4fa2-810f-501442c6f063 tempest-VolumesGetTestJSON-530398830 None] <== create_volume: return (1902ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922'} {{(pid=87444) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 04:37:24 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [req-1ec6c905-13b6-4e55-9353-bc5c1b6546a5 req-66f06646-2611-4fa2-810f-501442c6f063 tempest-VolumesGetTestJSON-530398830 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.904s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 04:37:24 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-c29900d0-e254-41fc-959b-17fafdc3b239 tempest-AttachVolumeTestJSON-83712851 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.091s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 04:37:24 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-c29900d0-e254-41fc-959b-17fafdc3b239 tempest-AttachVolumeTestJSON-83712851 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T02:37:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1510218562',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f0d6ebdd-da52-4fd1-8a77-761449439557,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='09cffa6d710e4979be4a1aa7d69e8d1f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T02:37:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T02:37:24Z,use_quota=True,user_id='37611270de3f4371b8c876167fa097ec',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(317e369e-1e06-434d-ae95-a335f0e6c903),volume_type_id=317e369e-1e06-434d-ae95-a335f0e6c903)}" {{(pid=87444) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 04:37:24 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.remotefs [None req-c29900d0-e254-41fc-959b-17fafdc3b239 tempest-AttachVolumeTestJSON-83712851 None] Creating volume f0d6ebdd-da52-4fd1-8a77-761449439557 {{(pid=87444) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 04:37:24 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-c29900d0-e254-41fc-959b-17fafdc3b239 tempest-AttachVolumeTestJSON-83712851 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 04:37:24 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-c29900d0-e254-41fc-959b-17fafdc3b239 tempest-AttachVolumeTestJSON-83712851 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 04:37:24 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-c29900d0-e254-41fc-959b-17fafdc3b239 tempest-AttachVolumeTestJSON-83712851 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922': None} {{(pid=87444) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 04:37:24 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-c29900d0-e254-41fc-959b-17fafdc3b239 tempest-AttachVolumeTestJSON-83712851 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922'] {{(pid=87444) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 04:37:24 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-c29900d0-e254-41fc-959b-17fafdc3b239 tempest-AttachVolumeTestJSON-83712851 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 04:37:24 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-c29900d0-e254-41fc-959b-17fafdc3b239 tempest-AttachVolumeTestJSON-83712851 None] Selected osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922 as target Quobyte volume. {{(pid=87444) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 04:37:24 devstack cinder-volume[87444]: INFO cinder.volume.drivers.remotefs [None req-c29900d0-e254-41fc-959b-17fafdc3b239 tempest-AttachVolumeTestJSON-83712851 None] casted to osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922 Jul 10 04:37:24 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-c29900d0-e254-41fc-959b-17fafdc3b239 tempest-AttachVolumeTestJSON-83712851 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-f0d6ebdd-da52-4fd1-8a77-761449439557 1073741824 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:37:24 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [req-1ec6c905-13b6-4e55-9353-bc5c1b6546a5 req-66f06646-2611-4fa2-810f-501442c6f063 tempest-VolumesGetTestJSON-530398830 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (06b04887-5331-4483-97e9-2acece559c06) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-042fb102-fea2-4989-90e1-69a01514e6bb', 'volume_size': 1}' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:37:24 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [req-1ec6c905-13b6-4e55-9353-bc5c1b6546a5 req-66f06646-2611-4fa2-810f-501442c6f063 tempest-VolumesGetTestJSON-530398830 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2b992f59-a5de-47e3-983a-13eb087c316d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:37:24 devstack sudo[93308]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-f0d6ebdd-da52-4fd1-8a77-761449439557 1073741824 Jul 10 04:37:24 devstack sudo[93308]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:37:24 devstack cinder-volume[87444]: INFO cinder.volume.flows.manager.create_volume [req-1ec6c905-13b6-4e55-9353-bc5c1b6546a5 req-66f06646-2611-4fa2-810f-501442c6f063 tempest-VolumesGetTestJSON-530398830 None] Volume volume-042fb102-fea2-4989-90e1-69a01514e6bb (042fb102-fea2-4989-90e1-69a01514e6bb): created successfully Jul 10 04:37:24 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [req-1ec6c905-13b6-4e55-9353-bc5c1b6546a5 req-66f06646-2611-4fa2-810f-501442c6f063 tempest-VolumesGetTestJSON-530398830 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2b992f59-a5de-47e3-983a-13eb087c316d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:37:24 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [req-1ec6c905-13b6-4e55-9353-bc5c1b6546a5 req-66f06646-2611-4fa2-810f-501442c6f063 tempest-VolumesGetTestJSON-530398830 None] Flow 'volume_create_manager' (104ee945-d864-496e-98ec-684183981136) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87444) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 04:37:24 devstack cinder-volume[87444]: INFO cinder.volume.manager [req-1ec6c905-13b6-4e55-9353-bc5c1b6546a5 req-66f06646-2611-4fa2-810f-501442c6f063 tempest-VolumesGetTestJSON-530398830 None] Created volume successfully. Jul 10 04:37:24 devstack cinder-volume[87444]: DEBUG cinder.coordination [req-a7033f1b-7157-4e5b-87bb-fc08bf31125f req-8b222097-3667-4e0b-aa6f-b76df5def7dc tempest-VolumesGetTestJSON-530398830 None] Acquiring lock "cinder-042fb102-fea2-4989-90e1-69a01514e6bb-delete_volume" by "delete_volume" {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 04:37:24 devstack cinder-volume[87444]: DEBUG cinder.coordination [req-a7033f1b-7157-4e5b-87bb-fc08bf31125f req-8b222097-3667-4e0b-aa6f-b76df5def7dc tempest-VolumesGetTestJSON-530398830 None] Lock "cinder-042fb102-fea2-4989-90e1-69a01514e6bb-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 04:37:25 devstack cinder-volume[87444]: DEBUG cinder.coordination [req-a7033f1b-7157-4e5b-87bb-fc08bf31125f req-8b222097-3667-4e0b-aa6f-b76df5def7dc tempest-VolumesGetTestJSON-530398830 None] Acquiring lock "cinder-quobyte-042fb102-fea2-4989-90e1-69a01514e6bb" by "delete_volume" {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 04:37:25 devstack cinder-volume[87444]: DEBUG cinder.coordination [req-a7033f1b-7157-4e5b-87bb-fc08bf31125f req-8b222097-3667-4e0b-aa6f-b76df5def7dc tempest-VolumesGetTestJSON-530398830 None] Lock "cinder-quobyte-042fb102-fea2-4989-90e1-69a01514e6bb" acquired by "delete_volume" :: waited 0.025s {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 04:37:25 devstack cinder-volume[87444]: DEBUG oslo.privsep.daemon [-] privsep: reply[32771b57-d2cb-4a5b-813d-11bba5217b03]: (4, 'qcow2') {{(pid=88499) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 04:37:25 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [req-a7033f1b-7157-4e5b-87bb-fc08bf31125f req-8b222097-3667-4e0b-aa6f-b76df5def7dc tempest-VolumesGetTestJSON-530398830 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-042fb102-fea2-4989-90e1-69a01514e6bb {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:37:25 devstack sudo[93311]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-042fb102-fea2-4989-90e1-69a01514e6bb Jul 10 04:37:25 devstack sudo[93311]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:37:25 devstack sudo[93308]: pam_unix(sudo:session): session closed for user root Jul 10 04:37:25 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-c29900d0-e254-41fc-959b-17fafdc3b239 tempest-AttachVolumeTestJSON-83712851 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-f0d6ebdd-da52-4fd1-8a77-761449439557 1073741824" returned: 0 in 1.135s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:37:25 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-c29900d0-e254-41fc-959b-17fafdc3b239 tempest-AttachVolumeTestJSON-83712851 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-f0d6ebdd-da52-4fd1-8a77-761449439557 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:37:25 devstack sudo[93317]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-f0d6ebdd-da52-4fd1-8a77-761449439557 Jul 10 04:37:25 devstack sudo[93317]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:37:26 devstack sudo[93311]: pam_unix(sudo:session): session closed for user root Jul 10 04:37:26 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [req-a7033f1b-7157-4e5b-87bb-fc08bf31125f req-8b222097-3667-4e0b-aa6f-b76df5def7dc tempest-VolumesGetTestJSON-530398830 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-042fb102-fea2-4989-90e1-69a01514e6bb" returned: 0 in 0.915s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:37:26 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [req-a7033f1b-7157-4e5b-87bb-fc08bf31125f req-8b222097-3667-4e0b-aa6f-b76df5def7dc tempest-VolumesGetTestJSON-530398830 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-042fb102-fea2-4989-90e1-69a01514e6bb {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:37:26 devstack sudo[93323]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-042fb102-fea2-4989-90e1-69a01514e6bb Jul 10 04:37:26 devstack sudo[93323]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:37:26 devstack sudo[93317]: pam_unix(sudo:session): session closed for user root Jul 10 04:37:26 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-c29900d0-e254-41fc-959b-17fafdc3b239 tempest-AttachVolumeTestJSON-83712851 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-f0d6ebdd-da52-4fd1-8a77-761449439557" returned: 0 in 0.760s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:37:26 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-c29900d0-e254-41fc-959b-17fafdc3b239 tempest-AttachVolumeTestJSON-83712851 None] <== create_volume: return (1957ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922'} {{(pid=87444) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 04:37:26 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-c29900d0-e254-41fc-959b-17fafdc3b239 tempest-AttachVolumeTestJSON-83712851 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.959s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 04:37:26 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-c29900d0-e254-41fc-959b-17fafdc3b239 tempest-AttachVolumeTestJSON-83712851 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3498f0f0-a963-460b-96d6-54133c3b8357) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f0d6ebdd-da52-4fd1-8a77-761449439557', 'volume_size': 1}' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:37:26 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-c29900d0-e254-41fc-959b-17fafdc3b239 tempest-AttachVolumeTestJSON-83712851 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (62469ca2-e570-48f0-a833-664255295c2c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:37:26 devstack cinder-volume[87444]: INFO cinder.volume.flows.manager.create_volume [None req-c29900d0-e254-41fc-959b-17fafdc3b239 tempest-AttachVolumeTestJSON-83712851 None] Volume volume-f0d6ebdd-da52-4fd1-8a77-761449439557 (f0d6ebdd-da52-4fd1-8a77-761449439557): created successfully Jul 10 04:37:26 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-c29900d0-e254-41fc-959b-17fafdc3b239 tempest-AttachVolumeTestJSON-83712851 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (62469ca2-e570-48f0-a833-664255295c2c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:37:26 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-c29900d0-e254-41fc-959b-17fafdc3b239 tempest-AttachVolumeTestJSON-83712851 None] Flow 'volume_create_manager' (55629395-b59b-4a2a-8973-4be3c45cf8f1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87444) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 04:37:26 devstack cinder-volume[87444]: INFO cinder.volume.manager [None req-c29900d0-e254-41fc-959b-17fafdc3b239 tempest-AttachVolumeTestJSON-83712851 None] Created volume successfully. Jul 10 04:37:26 devstack sudo[93323]: pam_unix(sudo:session): session closed for user root Jul 10 04:37:26 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [req-a7033f1b-7157-4e5b-87bb-fc08bf31125f req-8b222097-3667-4e0b-aa6f-b76df5def7dc tempest-VolumesGetTestJSON-530398830 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-042fb102-fea2-4989-90e1-69a01514e6bb" returned: 0 in 0.766s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:37:26 devstack cinder-volume[87444]: DEBUG cinder.coordination [req-a7033f1b-7157-4e5b-87bb-fc08bf31125f req-8b222097-3667-4e0b-aa6f-b76df5def7dc tempest-VolumesGetTestJSON-530398830 None] Lock "cinder-quobyte-042fb102-fea2-4989-90e1-69a01514e6bb" released by "delete_volume" :: held 1.752s {{(pid=87444) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 04:37:26 devstack cinder-volume[87444]: DEBUG cinder.quota [req-a7033f1b-7157-4e5b-87bb-fc08bf31125f req-8b222097-3667-4e0b-aa6f-b76df5def7dc tempest-VolumesGetTestJSON-530398830 None] Created reservations ['39ebdd37-cea0-49da-9eea-807e222057d0', 'd483a3ea-3b04-45e0-a86e-842e578f3924', 'dd28acb5-a0c6-413e-b7fe-5b9b925ccfc1', 'e8564e94-8ce9-484b-a810-aeede31eb39c'] {{(pid=87444) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 04:37:26 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [req-a7033f1b-7157-4e5b-87bb-fc08bf31125f req-8b222097-3667-4e0b-aa6f-b76df5def7dc tempest-VolumesGetTestJSON-530398830 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 04:37:26 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [req-a7033f1b-7157-4e5b-87bb-fc08bf31125f req-8b222097-3667-4e0b-aa6f-b76df5def7dc tempest-VolumesGetTestJSON-530398830 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 04:37:26 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [req-a7033f1b-7157-4e5b-87bb-fc08bf31125f req-8b222097-3667-4e0b-aa6f-b76df5def7dc tempest-VolumesGetTestJSON-530398830 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922': None} {{(pid=87444) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 04:37:26 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [req-a7033f1b-7157-4e5b-87bb-fc08bf31125f req-8b222097-3667-4e0b-aa6f-b76df5def7dc tempest-VolumesGetTestJSON-530398830 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922'] {{(pid=87444) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 04:37:26 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [req-a7033f1b-7157-4e5b-87bb-fc08bf31125f req-8b222097-3667-4e0b-aa6f-b76df5def7dc tempest-VolumesGetTestJSON-530398830 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 04:37:26 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [req-a7033f1b-7157-4e5b-87bb-fc08bf31125f req-8b222097-3667-4e0b-aa6f-b76df5def7dc tempest-VolumesGetTestJSON-530398830 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:37:26 devstack sudo[93361]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097 Jul 10 04:37:26 devstack sudo[93361]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:37:27 devstack sudo[93361]: pam_unix(sudo:session): session closed for user root Jul 10 04:37:27 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [req-a7033f1b-7157-4e5b-87bb-fc08bf31125f req-8b222097-3667-4e0b-aa6f-b76df5def7dc tempest-VolumesGetTestJSON-530398830 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097" returned: 0 in 0.769s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:37:27 devstack cinder-volume[87444]: DEBUG cinder.manager [req-a7033f1b-7157-4e5b-87bb-fc08bf31125f req-8b222097-3667-4e0b-aa6f-b76df5def7dc tempest-VolumesGetTestJSON-530398830 None] Notifying Schedulers of capabilities ... {{(pid=87444) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 04:37:27 devstack cinder-volume[87444]: INFO cinder.volume.manager [req-a7033f1b-7157-4e5b-87bb-fc08bf31125f req-8b222097-3667-4e0b-aa6f-b76df5def7dc tempest-VolumesGetTestJSON-530398830 None] Deleted volume successfully. Jul 10 04:37:27 devstack cinder-volume[87444]: DEBUG cinder.coordination [req-a7033f1b-7157-4e5b-87bb-fc08bf31125f req-8b222097-3667-4e0b-aa6f-b76df5def7dc tempest-VolumesGetTestJSON-530398830 None] Lock "cinder-042fb102-fea2-4989-90e1-69a01514e6bb-delete_volume" released by "delete_volume" :: held 2.790s {{(pid=87444) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 04:37:30 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [req-4b073587-0929-455a-ba35-a52d6c764946 req-2df5c5e3-0c89-41e4-8eee-847c93decec9 tempest-AttachVolumeTestJSON-83712851 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 04:37:30 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [req-4b073587-0929-455a-ba35-a52d6c764946 req-2df5c5e3-0c89-41e4-8eee-847c93decec9 tempest-AttachVolumeTestJSON-83712851 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 04:37:30 devstack cinder-volume[87444]: DEBUG oslo.privsep.daemon [-] privsep: reply[13bd6bdb-f632-4562-a996-fe1be1dce276]: (4, 'qcow2') {{(pid=88499) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 04:37:30 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [req-4b073587-0929-455a-ba35-a52d6c764946 req-2df5c5e3-0c89-41e4-8eee-847c93decec9 tempest-AttachVolumeTestJSON-83712851 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-f0d6ebdd-da52-4fd1-8a77-761449439557 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:37:30 devstack sudo[93381]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-f0d6ebdd-da52-4fd1-8a77-761449439557 Jul 10 04:37:30 devstack sudo[93381]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:37:32 devstack sudo[93381]: pam_unix(sudo:session): session closed for user root Jul 10 04:37:32 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [req-4b073587-0929-455a-ba35-a52d6c764946 req-2df5c5e3-0c89-41e4-8eee-847c93decec9 tempest-AttachVolumeTestJSON-83712851 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-f0d6ebdd-da52-4fd1-8a77-761449439557" returned: 0 in 1.266s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:37:32 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [req-4b073587-0929-455a-ba35-a52d6c764946 req-2df5c5e3-0c89-41e4-8eee-847c93decec9 tempest-AttachVolumeTestJSON-83712851 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.290s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 04:37:32 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [req-4b073587-0929-455a-ba35-a52d6c764946 req-2df5c5e3-0c89-41e4-8eee-847c93decec9 tempest-AttachVolumeTestJSON-83712851 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922', 'name': 'volume-f0d6ebdd-da52-4fd1-8a77-761449439557', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '9a01a693-c353-41a3-aaae-45d22db2fa5e', 'enforce_multipath': True} {{(pid=87444) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 10 04:37:32 devstack cinder-volume[87444]: INFO cinder.volume.manager [req-4b073587-0929-455a-ba35-a52d6c764946 req-2df5c5e3-0c89-41e4-8eee-847c93decec9 tempest-AttachVolumeTestJSON-83712851 None] attachment_update completed successfully. Jul 10 04:37:32 devstack cinder-volume[87444]: DEBUG oslo_service.periodic_task [None req-01f0ce3e-6850-4e14-881d-e40d3c4ad6e5 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87444) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 10 04:37:32 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-01f0ce3e-6850-4e14-881d-e40d3c4ad6e5 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 04:37:32 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-01f0ce3e-6850-4e14-881d-e40d3c4ad6e5 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 04:37:32 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-01f0ce3e-6850-4e14-881d-e40d3c4ad6e5 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922': None} {{(pid=87444) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 04:37:32 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-01f0ce3e-6850-4e14-881d-e40d3c4ad6e5 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922'] {{(pid=87444) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 04:37:32 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-01f0ce3e-6850-4e14-881d-e40d3c4ad6e5 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 04:37:32 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-01f0ce3e-6850-4e14-881d-e40d3c4ad6e5 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:37:33 devstack sudo[93480]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097 Jul 10 04:37:33 devstack sudo[93480]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:37:33 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-aa83d93e-cce8-48fa-8544-e600f97b2d56 tempest-BackendsCapabilitiesAdminTestsJSON-65365395 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.7577743530273, 'free_capacity_gb': 1775.7577743530273, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=87444) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Jul 10 04:37:33 devstack sudo[93480]: pam_unix(sudo:session): session closed for user root Jul 10 04:37:33 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-01f0ce3e-6850-4e14-881d-e40d3c4ad6e5 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097" returned: 0 in 0.918s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:37:33 devstack cinder-volume[87444]: DEBUG cinder.manager [None req-01f0ce3e-6850-4e14-881d-e40d3c4ad6e5 None None] Notifying Schedulers of capabilities ... {{(pid=87444) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 04:37:33 devstack cinder-volume[87444]: DEBUG oslo_service.periodic_task [None req-01f0ce3e-6850-4e14-881d-e40d3c4ad6e5 None None] Running periodic task VolumeManager._thread_info {{(pid=87444) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 10 04:37:33 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-01f0ce3e-6850-4e14-881d-e40d3c4ad6e5 None None] thread count: 8 {{(pid=87444) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 10 04:37:33 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-01f0ce3e-6850-4e14-881d-e40d3c4ad6e5 None None] thread info: [<_MainThread(MainThread, started 126839257915520)>, , , , , , , ] {{(pid=87444) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 10 04:37:34 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-83de6f34-6b85-4318-a25a-5c9e6222fb16 tempest-BackendsCapabilitiesAdminTestsJSON-65365395 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.7577743530273, 'free_capacity_gb': 1775.7577743530273, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=87444) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Jul 10 04:37:37 devstack cinder-volume[87444]: DEBUG cinder.volume.flows.manager.create_volume [None req-d6fb7350-7735-42ed-86d3-507b58f8aec8 tempest-AttachVolumeTestJSON-83712851 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87444) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 04:37:37 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-d6fb7350-7735-42ed-86d3-507b58f8aec8 tempest-AttachVolumeTestJSON-83712851 None] Flow 'volume_create_manager' (ad25af8d-1ca2-4d3f-bc44-30a57f0c5dbd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 04:37:37 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-d6fb7350-7735-42ed-86d3-507b58f8aec8 tempest-AttachVolumeTestJSON-83712851 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e67c282b-2020-4fd4-8276-fe89b7099796) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:37:37 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-d6fb7350-7735-42ed-86d3-507b58f8aec8 tempest-AttachVolumeTestJSON-83712851 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e67c282b-2020-4fd4-8276-fe89b7099796) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T02:37:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1161112162',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d11d441e-9b4f-42f2-850f-b00c3ed1af62,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='09cffa6d710e4979be4a1aa7d69e8d1f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T02:37:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T02:37:37Z,use_quota=True,user_id='37611270de3f4371b8c876167fa097ec',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(317e369e-1e06-434d-ae95-a335f0e6c903),volume_type_id=317e369e-1e06-434d-ae95-a335f0e6c903)' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:37:37 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-d6fb7350-7735-42ed-86d3-507b58f8aec8 tempest-AttachVolumeTestJSON-83712851 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b45f62d5-12ba-40f6-825e-8589c02e1f2d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:37:37 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-d6fb7350-7735-42ed-86d3-507b58f8aec8 tempest-AttachVolumeTestJSON-83712851 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b45f62d5-12ba-40f6-825e-8589c02e1f2d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:37:37 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-d6fb7350-7735-42ed-86d3-507b58f8aec8 tempest-AttachVolumeTestJSON-83712851 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7a30acf8-db6d-4164-92e8-e9cdfad4d17f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:37:37 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-d6fb7350-7735-42ed-86d3-507b58f8aec8 tempest-AttachVolumeTestJSON-83712851 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7a30acf8-db6d-4164-92e8-e9cdfad4d17f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd11d441e-9b4f-42f2-850f-b00c3ed1af62', 'volume_name': 'volume-d11d441e-9b4f-42f2-850f-b00c3ed1af62', 'volume_size': 1}' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:37:37 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-d6fb7350-7735-42ed-86d3-507b58f8aec8 tempest-AttachVolumeTestJSON-83712851 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (29cc2a38-a8f4-4b0e-b384-11d1ab8b2c5a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:37:37 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-d6fb7350-7735-42ed-86d3-507b58f8aec8 tempest-AttachVolumeTestJSON-83712851 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (29cc2a38-a8f4-4b0e-b384-11d1ab8b2c5a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:37:37 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-d6fb7350-7735-42ed-86d3-507b58f8aec8 tempest-AttachVolumeTestJSON-83712851 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8a136d0d-bd75-496e-aa82-873941bb69b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:37:37 devstack cinder-volume[87444]: INFO cinder.volume.flows.manager.create_volume [None req-d6fb7350-7735-42ed-86d3-507b58f8aec8 tempest-AttachVolumeTestJSON-83712851 None] Volume d11d441e-9b4f-42f2-850f-b00c3ed1af62: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d11d441e-9b4f-42f2-850f-b00c3ed1af62', 'volume_size': 1} Jul 10 04:37:37 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-d6fb7350-7735-42ed-86d3-507b58f8aec8 tempest-AttachVolumeTestJSON-83712851 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 04:37:37 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-d6fb7350-7735-42ed-86d3-507b58f8aec8 tempest-AttachVolumeTestJSON-83712851 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 04:37:37 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-d6fb7350-7735-42ed-86d3-507b58f8aec8 tempest-AttachVolumeTestJSON-83712851 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T02:37:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1161112162',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d11d441e-9b4f-42f2-850f-b00c3ed1af62,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='09cffa6d710e4979be4a1aa7d69e8d1f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T02:37:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T02:37:37Z,use_quota=True,user_id='37611270de3f4371b8c876167fa097ec',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(317e369e-1e06-434d-ae95-a335f0e6c903),volume_type_id=317e369e-1e06-434d-ae95-a335f0e6c903)}" {{(pid=87444) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 04:37:37 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.remotefs [None req-d6fb7350-7735-42ed-86d3-507b58f8aec8 tempest-AttachVolumeTestJSON-83712851 None] Creating volume d11d441e-9b4f-42f2-850f-b00c3ed1af62 {{(pid=87444) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 04:37:37 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-d6fb7350-7735-42ed-86d3-507b58f8aec8 tempest-AttachVolumeTestJSON-83712851 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 04:37:37 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-d6fb7350-7735-42ed-86d3-507b58f8aec8 tempest-AttachVolumeTestJSON-83712851 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 04:37:37 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-d6fb7350-7735-42ed-86d3-507b58f8aec8 tempest-AttachVolumeTestJSON-83712851 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922': None} {{(pid=87444) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 04:37:37 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-d6fb7350-7735-42ed-86d3-507b58f8aec8 tempest-AttachVolumeTestJSON-83712851 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922'] {{(pid=87444) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 04:37:37 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-d6fb7350-7735-42ed-86d3-507b58f8aec8 tempest-AttachVolumeTestJSON-83712851 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 04:37:37 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-d6fb7350-7735-42ed-86d3-507b58f8aec8 tempest-AttachVolumeTestJSON-83712851 None] Selected osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922 as target Quobyte volume. {{(pid=87444) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 04:37:37 devstack cinder-volume[87444]: INFO cinder.volume.drivers.remotefs [None req-d6fb7350-7735-42ed-86d3-507b58f8aec8 tempest-AttachVolumeTestJSON-83712851 None] casted to osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922 Jul 10 04:37:37 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-d6fb7350-7735-42ed-86d3-507b58f8aec8 tempest-AttachVolumeTestJSON-83712851 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-d11d441e-9b4f-42f2-850f-b00c3ed1af62 1073741824 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:37:37 devstack sudo[93798]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-d11d441e-9b4f-42f2-850f-b00c3ed1af62 1073741824 Jul 10 04:37:37 devstack sudo[93798]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:37:38 devstack sudo[93798]: pam_unix(sudo:session): session closed for user root Jul 10 04:37:38 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-d6fb7350-7735-42ed-86d3-507b58f8aec8 tempest-AttachVolumeTestJSON-83712851 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-d11d441e-9b4f-42f2-850f-b00c3ed1af62 1073741824" returned: 0 in 1.092s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:37:38 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-d6fb7350-7735-42ed-86d3-507b58f8aec8 tempest-AttachVolumeTestJSON-83712851 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-d11d441e-9b4f-42f2-850f-b00c3ed1af62 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:37:38 devstack sudo[93804]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-d11d441e-9b4f-42f2-850f-b00c3ed1af62 Jul 10 04:37:38 devstack sudo[93804]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:37:39 devstack sudo[93804]: pam_unix(sudo:session): session closed for user root Jul 10 04:37:39 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-d6fb7350-7735-42ed-86d3-507b58f8aec8 tempest-AttachVolumeTestJSON-83712851 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-d11d441e-9b4f-42f2-850f-b00c3ed1af62" returned: 0 in 1.292s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:37:39 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-d6fb7350-7735-42ed-86d3-507b58f8aec8 tempest-AttachVolumeTestJSON-83712851 None] <== create_volume: return (2440ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922'} {{(pid=87444) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 04:37:39 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-d6fb7350-7735-42ed-86d3-507b58f8aec8 tempest-AttachVolumeTestJSON-83712851 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.445s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 04:37:39 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-d6fb7350-7735-42ed-86d3-507b58f8aec8 tempest-AttachVolumeTestJSON-83712851 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8a136d0d-bd75-496e-aa82-873941bb69b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d11d441e-9b4f-42f2-850f-b00c3ed1af62', 'volume_size': 1}' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:37:39 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-d6fb7350-7735-42ed-86d3-507b58f8aec8 tempest-AttachVolumeTestJSON-83712851 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7af0b088-58ac-45b4-847d-a075a8eeb1f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:37:39 devstack cinder-volume[87444]: INFO cinder.volume.flows.manager.create_volume [None req-d6fb7350-7735-42ed-86d3-507b58f8aec8 tempest-AttachVolumeTestJSON-83712851 None] Volume volume-d11d441e-9b4f-42f2-850f-b00c3ed1af62 (d11d441e-9b4f-42f2-850f-b00c3ed1af62): created successfully Jul 10 04:37:40 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-d6fb7350-7735-42ed-86d3-507b58f8aec8 tempest-AttachVolumeTestJSON-83712851 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7af0b088-58ac-45b4-847d-a075a8eeb1f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:37:40 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-d6fb7350-7735-42ed-86d3-507b58f8aec8 tempest-AttachVolumeTestJSON-83712851 None] Flow 'volume_create_manager' (ad25af8d-1ca2-4d3f-bc44-30a57f0c5dbd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87444) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 04:37:40 devstack cinder-volume[87444]: INFO cinder.volume.manager [None req-d6fb7350-7735-42ed-86d3-507b58f8aec8 tempest-AttachVolumeTestJSON-83712851 None] Created volume successfully. Jul 10 04:37:44 devstack cinder-volume[87444]: DEBUG dbcounter [-] [87444] Writing DB stats cinder:SELECT=53,cinder:INSERT=10,cinder:UPDATE=59,cinder:DELETE=3 {{(pid=87444) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 10 04:37:44 devstack cinder-volume[87444]: DEBUG dbcounter [-] [87444] Writing DB stats cinder:SELECT=54,cinder:UPDATE=56,cinder:INSERT=16,cinder:DELETE=7 {{(pid=87444) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 10 04:37:44 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [req-480142eb-cdb7-4876-97f7-0b579c1fcc96 req-4df5a43d-9f61-4a34-96e4-83e1564ff93a tempest-AttachVolumeTestJSON-83712851 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 04:37:44 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [req-480142eb-cdb7-4876-97f7-0b579c1fcc96 req-4df5a43d-9f61-4a34-96e4-83e1564ff93a tempest-AttachVolumeTestJSON-83712851 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 04:37:44 devstack cinder-volume[87444]: DEBUG oslo.privsep.daemon [-] privsep: reply[9fa49ada-fbf9-4e50-8588-2049748196d2]: (4, 'qcow2') {{(pid=88499) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 04:37:44 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [req-480142eb-cdb7-4876-97f7-0b579c1fcc96 req-4df5a43d-9f61-4a34-96e4-83e1564ff93a tempest-AttachVolumeTestJSON-83712851 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-d11d441e-9b4f-42f2-850f-b00c3ed1af62 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:37:44 devstack sudo[93895]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-d11d441e-9b4f-42f2-850f-b00c3ed1af62 Jul 10 04:37:44 devstack sudo[93895]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:37:44 devstack cinder-volume[87444]: INFO cinder.volume.manager [None req-d6a3a20e-ac9f-4c6c-936d-bb30e5b2101e tempest-GroupSnapshotsV319Test-32396274 None] Group tempest-GroupSnapshotsV319Test-Group-815863241: creating Jul 10 04:37:44 devstack cinder-volume[87444]: INFO cinder.volume.manager [None req-d6a3a20e-ac9f-4c6c-936d-bb30e5b2101e tempest-GroupSnapshotsV319Test-32396274 None] Group tempest-GroupSnapshotsV319Test-Group-815863241: created successfully Jul 10 04:37:44 devstack cinder-volume[87444]: INFO cinder.volume.manager [None req-d6a3a20e-ac9f-4c6c-936d-bb30e5b2101e tempest-GroupSnapshotsV319Test-32396274 None] Create group completed successfully. Jul 10 04:37:45 devstack sudo[93895]: pam_unix(sudo:session): session closed for user root Jul 10 04:37:45 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [req-480142eb-cdb7-4876-97f7-0b579c1fcc96 req-4df5a43d-9f61-4a34-96e4-83e1564ff93a tempest-AttachVolumeTestJSON-83712851 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-d11d441e-9b4f-42f2-850f-b00c3ed1af62" returned: 0 in 1.280s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:37:45 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [req-480142eb-cdb7-4876-97f7-0b579c1fcc96 req-4df5a43d-9f61-4a34-96e4-83e1564ff93a tempest-AttachVolumeTestJSON-83712851 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.315s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 04:37:45 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [req-480142eb-cdb7-4876-97f7-0b579c1fcc96 req-4df5a43d-9f61-4a34-96e4-83e1564ff93a tempest-AttachVolumeTestJSON-83712851 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922', 'name': 'volume-d11d441e-9b4f-42f2-850f-b00c3ed1af62', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '8263bec5-81b1-4a2f-bc3a-9172a2700d42', 'enforce_multipath': True} {{(pid=87444) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 10 04:37:45 devstack cinder-volume[87444]: INFO cinder.volume.manager [req-480142eb-cdb7-4876-97f7-0b579c1fcc96 req-4df5a43d-9f61-4a34-96e4-83e1564ff93a tempest-AttachVolumeTestJSON-83712851 None] attachment_update completed successfully. Jul 10 04:37:46 devstack cinder-volume[87444]: DEBUG cinder.volume.flows.manager.create_volume [None req-5a142cb8-a9fa-4afa-b822-9847957da7eb tempest-GroupSnapshotsV319Test-32396274 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87444) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 04:37:46 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-5a142cb8-a9fa-4afa-b822-9847957da7eb tempest-GroupSnapshotsV319Test-32396274 None] Flow 'volume_create_manager' (3445dc2e-476a-4091-a5b0-2ca7cef3a5b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 04:37:46 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-5a142cb8-a9fa-4afa-b822-9847957da7eb tempest-GroupSnapshotsV319Test-32396274 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d181cc45-3452-4e64-8bc1-ff9c8342255f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:37:46 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-5a142cb8-a9fa-4afa-b822-9847957da7eb tempest-GroupSnapshotsV319Test-32396274 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d181cc45-3452-4e64-8bc1-ff9c8342255f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T02:37:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1538203194',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=9475c8c0-5ed4-425a-a23c-cd03f67eebce,host='devstack@QuobyteHD#QuobyteHD',id=63563655-06a8-4376-be29-4ba6f3c7b1b1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='60d71d44695f4ad59754f8db640e908a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T02:37:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T02:37:47Z,use_quota=True,user_id='8b22f4fdb1d046e8b16a3ab4c5d21594',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0f950fe5-85f2-48c3-aabf-63a4bdb1c506),volume_type_id=0f950fe5-85f2-48c3-aabf-63a4bdb1c506)' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:37:46 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-5a142cb8-a9fa-4afa-b822-9847957da7eb tempest-GroupSnapshotsV319Test-32396274 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c3e3a0d4-a801-46e2-ac57-214d23764cbb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:37:46 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-5a142cb8-a9fa-4afa-b822-9847957da7eb tempest-GroupSnapshotsV319Test-32396274 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c3e3a0d4-a801-46e2-ac57-214d23764cbb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:37:46 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-5a142cb8-a9fa-4afa-b822-9847957da7eb tempest-GroupSnapshotsV319Test-32396274 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8c132a7c-82cd-4920-b919-577597d6cca6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:37:46 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-5a142cb8-a9fa-4afa-b822-9847957da7eb tempest-GroupSnapshotsV319Test-32396274 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8c132a7c-82cd-4920-b919-577597d6cca6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '63563655-06a8-4376-be29-4ba6f3c7b1b1', 'volume_name': 'volume-63563655-06a8-4376-be29-4ba6f3c7b1b1', 'volume_size': 1}' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:37:46 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-5a142cb8-a9fa-4afa-b822-9847957da7eb tempest-GroupSnapshotsV319Test-32396274 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (067d0e89-f3bb-438a-9efe-738b57310b36) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:37:46 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-5a142cb8-a9fa-4afa-b822-9847957da7eb tempest-GroupSnapshotsV319Test-32396274 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (067d0e89-f3bb-438a-9efe-738b57310b36) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:37:46 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-5a142cb8-a9fa-4afa-b822-9847957da7eb tempest-GroupSnapshotsV319Test-32396274 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (735afaae-bfe2-4ba3-a4b1-e882e118721e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:37:46 devstack cinder-volume[87444]: INFO cinder.volume.flows.manager.create_volume [None req-5a142cb8-a9fa-4afa-b822-9847957da7eb tempest-GroupSnapshotsV319Test-32396274 None] Volume 63563655-06a8-4376-be29-4ba6f3c7b1b1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-63563655-06a8-4376-be29-4ba6f3c7b1b1', 'volume_size': 1} Jul 10 04:37:46 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-5a142cb8-a9fa-4afa-b822-9847957da7eb tempest-GroupSnapshotsV319Test-32396274 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 04:37:46 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-5a142cb8-a9fa-4afa-b822-9847957da7eb tempest-GroupSnapshotsV319Test-32396274 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 04:37:46 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-5a142cb8-a9fa-4afa-b822-9847957da7eb tempest-GroupSnapshotsV319Test-32396274 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=9475c8c0-5ed4-425a-a23c-cd03f67eebce,created_at=2026-07-10T02:37:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1538203194',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=9475c8c0-5ed4-425a-a23c-cd03f67eebce,host='devstack@QuobyteHD#QuobyteHD',id=63563655-06a8-4376-be29-4ba6f3c7b1b1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='60d71d44695f4ad59754f8db640e908a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T02:37:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T02:37:47Z,use_quota=True,user_id='8b22f4fdb1d046e8b16a3ab4c5d21594',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0f950fe5-85f2-48c3-aabf-63a4bdb1c506),volume_type_id=0f950fe5-85f2-48c3-aabf-63a4bdb1c506)}" {{(pid=87444) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 04:37:46 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.remotefs [None req-5a142cb8-a9fa-4afa-b822-9847957da7eb tempest-GroupSnapshotsV319Test-32396274 None] Creating volume 63563655-06a8-4376-be29-4ba6f3c7b1b1 {{(pid=87444) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 04:37:46 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-5a142cb8-a9fa-4afa-b822-9847957da7eb tempest-GroupSnapshotsV319Test-32396274 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 04:37:46 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-5a142cb8-a9fa-4afa-b822-9847957da7eb tempest-GroupSnapshotsV319Test-32396274 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 04:37:46 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-5a142cb8-a9fa-4afa-b822-9847957da7eb tempest-GroupSnapshotsV319Test-32396274 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922': None} {{(pid=87444) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 04:37:46 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-5a142cb8-a9fa-4afa-b822-9847957da7eb tempest-GroupSnapshotsV319Test-32396274 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922'] {{(pid=87444) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 04:37:46 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-5a142cb8-a9fa-4afa-b822-9847957da7eb tempest-GroupSnapshotsV319Test-32396274 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 04:37:46 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-5a142cb8-a9fa-4afa-b822-9847957da7eb tempest-GroupSnapshotsV319Test-32396274 None] Selected osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922 as target Quobyte volume. {{(pid=87444) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 04:37:46 devstack cinder-volume[87444]: INFO cinder.volume.drivers.remotefs [None req-5a142cb8-a9fa-4afa-b822-9847957da7eb tempest-GroupSnapshotsV319Test-32396274 None] casted to osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922 Jul 10 04:37:46 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-5a142cb8-a9fa-4afa-b822-9847957da7eb tempest-GroupSnapshotsV319Test-32396274 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-63563655-06a8-4376-be29-4ba6f3c7b1b1 1073741824 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:37:46 devstack sudo[93910]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-63563655-06a8-4376-be29-4ba6f3c7b1b1 1073741824 Jul 10 04:37:46 devstack sudo[93910]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:37:48 devstack sudo[93910]: pam_unix(sudo:session): session closed for user root Jul 10 04:37:48 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-5a142cb8-a9fa-4afa-b822-9847957da7eb tempest-GroupSnapshotsV319Test-32396274 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-63563655-06a8-4376-be29-4ba6f3c7b1b1 1073741824" returned: 0 in 1.376s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:37:48 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-5a142cb8-a9fa-4afa-b822-9847957da7eb tempest-GroupSnapshotsV319Test-32396274 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-63563655-06a8-4376-be29-4ba6f3c7b1b1 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:37:48 devstack sudo[93918]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-63563655-06a8-4376-be29-4ba6f3c7b1b1 Jul 10 04:37:48 devstack sudo[93918]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:37:49 devstack sudo[93918]: pam_unix(sudo:session): session closed for user root Jul 10 04:37:49 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-5a142cb8-a9fa-4afa-b822-9847957da7eb tempest-GroupSnapshotsV319Test-32396274 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-63563655-06a8-4376-be29-4ba6f3c7b1b1" returned: 0 in 0.892s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:37:49 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-5a142cb8-a9fa-4afa-b822-9847957da7eb tempest-GroupSnapshotsV319Test-32396274 None] <== create_volume: return (2371ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922'} {{(pid=87444) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 04:37:49 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-5a142cb8-a9fa-4afa-b822-9847957da7eb tempest-GroupSnapshotsV319Test-32396274 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.377s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 04:37:49 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-5a142cb8-a9fa-4afa-b822-9847957da7eb tempest-GroupSnapshotsV319Test-32396274 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (735afaae-bfe2-4ba3-a4b1-e882e118721e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-63563655-06a8-4376-be29-4ba6f3c7b1b1', 'volume_size': 1}' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:37:49 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-5a142cb8-a9fa-4afa-b822-9847957da7eb tempest-GroupSnapshotsV319Test-32396274 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ac63a63d-983a-4219-b489-ec2b56f971ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:37:49 devstack cinder-volume[87444]: INFO cinder.volume.flows.manager.create_volume [None req-5a142cb8-a9fa-4afa-b822-9847957da7eb tempest-GroupSnapshotsV319Test-32396274 None] Volume volume-63563655-06a8-4376-be29-4ba6f3c7b1b1 (63563655-06a8-4376-be29-4ba6f3c7b1b1): created successfully Jul 10 04:37:49 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-5a142cb8-a9fa-4afa-b822-9847957da7eb tempest-GroupSnapshotsV319Test-32396274 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ac63a63d-983a-4219-b489-ec2b56f971ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:37:49 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-5a142cb8-a9fa-4afa-b822-9847957da7eb tempest-GroupSnapshotsV319Test-32396274 None] Flow 'volume_create_manager' (3445dc2e-476a-4091-a5b0-2ca7cef3a5b5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87444) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 04:37:49 devstack cinder-volume[87444]: INFO cinder.volume.manager [None req-5a142cb8-a9fa-4afa-b822-9847957da7eb tempest-GroupSnapshotsV319Test-32396274 None] Created volume successfully. Jul 10 04:37:51 devstack cinder-volume[87444]: INFO cinder.volume.manager [None req-ef7eff87-aaa1-4ff7-8238-c44413a60648 tempest-GroupSnapshotsV319Test-32396274 None] GroupSnapshot a7c7e10e-cc89-4047-8d62-87d9311c67e3: creating. Jul 10 04:37:51 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-ef7eff87-aaa1-4ff7-8238-c44413a60648 tempest-GroupSnapshotsV319Test-32396274 None] Group snapshot a7c7e10e-cc89-4047-8d62-87d9311c67e3: creating. {{(pid=87444) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Jul 10 04:37:51 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-ef7eff87-aaa1-4ff7-8238-c44413a60648 tempest-GroupSnapshotsV319Test-32396274 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 04:37:51 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-ef7eff87-aaa1-4ff7-8238-c44413a60648 tempest-GroupSnapshotsV319Test-32396274 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 04:37:51 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.remotefs [None req-ef7eff87-aaa1-4ff7-8238-c44413a60648 tempest-GroupSnapshotsV319Test-32396274 None] Creating offline snapshot 36b2b526-48b1-435f-9024-868e9f499c19 of volume 63563655-06a8-4376-be29-4ba6f3c7b1b1 {{(pid=87444) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 10 04:37:51 devstack cinder-volume[87444]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0bdf85e-c861-4b96-a41a-934d6390d9af]: (4, 'qcow2') {{(pid=88499) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 04:37:51 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-ef7eff87-aaa1-4ff7-8238-c44413a60648 tempest-GroupSnapshotsV319Test-32396274 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-63563655-06a8-4376-be29-4ba6f3c7b1b1 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:37:51 devstack sudo[93940]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-63563655-06a8-4376-be29-4ba6f3c7b1b1 Jul 10 04:37:51 devstack sudo[93940]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:37:52 devstack sudo[93940]: pam_unix(sudo:session): session closed for user root Jul 10 04:37:52 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-ef7eff87-aaa1-4ff7-8238-c44413a60648 tempest-GroupSnapshotsV319Test-32396274 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-63563655-06a8-4376-be29-4ba6f3c7b1b1" returned: 0 in 1.443s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:37:52 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-ef7eff87-aaa1-4ff7-8238-c44413a60648 tempest-GroupSnapshotsV319Test-32396274 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-63563655-06a8-4376-be29-4ba6f3c7b1b1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-63563655-06a8-4376-be29-4ba6f3c7b1b1.36b2b526-48b1-435f-9024-868e9f499c19 1G {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:37:52 devstack sudo[93983]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-63563655-06a8-4376-be29-4ba6f3c7b1b1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-63563655-06a8-4376-be29-4ba6f3c7b1b1.36b2b526-48b1-435f-9024-868e9f499c19 1G Jul 10 04:37:52 devstack sudo[93983]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:37:53 devstack cinder-volume[87444]: INFO cinder.volume.manager [req-7232aaaf-5c58-4647-afab-fe300f5d674f req-283511c2-cde5-4571-89a5-624a73bac3dc tempest-AttachVolumeTestJSON-83712851 None] Terminate volume connection completed successfully. Jul 10 04:37:53 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [req-7232aaaf-5c58-4647-afab-fe300f5d674f req-283511c2-cde5-4571-89a5-624a73bac3dc tempest-AttachVolumeTestJSON-83712851 None] Deleting attachment 9a01a693-c353-41a3-aaae-45d22db2fa5e. {{(pid=87444) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 10 04:37:53 devstack sudo[93983]: pam_unix(sudo:session): session closed for user root Jul 10 04:37:53 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-ef7eff87-aaa1-4ff7-8238-c44413a60648 tempest-GroupSnapshotsV319Test-32396274 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-63563655-06a8-4376-be29-4ba6f3c7b1b1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-63563655-06a8-4376-be29-4ba6f3c7b1b1.36b2b526-48b1-435f-9024-868e9f499c19 1G" returned: 0 in 0.841s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:37:53 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-ef7eff87-aaa1-4ff7-8238-c44413a60648 tempest-GroupSnapshotsV319Test-32396274 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-63563655-06a8-4376-be29-4ba6f3c7b1b1 -F qcow2 /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-63563655-06a8-4376-be29-4ba6f3c7b1b1.36b2b526-48b1-435f-9024-868e9f499c19 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:37:53 devstack sudo[93995]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-63563655-06a8-4376-be29-4ba6f3c7b1b1 -F qcow2 /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-63563655-06a8-4376-be29-4ba6f3c7b1b1.36b2b526-48b1-435f-9024-868e9f499c19 Jul 10 04:37:53 devstack sudo[93995]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:37:55 devstack sudo[93995]: pam_unix(sudo:session): session closed for user root Jul 10 04:37:55 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-ef7eff87-aaa1-4ff7-8238-c44413a60648 tempest-GroupSnapshotsV319Test-32396274 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-63563655-06a8-4376-be29-4ba6f3c7b1b1 -F qcow2 /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-63563655-06a8-4376-be29-4ba6f3c7b1b1.36b2b526-48b1-435f-9024-868e9f499c19" returned: 0 in 1.399s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:37:55 devstack cinder-volume[87444]: WARNING cinder.volume.drivers.remotefs [None req-ef7eff87-aaa1-4ff7-8238-c44413a60648 tempest-GroupSnapshotsV319Test-32396274 None] /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-63563655-06a8-4376-be29-4ba6f3c7b1b1.36b2b526-48b1-435f-9024-868e9f499c19 is being set with open permissions: ugo+rw: NotImplementedError Jul 10 04:37:55 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-ef7eff87-aaa1-4ff7-8238-c44413a60648 tempest-GroupSnapshotsV319Test-32396274 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-63563655-06a8-4376-be29-4ba6f3c7b1b1.36b2b526-48b1-435f-9024-868e9f499c19 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:37:55 devstack sudo[94043]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-63563655-06a8-4376-be29-4ba6f3c7b1b1.36b2b526-48b1-435f-9024-868e9f499c19 Jul 10 04:37:55 devstack sudo[94043]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:37:56 devstack sudo[94043]: pam_unix(sudo:session): session closed for user root Jul 10 04:37:56 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-ef7eff87-aaa1-4ff7-8238-c44413a60648 tempest-GroupSnapshotsV319Test-32396274 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-63563655-06a8-4376-be29-4ba6f3c7b1b1.36b2b526-48b1-435f-9024-868e9f499c19" returned: 0 in 0.983s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:37:56 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-ef7eff87-aaa1-4ff7-8238-c44413a60648 tempest-GroupSnapshotsV319Test-32396274 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-63563655-06a8-4376-be29-4ba6f3c7b1b1.info {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:37:56 devstack sudo[94088]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-63563655-06a8-4376-be29-4ba6f3c7b1b1.info Jul 10 04:37:56 devstack sudo[94088]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:37:56 devstack cinder-volume[87444]: INFO cinder.volume.manager [req-95ad257d-cbe2-46ec-bd7b-5721ed34cb24 req-fc25ab08-fc09-473f-8e40-733765416e75 tempest-AttachVolumeTestJSON-83712851 None] Terminate volume connection completed successfully. Jul 10 04:37:56 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [req-95ad257d-cbe2-46ec-bd7b-5721ed34cb24 req-fc25ab08-fc09-473f-8e40-733765416e75 tempest-AttachVolumeTestJSON-83712851 None] Deleting attachment 8263bec5-81b1-4a2f-bc3a-9172a2700d42. {{(pid=87444) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 10 04:37:57 devstack sudo[94088]: pam_unix(sudo:session): session closed for user root Jul 10 04:37:57 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-ef7eff87-aaa1-4ff7-8238-c44413a60648 tempest-GroupSnapshotsV319Test-32396274 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-63563655-06a8-4376-be29-4ba6f3c7b1b1.info" returned: 0 in 0.955s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:37:57 devstack cinder-volume[87444]: WARNING cinder.volume.drivers.remotefs [None req-ef7eff87-aaa1-4ff7-8238-c44413a60648 tempest-GroupSnapshotsV319Test-32396274 None] /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-63563655-06a8-4376-be29-4ba6f3c7b1b1.info is being set with open permissions: ugo+rw: NotImplementedError Jul 10 04:37:57 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-ef7eff87-aaa1-4ff7-8238-c44413a60648 tempest-GroupSnapshotsV319Test-32396274 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-63563655-06a8-4376-be29-4ba6f3c7b1b1.info {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:37:57 devstack sudo[94111]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-63563655-06a8-4376-be29-4ba6f3c7b1b1.info Jul 10 04:37:57 devstack sudo[94111]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:37:58 devstack sudo[94111]: pam_unix(sudo:session): session closed for user root Jul 10 04:37:58 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-ef7eff87-aaa1-4ff7-8238-c44413a60648 tempest-GroupSnapshotsV319Test-32396274 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-63563655-06a8-4376-be29-4ba6f3c7b1b1.info" returned: 0 in 0.910s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:37:58 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-ef7eff87-aaa1-4ff7-8238-c44413a60648 tempest-GroupSnapshotsV319Test-32396274 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 6.633s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 04:37:58 devstack cinder-volume[87444]: INFO cinder.volume.manager [None req-ef7eff87-aaa1-4ff7-8238-c44413a60648 tempest-GroupSnapshotsV319Test-32396274 None] group_snapshot a7c7e10e-cc89-4047-8d62-87d9311c67e3: created successfully Jul 10 04:37:59 devstack cinder-volume[87444]: INFO cinder.volume.manager [None req-610cbc55-77e1-4d40-8cf6-2abf17d861ab tempest-GroupSnapshotsV319Test-32396274 None] group_snapshot a7c7e10e-cc89-4047-8d62-87d9311c67e3: deleting Jul 10 04:37:59 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-610cbc55-77e1-4d40-8cf6-2abf17d861ab tempest-GroupSnapshotsV319Test-32396274 None] group_snapshot a7c7e10e-cc89-4047-8d62-87d9311c67e3: deleting {{(pid=87444) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Jul 10 04:37:59 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-610cbc55-77e1-4d40-8cf6-2abf17d861ab tempest-GroupSnapshotsV319Test-32396274 None] Acquiring lock "cinder-quobyte-63563655-06a8-4376-be29-4ba6f3c7b1b1" by "delete_snapshot" {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 04:37:59 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-610cbc55-77e1-4d40-8cf6-2abf17d861ab tempest-GroupSnapshotsV319Test-32396274 None] Lock "cinder-quobyte-63563655-06a8-4376-be29-4ba6f3c7b1b1" acquired by "delete_snapshot" :: waited 0.050s {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 04:37:59 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-610cbc55-77e1-4d40-8cf6-2abf17d861ab tempest-GroupSnapshotsV319Test-32396274 None] Acquiring lock "cinder-quobyte-36b2b526-48b1-435f-9024-868e9f499c19" by "_delete_snapshot" {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 04:37:59 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-610cbc55-77e1-4d40-8cf6-2abf17d861ab tempest-GroupSnapshotsV319Test-32396274 None] Lock "cinder-quobyte-36b2b526-48b1-435f-9024-868e9f499c19" acquired by "_delete_snapshot" :: waited 0.036s {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 04:37:59 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.remotefs [None req-610cbc55-77e1-4d40-8cf6-2abf17d861ab tempest-GroupSnapshotsV319Test-32396274 None] Deleting offline snapshot 36b2b526-48b1-435f-9024-868e9f499c19 of volume 63563655-06a8-4376-be29-4ba6f3c7b1b1 {{(pid=87444) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 10 04:37:59 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.remotefs [None req-610cbc55-77e1-4d40-8cf6-2abf17d861ab tempest-GroupSnapshotsV319Test-32396274 None] snapshot_file for this snap is: volume-63563655-06a8-4376-be29-4ba6f3c7b1b1.36b2b526-48b1-435f-9024-868e9f499c19 {{(pid=87444) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 10 04:37:59 devstack cinder-volume[87444]: DEBUG oslo.privsep.daemon [-] privsep: reply[17c9141c-2f5f-41fd-b0b0-5543b6d4a186]: (4, 'qcow2') {{(pid=88499) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 04:37:59 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-610cbc55-77e1-4d40-8cf6-2abf17d861ab tempest-GroupSnapshotsV319Test-32396274 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-63563655-06a8-4376-be29-4ba6f3c7b1b1.36b2b526-48b1-435f-9024-868e9f499c19 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:38:00 devstack sudo[94140]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-63563655-06a8-4376-be29-4ba6f3c7b1b1.36b2b526-48b1-435f-9024-868e9f499c19 Jul 10 04:38:00 devstack sudo[94140]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:38:00 devstack sudo[94140]: pam_unix(sudo:session): session closed for user root Jul 10 04:38:00 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-610cbc55-77e1-4d40-8cf6-2abf17d861ab tempest-GroupSnapshotsV319Test-32396274 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-63563655-06a8-4376-be29-4ba6f3c7b1b1.36b2b526-48b1-435f-9024-868e9f499c19" returned: 0 in 0.979s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:38:00 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.remotefs [None req-610cbc55-77e1-4d40-8cf6-2abf17d861ab tempest-GroupSnapshotsV319Test-32396274 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-63563655-06a8-4376-be29-4ba6f3c7b1b1(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87444) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 10 04:38:00 devstack cinder-volume[87444]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ee0d4de-ec7a-45a8-af94-53ad9e512f3b]: (4, 'qcow2') {{(pid=88499) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 04:38:00 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-610cbc55-77e1-4d40-8cf6-2abf17d861ab tempest-GroupSnapshotsV319Test-32396274 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-63563655-06a8-4376-be29-4ba6f3c7b1b1 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:38:01 devstack sudo[94150]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-63563655-06a8-4376-be29-4ba6f3c7b1b1 Jul 10 04:38:01 devstack sudo[94150]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:38:02 devstack sudo[94150]: pam_unix(sudo:session): session closed for user root Jul 10 04:38:02 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-610cbc55-77e1-4d40-8cf6-2abf17d861ab tempest-GroupSnapshotsV319Test-32396274 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-63563655-06a8-4376-be29-4ba6f3c7b1b1" returned: 0 in 1.474s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:38:02 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-610cbc55-77e1-4d40-8cf6-2abf17d861ab tempest-GroupSnapshotsV319Test-32396274 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-63563655-06a8-4376-be29-4ba6f3c7b1b1.36b2b526-48b1-435f-9024-868e9f499c19 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:38:02 devstack sudo[94173]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-63563655-06a8-4376-be29-4ba6f3c7b1b1.36b2b526-48b1-435f-9024-868e9f499c19 Jul 10 04:38:02 devstack sudo[94173]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:38:04 devstack sudo[94173]: pam_unix(sudo:session): session closed for user root Jul 10 04:38:04 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-610cbc55-77e1-4d40-8cf6-2abf17d861ab tempest-GroupSnapshotsV319Test-32396274 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-63563655-06a8-4376-be29-4ba6f3c7b1b1.36b2b526-48b1-435f-9024-868e9f499c19" returned: 0 in 1.852s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:38:04 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-610cbc55-77e1-4d40-8cf6-2abf17d861ab tempest-GroupSnapshotsV319Test-32396274 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-63563655-06a8-4376-be29-4ba6f3c7b1b1.36b2b526-48b1-435f-9024-868e9f499c19 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:38:04 devstack sudo[94181]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-63563655-06a8-4376-be29-4ba6f3c7b1b1.36b2b526-48b1-435f-9024-868e9f499c19 Jul 10 04:38:04 devstack sudo[94181]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:38:05 devstack sudo[94181]: pam_unix(sudo:session): session closed for user root Jul 10 04:38:05 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-610cbc55-77e1-4d40-8cf6-2abf17d861ab tempest-GroupSnapshotsV319Test-32396274 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-63563655-06a8-4376-be29-4ba6f3c7b1b1.36b2b526-48b1-435f-9024-868e9f499c19" returned: 0 in 1.044s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:38:05 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-610cbc55-77e1-4d40-8cf6-2abf17d861ab tempest-GroupSnapshotsV319Test-32396274 None] Lock "cinder-quobyte-36b2b526-48b1-435f-9024-868e9f499c19" released by "_delete_snapshot" :: held 5.495s {{(pid=87444) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 04:38:05 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-610cbc55-77e1-4d40-8cf6-2abf17d861ab tempest-GroupSnapshotsV319Test-32396274 None] Lock "cinder-quobyte-63563655-06a8-4376-be29-4ba6f3c7b1b1" released by "delete_snapshot" :: held 5.541s {{(pid=87444) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 04:38:05 devstack cinder-volume[87444]: WARNING cinder.quota [None req-610cbc55-77e1-4d40-8cf6-2abf17d861ab tempest-GroupSnapshotsV319Test-32396274 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsV319Test-volume-type-427017998 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsV319Test-volume-type-427017998, it is now deprecated. Please use the default quota class for default quota. Jul 10 04:38:05 devstack cinder-volume[87444]: WARNING cinder.quota [None req-610cbc55-77e1-4d40-8cf6-2abf17d861ab tempest-GroupSnapshotsV319Test-32396274 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsV319Test-volume-type-427017998 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsV319Test-volume-type-427017998, it is now deprecated. Please use the default quota class for default quota. Jul 10 04:38:05 devstack cinder-volume[87444]: DEBUG cinder.quota [None req-610cbc55-77e1-4d40-8cf6-2abf17d861ab tempest-GroupSnapshotsV319Test-32396274 None] Created reservations ['e20d5678-56b2-45b9-ba79-b2a12910f057', '4a8f128b-6466-4f9e-90b1-4f426ec4423d', '8681f413-1923-4b5b-8b3d-e854fd83434e', '75b8f6cd-e82e-4510-9518-a5ba1b4ab785'] {{(pid=87444) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 04:38:05 devstack cinder-volume[87444]: INFO cinder.volume.manager [None req-610cbc55-77e1-4d40-8cf6-2abf17d861ab tempest-GroupSnapshotsV319Test-32396274 None] group_snapshot a7c7e10e-cc89-4047-8d62-87d9311c67e3: deleted successfully Jul 10 04:38:06 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-376cb5d3-7cfd-4030-bb64-f0585f0fe168 tempest-GroupSnapshotsV319Test-32396274 None] Acquiring lock "cinder-quobyte-63563655-06a8-4376-be29-4ba6f3c7b1b1" by "delete_volume" {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 04:38:06 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-376cb5d3-7cfd-4030-bb64-f0585f0fe168 tempest-GroupSnapshotsV319Test-32396274 None] Lock "cinder-quobyte-63563655-06a8-4376-be29-4ba6f3c7b1b1" acquired by "delete_volume" :: waited 0.052s {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 04:38:06 devstack cinder-volume[87444]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e2ae918-ec0c-4667-a8ba-b1934934f7cf]: (4, 'qcow2') {{(pid=88499) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 04:38:06 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-376cb5d3-7cfd-4030-bb64-f0585f0fe168 tempest-GroupSnapshotsV319Test-32396274 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-63563655-06a8-4376-be29-4ba6f3c7b1b1 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:38:06 devstack sudo[94185]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-63563655-06a8-4376-be29-4ba6f3c7b1b1 Jul 10 04:38:06 devstack sudo[94185]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:38:07 devstack cinder-volume[87444]: DEBUG cinder.volume.flows.manager.create_volume [None req-d05873ae-00b1-4f67-9e3e-b5817db89791 tempest-AttachVolumeNegativeTest-538483290 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87444) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 04:38:07 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-d05873ae-00b1-4f67-9e3e-b5817db89791 tempest-AttachVolumeNegativeTest-538483290 None] Flow 'volume_create_manager' (13abf013-efae-4332-9441-6b558a30f221) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 04:38:07 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-d05873ae-00b1-4f67-9e3e-b5817db89791 tempest-AttachVolumeNegativeTest-538483290 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (678981dd-2bd9-4b53-90be-4b8a4e2416d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:38:07 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-d05873ae-00b1-4f67-9e3e-b5817db89791 tempest-AttachVolumeNegativeTest-538483290 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (678981dd-2bd9-4b53-90be-4b8a4e2416d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T02:38:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-260139387',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=abbefe22-5fda-470d-a8de-1b7a0eaba97d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='29fcd8a4a5154aac8d732f7c646222a9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T02:38:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T02:38:07Z,use_quota=True,user_id='cef39b8882e44f7181e1d9bd61d176a3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(317e369e-1e06-434d-ae95-a335f0e6c903),volume_type_id=317e369e-1e06-434d-ae95-a335f0e6c903)' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:38:07 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-d05873ae-00b1-4f67-9e3e-b5817db89791 tempest-AttachVolumeNegativeTest-538483290 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f33cf9f7-db96-411b-bb31-38e81810136d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:38:07 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-d05873ae-00b1-4f67-9e3e-b5817db89791 tempest-AttachVolumeNegativeTest-538483290 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f33cf9f7-db96-411b-bb31-38e81810136d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:38:07 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-d05873ae-00b1-4f67-9e3e-b5817db89791 tempest-AttachVolumeNegativeTest-538483290 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5fa4d638-33d5-4bdc-a1b3-8debf4e2eb77) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:38:07 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-d05873ae-00b1-4f67-9e3e-b5817db89791 tempest-AttachVolumeNegativeTest-538483290 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5fa4d638-33d5-4bdc-a1b3-8debf4e2eb77) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'abbefe22-5fda-470d-a8de-1b7a0eaba97d', 'volume_name': 'volume-abbefe22-5fda-470d-a8de-1b7a0eaba97d', 'volume_size': 1}' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:38:07 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-d05873ae-00b1-4f67-9e3e-b5817db89791 tempest-AttachVolumeNegativeTest-538483290 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dd052339-089c-446b-9bd8-c5f1766ad681) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:38:07 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-d05873ae-00b1-4f67-9e3e-b5817db89791 tempest-AttachVolumeNegativeTest-538483290 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dd052339-089c-446b-9bd8-c5f1766ad681) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:38:07 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-d05873ae-00b1-4f67-9e3e-b5817db89791 tempest-AttachVolumeNegativeTest-538483290 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e62ce623-46a7-4b8c-808a-5cd8b7462f61) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:38:07 devstack cinder-volume[87444]: INFO cinder.volume.flows.manager.create_volume [None req-d05873ae-00b1-4f67-9e3e-b5817db89791 tempest-AttachVolumeNegativeTest-538483290 None] Volume abbefe22-5fda-470d-a8de-1b7a0eaba97d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-abbefe22-5fda-470d-a8de-1b7a0eaba97d', 'volume_size': 1} Jul 10 04:38:07 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-d05873ae-00b1-4f67-9e3e-b5817db89791 tempest-AttachVolumeNegativeTest-538483290 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 04:38:07 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-d05873ae-00b1-4f67-9e3e-b5817db89791 tempest-AttachVolumeNegativeTest-538483290 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 04:38:07 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-d05873ae-00b1-4f67-9e3e-b5817db89791 tempest-AttachVolumeNegativeTest-538483290 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T02:38:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-260139387',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=abbefe22-5fda-470d-a8de-1b7a0eaba97d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='29fcd8a4a5154aac8d732f7c646222a9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T02:38:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T02:38:07Z,use_quota=True,user_id='cef39b8882e44f7181e1d9bd61d176a3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(317e369e-1e06-434d-ae95-a335f0e6c903),volume_type_id=317e369e-1e06-434d-ae95-a335f0e6c903)}" {{(pid=87444) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 04:38:07 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.remotefs [None req-d05873ae-00b1-4f67-9e3e-b5817db89791 tempest-AttachVolumeNegativeTest-538483290 None] Creating volume abbefe22-5fda-470d-a8de-1b7a0eaba97d {{(pid=87444) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 04:38:07 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-d05873ae-00b1-4f67-9e3e-b5817db89791 tempest-AttachVolumeNegativeTest-538483290 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 04:38:07 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-d05873ae-00b1-4f67-9e3e-b5817db89791 tempest-AttachVolumeNegativeTest-538483290 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 04:38:07 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-d05873ae-00b1-4f67-9e3e-b5817db89791 tempest-AttachVolumeNegativeTest-538483290 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922': None} {{(pid=87444) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 04:38:07 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-d05873ae-00b1-4f67-9e3e-b5817db89791 tempest-AttachVolumeNegativeTest-538483290 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922'] {{(pid=87444) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 04:38:07 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-d05873ae-00b1-4f67-9e3e-b5817db89791 tempest-AttachVolumeNegativeTest-538483290 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 04:38:07 devstack sudo[94185]: pam_unix(sudo:session): session closed for user root Jul 10 04:38:07 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-d05873ae-00b1-4f67-9e3e-b5817db89791 tempest-AttachVolumeNegativeTest-538483290 None] Selected osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922 as target Quobyte volume. {{(pid=87444) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 04:38:07 devstack cinder-volume[87444]: INFO cinder.volume.drivers.remotefs [None req-d05873ae-00b1-4f67-9e3e-b5817db89791 tempest-AttachVolumeNegativeTest-538483290 None] casted to osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922 Jul 10 04:38:07 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-d05873ae-00b1-4f67-9e3e-b5817db89791 tempest-AttachVolumeNegativeTest-538483290 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-abbefe22-5fda-470d-a8de-1b7a0eaba97d 1073741824 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:38:07 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-376cb5d3-7cfd-4030-bb64-f0585f0fe168 tempest-GroupSnapshotsV319Test-32396274 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-63563655-06a8-4376-be29-4ba6f3c7b1b1" returned: 0 in 1.036s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:38:07 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-376cb5d3-7cfd-4030-bb64-f0585f0fe168 tempest-GroupSnapshotsV319Test-32396274 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-63563655-06a8-4376-be29-4ba6f3c7b1b1 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:38:07 devstack sudo[94197]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-abbefe22-5fda-470d-a8de-1b7a0eaba97d 1073741824 Jul 10 04:38:07 devstack sudo[94197]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:38:07 devstack sudo[94198]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-63563655-06a8-4376-be29-4ba6f3c7b1b1 Jul 10 04:38:07 devstack sudo[94198]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:38:08 devstack sudo[94198]: pam_unix(sudo:session): session closed for user root Jul 10 04:38:08 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-376cb5d3-7cfd-4030-bb64-f0585f0fe168 tempest-GroupSnapshotsV319Test-32396274 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-63563655-06a8-4376-be29-4ba6f3c7b1b1" returned: 0 in 0.799s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:38:08 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-376cb5d3-7cfd-4030-bb64-f0585f0fe168 tempest-GroupSnapshotsV319Test-32396274 None] Lock "cinder-quobyte-63563655-06a8-4376-be29-4ba6f3c7b1b1" released by "delete_volume" :: held 1.953s {{(pid=87444) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 04:38:08 devstack cinder-volume[87444]: DEBUG cinder.quota [None req-376cb5d3-7cfd-4030-bb64-f0585f0fe168 tempest-GroupSnapshotsV319Test-32396274 None] Created reservations ['5ac33fa6-4fd1-4019-91d0-3cc6c9c6209d'] {{(pid=87444) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 04:38:08 devstack cinder-volume[87444]: WARNING cinder.quota [None req-376cb5d3-7cfd-4030-bb64-f0585f0fe168 tempest-GroupSnapshotsV319Test-32396274 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsV319Test-volume-type-427017998 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsV319Test-volume-type-427017998, it is now deprecated. Please use the default quota class for default quota. Jul 10 04:38:08 devstack cinder-volume[87444]: DEBUG cinder.quota [None req-376cb5d3-7cfd-4030-bb64-f0585f0fe168 tempest-GroupSnapshotsV319Test-32396274 None] Created reservations ['f740a139-148b-4d9b-b6a4-dcb5f55e0403', 'f8cb9086-4267-4942-8249-a0310813e025', '2f136cdf-7a83-45be-bc1e-06393d2899a2', '0140e556-9228-4c11-ae64-f2606d2a7f02'] {{(pid=87444) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 04:38:08 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-376cb5d3-7cfd-4030-bb64-f0585f0fe168 tempest-GroupSnapshotsV319Test-32396274 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 04:38:08 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-376cb5d3-7cfd-4030-bb64-f0585f0fe168 tempest-GroupSnapshotsV319Test-32396274 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 04:38:08 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-376cb5d3-7cfd-4030-bb64-f0585f0fe168 tempest-GroupSnapshotsV319Test-32396274 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922': None} {{(pid=87444) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 04:38:08 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-376cb5d3-7cfd-4030-bb64-f0585f0fe168 tempest-GroupSnapshotsV319Test-32396274 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922'] {{(pid=87444) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 04:38:08 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-376cb5d3-7cfd-4030-bb64-f0585f0fe168 tempest-GroupSnapshotsV319Test-32396274 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 04:38:08 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-376cb5d3-7cfd-4030-bb64-f0585f0fe168 tempest-GroupSnapshotsV319Test-32396274 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:38:08 devstack sudo[94213]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097 Jul 10 04:38:08 devstack sudo[94213]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:38:08 devstack sudo[94197]: pam_unix(sudo:session): session closed for user root Jul 10 04:38:08 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-d05873ae-00b1-4f67-9e3e-b5817db89791 tempest-AttachVolumeNegativeTest-538483290 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-abbefe22-5fda-470d-a8de-1b7a0eaba97d 1073741824" returned: 0 in 1.287s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:38:08 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-d05873ae-00b1-4f67-9e3e-b5817db89791 tempest-AttachVolumeNegativeTest-538483290 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-abbefe22-5fda-470d-a8de-1b7a0eaba97d {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:38:08 devstack sudo[94215]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-abbefe22-5fda-470d-a8de-1b7a0eaba97d Jul 10 04:38:08 devstack sudo[94215]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:38:09 devstack sudo[94213]: pam_unix(sudo:session): session closed for user root Jul 10 04:38:09 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-376cb5d3-7cfd-4030-bb64-f0585f0fe168 tempest-GroupSnapshotsV319Test-32396274 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097" returned: 0 in 1.140s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:38:09 devstack cinder-volume[87444]: DEBUG cinder.manager [None req-376cb5d3-7cfd-4030-bb64-f0585f0fe168 tempest-GroupSnapshotsV319Test-32396274 None] Notifying Schedulers of capabilities ... {{(pid=87444) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 04:38:09 devstack cinder-volume[87444]: INFO cinder.volume.manager [None req-376cb5d3-7cfd-4030-bb64-f0585f0fe168 tempest-GroupSnapshotsV319Test-32396274 None] Delete group completed successfully. Jul 10 04:38:10 devstack sudo[94215]: pam_unix(sudo:session): session closed for user root Jul 10 04:38:10 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-d05873ae-00b1-4f67-9e3e-b5817db89791 tempest-AttachVolumeNegativeTest-538483290 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-abbefe22-5fda-470d-a8de-1b7a0eaba97d" returned: 0 in 1.340s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:38:10 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-d05873ae-00b1-4f67-9e3e-b5817db89791 tempest-AttachVolumeNegativeTest-538483290 None] <== create_volume: return (2684ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922'} {{(pid=87444) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 04:38:10 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-d05873ae-00b1-4f67-9e3e-b5817db89791 tempest-AttachVolumeNegativeTest-538483290 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.690s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 04:38:10 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-d05873ae-00b1-4f67-9e3e-b5817db89791 tempest-AttachVolumeNegativeTest-538483290 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e62ce623-46a7-4b8c-808a-5cd8b7462f61) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-abbefe22-5fda-470d-a8de-1b7a0eaba97d', 'volume_size': 1}' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:38:10 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-d05873ae-00b1-4f67-9e3e-b5817db89791 tempest-AttachVolumeNegativeTest-538483290 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2ed987a9-61b1-4e8a-824e-5dd2c906ae93) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:38:10 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-5f5d6f01-51f2-4b1f-9b5b-f0596dc7b7c8 tempest-AttachVolumeTestJSON-83712851 None] Acquiring lock "cinder-d11d441e-9b4f-42f2-850f-b00c3ed1af62-delete_volume" by "delete_volume" {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 04:38:10 devstack cinder-volume[87444]: INFO cinder.volume.flows.manager.create_volume [None req-d05873ae-00b1-4f67-9e3e-b5817db89791 tempest-AttachVolumeNegativeTest-538483290 None] Volume volume-abbefe22-5fda-470d-a8de-1b7a0eaba97d (abbefe22-5fda-470d-a8de-1b7a0eaba97d): created successfully Jul 10 04:38:10 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-d05873ae-00b1-4f67-9e3e-b5817db89791 tempest-AttachVolumeNegativeTest-538483290 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2ed987a9-61b1-4e8a-824e-5dd2c906ae93) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:38:10 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-d05873ae-00b1-4f67-9e3e-b5817db89791 tempest-AttachVolumeNegativeTest-538483290 None] Flow 'volume_create_manager' (13abf013-efae-4332-9441-6b558a30f221) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87444) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 04:38:10 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-5f5d6f01-51f2-4b1f-9b5b-f0596dc7b7c8 tempest-AttachVolumeTestJSON-83712851 None] Lock "cinder-d11d441e-9b4f-42f2-850f-b00c3ed1af62-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 04:38:10 devstack cinder-volume[87444]: INFO cinder.volume.manager [None req-d05873ae-00b1-4f67-9e3e-b5817db89791 tempest-AttachVolumeNegativeTest-538483290 None] Created volume successfully. Jul 10 04:38:10 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-5f5d6f01-51f2-4b1f-9b5b-f0596dc7b7c8 tempest-AttachVolumeTestJSON-83712851 None] Acquiring lock "cinder-quobyte-d11d441e-9b4f-42f2-850f-b00c3ed1af62" by "delete_volume" {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 04:38:10 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-5f5d6f01-51f2-4b1f-9b5b-f0596dc7b7c8 tempest-AttachVolumeTestJSON-83712851 None] Lock "cinder-quobyte-d11d441e-9b4f-42f2-850f-b00c3ed1af62" acquired by "delete_volume" :: waited 0.026s {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 04:38:10 devstack cinder-volume[87444]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ce59370-d1db-456f-b6c4-9b140f01c39d]: (4, 'qcow2') {{(pid=88499) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 04:38:10 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-5f5d6f01-51f2-4b1f-9b5b-f0596dc7b7c8 tempest-AttachVolumeTestJSON-83712851 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-d11d441e-9b4f-42f2-850f-b00c3ed1af62 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:38:10 devstack sudo[94220]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-d11d441e-9b4f-42f2-850f-b00c3ed1af62 Jul 10 04:38:10 devstack sudo[94220]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:38:11 devstack sudo[94220]: pam_unix(sudo:session): session closed for user root Jul 10 04:38:11 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-5f5d6f01-51f2-4b1f-9b5b-f0596dc7b7c8 tempest-AttachVolumeTestJSON-83712851 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-d11d441e-9b4f-42f2-850f-b00c3ed1af62" returned: 0 in 1.033s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:38:11 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-5f5d6f01-51f2-4b1f-9b5b-f0596dc7b7c8 tempest-AttachVolumeTestJSON-83712851 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-d11d441e-9b4f-42f2-850f-b00c3ed1af62 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:38:11 devstack sudo[94248]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-d11d441e-9b4f-42f2-850f-b00c3ed1af62 Jul 10 04:38:11 devstack sudo[94248]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:38:12 devstack sudo[94248]: pam_unix(sudo:session): session closed for user root Jul 10 04:38:12 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-5f5d6f01-51f2-4b1f-9b5b-f0596dc7b7c8 tempest-AttachVolumeTestJSON-83712851 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-d11d441e-9b4f-42f2-850f-b00c3ed1af62" returned: 0 in 0.732s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:38:12 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-5f5d6f01-51f2-4b1f-9b5b-f0596dc7b7c8 tempest-AttachVolumeTestJSON-83712851 None] Lock "cinder-quobyte-d11d441e-9b4f-42f2-850f-b00c3ed1af62" released by "delete_volume" :: held 1.826s {{(pid=87444) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 04:38:12 devstack cinder-volume[87444]: DEBUG cinder.quota [None req-5f5d6f01-51f2-4b1f-9b5b-f0596dc7b7c8 tempest-AttachVolumeTestJSON-83712851 None] Created reservations ['c2ead382-e8a0-40c5-af0c-8fb1e07c4bb6', '72f08fd9-40bf-4d33-8c83-e2fae8e3e22e', '643a27ef-c46f-4b73-a42d-a47cd2049f9e', '2c9dd613-4f9a-488d-bd22-65b0840e62b1'] {{(pid=87444) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 04:38:12 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-5f5d6f01-51f2-4b1f-9b5b-f0596dc7b7c8 tempest-AttachVolumeTestJSON-83712851 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 04:38:12 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-5f5d6f01-51f2-4b1f-9b5b-f0596dc7b7c8 tempest-AttachVolumeTestJSON-83712851 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 04:38:12 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-5f5d6f01-51f2-4b1f-9b5b-f0596dc7b7c8 tempest-AttachVolumeTestJSON-83712851 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922': None} {{(pid=87444) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 04:38:12 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-5f5d6f01-51f2-4b1f-9b5b-f0596dc7b7c8 tempest-AttachVolumeTestJSON-83712851 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922'] {{(pid=87444) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 04:38:12 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-5f5d6f01-51f2-4b1f-9b5b-f0596dc7b7c8 tempest-AttachVolumeTestJSON-83712851 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 04:38:12 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-5f5d6f01-51f2-4b1f-9b5b-f0596dc7b7c8 tempest-AttachVolumeTestJSON-83712851 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:38:12 devstack sudo[94267]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097 Jul 10 04:38:12 devstack sudo[94267]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:38:12 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-ae15c749-8006-4b65-a9d0-e26f6a36b470 tempest-AttachVolumeTestJSON-83712851 None] Acquiring lock "cinder-f0d6ebdd-da52-4fd1-8a77-761449439557-delete_volume" by "delete_volume" {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 04:38:12 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-ae15c749-8006-4b65-a9d0-e26f6a36b470 tempest-AttachVolumeTestJSON-83712851 None] Lock "cinder-f0d6ebdd-da52-4fd1-8a77-761449439557-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 04:38:12 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-ae15c749-8006-4b65-a9d0-e26f6a36b470 tempest-AttachVolumeTestJSON-83712851 None] Acquiring lock "cinder-quobyte-f0d6ebdd-da52-4fd1-8a77-761449439557" by "delete_volume" {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 04:38:12 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-ae15c749-8006-4b65-a9d0-e26f6a36b470 tempest-AttachVolumeTestJSON-83712851 None] Lock "cinder-quobyte-f0d6ebdd-da52-4fd1-8a77-761449439557" acquired by "delete_volume" :: waited 0.024s {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 04:38:12 devstack cinder-volume[87444]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c265b31-75d7-4ebb-9648-7bb21d8f7bfe]: (4, 'qcow2') {{(pid=88499) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 04:38:12 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-ae15c749-8006-4b65-a9d0-e26f6a36b470 tempest-AttachVolumeTestJSON-83712851 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-f0d6ebdd-da52-4fd1-8a77-761449439557 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:38:12 devstack sudo[94277]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-f0d6ebdd-da52-4fd1-8a77-761449439557 Jul 10 04:38:12 devstack sudo[94277]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:38:13 devstack sudo[94267]: pam_unix(sudo:session): session closed for user root Jul 10 04:38:13 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-5f5d6f01-51f2-4b1f-9b5b-f0596dc7b7c8 tempest-AttachVolumeTestJSON-83712851 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097" returned: 0 in 1.113s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:38:13 devstack cinder-volume[87444]: DEBUG cinder.manager [None req-5f5d6f01-51f2-4b1f-9b5b-f0596dc7b7c8 tempest-AttachVolumeTestJSON-83712851 None] Notifying Schedulers of capabilities ... {{(pid=87444) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 04:38:13 devstack cinder-volume[87444]: INFO cinder.volume.manager [None req-5f5d6f01-51f2-4b1f-9b5b-f0596dc7b7c8 tempest-AttachVolumeTestJSON-83712851 None] Deleted volume successfully. Jul 10 04:38:13 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-5f5d6f01-51f2-4b1f-9b5b-f0596dc7b7c8 tempest-AttachVolumeTestJSON-83712851 None] Lock "cinder-d11d441e-9b4f-42f2-850f-b00c3ed1af62-delete_volume" released by "delete_volume" :: held 3.331s {{(pid=87444) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 04:38:13 devstack sudo[94277]: pam_unix(sudo:session): session closed for user root Jul 10 04:38:13 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-ae15c749-8006-4b65-a9d0-e26f6a36b470 tempest-AttachVolumeTestJSON-83712851 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-f0d6ebdd-da52-4fd1-8a77-761449439557" returned: 0 in 1.198s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:38:13 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-ae15c749-8006-4b65-a9d0-e26f6a36b470 tempest-AttachVolumeTestJSON-83712851 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-f0d6ebdd-da52-4fd1-8a77-761449439557 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:38:13 devstack sudo[94292]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-f0d6ebdd-da52-4fd1-8a77-761449439557 Jul 10 04:38:13 devstack sudo[94292]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:38:14 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [req-4fdaca9d-8836-4d53-b229-573b9c8e370d req-8532b06c-6d1a-4aea-9fd4-f09c16d8cb6a tempest-AttachVolumeNegativeTest-538483290 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 04:38:14 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [req-4fdaca9d-8836-4d53-b229-573b9c8e370d req-8532b06c-6d1a-4aea-9fd4-f09c16d8cb6a tempest-AttachVolumeNegativeTest-538483290 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 04:38:14 devstack cinder-volume[87444]: DEBUG oslo.privsep.daemon [-] privsep: reply[46aca849-581c-4adf-912b-3c429757f300]: (4, 'qcow2') {{(pid=88499) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 04:38:14 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [req-4fdaca9d-8836-4d53-b229-573b9c8e370d req-8532b06c-6d1a-4aea-9fd4-f09c16d8cb6a tempest-AttachVolumeNegativeTest-538483290 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-abbefe22-5fda-470d-a8de-1b7a0eaba97d {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:38:14 devstack sudo[94295]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-abbefe22-5fda-470d-a8de-1b7a0eaba97d Jul 10 04:38:14 devstack sudo[94295]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:38:14 devstack sudo[94292]: pam_unix(sudo:session): session closed for user root Jul 10 04:38:14 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-ae15c749-8006-4b65-a9d0-e26f6a36b470 tempest-AttachVolumeTestJSON-83712851 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-f0d6ebdd-da52-4fd1-8a77-761449439557" returned: 0 in 0.869s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:38:14 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-ae15c749-8006-4b65-a9d0-e26f6a36b470 tempest-AttachVolumeTestJSON-83712851 None] Lock "cinder-quobyte-f0d6ebdd-da52-4fd1-8a77-761449439557" released by "delete_volume" :: held 2.136s {{(pid=87444) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 04:38:14 devstack cinder-volume[87444]: DEBUG cinder.quota [None req-ae15c749-8006-4b65-a9d0-e26f6a36b470 tempest-AttachVolumeTestJSON-83712851 None] Created reservations ['bc583a18-ca45-4a97-b513-d09dc54153e9', 'aac249e6-d364-450f-93ad-d7cb3e8492fa', '65f276ff-5a4c-4517-bfb2-f695bc4146a9', '47e0e73b-3880-4dac-a5c3-05e471d2fedb'] {{(pid=87444) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 04:38:14 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-ae15c749-8006-4b65-a9d0-e26f6a36b470 tempest-AttachVolumeTestJSON-83712851 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 04:38:14 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-ae15c749-8006-4b65-a9d0-e26f6a36b470 tempest-AttachVolumeTestJSON-83712851 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 04:38:14 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-ae15c749-8006-4b65-a9d0-e26f6a36b470 tempest-AttachVolumeTestJSON-83712851 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922': None} {{(pid=87444) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 04:38:15 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-ae15c749-8006-4b65-a9d0-e26f6a36b470 tempest-AttachVolumeTestJSON-83712851 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922'] {{(pid=87444) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 04:38:15 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-ae15c749-8006-4b65-a9d0-e26f6a36b470 tempest-AttachVolumeTestJSON-83712851 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 04:38:15 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-ae15c749-8006-4b65-a9d0-e26f6a36b470 tempest-AttachVolumeTestJSON-83712851 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:38:15 devstack sudo[94301]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097 Jul 10 04:38:15 devstack sudo[94301]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:38:15 devstack sudo[94295]: pam_unix(sudo:session): session closed for user root Jul 10 04:38:15 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [req-4fdaca9d-8836-4d53-b229-573b9c8e370d req-8532b06c-6d1a-4aea-9fd4-f09c16d8cb6a tempest-AttachVolumeNegativeTest-538483290 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-abbefe22-5fda-470d-a8de-1b7a0eaba97d" returned: 0 in 1.182s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:38:15 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [req-4fdaca9d-8836-4d53-b229-573b9c8e370d req-8532b06c-6d1a-4aea-9fd4-f09c16d8cb6a tempest-AttachVolumeNegativeTest-538483290 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.221s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 04:38:15 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [req-4fdaca9d-8836-4d53-b229-573b9c8e370d req-8532b06c-6d1a-4aea-9fd4-f09c16d8cb6a tempest-AttachVolumeNegativeTest-538483290 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922', 'name': 'volume-abbefe22-5fda-470d-a8de-1b7a0eaba97d', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '330245eb-2a7d-4df3-8a6f-f3a9da551d84', 'enforce_multipath': True} {{(pid=87444) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 10 04:38:15 devstack cinder-volume[87444]: INFO cinder.volume.manager [req-4fdaca9d-8836-4d53-b229-573b9c8e370d req-8532b06c-6d1a-4aea-9fd4-f09c16d8cb6a tempest-AttachVolumeNegativeTest-538483290 None] attachment_update completed successfully. Jul 10 04:38:16 devstack sudo[94301]: pam_unix(sudo:session): session closed for user root Jul 10 04:38:16 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-ae15c749-8006-4b65-a9d0-e26f6a36b470 tempest-AttachVolumeTestJSON-83712851 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097" returned: 0 in 1.025s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:38:16 devstack cinder-volume[87444]: DEBUG cinder.manager [None req-ae15c749-8006-4b65-a9d0-e26f6a36b470 tempest-AttachVolumeTestJSON-83712851 None] Notifying Schedulers of capabilities ... {{(pid=87444) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 04:38:16 devstack cinder-volume[87444]: INFO cinder.volume.manager [None req-ae15c749-8006-4b65-a9d0-e26f6a36b470 tempest-AttachVolumeTestJSON-83712851 None] Deleted volume successfully. Jul 10 04:38:16 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-ae15c749-8006-4b65-a9d0-e26f6a36b470 tempest-AttachVolumeTestJSON-83712851 None] Lock "cinder-f0d6ebdd-da52-4fd1-8a77-761449439557-delete_volume" released by "delete_volume" :: held 3.566s {{(pid=87444) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 04:38:16 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-587d7638-948e-4869-a4c7-94254c78500a tempest-AttachVolumeTestJSON-83712851 None] Acquiring lock "cinder-9dcd111d-4c76-4047-8756-77a57720f402-delete_volume" by "delete_volume" {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 04:38:16 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-587d7638-948e-4869-a4c7-94254c78500a tempest-AttachVolumeTestJSON-83712851 None] Lock "cinder-9dcd111d-4c76-4047-8756-77a57720f402-delete_volume" acquired by "delete_volume" :: waited 0.045s {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 04:38:16 devstack cinder-volume[87444]: DEBUG cinder.volume.flows.manager.create_volume [None req-ac2529a1-0502-4117-984a-9f541d016a93 tempest-ServerRescueNegativeTestJSON-1920570579 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87444) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 04:38:16 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-ac2529a1-0502-4117-984a-9f541d016a93 tempest-ServerRescueNegativeTestJSON-1920570579 None] Flow 'volume_create_manager' (a21214db-2658-44ab-a7fd-f2939d5bc31e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 04:38:16 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-ac2529a1-0502-4117-984a-9f541d016a93 tempest-ServerRescueNegativeTestJSON-1920570579 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (acddfdf4-35fb-4b87-93f0-8b665f26d4bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:38:16 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-ac2529a1-0502-4117-984a-9f541d016a93 tempest-ServerRescueNegativeTestJSON-1920570579 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (acddfdf4-35fb-4b87-93f0-8b665f26d4bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T02:38:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-2055044130',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e44ceeeb-1d2d-4f94-9705-2697174ac171,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ebbdcf8ae17a44d9b1cccf5af13dd48a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T02:38:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T02:38:16Z,use_quota=True,user_id='4f3aaa1fa9e442febb232684300ac7eb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(317e369e-1e06-434d-ae95-a335f0e6c903),volume_type_id=317e369e-1e06-434d-ae95-a335f0e6c903)' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:38:16 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-ac2529a1-0502-4117-984a-9f541d016a93 tempest-ServerRescueNegativeTestJSON-1920570579 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (af67b152-3bbc-4a18-9b84-02035623d2fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:38:16 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-ac2529a1-0502-4117-984a-9f541d016a93 tempest-ServerRescueNegativeTestJSON-1920570579 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (af67b152-3bbc-4a18-9b84-02035623d2fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:38:16 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-ac2529a1-0502-4117-984a-9f541d016a93 tempest-ServerRescueNegativeTestJSON-1920570579 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c1310abb-61fc-42f0-80aa-84aa0a994aed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:38:16 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-ac2529a1-0502-4117-984a-9f541d016a93 tempest-ServerRescueNegativeTestJSON-1920570579 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c1310abb-61fc-42f0-80aa-84aa0a994aed) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e44ceeeb-1d2d-4f94-9705-2697174ac171', 'volume_name': 'volume-e44ceeeb-1d2d-4f94-9705-2697174ac171', 'volume_size': 1}' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:38:16 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-ac2529a1-0502-4117-984a-9f541d016a93 tempest-ServerRescueNegativeTestJSON-1920570579 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4dccfbf6-2fd0-4c12-aa9d-6c94be166faf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:38:16 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-ac2529a1-0502-4117-984a-9f541d016a93 tempest-ServerRescueNegativeTestJSON-1920570579 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4dccfbf6-2fd0-4c12-aa9d-6c94be166faf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:38:16 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-ac2529a1-0502-4117-984a-9f541d016a93 tempest-ServerRescueNegativeTestJSON-1920570579 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eadf91a7-f85f-49bf-b44a-a21ac668e056) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:38:16 devstack cinder-volume[87444]: INFO cinder.volume.flows.manager.create_volume [None req-ac2529a1-0502-4117-984a-9f541d016a93 tempest-ServerRescueNegativeTestJSON-1920570579 None] Volume e44ceeeb-1d2d-4f94-9705-2697174ac171: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e44ceeeb-1d2d-4f94-9705-2697174ac171', 'volume_size': 1} Jul 10 04:38:16 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-ac2529a1-0502-4117-984a-9f541d016a93 tempest-ServerRescueNegativeTestJSON-1920570579 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 04:38:16 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-ac2529a1-0502-4117-984a-9f541d016a93 tempest-ServerRescueNegativeTestJSON-1920570579 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 04:38:16 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-ac2529a1-0502-4117-984a-9f541d016a93 tempest-ServerRescueNegativeTestJSON-1920570579 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T02:38:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-2055044130',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e44ceeeb-1d2d-4f94-9705-2697174ac171,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ebbdcf8ae17a44d9b1cccf5af13dd48a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T02:38:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T02:38:16Z,use_quota=True,user_id='4f3aaa1fa9e442febb232684300ac7eb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(317e369e-1e06-434d-ae95-a335f0e6c903),volume_type_id=317e369e-1e06-434d-ae95-a335f0e6c903)}" {{(pid=87444) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 04:38:16 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.remotefs [None req-ac2529a1-0502-4117-984a-9f541d016a93 tempest-ServerRescueNegativeTestJSON-1920570579 None] Creating volume e44ceeeb-1d2d-4f94-9705-2697174ac171 {{(pid=87444) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 04:38:16 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-ac2529a1-0502-4117-984a-9f541d016a93 tempest-ServerRescueNegativeTestJSON-1920570579 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 04:38:16 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-ac2529a1-0502-4117-984a-9f541d016a93 tempest-ServerRescueNegativeTestJSON-1920570579 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 04:38:16 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-ac2529a1-0502-4117-984a-9f541d016a93 tempest-ServerRescueNegativeTestJSON-1920570579 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922': None} {{(pid=87444) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 04:38:16 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-ac2529a1-0502-4117-984a-9f541d016a93 tempest-ServerRescueNegativeTestJSON-1920570579 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922'] {{(pid=87444) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 04:38:16 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-ac2529a1-0502-4117-984a-9f541d016a93 tempest-ServerRescueNegativeTestJSON-1920570579 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 04:38:16 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-ac2529a1-0502-4117-984a-9f541d016a93 tempest-ServerRescueNegativeTestJSON-1920570579 None] Selected osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922 as target Quobyte volume. {{(pid=87444) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 04:38:16 devstack cinder-volume[87444]: INFO cinder.volume.drivers.remotefs [None req-ac2529a1-0502-4117-984a-9f541d016a93 tempest-ServerRescueNegativeTestJSON-1920570579 None] casted to osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922 Jul 10 04:38:16 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-ac2529a1-0502-4117-984a-9f541d016a93 tempest-ServerRescueNegativeTestJSON-1920570579 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-e44ceeeb-1d2d-4f94-9705-2697174ac171 1073741824 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:38:16 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-587d7638-948e-4869-a4c7-94254c78500a tempest-AttachVolumeTestJSON-83712851 None] Acquiring lock "cinder-quobyte-9dcd111d-4c76-4047-8756-77a57720f402" by "delete_volume" {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 04:38:16 devstack sudo[94686]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-e44ceeeb-1d2d-4f94-9705-2697174ac171 1073741824 Jul 10 04:38:16 devstack sudo[94686]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:38:16 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-587d7638-948e-4869-a4c7-94254c78500a tempest-AttachVolumeTestJSON-83712851 None] Lock "cinder-quobyte-9dcd111d-4c76-4047-8756-77a57720f402" acquired by "delete_volume" :: waited 0.046s {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 04:38:16 devstack cinder-volume[87444]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c6bb70f-38a6-4b7b-83c7-27684a400e6b]: (4, 'qcow2') {{(pid=88499) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 04:38:16 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-587d7638-948e-4869-a4c7-94254c78500a tempest-AttachVolumeTestJSON-83712851 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-9dcd111d-4c76-4047-8756-77a57720f402 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:38:16 devstack sudo[94688]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-9dcd111d-4c76-4047-8756-77a57720f402 Jul 10 04:38:16 devstack sudo[94688]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:38:17 devstack sudo[94686]: pam_unix(sudo:session): session closed for user root Jul 10 04:38:17 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-ac2529a1-0502-4117-984a-9f541d016a93 tempest-ServerRescueNegativeTestJSON-1920570579 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-e44ceeeb-1d2d-4f94-9705-2697174ac171 1073741824" returned: 0 in 1.109s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:38:17 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-ac2529a1-0502-4117-984a-9f541d016a93 tempest-ServerRescueNegativeTestJSON-1920570579 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-e44ceeeb-1d2d-4f94-9705-2697174ac171 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:38:17 devstack sudo[94697]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-e44ceeeb-1d2d-4f94-9705-2697174ac171 Jul 10 04:38:17 devstack sudo[94697]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:38:17 devstack sudo[94688]: pam_unix(sudo:session): session closed for user root Jul 10 04:38:17 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-587d7638-948e-4869-a4c7-94254c78500a tempest-AttachVolumeTestJSON-83712851 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-9dcd111d-4c76-4047-8756-77a57720f402" returned: 0 in 1.095s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:38:17 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-587d7638-948e-4869-a4c7-94254c78500a tempest-AttachVolumeTestJSON-83712851 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-9dcd111d-4c76-4047-8756-77a57720f402 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:38:17 devstack sudo[94699]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-9dcd111d-4c76-4047-8756-77a57720f402 Jul 10 04:38:17 devstack sudo[94699]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:38:18 devstack sudo[94697]: pam_unix(sudo:session): session closed for user root Jul 10 04:38:18 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-ac2529a1-0502-4117-984a-9f541d016a93 tempest-ServerRescueNegativeTestJSON-1920570579 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-e44ceeeb-1d2d-4f94-9705-2697174ac171" returned: 0 in 0.812s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:38:18 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-ac2529a1-0502-4117-984a-9f541d016a93 tempest-ServerRescueNegativeTestJSON-1920570579 None] <== create_volume: return (1980ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922'} {{(pid=87444) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 04:38:18 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-ac2529a1-0502-4117-984a-9f541d016a93 tempest-ServerRescueNegativeTestJSON-1920570579 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.982s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 04:38:18 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-ac2529a1-0502-4117-984a-9f541d016a93 tempest-ServerRescueNegativeTestJSON-1920570579 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eadf91a7-f85f-49bf-b44a-a21ac668e056) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e44ceeeb-1d2d-4f94-9705-2697174ac171', 'volume_size': 1}' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:38:18 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-ac2529a1-0502-4117-984a-9f541d016a93 tempest-ServerRescueNegativeTestJSON-1920570579 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (205f2e93-8c7b-4375-8e15-9dc1c4199966) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:38:18 devstack cinder-volume[87444]: INFO cinder.volume.flows.manager.create_volume [None req-ac2529a1-0502-4117-984a-9f541d016a93 tempest-ServerRescueNegativeTestJSON-1920570579 None] Volume volume-e44ceeeb-1d2d-4f94-9705-2697174ac171 (e44ceeeb-1d2d-4f94-9705-2697174ac171): created successfully Jul 10 04:38:18 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-ac2529a1-0502-4117-984a-9f541d016a93 tempest-ServerRescueNegativeTestJSON-1920570579 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (205f2e93-8c7b-4375-8e15-9dc1c4199966) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:38:18 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-ac2529a1-0502-4117-984a-9f541d016a93 tempest-ServerRescueNegativeTestJSON-1920570579 None] Flow 'volume_create_manager' (a21214db-2658-44ab-a7fd-f2939d5bc31e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87444) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 04:38:18 devstack cinder-volume[87444]: INFO cinder.volume.manager [None req-ac2529a1-0502-4117-984a-9f541d016a93 tempest-ServerRescueNegativeTestJSON-1920570579 None] Created volume successfully. Jul 10 04:38:19 devstack sudo[94699]: pam_unix(sudo:session): session closed for user root Jul 10 04:38:19 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-587d7638-948e-4869-a4c7-94254c78500a tempest-AttachVolumeTestJSON-83712851 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-9dcd111d-4c76-4047-8756-77a57720f402" returned: 0 in 1.115s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:38:19 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-587d7638-948e-4869-a4c7-94254c78500a tempest-AttachVolumeTestJSON-83712851 None] Lock "cinder-quobyte-9dcd111d-4c76-4047-8756-77a57720f402" released by "delete_volume" :: held 2.293s {{(pid=87444) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 04:38:19 devstack cinder-volume[87444]: DEBUG cinder.quota [None req-587d7638-948e-4869-a4c7-94254c78500a tempest-AttachVolumeTestJSON-83712851 None] Created reservations ['d8932e89-9ded-4b3b-8acb-792b4426bf26', 'cbc18fa5-c713-48c5-b1d5-ecef7a440cc3', 'b620f397-ced8-48b4-ba08-471f0b30e4ba', '0e656808-8d6c-4a3b-b56b-b370a0d233c7'] {{(pid=87444) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 04:38:19 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-587d7638-948e-4869-a4c7-94254c78500a tempest-AttachVolumeTestJSON-83712851 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 04:38:19 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-587d7638-948e-4869-a4c7-94254c78500a tempest-AttachVolumeTestJSON-83712851 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 04:38:19 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-587d7638-948e-4869-a4c7-94254c78500a tempest-AttachVolumeTestJSON-83712851 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922': None} {{(pid=87444) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 04:38:19 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-587d7638-948e-4869-a4c7-94254c78500a tempest-AttachVolumeTestJSON-83712851 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922'] {{(pid=87444) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 04:38:19 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-587d7638-948e-4869-a4c7-94254c78500a tempest-AttachVolumeTestJSON-83712851 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 04:38:19 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-587d7638-948e-4869-a4c7-94254c78500a tempest-AttachVolumeTestJSON-83712851 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:38:19 devstack sudo[94703]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097 Jul 10 04:38:19 devstack sudo[94703]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:38:20 devstack sudo[94703]: pam_unix(sudo:session): session closed for user root Jul 10 04:38:20 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-587d7638-948e-4869-a4c7-94254c78500a tempest-AttachVolumeTestJSON-83712851 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097" returned: 0 in 0.879s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:38:20 devstack cinder-volume[87444]: DEBUG cinder.manager [None req-587d7638-948e-4869-a4c7-94254c78500a tempest-AttachVolumeTestJSON-83712851 None] Notifying Schedulers of capabilities ... {{(pid=87444) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 04:38:20 devstack cinder-volume[87444]: INFO cinder.volume.manager [None req-587d7638-948e-4869-a4c7-94254c78500a tempest-AttachVolumeTestJSON-83712851 None] Deleted volume successfully. Jul 10 04:38:20 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-587d7638-948e-4869-a4c7-94254c78500a tempest-AttachVolumeTestJSON-83712851 None] Lock "cinder-9dcd111d-4c76-4047-8756-77a57720f402-delete_volume" released by "delete_volume" :: held 3.640s {{(pid=87444) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 04:38:23 devstack cinder-volume[87444]: INFO cinder.volume.manager [req-97d9abd3-ba68-46be-84c1-40f37ac2c05c req-1db8e8a9-d547-4c66-abf3-4a60ac30c824 tempest-AttachVolumeNegativeTest-538483290 None] Terminate volume connection completed successfully. Jul 10 04:38:23 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [req-97d9abd3-ba68-46be-84c1-40f37ac2c05c req-1db8e8a9-d547-4c66-abf3-4a60ac30c824 tempest-AttachVolumeNegativeTest-538483290 None] Deleting attachment 330245eb-2a7d-4df3-8a6f-f3a9da551d84. {{(pid=87444) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 10 04:38:25 devstack cinder-volume[87444]: INFO cinder.volume.manager [None req-530b3c6a-49d3-4f05-8c4f-aadeada38c19 tempest-GroupsV314Test-1240250205 None] Group tempest-GroupsV314Test-Group-937894432: creating Jul 10 04:38:25 devstack cinder-volume[87444]: INFO cinder.volume.manager [None req-530b3c6a-49d3-4f05-8c4f-aadeada38c19 tempest-GroupsV314Test-1240250205 None] Group tempest-GroupsV314Test-Group-937894432: created successfully Jul 10 04:38:25 devstack cinder-volume[87444]: INFO cinder.volume.manager [None req-530b3c6a-49d3-4f05-8c4f-aadeada38c19 tempest-GroupsV314Test-1240250205 None] Create group completed successfully. Jul 10 04:38:27 devstack cinder-volume[87444]: DEBUG cinder.volume.flows.manager.create_volume [None req-b13057a7-ccd1-467d-ba26-378bf39a437f tempest-GroupsV314Test-1240250205 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87444) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 04:38:27 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-b13057a7-ccd1-467d-ba26-378bf39a437f tempest-GroupsV314Test-1240250205 None] Flow 'volume_create_manager' (8c017243-7fdc-4855-8c56-7d20b3e1c078) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 04:38:27 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-b13057a7-ccd1-467d-ba26-378bf39a437f tempest-GroupsV314Test-1240250205 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (18c8de74-c9df-4aef-af81-3193baa8d1e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:38:27 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-b13057a7-ccd1-467d-ba26-378bf39a437f tempest-GroupsV314Test-1240250205 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (18c8de74-c9df-4aef-af81-3193baa8d1e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T02:38:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-865399108',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=964c9a7d-032b-46da-90b3-e20a19b02f90,host='devstack@QuobyteHD#QuobyteHD',id=e09f0338-cb01-4dcb-99b6-6d68ac989e0b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3552cb33027d4116b157b270403c4714',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T02:38:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T02:38:27Z,use_quota=True,user_id='2724e0f16ff141c19aeef92e1f6a23ff',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f1f47c39-6096-45cc-a552-74e8dd11408f),volume_type_id=f1f47c39-6096-45cc-a552-74e8dd11408f)' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:38:27 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-b13057a7-ccd1-467d-ba26-378bf39a437f tempest-GroupsV314Test-1240250205 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (06fb4612-9eb6-42b5-b311-5e759b0b115b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:38:27 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-b13057a7-ccd1-467d-ba26-378bf39a437f tempest-GroupsV314Test-1240250205 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (06fb4612-9eb6-42b5-b311-5e759b0b115b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:38:27 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-b13057a7-ccd1-467d-ba26-378bf39a437f tempest-GroupsV314Test-1240250205 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1ee0117d-fd14-4c8c-af30-66abec538e2a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:38:27 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-b13057a7-ccd1-467d-ba26-378bf39a437f tempest-GroupsV314Test-1240250205 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1ee0117d-fd14-4c8c-af30-66abec538e2a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e09f0338-cb01-4dcb-99b6-6d68ac989e0b', 'volume_name': 'volume-e09f0338-cb01-4dcb-99b6-6d68ac989e0b', 'volume_size': 1}' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:38:27 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-b13057a7-ccd1-467d-ba26-378bf39a437f tempest-GroupsV314Test-1240250205 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9aaced22-678c-41fa-bfc8-5e11c51430c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:38:27 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-b13057a7-ccd1-467d-ba26-378bf39a437f tempest-GroupsV314Test-1240250205 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9aaced22-678c-41fa-bfc8-5e11c51430c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:38:27 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-b13057a7-ccd1-467d-ba26-378bf39a437f tempest-GroupsV314Test-1240250205 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a0401000-374b-47a0-b6bf-babdfc56bd28) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:38:27 devstack cinder-volume[87444]: INFO cinder.volume.flows.manager.create_volume [None req-b13057a7-ccd1-467d-ba26-378bf39a437f tempest-GroupsV314Test-1240250205 None] Volume e09f0338-cb01-4dcb-99b6-6d68ac989e0b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e09f0338-cb01-4dcb-99b6-6d68ac989e0b', 'volume_size': 1} Jul 10 04:38:27 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-b13057a7-ccd1-467d-ba26-378bf39a437f tempest-GroupsV314Test-1240250205 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 04:38:27 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-b13057a7-ccd1-467d-ba26-378bf39a437f tempest-GroupsV314Test-1240250205 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 04:38:27 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-b13057a7-ccd1-467d-ba26-378bf39a437f tempest-GroupsV314Test-1240250205 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=964c9a7d-032b-46da-90b3-e20a19b02f90,created_at=2026-07-10T02:38:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-865399108',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=964c9a7d-032b-46da-90b3-e20a19b02f90,host='devstack@QuobyteHD#QuobyteHD',id=e09f0338-cb01-4dcb-99b6-6d68ac989e0b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3552cb33027d4116b157b270403c4714',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T02:38:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T02:38:27Z,use_quota=True,user_id='2724e0f16ff141c19aeef92e1f6a23ff',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f1f47c39-6096-45cc-a552-74e8dd11408f),volume_type_id=f1f47c39-6096-45cc-a552-74e8dd11408f)}" {{(pid=87444) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 04:38:27 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.remotefs [None req-b13057a7-ccd1-467d-ba26-378bf39a437f tempest-GroupsV314Test-1240250205 None] Creating volume e09f0338-cb01-4dcb-99b6-6d68ac989e0b {{(pid=87444) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 04:38:27 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-b13057a7-ccd1-467d-ba26-378bf39a437f tempest-GroupsV314Test-1240250205 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 04:38:27 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-b13057a7-ccd1-467d-ba26-378bf39a437f tempest-GroupsV314Test-1240250205 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 04:38:27 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-b13057a7-ccd1-467d-ba26-378bf39a437f tempest-GroupsV314Test-1240250205 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922': None} {{(pid=87444) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 04:38:27 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-b13057a7-ccd1-467d-ba26-378bf39a437f tempest-GroupsV314Test-1240250205 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922'] {{(pid=87444) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 04:38:27 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-b13057a7-ccd1-467d-ba26-378bf39a437f tempest-GroupsV314Test-1240250205 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 04:38:27 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-b13057a7-ccd1-467d-ba26-378bf39a437f tempest-GroupsV314Test-1240250205 None] Selected osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922 as target Quobyte volume. {{(pid=87444) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 04:38:27 devstack cinder-volume[87444]: INFO cinder.volume.drivers.remotefs [None req-b13057a7-ccd1-467d-ba26-378bf39a437f tempest-GroupsV314Test-1240250205 None] casted to osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922 Jul 10 04:38:27 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-b13057a7-ccd1-467d-ba26-378bf39a437f tempest-GroupsV314Test-1240250205 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-e09f0338-cb01-4dcb-99b6-6d68ac989e0b 1073741824 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:38:27 devstack sudo[94813]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-e09f0338-cb01-4dcb-99b6-6d68ac989e0b 1073741824 Jul 10 04:38:27 devstack sudo[94813]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:38:28 devstack sudo[94813]: pam_unix(sudo:session): session closed for user root Jul 10 04:38:28 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-b13057a7-ccd1-467d-ba26-378bf39a437f tempest-GroupsV314Test-1240250205 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-e09f0338-cb01-4dcb-99b6-6d68ac989e0b 1073741824" returned: 0 in 1.306s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:38:28 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-b13057a7-ccd1-467d-ba26-378bf39a437f tempest-GroupsV314Test-1240250205 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-e09f0338-cb01-4dcb-99b6-6d68ac989e0b {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:38:28 devstack sudo[94826]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-e09f0338-cb01-4dcb-99b6-6d68ac989e0b Jul 10 04:38:28 devstack sudo[94826]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:38:29 devstack sudo[94826]: pam_unix(sudo:session): session closed for user root Jul 10 04:38:29 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-b13057a7-ccd1-467d-ba26-378bf39a437f tempest-GroupsV314Test-1240250205 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-e09f0338-cb01-4dcb-99b6-6d68ac989e0b" returned: 0 in 0.796s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:38:29 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-b13057a7-ccd1-467d-ba26-378bf39a437f tempest-GroupsV314Test-1240250205 None] <== create_volume: return (2154ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922'} {{(pid=87444) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 04:38:29 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-b13057a7-ccd1-467d-ba26-378bf39a437f tempest-GroupsV314Test-1240250205 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.156s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 04:38:29 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-b13057a7-ccd1-467d-ba26-378bf39a437f tempest-GroupsV314Test-1240250205 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a0401000-374b-47a0-b6bf-babdfc56bd28) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e09f0338-cb01-4dcb-99b6-6d68ac989e0b', 'volume_size': 1}' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:38:29 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-b13057a7-ccd1-467d-ba26-378bf39a437f tempest-GroupsV314Test-1240250205 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (23d29fa2-93f3-42b2-ab47-4a78ce540296) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:38:29 devstack cinder-volume[87444]: INFO cinder.volume.flows.manager.create_volume [None req-b13057a7-ccd1-467d-ba26-378bf39a437f tempest-GroupsV314Test-1240250205 None] Volume volume-e09f0338-cb01-4dcb-99b6-6d68ac989e0b (e09f0338-cb01-4dcb-99b6-6d68ac989e0b): created successfully Jul 10 04:38:29 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-b13057a7-ccd1-467d-ba26-378bf39a437f tempest-GroupsV314Test-1240250205 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (23d29fa2-93f3-42b2-ab47-4a78ce540296) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:38:29 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-b13057a7-ccd1-467d-ba26-378bf39a437f tempest-GroupsV314Test-1240250205 None] Flow 'volume_create_manager' (8c017243-7fdc-4855-8c56-7d20b3e1c078) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87444) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 04:38:29 devstack cinder-volume[87444]: INFO cinder.volume.manager [None req-b13057a7-ccd1-467d-ba26-378bf39a437f tempest-GroupsV314Test-1240250205 None] Created volume successfully. Jul 10 04:38:30 devstack cinder-volume[87444]: DEBUG cinder.volume.flows.manager.create_volume [None req-ed62b261-3ef0-4007-aa51-ea9d06d7c15a tempest-VolumesTestJSON-1537374362 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87444) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 04:38:30 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-ed62b261-3ef0-4007-aa51-ea9d06d7c15a tempest-VolumesTestJSON-1537374362 None] Flow 'volume_create_manager' (5e0937fc-309b-4579-a3a8-8255727943bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 04:38:30 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-ed62b261-3ef0-4007-aa51-ea9d06d7c15a tempest-VolumesTestJSON-1537374362 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a1b17373-081c-41c0-b417-8caf607f942a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:38:30 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-ed62b261-3ef0-4007-aa51-ea9d06d7c15a tempest-VolumesTestJSON-1537374362 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a1b17373-081c-41c0-b417-8caf607f942a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T02:38:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-735619734',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=165bf717-01bd-4fdb-92d7-ba8e75c2a5ba,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='2bf91653b8e04fc8b20465f2f733c298',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T02:38:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T02:38:30Z,use_quota=True,user_id='be96d3c6d4fa46caa41b98827727ee62',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(317e369e-1e06-434d-ae95-a335f0e6c903),volume_type_id=317e369e-1e06-434d-ae95-a335f0e6c903)' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:38:30 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-ed62b261-3ef0-4007-aa51-ea9d06d7c15a tempest-VolumesTestJSON-1537374362 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bf5cca34-0030-41c1-8c38-c635ce3b3ea0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:38:30 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-ed62b261-3ef0-4007-aa51-ea9d06d7c15a tempest-VolumesTestJSON-1537374362 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bf5cca34-0030-41c1-8c38-c635ce3b3ea0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:38:30 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-ed62b261-3ef0-4007-aa51-ea9d06d7c15a tempest-VolumesTestJSON-1537374362 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4024f07a-eab8-4582-b3e7-fd3cb2edddee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:38:30 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-ed62b261-3ef0-4007-aa51-ea9d06d7c15a tempest-VolumesTestJSON-1537374362 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4024f07a-eab8-4582-b3e7-fd3cb2edddee) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '165bf717-01bd-4fdb-92d7-ba8e75c2a5ba', 'volume_name': 'volume-165bf717-01bd-4fdb-92d7-ba8e75c2a5ba', 'volume_size': 1}' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:38:30 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-ed62b261-3ef0-4007-aa51-ea9d06d7c15a tempest-VolumesTestJSON-1537374362 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3193b153-2d51-4315-8bec-f5c967d3a2b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:38:30 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-ed62b261-3ef0-4007-aa51-ea9d06d7c15a tempest-VolumesTestJSON-1537374362 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3193b153-2d51-4315-8bec-f5c967d3a2b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:38:30 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-ed62b261-3ef0-4007-aa51-ea9d06d7c15a tempest-VolumesTestJSON-1537374362 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (91522aac-58df-4b01-8c58-b783c0fac3ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:38:30 devstack cinder-volume[87444]: INFO cinder.volume.flows.manager.create_volume [None req-ed62b261-3ef0-4007-aa51-ea9d06d7c15a tempest-VolumesTestJSON-1537374362 None] Volume 165bf717-01bd-4fdb-92d7-ba8e75c2a5ba: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-165bf717-01bd-4fdb-92d7-ba8e75c2a5ba', 'volume_size': 1} Jul 10 04:38:30 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-ed62b261-3ef0-4007-aa51-ea9d06d7c15a tempest-VolumesTestJSON-1537374362 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 04:38:30 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-ed62b261-3ef0-4007-aa51-ea9d06d7c15a tempest-VolumesTestJSON-1537374362 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 04:38:30 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-ed62b261-3ef0-4007-aa51-ea9d06d7c15a tempest-VolumesTestJSON-1537374362 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T02:38:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-735619734',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=165bf717-01bd-4fdb-92d7-ba8e75c2a5ba,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='2bf91653b8e04fc8b20465f2f733c298',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T02:38:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T02:38:30Z,use_quota=True,user_id='be96d3c6d4fa46caa41b98827727ee62',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(317e369e-1e06-434d-ae95-a335f0e6c903),volume_type_id=317e369e-1e06-434d-ae95-a335f0e6c903)}" {{(pid=87444) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 04:38:30 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.remotefs [None req-ed62b261-3ef0-4007-aa51-ea9d06d7c15a tempest-VolumesTestJSON-1537374362 None] Creating volume 165bf717-01bd-4fdb-92d7-ba8e75c2a5ba {{(pid=87444) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 04:38:30 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-ed62b261-3ef0-4007-aa51-ea9d06d7c15a tempest-VolumesTestJSON-1537374362 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 04:38:30 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-ed62b261-3ef0-4007-aa51-ea9d06d7c15a tempest-VolumesTestJSON-1537374362 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 04:38:30 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-ed62b261-3ef0-4007-aa51-ea9d06d7c15a tempest-VolumesTestJSON-1537374362 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922': None} {{(pid=87444) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 04:38:30 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-ed62b261-3ef0-4007-aa51-ea9d06d7c15a tempest-VolumesTestJSON-1537374362 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922'] {{(pid=87444) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 04:38:30 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-ed62b261-3ef0-4007-aa51-ea9d06d7c15a tempest-VolumesTestJSON-1537374362 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 04:38:30 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-ed62b261-3ef0-4007-aa51-ea9d06d7c15a tempest-VolumesTestJSON-1537374362 None] Selected osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922 as target Quobyte volume. {{(pid=87444) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 04:38:30 devstack cinder-volume[87444]: INFO cinder.volume.drivers.remotefs [None req-ed62b261-3ef0-4007-aa51-ea9d06d7c15a tempest-VolumesTestJSON-1537374362 None] casted to osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922 Jul 10 04:38:30 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-ed62b261-3ef0-4007-aa51-ea9d06d7c15a tempest-VolumesTestJSON-1537374362 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-165bf717-01bd-4fdb-92d7-ba8e75c2a5ba 1073741824 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:38:30 devstack sudo[94851]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-165bf717-01bd-4fdb-92d7-ba8e75c2a5ba 1073741824 Jul 10 04:38:30 devstack sudo[94851]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:38:31 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-52a8483b-c1e7-47f5-b3b6-0a6f9bc63939 tempest-GroupsV314Test-1240250205 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 04:38:31 devstack sudo[94851]: pam_unix(sudo:session): session closed for user root Jul 10 04:38:31 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-ed62b261-3ef0-4007-aa51-ea9d06d7c15a tempest-VolumesTestJSON-1537374362 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-165bf717-01bd-4fdb-92d7-ba8e75c2a5ba 1073741824" returned: 0 in 1.077s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:38:31 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-ed62b261-3ef0-4007-aa51-ea9d06d7c15a tempest-VolumesTestJSON-1537374362 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-165bf717-01bd-4fdb-92d7-ba8e75c2a5ba {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:38:31 devstack sudo[94858]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-165bf717-01bd-4fdb-92d7-ba8e75c2a5ba Jul 10 04:38:31 devstack sudo[94858]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:38:32 devstack sudo[94858]: pam_unix(sudo:session): session closed for user root Jul 10 04:38:32 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-ed62b261-3ef0-4007-aa51-ea9d06d7c15a tempest-VolumesTestJSON-1537374362 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-165bf717-01bd-4fdb-92d7-ba8e75c2a5ba" returned: 0 in 0.796s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:38:32 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-ed62b261-3ef0-4007-aa51-ea9d06d7c15a tempest-VolumesTestJSON-1537374362 None] <== create_volume: return (1915ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922'} {{(pid=87444) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 04:38:32 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-ed62b261-3ef0-4007-aa51-ea9d06d7c15a tempest-VolumesTestJSON-1537374362 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.918s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 04:38:32 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-52a8483b-c1e7-47f5-b3b6-0a6f9bc63939 tempest-GroupsV314Test-1240250205 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 1.333s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 04:38:32 devstack cinder-volume[87444]: INFO cinder.volume.drivers.remotefs [None req-52a8483b-c1e7-47f5-b3b6-0a6f9bc63939 tempest-GroupsV314Test-1240250205 None] Cloning volume e09f0338-cb01-4dcb-99b6-6d68ac989e0b to volume a4140352-58bc-4a6c-b55e-2e7ac27e716d Jul 10 04:38:32 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-ed62b261-3ef0-4007-aa51-ea9d06d7c15a tempest-VolumesTestJSON-1537374362 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (91522aac-58df-4b01-8c58-b783c0fac3ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-165bf717-01bd-4fdb-92d7-ba8e75c2a5ba', 'volume_size': 1}' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:38:32 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-ed62b261-3ef0-4007-aa51-ea9d06d7c15a tempest-VolumesTestJSON-1537374362 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c99e88c7-219c-4e70-87aa-8187ddffc5f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:38:32 devstack cinder-volume[87444]: INFO cinder.volume.flows.manager.create_volume [None req-ed62b261-3ef0-4007-aa51-ea9d06d7c15a tempest-VolumesTestJSON-1537374362 None] Volume volume-165bf717-01bd-4fdb-92d7-ba8e75c2a5ba (165bf717-01bd-4fdb-92d7-ba8e75c2a5ba): created successfully Jul 10 04:38:32 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-ed62b261-3ef0-4007-aa51-ea9d06d7c15a tempest-VolumesTestJSON-1537374362 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c99e88c7-219c-4e70-87aa-8187ddffc5f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:38:32 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-ed62b261-3ef0-4007-aa51-ea9d06d7c15a tempest-VolumesTestJSON-1537374362 None] Flow 'volume_create_manager' (5e0937fc-309b-4579-a3a8-8255727943bf) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87444) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 04:38:32 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.remotefs [None req-52a8483b-c1e7-47f5-b3b6-0a6f9bc63939 tempest-GroupsV314Test-1240250205 None] Creating offline snapshot c09d1d53-a1b4-4ce0-afdf-e7ff9899a92b of volume e09f0338-cb01-4dcb-99b6-6d68ac989e0b {{(pid=87444) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 10 04:38:32 devstack cinder-volume[87444]: INFO cinder.volume.manager [None req-ed62b261-3ef0-4007-aa51-ea9d06d7c15a tempest-VolumesTestJSON-1537374362 None] Created volume successfully. Jul 10 04:38:32 devstack cinder-volume[87444]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a23b53d-fbd2-4d63-ad65-2c86ce42c3cd]: (4, 'qcow2') {{(pid=88499) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 04:38:32 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-52a8483b-c1e7-47f5-b3b6-0a6f9bc63939 tempest-GroupsV314Test-1240250205 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-e09f0338-cb01-4dcb-99b6-6d68ac989e0b {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:38:32 devstack sudo[94861]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-e09f0338-cb01-4dcb-99b6-6d68ac989e0b Jul 10 04:38:32 devstack sudo[94861]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:38:32 devstack cinder-volume[87444]: DEBUG oslo_service.periodic_task [None req-01f0ce3e-6850-4e14-881d-e40d3c4ad6e5 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87444) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 10 04:38:32 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-01f0ce3e-6850-4e14-881d-e40d3c4ad6e5 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 04:38:32 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-01f0ce3e-6850-4e14-881d-e40d3c4ad6e5 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 04:38:32 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-01f0ce3e-6850-4e14-881d-e40d3c4ad6e5 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922': None} {{(pid=87444) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 04:38:33 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-01f0ce3e-6850-4e14-881d-e40d3c4ad6e5 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922'] {{(pid=87444) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 04:38:33 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-01f0ce3e-6850-4e14-881d-e40d3c4ad6e5 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 04:38:33 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-01f0ce3e-6850-4e14-881d-e40d3c4ad6e5 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:38:33 devstack sudo[94864]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097 Jul 10 04:38:33 devstack sudo[94864]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:38:33 devstack sudo[94861]: pam_unix(sudo:session): session closed for user root Jul 10 04:38:33 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-52a8483b-c1e7-47f5-b3b6-0a6f9bc63939 tempest-GroupsV314Test-1240250205 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-e09f0338-cb01-4dcb-99b6-6d68ac989e0b" returned: 0 in 1.108s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:38:33 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-52a8483b-c1e7-47f5-b3b6-0a6f9bc63939 tempest-GroupsV314Test-1240250205 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-e09f0338-cb01-4dcb-99b6-6d68ac989e0b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-e09f0338-cb01-4dcb-99b6-6d68ac989e0b.c09d1d53-a1b4-4ce0-afdf-e7ff9899a92b 1G {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:38:33 devstack sudo[94869]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-e09f0338-cb01-4dcb-99b6-6d68ac989e0b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-e09f0338-cb01-4dcb-99b6-6d68ac989e0b.c09d1d53-a1b4-4ce0-afdf-e7ff9899a92b 1G Jul 10 04:38:33 devstack sudo[94869]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:38:34 devstack sudo[94864]: pam_unix(sudo:session): session closed for user root Jul 10 04:38:34 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-01f0ce3e-6850-4e14-881d-e40d3c4ad6e5 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097" returned: 0 in 1.598s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:38:34 devstack cinder-volume[87444]: DEBUG cinder.manager [None req-01f0ce3e-6850-4e14-881d-e40d3c4ad6e5 None None] Notifying Schedulers of capabilities ... {{(pid=87444) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 04:38:34 devstack cinder-volume[87444]: DEBUG oslo_service.periodic_task [None req-01f0ce3e-6850-4e14-881d-e40d3c4ad6e5 None None] Running periodic task VolumeManager._thread_info {{(pid=87444) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 10 04:38:34 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-01f0ce3e-6850-4e14-881d-e40d3c4ad6e5 None None] thread count: 8 {{(pid=87444) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 10 04:38:34 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-01f0ce3e-6850-4e14-881d-e40d3c4ad6e5 None None] thread info: [<_MainThread(MainThread, started 126839257915520)>, , , , , , , ] {{(pid=87444) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 10 04:38:35 devstack cinder-volume[87444]: DEBUG cinder.volume.flows.manager.create_volume [None req-4cf5c7a1-edbf-4f0d-819e-f572263a38f3 tempest-VolumesTestJSON-1537374362 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87444) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 04:38:35 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-4cf5c7a1-edbf-4f0d-819e-f572263a38f3 tempest-VolumesTestJSON-1537374362 None] Flow 'volume_create_manager' (7c5ef898-c450-4559-bb7b-9b1440d66804) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 04:38:35 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-4cf5c7a1-edbf-4f0d-819e-f572263a38f3 tempest-VolumesTestJSON-1537374362 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (66d4b9ce-242c-48b2-849f-8b57c40260ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:38:35 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-4cf5c7a1-edbf-4f0d-819e-f572263a38f3 tempest-VolumesTestJSON-1537374362 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (66d4b9ce-242c-48b2-849f-8b57c40260ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T02:38:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-406250174',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dfa576c6-ab3e-45f1-9f79-fbc394548985,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='2bf91653b8e04fc8b20465f2f733c298',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T02:38:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T02:38:35Z,use_quota=True,user_id='be96d3c6d4fa46caa41b98827727ee62',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(317e369e-1e06-434d-ae95-a335f0e6c903),volume_type_id=317e369e-1e06-434d-ae95-a335f0e6c903)' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:38:35 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-4cf5c7a1-edbf-4f0d-819e-f572263a38f3 tempest-VolumesTestJSON-1537374362 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a08cea06-f0d7-4ba0-ae12-d0fb78c9aaaf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:38:35 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-4cf5c7a1-edbf-4f0d-819e-f572263a38f3 tempest-VolumesTestJSON-1537374362 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a08cea06-f0d7-4ba0-ae12-d0fb78c9aaaf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:38:35 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-4cf5c7a1-edbf-4f0d-819e-f572263a38f3 tempest-VolumesTestJSON-1537374362 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (784a4570-37b0-46f1-9d00-2c6101cea156) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:38:35 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-4cf5c7a1-edbf-4f0d-819e-f572263a38f3 tempest-VolumesTestJSON-1537374362 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (784a4570-37b0-46f1-9d00-2c6101cea156) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'dfa576c6-ab3e-45f1-9f79-fbc394548985', 'volume_name': 'volume-dfa576c6-ab3e-45f1-9f79-fbc394548985', 'volume_size': 1}' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:38:35 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-4cf5c7a1-edbf-4f0d-819e-f572263a38f3 tempest-VolumesTestJSON-1537374362 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dd204038-fd52-4e5d-984e-52c808b1ecd0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:38:35 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-4cf5c7a1-edbf-4f0d-819e-f572263a38f3 tempest-VolumesTestJSON-1537374362 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dd204038-fd52-4e5d-984e-52c808b1ecd0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:38:35 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-4cf5c7a1-edbf-4f0d-819e-f572263a38f3 tempest-VolumesTestJSON-1537374362 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3adc4c15-a73d-4560-a25b-458a85c4f3ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:38:35 devstack cinder-volume[87444]: INFO cinder.volume.flows.manager.create_volume [None req-4cf5c7a1-edbf-4f0d-819e-f572263a38f3 tempest-VolumesTestJSON-1537374362 None] Volume dfa576c6-ab3e-45f1-9f79-fbc394548985: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-dfa576c6-ab3e-45f1-9f79-fbc394548985', 'volume_size': 1} Jul 10 04:38:35 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-4cf5c7a1-edbf-4f0d-819e-f572263a38f3 tempest-VolumesTestJSON-1537374362 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 04:38:35 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-d9559169-2b4d-4f95-917c-a45aab984d32 tempest-AttachVolumeNegativeTest-538483290 None] Acquiring lock "cinder-abbefe22-5fda-470d-a8de-1b7a0eaba97d-delete_volume" by "delete_volume" {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 04:38:35 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-d9559169-2b4d-4f95-917c-a45aab984d32 tempest-AttachVolumeNegativeTest-538483290 None] Lock "cinder-abbefe22-5fda-470d-a8de-1b7a0eaba97d-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 04:38:35 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-d9559169-2b4d-4f95-917c-a45aab984d32 tempest-AttachVolumeNegativeTest-538483290 None] Acquiring lock "cinder-quobyte-abbefe22-5fda-470d-a8de-1b7a0eaba97d" by "delete_volume" {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 04:38:35 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-d9559169-2b4d-4f95-917c-a45aab984d32 tempest-AttachVolumeNegativeTest-538483290 None] Lock "cinder-quobyte-abbefe22-5fda-470d-a8de-1b7a0eaba97d" acquired by "delete_volume" :: waited 0.030s {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 04:38:35 devstack cinder-volume[87444]: DEBUG oslo.privsep.daemon [-] privsep: reply[860f0025-3bb6-4358-953d-e62337b02a83]: (4, 'qcow2') {{(pid=88499) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 04:38:35 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-d9559169-2b4d-4f95-917c-a45aab984d32 tempest-AttachVolumeNegativeTest-538483290 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-abbefe22-5fda-470d-a8de-1b7a0eaba97d {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:38:35 devstack sudo[94869]: pam_unix(sudo:session): session closed for user root Jul 10 04:38:35 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-52a8483b-c1e7-47f5-b3b6-0a6f9bc63939 tempest-GroupsV314Test-1240250205 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-e09f0338-cb01-4dcb-99b6-6d68ac989e0b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-e09f0338-cb01-4dcb-99b6-6d68ac989e0b.c09d1d53-a1b4-4ce0-afdf-e7ff9899a92b 1G" returned: 0 in 2.135s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:38:35 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-52a8483b-c1e7-47f5-b3b6-0a6f9bc63939 tempest-GroupsV314Test-1240250205 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e09f0338-cb01-4dcb-99b6-6d68ac989e0b -F qcow2 /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-e09f0338-cb01-4dcb-99b6-6d68ac989e0b.c09d1d53-a1b4-4ce0-afdf-e7ff9899a92b {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:38:35 devstack sudo[94881]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-abbefe22-5fda-470d-a8de-1b7a0eaba97d Jul 10 04:38:35 devstack sudo[94881]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:38:35 devstack sudo[94883]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e09f0338-cb01-4dcb-99b6-6d68ac989e0b -F qcow2 /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-e09f0338-cb01-4dcb-99b6-6d68ac989e0b.c09d1d53-a1b4-4ce0-afdf-e7ff9899a92b Jul 10 04:38:35 devstack sudo[94883]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:38:36 devstack sudo[94881]: pam_unix(sudo:session): session closed for user root Jul 10 04:38:36 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-d9559169-2b4d-4f95-917c-a45aab984d32 tempest-AttachVolumeNegativeTest-538483290 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-abbefe22-5fda-470d-a8de-1b7a0eaba97d" returned: 0 in 0.839s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:38:36 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-d9559169-2b4d-4f95-917c-a45aab984d32 tempest-AttachVolumeNegativeTest-538483290 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-abbefe22-5fda-470d-a8de-1b7a0eaba97d {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:38:36 devstack sudo[94883]: pam_unix(sudo:session): session closed for user root Jul 10 04:38:36 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-52a8483b-c1e7-47f5-b3b6-0a6f9bc63939 tempest-GroupsV314Test-1240250205 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e09f0338-cb01-4dcb-99b6-6d68ac989e0b -F qcow2 /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-e09f0338-cb01-4dcb-99b6-6d68ac989e0b.c09d1d53-a1b4-4ce0-afdf-e7ff9899a92b" returned: 0 in 0.785s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:38:36 devstack cinder-volume[87444]: WARNING cinder.volume.drivers.remotefs [None req-52a8483b-c1e7-47f5-b3b6-0a6f9bc63939 tempest-GroupsV314Test-1240250205 None] /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-e09f0338-cb01-4dcb-99b6-6d68ac989e0b.c09d1d53-a1b4-4ce0-afdf-e7ff9899a92b is being set with open permissions: ugo+rw: NotImplementedError Jul 10 04:38:36 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-52a8483b-c1e7-47f5-b3b6-0a6f9bc63939 tempest-GroupsV314Test-1240250205 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-e09f0338-cb01-4dcb-99b6-6d68ac989e0b.c09d1d53-a1b4-4ce0-afdf-e7ff9899a92b {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:38:36 devstack sudo[94925]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-abbefe22-5fda-470d-a8de-1b7a0eaba97d Jul 10 04:38:36 devstack sudo[94925]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:38:36 devstack sudo[94931]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-e09f0338-cb01-4dcb-99b6-6d68ac989e0b.c09d1d53-a1b4-4ce0-afdf-e7ff9899a92b Jul 10 04:38:36 devstack sudo[94931]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:38:37 devstack sudo[94931]: pam_unix(sudo:session): session closed for user root Jul 10 04:38:37 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-52a8483b-c1e7-47f5-b3b6-0a6f9bc63939 tempest-GroupsV314Test-1240250205 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-e09f0338-cb01-4dcb-99b6-6d68ac989e0b.c09d1d53-a1b4-4ce0-afdf-e7ff9899a92b" returned: 0 in 0.818s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:38:37 devstack sudo[94925]: pam_unix(sudo:session): session closed for user root Jul 10 04:38:37 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-d9559169-2b4d-4f95-917c-a45aab984d32 tempest-AttachVolumeNegativeTest-538483290 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-abbefe22-5fda-470d-a8de-1b7a0eaba97d" returned: 0 in 0.872s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:38:37 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-d9559169-2b4d-4f95-917c-a45aab984d32 tempest-AttachVolumeNegativeTest-538483290 None] Lock "cinder-quobyte-abbefe22-5fda-470d-a8de-1b7a0eaba97d" released by "delete_volume" :: held 1.766s {{(pid=87444) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 04:38:37 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-52a8483b-c1e7-47f5-b3b6-0a6f9bc63939 tempest-GroupsV314Test-1240250205 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-e09f0338-cb01-4dcb-99b6-6d68ac989e0b.info {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:38:37 devstack sudo[94948]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-e09f0338-cb01-4dcb-99b6-6d68ac989e0b.info Jul 10 04:38:37 devstack sudo[94948]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:38:37 devstack cinder-volume[87444]: DEBUG cinder.quota [None req-d9559169-2b4d-4f95-917c-a45aab984d32 tempest-AttachVolumeNegativeTest-538483290 None] Created reservations ['7afc518c-69ab-4b42-8f0b-6cc4a61bc529', '9f5beddc-4b3f-498f-a464-b1b96bf1659a', 'ff6bdd3a-c59a-4daf-a9bd-5460524c7cf1', '352e8cbd-df50-41c6-b244-89bc529dca24'] {{(pid=87444) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 04:38:37 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-d9559169-2b4d-4f95-917c-a45aab984d32 tempest-AttachVolumeNegativeTest-538483290 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 04:38:37 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-d9559169-2b4d-4f95-917c-a45aab984d32 tempest-AttachVolumeNegativeTest-538483290 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 04:38:37 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-d9559169-2b4d-4f95-917c-a45aab984d32 tempest-AttachVolumeNegativeTest-538483290 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922': None} {{(pid=87444) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 04:38:37 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-d9559169-2b4d-4f95-917c-a45aab984d32 tempest-AttachVolumeNegativeTest-538483290 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922'] {{(pid=87444) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 04:38:37 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-d9559169-2b4d-4f95-917c-a45aab984d32 tempest-AttachVolumeNegativeTest-538483290 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 04:38:37 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-d9559169-2b4d-4f95-917c-a45aab984d32 tempest-AttachVolumeNegativeTest-538483290 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:38:37 devstack sudo[94950]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097 Jul 10 04:38:37 devstack sudo[94950]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:38:38 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-e2b1f01e-54a8-45d0-b8cf-33c8dd6d9144 tempest-AttachVolumeNegativeTest-538483290 None] Acquiring lock "cinder-984497cd-0a44-4b53-abf9-1c2c4ed73d8c-delete_volume" by "delete_volume" {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 04:38:38 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-e2b1f01e-54a8-45d0-b8cf-33c8dd6d9144 tempest-AttachVolumeNegativeTest-538483290 None] Lock "cinder-984497cd-0a44-4b53-abf9-1c2c4ed73d8c-delete_volume" acquired by "delete_volume" :: waited 0.065s {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 04:38:38 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-e2b1f01e-54a8-45d0-b8cf-33c8dd6d9144 tempest-AttachVolumeNegativeTest-538483290 None] Acquiring lock "cinder-quobyte-984497cd-0a44-4b53-abf9-1c2c4ed73d8c" by "delete_volume" {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 04:38:38 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-e2b1f01e-54a8-45d0-b8cf-33c8dd6d9144 tempest-AttachVolumeNegativeTest-538483290 None] Lock "cinder-quobyte-984497cd-0a44-4b53-abf9-1c2c4ed73d8c" acquired by "delete_volume" :: waited 0.038s {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 04:38:38 devstack sudo[94948]: pam_unix(sudo:session): session closed for user root Jul 10 04:38:38 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-52a8483b-c1e7-47f5-b3b6-0a6f9bc63939 tempest-GroupsV314Test-1240250205 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-e09f0338-cb01-4dcb-99b6-6d68ac989e0b.info" returned: 0 in 0.935s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:38:38 devstack cinder-volume[87444]: WARNING cinder.volume.drivers.remotefs [None req-52a8483b-c1e7-47f5-b3b6-0a6f9bc63939 tempest-GroupsV314Test-1240250205 None] /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-e09f0338-cb01-4dcb-99b6-6d68ac989e0b.info is being set with open permissions: ugo+rw: NotImplementedError Jul 10 04:38:38 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-52a8483b-c1e7-47f5-b3b6-0a6f9bc63939 tempest-GroupsV314Test-1240250205 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-e09f0338-cb01-4dcb-99b6-6d68ac989e0b.info {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:38:38 devstack cinder-volume[87444]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc323e93-0542-4733-8ab1-584571d1a7e2]: (4, 'qcow2') {{(pid=88499) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 04:38:38 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-e2b1f01e-54a8-45d0-b8cf-33c8dd6d9144 tempest-AttachVolumeNegativeTest-538483290 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-984497cd-0a44-4b53-abf9-1c2c4ed73d8c {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:38:38 devstack sudo[94954]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-e09f0338-cb01-4dcb-99b6-6d68ac989e0b.info Jul 10 04:38:38 devstack sudo[94954]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:38:38 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-db47186c-7920-4977-be5a-811632f2d440 tempest-ServerRescueNegativeTestJSON-1920570579 None] Acquiring lock "cinder-e44ceeeb-1d2d-4f94-9705-2697174ac171-delete_volume" by "delete_volume" {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 04:38:38 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-db47186c-7920-4977-be5a-811632f2d440 tempest-ServerRescueNegativeTestJSON-1920570579 None] Lock "cinder-e44ceeeb-1d2d-4f94-9705-2697174ac171-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 04:38:38 devstack sudo[94955]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-984497cd-0a44-4b53-abf9-1c2c4ed73d8c Jul 10 04:38:38 devstack sudo[94955]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:38:38 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-db47186c-7920-4977-be5a-811632f2d440 tempest-ServerRescueNegativeTestJSON-1920570579 None] Acquiring lock "cinder-quobyte-e44ceeeb-1d2d-4f94-9705-2697174ac171" by "delete_volume" {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 04:38:38 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-db47186c-7920-4977-be5a-811632f2d440 tempest-ServerRescueNegativeTestJSON-1920570579 None] Lock "cinder-quobyte-e44ceeeb-1d2d-4f94-9705-2697174ac171" acquired by "delete_volume" :: waited 0.048s {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 04:38:38 devstack sudo[94950]: pam_unix(sudo:session): session closed for user root Jul 10 04:38:38 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-d9559169-2b4d-4f95-917c-a45aab984d32 tempest-AttachVolumeNegativeTest-538483290 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097" returned: 0 in 1.218s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:38:38 devstack cinder-volume[87444]: DEBUG cinder.manager [None req-d9559169-2b4d-4f95-917c-a45aab984d32 tempest-AttachVolumeNegativeTest-538483290 None] Notifying Schedulers of capabilities ... {{(pid=87444) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 04:38:38 devstack cinder-volume[87444]: INFO cinder.volume.manager [None req-d9559169-2b4d-4f95-917c-a45aab984d32 tempest-AttachVolumeNegativeTest-538483290 None] Deleted volume successfully. Jul 10 04:38:38 devstack cinder-volume[87444]: DEBUG oslo.privsep.daemon [-] privsep: reply[1081d61d-58af-4af7-a835-20c91cee497e]: (4, 'qcow2') {{(pid=88499) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 04:38:38 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-db47186c-7920-4977-be5a-811632f2d440 tempest-ServerRescueNegativeTestJSON-1920570579 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-e44ceeeb-1d2d-4f94-9705-2697174ac171 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:38:38 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-d9559169-2b4d-4f95-917c-a45aab984d32 tempest-AttachVolumeNegativeTest-538483290 None] Lock "cinder-abbefe22-5fda-470d-a8de-1b7a0eaba97d-delete_volume" released by "delete_volume" :: held 3.331s {{(pid=87444) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 04:38:39 devstack sudo[94959]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-e44ceeeb-1d2d-4f94-9705-2697174ac171 Jul 10 04:38:39 devstack sudo[94959]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:38:39 devstack sudo[94954]: pam_unix(sudo:session): session closed for user root Jul 10 04:38:39 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-52a8483b-c1e7-47f5-b3b6-0a6f9bc63939 tempest-GroupsV314Test-1240250205 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-e09f0338-cb01-4dcb-99b6-6d68ac989e0b.info" returned: 0 in 1.250s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:38:39 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-52a8483b-c1e7-47f5-b3b6-0a6f9bc63939 tempest-GroupsV314Test-1240250205 None] Acquiring lock "cinder-quobyte-a4140352-58bc-4a6c-b55e-2e7ac27e716d" by "_copy_volume_from_snapshot" {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 04:38:39 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-52a8483b-c1e7-47f5-b3b6-0a6f9bc63939 tempest-GroupsV314Test-1240250205 None] Lock "cinder-quobyte-a4140352-58bc-4a6c-b55e-2e7ac27e716d" acquired by "_copy_volume_from_snapshot" :: waited 0.027s {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 04:38:39 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-52a8483b-c1e7-47f5-b3b6-0a6f9bc63939 tempest-GroupsV314Test-1240250205 None] snapshot: c09d1d53-a1b4-4ce0-afdf-e7ff9899a92b, volume: a4140352-58bc-4a6c-b55e-2e7ac27e716d, {{(pid=87444) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jul 10 04:38:39 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-52a8483b-c1e7-47f5-b3b6-0a6f9bc63939 tempest-GroupsV314Test-1240250205 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 04:38:39 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-52a8483b-c1e7-47f5-b3b6-0a6f9bc63939 tempest-GroupsV314Test-1240250205 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 04:38:39 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-52a8483b-c1e7-47f5-b3b6-0a6f9bc63939 tempest-GroupsV314Test-1240250205 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922': None} {{(pid=87444) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 04:38:39 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-52a8483b-c1e7-47f5-b3b6-0a6f9bc63939 tempest-GroupsV314Test-1240250205 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922'] {{(pid=87444) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 04:38:39 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-52a8483b-c1e7-47f5-b3b6-0a6f9bc63939 tempest-GroupsV314Test-1240250205 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 04:38:39 devstack cinder-volume[87444]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4131e62-b646-4e2b-803f-f7e417162466]: (4, 'qcow2') {{(pid=88499) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 04:38:39 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-52a8483b-c1e7-47f5-b3b6-0a6f9bc63939 tempest-GroupsV314Test-1240250205 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-e09f0338-cb01-4dcb-99b6-6d68ac989e0b.c09d1d53-a1b4-4ce0-afdf-e7ff9899a92b {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:38:39 devstack sudo[94955]: pam_unix(sudo:session): session closed for user root Jul 10 04:38:39 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-e2b1f01e-54a8-45d0-b8cf-33c8dd6d9144 tempest-AttachVolumeNegativeTest-538483290 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-984497cd-0a44-4b53-abf9-1c2c4ed73d8c" returned: 0 in 1.412s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:38:39 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-e2b1f01e-54a8-45d0-b8cf-33c8dd6d9144 tempest-AttachVolumeNegativeTest-538483290 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-984497cd-0a44-4b53-abf9-1c2c4ed73d8c {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:38:39 devstack sudo[94970]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-984497cd-0a44-4b53-abf9-1c2c4ed73d8c Jul 10 04:38:39 devstack sudo[94970]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:38:39 devstack sudo[94969]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-e09f0338-cb01-4dcb-99b6-6d68ac989e0b.c09d1d53-a1b4-4ce0-afdf-e7ff9899a92b Jul 10 04:38:39 devstack sudo[94969]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:38:39 devstack sudo[94959]: pam_unix(sudo:session): session closed for user root Jul 10 04:38:39 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-db47186c-7920-4977-be5a-811632f2d440 tempest-ServerRescueNegativeTestJSON-1920570579 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-e44ceeeb-1d2d-4f94-9705-2697174ac171" returned: 0 in 1.095s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:38:39 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-db47186c-7920-4977-be5a-811632f2d440 tempest-ServerRescueNegativeTestJSON-1920570579 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-e44ceeeb-1d2d-4f94-9705-2697174ac171 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:38:39 devstack sudo[94973]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-e44ceeeb-1d2d-4f94-9705-2697174ac171 Jul 10 04:38:39 devstack sudo[94973]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:38:40 devstack sudo[94970]: pam_unix(sudo:session): session closed for user root Jul 10 04:38:40 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-e2b1f01e-54a8-45d0-b8cf-33c8dd6d9144 tempest-AttachVolumeNegativeTest-538483290 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-984497cd-0a44-4b53-abf9-1c2c4ed73d8c" returned: 0 in 0.906s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:38:40 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-e2b1f01e-54a8-45d0-b8cf-33c8dd6d9144 tempest-AttachVolumeNegativeTest-538483290 None] Lock "cinder-quobyte-984497cd-0a44-4b53-abf9-1c2c4ed73d8c" released by "delete_volume" :: held 2.401s {{(pid=87444) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 04:38:40 devstack sudo[94973]: pam_unix(sudo:session): session closed for user root Jul 10 04:38:40 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-db47186c-7920-4977-be5a-811632f2d440 tempest-ServerRescueNegativeTestJSON-1920570579 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-e44ceeeb-1d2d-4f94-9705-2697174ac171" returned: 0 in 0.895s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:38:40 devstack sudo[94969]: pam_unix(sudo:session): session closed for user root Jul 10 04:38:40 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-52a8483b-c1e7-47f5-b3b6-0a6f9bc63939 tempest-GroupsV314Test-1240250205 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-e09f0338-cb01-4dcb-99b6-6d68ac989e0b.c09d1d53-a1b4-4ce0-afdf-e7ff9899a92b" returned: 0 in 1.106s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:38:40 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.remotefs [None req-52a8483b-c1e7-47f5-b3b6-0a6f9bc63939 tempest-GroupsV314Test-1240250205 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e09f0338-cb01-4dcb-99b6-6d68ac989e0b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87444) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 10 04:38:40 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-52a8483b-c1e7-47f5-b3b6-0a6f9bc63939 tempest-GroupsV314Test-1240250205 None] will copy from snapshot at /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-e09f0338-cb01-4dcb-99b6-6d68ac989e0b {{(pid=87444) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jul 10 04:38:40 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-52a8483b-c1e7-47f5-b3b6-0a6f9bc63939 tempest-GroupsV314Test-1240250205 None] Creating direct copy from snapshot {{(pid=87444) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jul 10 04:38:40 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-db47186c-7920-4977-be5a-811632f2d440 tempest-ServerRescueNegativeTestJSON-1920570579 None] Lock "cinder-quobyte-e44ceeeb-1d2d-4f94-9705-2697174ac171" released by "delete_volume" :: held 2.122s {{(pid=87444) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 04:38:40 devstack cinder-volume[87444]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a74ccaa-22ad-4372-bc0e-758159d74691]: (4, 'qcow2') {{(pid=88499) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 04:38:40 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-52a8483b-c1e7-47f5-b3b6-0a6f9bc63939 tempest-GroupsV314Test-1240250205 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-e09f0338-cb01-4dcb-99b6-6d68ac989e0b {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:38:40 devstack cinder-volume[87444]: DEBUG cinder.quota [None req-e2b1f01e-54a8-45d0-b8cf-33c8dd6d9144 tempest-AttachVolumeNegativeTest-538483290 None] Created reservations ['84e217b1-a295-4fa0-a9d3-c49e4e0690ab', '6d91e636-5e6f-4f7b-9092-0a90ba25e801', 'f14f9369-887e-4c08-9ae1-de81f104a453', '173eecad-0d06-4c60-8a46-735c40d12f78'] {{(pid=87444) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 04:38:40 devstack cinder-volume[87444]: DEBUG cinder.quota [None req-db47186c-7920-4977-be5a-811632f2d440 tempest-ServerRescueNegativeTestJSON-1920570579 None] Created reservations ['3e19f011-2060-47a6-b791-b2dd0937d676', '8e794b29-2487-41f4-babe-c49d6250eddf', '8be06eea-4746-4b54-b347-ce2039b8b5f2', '2056506e-6c33-44c3-a0de-cd4671101ad0'] {{(pid=87444) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 04:38:40 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-e2b1f01e-54a8-45d0-b8cf-33c8dd6d9144 tempest-AttachVolumeNegativeTest-538483290 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 04:38:40 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-e2b1f01e-54a8-45d0-b8cf-33c8dd6d9144 tempest-AttachVolumeNegativeTest-538483290 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 04:38:40 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-e2b1f01e-54a8-45d0-b8cf-33c8dd6d9144 tempest-AttachVolumeNegativeTest-538483290 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922': None} {{(pid=87444) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 04:38:41 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-e2b1f01e-54a8-45d0-b8cf-33c8dd6d9144 tempest-AttachVolumeNegativeTest-538483290 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922'] {{(pid=87444) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 04:38:41 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-e2b1f01e-54a8-45d0-b8cf-33c8dd6d9144 tempest-AttachVolumeNegativeTest-538483290 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 04:38:41 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-e2b1f01e-54a8-45d0-b8cf-33c8dd6d9144 tempest-AttachVolumeNegativeTest-538483290 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:38:41 devstack sudo[94982]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097 Jul 10 04:38:41 devstack sudo[94982]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:38:41 devstack sudo[94981]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-e09f0338-cb01-4dcb-99b6-6d68ac989e0b Jul 10 04:38:41 devstack sudo[94981]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:38:41 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-db47186c-7920-4977-be5a-811632f2d440 tempest-ServerRescueNegativeTestJSON-1920570579 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 04:38:41 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-db47186c-7920-4977-be5a-811632f2d440 tempest-ServerRescueNegativeTestJSON-1920570579 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 04:38:41 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-db47186c-7920-4977-be5a-811632f2d440 tempest-ServerRescueNegativeTestJSON-1920570579 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922': None} {{(pid=87444) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 04:38:41 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-db47186c-7920-4977-be5a-811632f2d440 tempest-ServerRescueNegativeTestJSON-1920570579 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922'] {{(pid=87444) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 04:38:41 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-db47186c-7920-4977-be5a-811632f2d440 tempest-ServerRescueNegativeTestJSON-1920570579 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 04:38:41 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-db47186c-7920-4977-be5a-811632f2d440 tempest-ServerRescueNegativeTestJSON-1920570579 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:38:41 devstack sudo[94985]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097 Jul 10 04:38:41 devstack sudo[94985]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:38:41 devstack sudo[94981]: pam_unix(sudo:session): session closed for user root Jul 10 04:38:41 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-52a8483b-c1e7-47f5-b3b6-0a6f9bc63939 tempest-GroupsV314Test-1240250205 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-e09f0338-cb01-4dcb-99b6-6d68ac989e0b" returned: 0 in 1.036s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:38:41 devstack cinder-volume[87444]: DEBUG cinder.utils [None req-52a8483b-c1e7-47f5-b3b6-0a6f9bc63939 tempest-GroupsV314Test-1240250205 None] Path /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-a4140352-58bc-4a6c-b55e-2e7ac27e716d not found in is_blk_device check {{(pid=87444) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 10 04:38:41 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-52a8483b-c1e7-47f5-b3b6-0a6f9bc63939 tempest-GroupsV314Test-1240250205 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-e09f0338-cb01-4dcb-99b6-6d68ac989e0b /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-a4140352-58bc-4a6c-b55e-2e7ac27e716d {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:38:41 devstack sudo[94991]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-e09f0338-cb01-4dcb-99b6-6d68ac989e0b /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-a4140352-58bc-4a6c-b55e-2e7ac27e716d Jul 10 04:38:41 devstack sudo[94991]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:38:42 devstack sudo[94982]: pam_unix(sudo:session): session closed for user root Jul 10 04:38:42 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-e2b1f01e-54a8-45d0-b8cf-33c8dd6d9144 tempest-AttachVolumeNegativeTest-538483290 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097" returned: 0 in 1.002s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:38:42 devstack cinder-volume[87444]: DEBUG cinder.manager [None req-e2b1f01e-54a8-45d0-b8cf-33c8dd6d9144 tempest-AttachVolumeNegativeTest-538483290 None] Notifying Schedulers of capabilities ... {{(pid=87444) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 04:38:42 devstack cinder-volume[87444]: INFO cinder.volume.manager [None req-e2b1f01e-54a8-45d0-b8cf-33c8dd6d9144 tempest-AttachVolumeNegativeTest-538483290 None] Deleted volume successfully. Jul 10 04:38:42 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-e2b1f01e-54a8-45d0-b8cf-33c8dd6d9144 tempest-AttachVolumeNegativeTest-538483290 None] Lock "cinder-984497cd-0a44-4b53-abf9-1c2c4ed73d8c-delete_volume" released by "delete_volume" :: held 3.842s {{(pid=87444) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 04:38:42 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-e64af31d-5966-4445-aa68-d9eb8bb42589 tempest-AttachVolumeNegativeTest-538483290 None] Acquiring lock "cinder-4462598e-fc33-4db1-884b-d68b9fce2f26-delete_volume" by "delete_volume" {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 04:38:42 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-e64af31d-5966-4445-aa68-d9eb8bb42589 tempest-AttachVolumeNegativeTest-538483290 None] Lock "cinder-4462598e-fc33-4db1-884b-d68b9fce2f26-delete_volume" acquired by "delete_volume" :: waited 0.047s {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 04:38:42 devstack sudo[94985]: pam_unix(sudo:session): session closed for user root Jul 10 04:38:42 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-db47186c-7920-4977-be5a-811632f2d440 tempest-ServerRescueNegativeTestJSON-1920570579 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097" returned: 0 in 1.165s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:38:42 devstack cinder-volume[87444]: DEBUG cinder.manager [None req-db47186c-7920-4977-be5a-811632f2d440 tempest-ServerRescueNegativeTestJSON-1920570579 None] Notifying Schedulers of capabilities ... {{(pid=87444) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 04:38:42 devstack cinder-volume[87444]: INFO cinder.volume.manager [None req-db47186c-7920-4977-be5a-811632f2d440 tempest-ServerRescueNegativeTestJSON-1920570579 None] Deleted volume successfully. Jul 10 04:38:42 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-db47186c-7920-4977-be5a-811632f2d440 tempest-ServerRescueNegativeTestJSON-1920570579 None] Lock "cinder-e44ceeeb-1d2d-4f94-9705-2697174ac171-delete_volume" released by "delete_volume" :: held 3.674s {{(pid=87444) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 04:38:42 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-e64af31d-5966-4445-aa68-d9eb8bb42589 tempest-AttachVolumeNegativeTest-538483290 None] Acquiring lock "cinder-quobyte-4462598e-fc33-4db1-884b-d68b9fce2f26" by "delete_volume" {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 04:38:42 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-e64af31d-5966-4445-aa68-d9eb8bb42589 tempest-AttachVolumeNegativeTest-538483290 None] Lock "cinder-quobyte-4462598e-fc33-4db1-884b-d68b9fce2f26" acquired by "delete_volume" :: waited 0.034s {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 04:38:42 devstack cinder-volume[87444]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b529dcc-69d1-48ca-b595-84b20e162376]: (4, 'qcow2') {{(pid=88499) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 04:38:42 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-e64af31d-5966-4445-aa68-d9eb8bb42589 tempest-AttachVolumeNegativeTest-538483290 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-4462598e-fc33-4db1-884b-d68b9fce2f26 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:38:42 devstack sudo[94994]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-4462598e-fc33-4db1-884b-d68b9fce2f26 Jul 10 04:38:42 devstack sudo[94994]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:38:43 devstack sudo[94994]: pam_unix(sudo:session): session closed for user root Jul 10 04:38:43 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-e64af31d-5966-4445-aa68-d9eb8bb42589 tempest-AttachVolumeNegativeTest-538483290 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-4462598e-fc33-4db1-884b-d68b9fce2f26" returned: 0 in 1.240s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:38:43 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-e64af31d-5966-4445-aa68-d9eb8bb42589 tempest-AttachVolumeNegativeTest-538483290 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-4462598e-fc33-4db1-884b-d68b9fce2f26 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:38:43 devstack sudo[95029]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-4462598e-fc33-4db1-884b-d68b9fce2f26 Jul 10 04:38:43 devstack sudo[95029]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:38:45 devstack sudo[95029]: pam_unix(sudo:session): session closed for user root Jul 10 04:38:45 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-e64af31d-5966-4445-aa68-d9eb8bb42589 tempest-AttachVolumeNegativeTest-538483290 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-4462598e-fc33-4db1-884b-d68b9fce2f26" returned: 0 in 1.958s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:38:45 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-e64af31d-5966-4445-aa68-d9eb8bb42589 tempest-AttachVolumeNegativeTest-538483290 None] Lock "cinder-quobyte-4462598e-fc33-4db1-884b-d68b9fce2f26" released by "delete_volume" :: held 3.305s {{(pid=87444) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 04:38:45 devstack cinder-volume[87444]: DEBUG dbcounter [-] [87444] Writing DB stats cinder:SELECT=83,cinder:UPDATE=90,cinder:INSERT=23,cinder:DELETE=8 {{(pid=87444) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 10 04:38:45 devstack cinder-volume[87444]: DEBUG dbcounter [-] [87444] Writing DB stats cinder:SELECT=88,cinder:UPDATE=87,cinder:INSERT=18,cinder:DELETE=3 {{(pid=87444) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 10 04:38:45 devstack cinder-volume[87444]: DEBUG cinder.quota [None req-e64af31d-5966-4445-aa68-d9eb8bb42589 tempest-AttachVolumeNegativeTest-538483290 None] Created reservations ['2d773cea-8186-4eac-9485-0d9509f9afac', '65a5cd00-c3f3-4e1a-9568-064dd85bf65d', '7992a377-0bc4-4603-b3c2-ae8150fa65c1', '6c220a80-889f-4f7d-b948-d1d6b60131f6'] {{(pid=87444) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 04:38:46 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-e64af31d-5966-4445-aa68-d9eb8bb42589 tempest-AttachVolumeNegativeTest-538483290 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 04:38:46 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-e64af31d-5966-4445-aa68-d9eb8bb42589 tempest-AttachVolumeNegativeTest-538483290 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 04:38:46 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-e64af31d-5966-4445-aa68-d9eb8bb42589 tempest-AttachVolumeNegativeTest-538483290 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922': None} {{(pid=87444) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 04:38:46 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-e64af31d-5966-4445-aa68-d9eb8bb42589 tempest-AttachVolumeNegativeTest-538483290 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922'] {{(pid=87444) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 04:38:46 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-e64af31d-5966-4445-aa68-d9eb8bb42589 tempest-AttachVolumeNegativeTest-538483290 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.044s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 04:38:46 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-e64af31d-5966-4445-aa68-d9eb8bb42589 tempest-AttachVolumeNegativeTest-538483290 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:38:46 devstack sudo[95059]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097 Jul 10 04:38:46 devstack sudo[95059]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:38:48 devstack sudo[95059]: pam_unix(sudo:session): session closed for user root Jul 10 04:38:48 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-e64af31d-5966-4445-aa68-d9eb8bb42589 tempest-AttachVolumeNegativeTest-538483290 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097" returned: 0 in 2.576s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:38:48 devstack cinder-volume[87444]: DEBUG cinder.manager [None req-e64af31d-5966-4445-aa68-d9eb8bb42589 tempest-AttachVolumeNegativeTest-538483290 None] Notifying Schedulers of capabilities ... {{(pid=87444) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 04:38:48 devstack cinder-volume[87444]: INFO cinder.volume.manager [None req-e64af31d-5966-4445-aa68-d9eb8bb42589 tempest-AttachVolumeNegativeTest-538483290 None] Deleted volume successfully. Jul 10 04:38:48 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-e64af31d-5966-4445-aa68-d9eb8bb42589 tempest-AttachVolumeNegativeTest-538483290 None] Lock "cinder-4462598e-fc33-4db1-884b-d68b9fce2f26-delete_volume" released by "delete_volume" :: held 6.663s {{(pid=87444) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 04:38:51 devstack sudo[94991]: pam_unix(sudo:session): session closed for user root Jul 10 04:38:51 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-52a8483b-c1e7-47f5-b3b6-0a6f9bc63939 tempest-GroupsV314Test-1240250205 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-e09f0338-cb01-4dcb-99b6-6d68ac989e0b /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-a4140352-58bc-4a6c-b55e-2e7ac27e716d" returned: 0 in 9.293s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:38:51 devstack cinder-volume[87444]: DEBUG oslo.privsep.daemon [-] privsep: reply[20616258-b678-4180-b007-5a7dfd42521f]: (4, 'qcow2') {{(pid=88499) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 04:38:51 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-52a8483b-c1e7-47f5-b3b6-0a6f9bc63939 tempest-GroupsV314Test-1240250205 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-e09f0338-cb01-4dcb-99b6-6d68ac989e0b {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:38:51 devstack sudo[95067]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-e09f0338-cb01-4dcb-99b6-6d68ac989e0b Jul 10 04:38:51 devstack sudo[95067]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:38:52 devstack sudo[95067]: pam_unix(sudo:session): session closed for user root Jul 10 04:38:52 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-52a8483b-c1e7-47f5-b3b6-0a6f9bc63939 tempest-GroupsV314Test-1240250205 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-e09f0338-cb01-4dcb-99b6-6d68ac989e0b" returned: 0 in 0.976s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:38:52 devstack cinder-volume[87444]: DEBUG cinder.image.image_utils [None req-52a8483b-c1e7-47f5-b3b6-0a6f9bc63939 tempest-GroupsV314Test-1240250205 None] Image conversion details: src /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-e09f0338-cb01-4dcb-99b6-6d68ac989e0b, size 1024.00 MB, duration 9.29 sec, destination /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-a4140352-58bc-4a6c-b55e-2e7ac27e716d {{(pid=87444) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:561}} Jul 10 04:38:52 devstack cinder-volume[87444]: INFO cinder.image.image_utils [None req-52a8483b-c1e7-47f5-b3b6-0a6f9bc63939 tempest-GroupsV314Test-1240250205 None] Converted 1024.00 MB image at 110.18 MB/s Jul 10 04:38:52 devstack cinder-volume[87444]: WARNING cinder.volume.drivers.remotefs [None req-52a8483b-c1e7-47f5-b3b6-0a6f9bc63939 tempest-GroupsV314Test-1240250205 None] /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-a4140352-58bc-4a6c-b55e-2e7ac27e716d is being set with open permissions: ugo+rw: NotImplementedError Jul 10 04:38:52 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-52a8483b-c1e7-47f5-b3b6-0a6f9bc63939 tempest-GroupsV314Test-1240250205 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-a4140352-58bc-4a6c-b55e-2e7ac27e716d {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:38:52 devstack sudo[95073]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-a4140352-58bc-4a6c-b55e-2e7ac27e716d Jul 10 04:38:52 devstack sudo[95073]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:38:52 devstack sudo[95073]: pam_unix(sudo:session): session closed for user root Jul 10 04:38:52 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-52a8483b-c1e7-47f5-b3b6-0a6f9bc63939 tempest-GroupsV314Test-1240250205 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-a4140352-58bc-4a6c-b55e-2e7ac27e716d" returned: 0 in 0.698s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:38:52 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-52a8483b-c1e7-47f5-b3b6-0a6f9bc63939 tempest-GroupsV314Test-1240250205 None] Lock "cinder-quobyte-a4140352-58bc-4a6c-b55e-2e7ac27e716d" released by "_copy_volume_from_snapshot" :: held 13.218s {{(pid=87444) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 04:38:52 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-52a8483b-c1e7-47f5-b3b6-0a6f9bc63939 tempest-GroupsV314Test-1240250205 None] Acquiring lock "cinder-quobyte-c09d1d53-a1b4-4ce0-afdf-e7ff9899a92b" by "_delete_snapshot" {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 04:38:52 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-52a8483b-c1e7-47f5-b3b6-0a6f9bc63939 tempest-GroupsV314Test-1240250205 None] Lock "cinder-quobyte-c09d1d53-a1b4-4ce0-afdf-e7ff9899a92b" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 04:38:52 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.remotefs [None req-52a8483b-c1e7-47f5-b3b6-0a6f9bc63939 tempest-GroupsV314Test-1240250205 None] Deleting offline snapshot c09d1d53-a1b4-4ce0-afdf-e7ff9899a92b of volume e09f0338-cb01-4dcb-99b6-6d68ac989e0b {{(pid=87444) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 10 04:38:52 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.remotefs [None req-52a8483b-c1e7-47f5-b3b6-0a6f9bc63939 tempest-GroupsV314Test-1240250205 None] snapshot_file for this snap is: volume-e09f0338-cb01-4dcb-99b6-6d68ac989e0b.c09d1d53-a1b4-4ce0-afdf-e7ff9899a92b {{(pid=87444) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 10 04:38:53 devstack cinder-volume[87444]: DEBUG oslo.privsep.daemon [-] privsep: reply[4460fd9e-56ba-44d1-8a04-9b91d2d5dff8]: (4, 'qcow2') {{(pid=88499) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 04:38:53 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-52a8483b-c1e7-47f5-b3b6-0a6f9bc63939 tempest-GroupsV314Test-1240250205 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-e09f0338-cb01-4dcb-99b6-6d68ac989e0b.c09d1d53-a1b4-4ce0-afdf-e7ff9899a92b {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:38:53 devstack sudo[95077]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-e09f0338-cb01-4dcb-99b6-6d68ac989e0b.c09d1d53-a1b4-4ce0-afdf-e7ff9899a92b Jul 10 04:38:53 devstack sudo[95077]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:38:53 devstack sudo[95077]: pam_unix(sudo:session): session closed for user root Jul 10 04:38:53 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-52a8483b-c1e7-47f5-b3b6-0a6f9bc63939 tempest-GroupsV314Test-1240250205 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-e09f0338-cb01-4dcb-99b6-6d68ac989e0b.c09d1d53-a1b4-4ce0-afdf-e7ff9899a92b" returned: 0 in 0.890s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:38:53 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.remotefs [None req-52a8483b-c1e7-47f5-b3b6-0a6f9bc63939 tempest-GroupsV314Test-1240250205 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e09f0338-cb01-4dcb-99b6-6d68ac989e0b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87444) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 10 04:38:53 devstack cinder-volume[87444]: DEBUG oslo.privsep.daemon [-] privsep: reply[08861648-2824-4a35-a62e-d74c6ed2ba3a]: (4, 'qcow2') {{(pid=88499) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 04:38:53 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-52a8483b-c1e7-47f5-b3b6-0a6f9bc63939 tempest-GroupsV314Test-1240250205 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-e09f0338-cb01-4dcb-99b6-6d68ac989e0b {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:38:54 devstack sudo[95082]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-e09f0338-cb01-4dcb-99b6-6d68ac989e0b Jul 10 04:38:54 devstack sudo[95082]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:38:54 devstack sudo[95082]: pam_unix(sudo:session): session closed for user root Jul 10 04:38:54 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-52a8483b-c1e7-47f5-b3b6-0a6f9bc63939 tempest-GroupsV314Test-1240250205 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-e09f0338-cb01-4dcb-99b6-6d68ac989e0b" returned: 0 in 0.910s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:38:54 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-52a8483b-c1e7-47f5-b3b6-0a6f9bc63939 tempest-GroupsV314Test-1240250205 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-e09f0338-cb01-4dcb-99b6-6d68ac989e0b.c09d1d53-a1b4-4ce0-afdf-e7ff9899a92b {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:38:54 devstack sudo[95093]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-e09f0338-cb01-4dcb-99b6-6d68ac989e0b.c09d1d53-a1b4-4ce0-afdf-e7ff9899a92b Jul 10 04:38:54 devstack sudo[95093]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:38:55 devstack sudo[95093]: pam_unix(sudo:session): session closed for user root Jul 10 04:38:55 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-52a8483b-c1e7-47f5-b3b6-0a6f9bc63939 tempest-GroupsV314Test-1240250205 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-e09f0338-cb01-4dcb-99b6-6d68ac989e0b.c09d1d53-a1b4-4ce0-afdf-e7ff9899a92b" returned: 0 in 1.095s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:38:55 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-52a8483b-c1e7-47f5-b3b6-0a6f9bc63939 tempest-GroupsV314Test-1240250205 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-e09f0338-cb01-4dcb-99b6-6d68ac989e0b.c09d1d53-a1b4-4ce0-afdf-e7ff9899a92b {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:38:55 devstack cinder-volume[87444]: DEBUG dbcounter [-] [87444] Writing DB stats cinder:SELECT=3,cinder:INSERT=4,cinder:UPDATE=6 {{(pid=87444) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 10 04:38:55 devstack sudo[95117]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-e09f0338-cb01-4dcb-99b6-6d68ac989e0b.c09d1d53-a1b4-4ce0-afdf-e7ff9899a92b Jul 10 04:38:55 devstack sudo[95117]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:38:56 devstack sudo[95117]: pam_unix(sudo:session): session closed for user root Jul 10 04:38:56 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-52a8483b-c1e7-47f5-b3b6-0a6f9bc63939 tempest-GroupsV314Test-1240250205 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-e09f0338-cb01-4dcb-99b6-6d68ac989e0b.c09d1d53-a1b4-4ce0-afdf-e7ff9899a92b" returned: 0 in 0.710s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:38:56 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-52a8483b-c1e7-47f5-b3b6-0a6f9bc63939 tempest-GroupsV314Test-1240250205 None] Lock "cinder-quobyte-c09d1d53-a1b4-4ce0-afdf-e7ff9899a92b" released by "_delete_snapshot" :: held 3.735s {{(pid=87444) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 04:38:56 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-52a8483b-c1e7-47f5-b3b6-0a6f9bc63939 tempest-GroupsV314Test-1240250205 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 24.284s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 04:38:56 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-4cf5c7a1-edbf-4f0d-819e-f572263a38f3 tempest-VolumesTestJSON-1537374362 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 21.179s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 04:38:56 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-4cf5c7a1-edbf-4f0d-819e-f572263a38f3 tempest-VolumesTestJSON-1537374362 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T02:38:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-406250174',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dfa576c6-ab3e-45f1-9f79-fbc394548985,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='2bf91653b8e04fc8b20465f2f733c298',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T02:38:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T02:38:35Z,use_quota=True,user_id='be96d3c6d4fa46caa41b98827727ee62',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(317e369e-1e06-434d-ae95-a335f0e6c903),volume_type_id=317e369e-1e06-434d-ae95-a335f0e6c903)}" {{(pid=87444) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 04:38:56 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.remotefs [None req-4cf5c7a1-edbf-4f0d-819e-f572263a38f3 tempest-VolumesTestJSON-1537374362 None] Creating volume dfa576c6-ab3e-45f1-9f79-fbc394548985 {{(pid=87444) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 04:38:56 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-4cf5c7a1-edbf-4f0d-819e-f572263a38f3 tempest-VolumesTestJSON-1537374362 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 04:38:56 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-4cf5c7a1-edbf-4f0d-819e-f572263a38f3 tempest-VolumesTestJSON-1537374362 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 04:38:56 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-4cf5c7a1-edbf-4f0d-819e-f572263a38f3 tempest-VolumesTestJSON-1537374362 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922': None} {{(pid=87444) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 04:38:56 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-4cf5c7a1-edbf-4f0d-819e-f572263a38f3 tempest-VolumesTestJSON-1537374362 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922'] {{(pid=87444) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 04:38:56 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-4cf5c7a1-edbf-4f0d-819e-f572263a38f3 tempest-VolumesTestJSON-1537374362 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 04:38:56 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-4cf5c7a1-edbf-4f0d-819e-f572263a38f3 tempest-VolumesTestJSON-1537374362 None] Selected osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922 as target Quobyte volume. {{(pid=87444) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 04:38:56 devstack cinder-volume[87444]: INFO cinder.volume.drivers.remotefs [None req-4cf5c7a1-edbf-4f0d-819e-f572263a38f3 tempest-VolumesTestJSON-1537374362 None] casted to osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922 Jul 10 04:38:56 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-4cf5c7a1-edbf-4f0d-819e-f572263a38f3 tempest-VolumesTestJSON-1537374362 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-dfa576c6-ab3e-45f1-9f79-fbc394548985 1073741824 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:38:56 devstack sudo[95121]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-dfa576c6-ab3e-45f1-9f79-fbc394548985 1073741824 Jul 10 04:38:56 devstack sudo[95121]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:38:56 devstack cinder-volume[87444]: INFO cinder.volume.manager [None req-52a8483b-c1e7-47f5-b3b6-0a6f9bc63939 tempest-GroupsV314Test-1240250205 None] Create group from source-group-964c9a7d-032b-46da-90b3-e20a19b02f90 completed successfully. Jul 10 04:38:57 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-e882932a-39c0-4dac-a208-dcb329d85430 tempest-GroupsV314Test-1240250205 None] Acquiring lock "cinder-quobyte-a4140352-58bc-4a6c-b55e-2e7ac27e716d" by "delete_volume" {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 04:38:57 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-e882932a-39c0-4dac-a208-dcb329d85430 tempest-GroupsV314Test-1240250205 None] Lock "cinder-quobyte-a4140352-58bc-4a6c-b55e-2e7ac27e716d" acquired by "delete_volume" :: waited 0.020s {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 04:38:57 devstack cinder-volume[87444]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce72dd7b-f3ad-41b9-8e10-2d7959ce827d]: (4, 'qcow2') {{(pid=88499) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 04:38:57 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-e882932a-39c0-4dac-a208-dcb329d85430 tempest-GroupsV314Test-1240250205 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-a4140352-58bc-4a6c-b55e-2e7ac27e716d {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:38:57 devstack sudo[95127]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-a4140352-58bc-4a6c-b55e-2e7ac27e716d Jul 10 04:38:57 devstack sudo[95127]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:38:57 devstack sudo[95121]: pam_unix(sudo:session): session closed for user root Jul 10 04:38:57 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-4cf5c7a1-edbf-4f0d-819e-f572263a38f3 tempest-VolumesTestJSON-1537374362 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-dfa576c6-ab3e-45f1-9f79-fbc394548985 1073741824" returned: 0 in 1.024s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:38:57 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-4cf5c7a1-edbf-4f0d-819e-f572263a38f3 tempest-VolumesTestJSON-1537374362 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-dfa576c6-ab3e-45f1-9f79-fbc394548985 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:38:57 devstack sudo[95129]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-dfa576c6-ab3e-45f1-9f79-fbc394548985 Jul 10 04:38:57 devstack sudo[95129]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:38:58 devstack cinder-volume[87444]: INFO cinder.volume.manager [None req-0ec3021f-f0c4-437f-a43d-f6d722b3e304 tempest-GroupSnapshotsTest-544795304 None] Group tempest-GroupSnapshotsTest-Group-2060019491: creating Jul 10 04:38:58 devstack cinder-volume[87444]: INFO cinder.volume.manager [None req-0ec3021f-f0c4-437f-a43d-f6d722b3e304 tempest-GroupSnapshotsTest-544795304 None] Group tempest-GroupSnapshotsTest-Group-2060019491: created successfully Jul 10 04:38:58 devstack cinder-volume[87444]: INFO cinder.volume.manager [None req-0ec3021f-f0c4-437f-a43d-f6d722b3e304 tempest-GroupSnapshotsTest-544795304 None] Create group completed successfully. Jul 10 04:38:58 devstack sudo[95127]: pam_unix(sudo:session): session closed for user root Jul 10 04:38:58 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-e882932a-39c0-4dac-a208-dcb329d85430 tempest-GroupsV314Test-1240250205 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-a4140352-58bc-4a6c-b55e-2e7ac27e716d" returned: 0 in 0.862s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:38:58 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-e882932a-39c0-4dac-a208-dcb329d85430 tempest-GroupsV314Test-1240250205 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-a4140352-58bc-4a6c-b55e-2e7ac27e716d {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:38:58 devstack sudo[95135]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-a4140352-58bc-4a6c-b55e-2e7ac27e716d Jul 10 04:38:58 devstack sudo[95135]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:38:58 devstack sudo[95129]: pam_unix(sudo:session): session closed for user root Jul 10 04:38:58 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-4cf5c7a1-edbf-4f0d-819e-f572263a38f3 tempest-VolumesTestJSON-1537374362 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-dfa576c6-ab3e-45f1-9f79-fbc394548985" returned: 0 in 0.727s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:38:58 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-4cf5c7a1-edbf-4f0d-819e-f572263a38f3 tempest-VolumesTestJSON-1537374362 None] <== create_volume: return (1797ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922'} {{(pid=87444) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 04:38:58 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-4cf5c7a1-edbf-4f0d-819e-f572263a38f3 tempest-VolumesTestJSON-1537374362 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.800s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 04:38:58 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-4cf5c7a1-edbf-4f0d-819e-f572263a38f3 tempest-VolumesTestJSON-1537374362 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3adc4c15-a73d-4560-a25b-458a85c4f3ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-dfa576c6-ab3e-45f1-9f79-fbc394548985', 'volume_size': 1}' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:38:58 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-4cf5c7a1-edbf-4f0d-819e-f572263a38f3 tempest-VolumesTestJSON-1537374362 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ba37d5b9-e8fb-42d1-92d2-f40ee378c1bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:38:58 devstack cinder-volume[87444]: INFO cinder.volume.flows.manager.create_volume [None req-4cf5c7a1-edbf-4f0d-819e-f572263a38f3 tempest-VolumesTestJSON-1537374362 None] Volume volume-dfa576c6-ab3e-45f1-9f79-fbc394548985 (dfa576c6-ab3e-45f1-9f79-fbc394548985): created successfully Jul 10 04:38:58 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-4cf5c7a1-edbf-4f0d-819e-f572263a38f3 tempest-VolumesTestJSON-1537374362 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ba37d5b9-e8fb-42d1-92d2-f40ee378c1bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:38:58 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-4cf5c7a1-edbf-4f0d-819e-f572263a38f3 tempest-VolumesTestJSON-1537374362 None] Flow 'volume_create_manager' (7c5ef898-c450-4559-bb7b-9b1440d66804) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87444) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 04:38:58 devstack cinder-volume[87444]: INFO cinder.volume.manager [None req-4cf5c7a1-edbf-4f0d-819e-f572263a38f3 tempest-VolumesTestJSON-1537374362 None] Created volume successfully. Jul 10 04:38:59 devstack sudo[95135]: pam_unix(sudo:session): session closed for user root Jul 10 04:38:59 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-e882932a-39c0-4dac-a208-dcb329d85430 tempest-GroupsV314Test-1240250205 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-a4140352-58bc-4a6c-b55e-2e7ac27e716d" returned: 0 in 0.686s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:38:59 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-e882932a-39c0-4dac-a208-dcb329d85430 tempest-GroupsV314Test-1240250205 None] Lock "cinder-quobyte-a4140352-58bc-4a6c-b55e-2e7ac27e716d" released by "delete_volume" :: held 1.609s {{(pid=87444) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 04:38:59 devstack cinder-volume[87444]: DEBUG cinder.quota [None req-e882932a-39c0-4dac-a208-dcb329d85430 tempest-GroupsV314Test-1240250205 None] Created reservations ['ba51c563-a8c9-40e2-8d00-bb9f484e9715'] {{(pid=87444) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 04:38:59 devstack cinder-volume[87444]: WARNING cinder.quota [None req-e882932a-39c0-4dac-a208-dcb329d85430 tempest-GroupsV314Test-1240250205 None] Deprecated: Default quota for resource: volumes_tempest-GroupsV314Test-volume-type-1275746530 is set by the default quota flag: quota_volumes_tempest-GroupsV314Test-volume-type-1275746530, it is now deprecated. Please use the default quota class for default quota. Jul 10 04:38:59 devstack cinder-volume[87444]: WARNING cinder.quota [None req-e882932a-39c0-4dac-a208-dcb329d85430 tempest-GroupsV314Test-1240250205 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsV314Test-volume-type-1275746530 is set by the default quota flag: quota_gigabytes_tempest-GroupsV314Test-volume-type-1275746530, it is now deprecated. Please use the default quota class for default quota. Jul 10 04:38:59 devstack cinder-volume[87444]: DEBUG cinder.quota [None req-e882932a-39c0-4dac-a208-dcb329d85430 tempest-GroupsV314Test-1240250205 None] Created reservations ['d87999d6-d0d8-4061-9b0c-00f3673f13b5', '9734e548-7d79-440d-91b9-4b06b4aa72b1', 'b54d3c64-59ac-440c-ab28-232685f71d3b', '11180664-7492-4155-8445-4f75fd95edfb'] {{(pid=87444) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 04:38:59 devstack cinder-volume[87444]: DEBUG cinder.volume.flows.manager.create_volume [None req-c2e70aea-51d2-4903-beaf-8def73a39ba8 tempest-VolumesTestJSON-1537374362 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87444) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 04:38:59 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-c2e70aea-51d2-4903-beaf-8def73a39ba8 tempest-VolumesTestJSON-1537374362 None] Flow 'volume_create_manager' (bb0e5c84-da3c-4001-9d71-361250bbc0a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 04:38:59 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-c2e70aea-51d2-4903-beaf-8def73a39ba8 tempest-VolumesTestJSON-1537374362 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a2c80e65-5986-478c-947c-7002a3c032db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:38:59 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-c2e70aea-51d2-4903-beaf-8def73a39ba8 tempest-VolumesTestJSON-1537374362 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a2c80e65-5986-478c-947c-7002a3c032db) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T02:38:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-489198026',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=50c1a516-f07a-4a35-8b12-20d4a8dfe097,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='2bf91653b8e04fc8b20465f2f733c298',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T02:38:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T02:38:59Z,use_quota=True,user_id='be96d3c6d4fa46caa41b98827727ee62',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(317e369e-1e06-434d-ae95-a335f0e6c903),volume_type_id=317e369e-1e06-434d-ae95-a335f0e6c903)' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:38:59 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-c2e70aea-51d2-4903-beaf-8def73a39ba8 tempest-VolumesTestJSON-1537374362 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (729b0479-3d44-4776-a908-585ddee6692e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:38:59 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-c2e70aea-51d2-4903-beaf-8def73a39ba8 tempest-VolumesTestJSON-1537374362 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (729b0479-3d44-4776-a908-585ddee6692e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:38:59 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-c2e70aea-51d2-4903-beaf-8def73a39ba8 tempest-VolumesTestJSON-1537374362 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4f8b9edb-3f48-464c-930b-17002ed27928) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:38:59 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-c2e70aea-51d2-4903-beaf-8def73a39ba8 tempest-VolumesTestJSON-1537374362 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4f8b9edb-3f48-464c-930b-17002ed27928) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '50c1a516-f07a-4a35-8b12-20d4a8dfe097', 'volume_name': 'volume-50c1a516-f07a-4a35-8b12-20d4a8dfe097', 'volume_size': 1}' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:38:59 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-c2e70aea-51d2-4903-beaf-8def73a39ba8 tempest-VolumesTestJSON-1537374362 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (699b1836-57aa-49ab-a4fd-088be197ba0a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:38:59 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-c2e70aea-51d2-4903-beaf-8def73a39ba8 tempest-VolumesTestJSON-1537374362 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (699b1836-57aa-49ab-a4fd-088be197ba0a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:38:59 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-c2e70aea-51d2-4903-beaf-8def73a39ba8 tempest-VolumesTestJSON-1537374362 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ea3a47af-d01c-467a-a1fa-5d0699115d43) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:38:59 devstack cinder-volume[87444]: INFO cinder.volume.flows.manager.create_volume [None req-c2e70aea-51d2-4903-beaf-8def73a39ba8 tempest-VolumesTestJSON-1537374362 None] Volume 50c1a516-f07a-4a35-8b12-20d4a8dfe097: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-50c1a516-f07a-4a35-8b12-20d4a8dfe097', 'volume_size': 1} Jul 10 04:38:59 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-c2e70aea-51d2-4903-beaf-8def73a39ba8 tempest-VolumesTestJSON-1537374362 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 04:38:59 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-c2e70aea-51d2-4903-beaf-8def73a39ba8 tempest-VolumesTestJSON-1537374362 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 04:38:59 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-c2e70aea-51d2-4903-beaf-8def73a39ba8 tempest-VolumesTestJSON-1537374362 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T02:38:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-489198026',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=50c1a516-f07a-4a35-8b12-20d4a8dfe097,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='2bf91653b8e04fc8b20465f2f733c298',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T02:38:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T02:38:59Z,use_quota=True,user_id='be96d3c6d4fa46caa41b98827727ee62',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(317e369e-1e06-434d-ae95-a335f0e6c903),volume_type_id=317e369e-1e06-434d-ae95-a335f0e6c903)}" {{(pid=87444) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 04:38:59 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.remotefs [None req-c2e70aea-51d2-4903-beaf-8def73a39ba8 tempest-VolumesTestJSON-1537374362 None] Creating volume 50c1a516-f07a-4a35-8b12-20d4a8dfe097 {{(pid=87444) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 04:38:59 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-c2e70aea-51d2-4903-beaf-8def73a39ba8 tempest-VolumesTestJSON-1537374362 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 04:38:59 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-c2e70aea-51d2-4903-beaf-8def73a39ba8 tempest-VolumesTestJSON-1537374362 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 04:38:59 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-c2e70aea-51d2-4903-beaf-8def73a39ba8 tempest-VolumesTestJSON-1537374362 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922': None} {{(pid=87444) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 04:38:59 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-c2e70aea-51d2-4903-beaf-8def73a39ba8 tempest-VolumesTestJSON-1537374362 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922'] {{(pid=87444) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 04:38:59 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-c2e70aea-51d2-4903-beaf-8def73a39ba8 tempest-VolumesTestJSON-1537374362 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 04:38:59 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-c2e70aea-51d2-4903-beaf-8def73a39ba8 tempest-VolumesTestJSON-1537374362 None] Selected osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922 as target Quobyte volume. {{(pid=87444) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 04:38:59 devstack cinder-volume[87444]: INFO cinder.volume.drivers.remotefs [None req-c2e70aea-51d2-4903-beaf-8def73a39ba8 tempest-VolumesTestJSON-1537374362 None] casted to osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922 Jul 10 04:38:59 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-c2e70aea-51d2-4903-beaf-8def73a39ba8 tempest-VolumesTestJSON-1537374362 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-50c1a516-f07a-4a35-8b12-20d4a8dfe097 1073741824 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:38:59 devstack sudo[95138]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-50c1a516-f07a-4a35-8b12-20d4a8dfe097 1073741824 Jul 10 04:38:59 devstack sudo[95138]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:38:59 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-e882932a-39c0-4dac-a208-dcb329d85430 tempest-GroupsV314Test-1240250205 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 04:38:59 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-e882932a-39c0-4dac-a208-dcb329d85430 tempest-GroupsV314Test-1240250205 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 04:38:59 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-e882932a-39c0-4dac-a208-dcb329d85430 tempest-GroupsV314Test-1240250205 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922': None} {{(pid=87444) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 04:38:59 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-e882932a-39c0-4dac-a208-dcb329d85430 tempest-GroupsV314Test-1240250205 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922'] {{(pid=87444) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 04:38:59 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-e882932a-39c0-4dac-a208-dcb329d85430 tempest-GroupsV314Test-1240250205 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 04:38:59 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-e882932a-39c0-4dac-a208-dcb329d85430 tempest-GroupsV314Test-1240250205 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:38:59 devstack sudo[95140]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097 Jul 10 04:38:59 devstack sudo[95140]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:38:59 devstack cinder-volume[87444]: DEBUG cinder.volume.flows.manager.create_volume [None req-54c98e0a-68ee-496b-a6d9-9da2ea967bca tempest-GroupSnapshotsTest-544795304 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87444) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 04:38:59 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-54c98e0a-68ee-496b-a6d9-9da2ea967bca tempest-GroupSnapshotsTest-544795304 None] Flow 'volume_create_manager' (bafb63eb-1f93-4b9e-b652-a150c7e56a41) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 04:38:59 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-54c98e0a-68ee-496b-a6d9-9da2ea967bca tempest-GroupSnapshotsTest-544795304 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8f357897-aac7-4a75-97e3-519cd3132659) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:38:59 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-54c98e0a-68ee-496b-a6d9-9da2ea967bca tempest-GroupSnapshotsTest-544795304 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8f357897-aac7-4a75-97e3-519cd3132659) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T02:39:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-477393857',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=9aed9073-dd3a-418e-941d-a0b383a9960d,host='devstack@QuobyteHD#QuobyteHD',id=d022d806-0a29-46b8-b021-953c88761b25,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='37897128afdc4de48f884e9b940e625f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T02:39:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T02:39:00Z,use_quota=True,user_id='720d99c11f4b4f88b1559d0cc385025d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c85b34f5-7279-445b-ac5a-186fa6c812e9),volume_type_id=c85b34f5-7279-445b-ac5a-186fa6c812e9)' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:38:59 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-54c98e0a-68ee-496b-a6d9-9da2ea967bca tempest-GroupSnapshotsTest-544795304 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (55e941f3-c494-448a-b6cc-660ed3d2ca70) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:38:59 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-54c98e0a-68ee-496b-a6d9-9da2ea967bca tempest-GroupSnapshotsTest-544795304 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (55e941f3-c494-448a-b6cc-660ed3d2ca70) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:39:00 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-54c98e0a-68ee-496b-a6d9-9da2ea967bca tempest-GroupSnapshotsTest-544795304 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b56dcca7-4f4c-409c-856d-42727edba389) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:39:00 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-54c98e0a-68ee-496b-a6d9-9da2ea967bca tempest-GroupSnapshotsTest-544795304 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b56dcca7-4f4c-409c-856d-42727edba389) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd022d806-0a29-46b8-b021-953c88761b25', 'volume_name': 'volume-d022d806-0a29-46b8-b021-953c88761b25', 'volume_size': 1}' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:39:00 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-54c98e0a-68ee-496b-a6d9-9da2ea967bca tempest-GroupSnapshotsTest-544795304 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (59864618-9a1f-45fe-8ab8-c1a296f13d66) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:39:00 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-54c98e0a-68ee-496b-a6d9-9da2ea967bca tempest-GroupSnapshotsTest-544795304 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (59864618-9a1f-45fe-8ab8-c1a296f13d66) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:39:00 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-54c98e0a-68ee-496b-a6d9-9da2ea967bca tempest-GroupSnapshotsTest-544795304 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fc9b5d37-88ad-456b-bb95-e0a7f03043fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:39:00 devstack cinder-volume[87444]: INFO cinder.volume.flows.manager.create_volume [None req-54c98e0a-68ee-496b-a6d9-9da2ea967bca tempest-GroupSnapshotsTest-544795304 None] Volume d022d806-0a29-46b8-b021-953c88761b25: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d022d806-0a29-46b8-b021-953c88761b25', 'volume_size': 1} Jul 10 04:39:00 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-54c98e0a-68ee-496b-a6d9-9da2ea967bca tempest-GroupSnapshotsTest-544795304 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 04:39:00 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-3d47bcc6-de91-48c6-b737-29b8e37de4c8 tempest-GroupsV314Test-1240250205 None] Acquiring lock "cinder-quobyte-e09f0338-cb01-4dcb-99b6-6d68ac989e0b" by "delete_volume" {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 04:39:00 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-3d47bcc6-de91-48c6-b737-29b8e37de4c8 tempest-GroupsV314Test-1240250205 None] Lock "cinder-quobyte-e09f0338-cb01-4dcb-99b6-6d68ac989e0b" acquired by "delete_volume" :: waited 0.023s {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 04:39:00 devstack cinder-volume[87444]: DEBUG oslo.privsep.daemon [-] privsep: reply[62a46a21-0a31-45df-a94c-c1b95481c91a]: (4, 'qcow2') {{(pid=88499) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 04:39:00 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-3d47bcc6-de91-48c6-b737-29b8e37de4c8 tempest-GroupsV314Test-1240250205 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-e09f0338-cb01-4dcb-99b6-6d68ac989e0b {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:39:00 devstack sudo[95140]: pam_unix(sudo:session): session closed for user root Jul 10 04:39:00 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-e882932a-39c0-4dac-a208-dcb329d85430 tempest-GroupsV314Test-1240250205 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097" returned: 0 in 0.844s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:39:00 devstack cinder-volume[87444]: DEBUG cinder.manager [None req-e882932a-39c0-4dac-a208-dcb329d85430 tempest-GroupsV314Test-1240250205 None] Notifying Schedulers of capabilities ... {{(pid=87444) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 04:39:00 devstack cinder-volume[87444]: INFO cinder.volume.manager [None req-e882932a-39c0-4dac-a208-dcb329d85430 tempest-GroupsV314Test-1240250205 None] Delete group completed successfully. Jul 10 04:39:00 devstack sudo[95138]: pam_unix(sudo:session): session closed for user root Jul 10 04:39:00 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-c2e70aea-51d2-4903-beaf-8def73a39ba8 tempest-VolumesTestJSON-1537374362 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-50c1a516-f07a-4a35-8b12-20d4a8dfe097 1073741824" returned: 0 in 0.999s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:39:00 devstack sudo[95148]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-e09f0338-cb01-4dcb-99b6-6d68ac989e0b Jul 10 04:39:00 devstack sudo[95148]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:39:00 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-c2e70aea-51d2-4903-beaf-8def73a39ba8 tempest-VolumesTestJSON-1537374362 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-50c1a516-f07a-4a35-8b12-20d4a8dfe097 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:39:00 devstack sudo[95150]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-50c1a516-f07a-4a35-8b12-20d4a8dfe097 Jul 10 04:39:00 devstack sudo[95150]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:39:01 devstack sudo[95150]: pam_unix(sudo:session): session closed for user root Jul 10 04:39:01 devstack sudo[95148]: pam_unix(sudo:session): session closed for user root Jul 10 04:39:01 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-c2e70aea-51d2-4903-beaf-8def73a39ba8 tempest-VolumesTestJSON-1537374362 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-50c1a516-f07a-4a35-8b12-20d4a8dfe097" returned: 0 in 0.671s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:39:01 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-c2e70aea-51d2-4903-beaf-8def73a39ba8 tempest-VolumesTestJSON-1537374362 None] <== create_volume: return (1711ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922'} {{(pid=87444) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 04:39:01 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-c2e70aea-51d2-4903-beaf-8def73a39ba8 tempest-VolumesTestJSON-1537374362 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.713s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 04:39:01 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-54c98e0a-68ee-496b-a6d9-9da2ea967bca tempest-GroupSnapshotsTest-544795304 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.104s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 04:39:01 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-54c98e0a-68ee-496b-a6d9-9da2ea967bca tempest-GroupSnapshotsTest-544795304 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=9aed9073-dd3a-418e-941d-a0b383a9960d,created_at=2026-07-10T02:39:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-477393857',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=9aed9073-dd3a-418e-941d-a0b383a9960d,host='devstack@QuobyteHD#QuobyteHD',id=d022d806-0a29-46b8-b021-953c88761b25,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='37897128afdc4de48f884e9b940e625f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T02:39:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T02:39:00Z,use_quota=True,user_id='720d99c11f4b4f88b1559d0cc385025d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c85b34f5-7279-445b-ac5a-186fa6c812e9),volume_type_id=c85b34f5-7279-445b-ac5a-186fa6c812e9)}" {{(pid=87444) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 04:39:01 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.remotefs [None req-54c98e0a-68ee-496b-a6d9-9da2ea967bca tempest-GroupSnapshotsTest-544795304 None] Creating volume d022d806-0a29-46b8-b021-953c88761b25 {{(pid=87444) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 04:39:01 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-54c98e0a-68ee-496b-a6d9-9da2ea967bca tempest-GroupSnapshotsTest-544795304 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 04:39:01 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-54c98e0a-68ee-496b-a6d9-9da2ea967bca tempest-GroupSnapshotsTest-544795304 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 04:39:01 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-54c98e0a-68ee-496b-a6d9-9da2ea967bca tempest-GroupSnapshotsTest-544795304 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922': None} {{(pid=87444) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 04:39:01 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-54c98e0a-68ee-496b-a6d9-9da2ea967bca tempest-GroupSnapshotsTest-544795304 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922'] {{(pid=87444) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 04:39:01 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-54c98e0a-68ee-496b-a6d9-9da2ea967bca tempest-GroupSnapshotsTest-544795304 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 04:39:01 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-54c98e0a-68ee-496b-a6d9-9da2ea967bca tempest-GroupSnapshotsTest-544795304 None] Selected osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922 as target Quobyte volume. {{(pid=87444) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 04:39:01 devstack cinder-volume[87444]: INFO cinder.volume.drivers.remotefs [None req-54c98e0a-68ee-496b-a6d9-9da2ea967bca tempest-GroupSnapshotsTest-544795304 None] casted to osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922 Jul 10 04:39:01 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-54c98e0a-68ee-496b-a6d9-9da2ea967bca tempest-GroupSnapshotsTest-544795304 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-d022d806-0a29-46b8-b021-953c88761b25 1073741824 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:39:01 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-3d47bcc6-de91-48c6-b737-29b8e37de4c8 tempest-GroupsV314Test-1240250205 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-e09f0338-cb01-4dcb-99b6-6d68ac989e0b" returned: 0 in 0.820s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:39:01 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-3d47bcc6-de91-48c6-b737-29b8e37de4c8 tempest-GroupsV314Test-1240250205 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-e09f0338-cb01-4dcb-99b6-6d68ac989e0b {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:39:01 devstack sudo[95156]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-d022d806-0a29-46b8-b021-953c88761b25 1073741824 Jul 10 04:39:01 devstack sudo[95156]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:39:01 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-c2e70aea-51d2-4903-beaf-8def73a39ba8 tempest-VolumesTestJSON-1537374362 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ea3a47af-d01c-467a-a1fa-5d0699115d43) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-50c1a516-f07a-4a35-8b12-20d4a8dfe097', 'volume_size': 1}' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:39:01 devstack sudo[95157]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-e09f0338-cb01-4dcb-99b6-6d68ac989e0b Jul 10 04:39:01 devstack sudo[95157]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:39:01 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-c2e70aea-51d2-4903-beaf-8def73a39ba8 tempest-VolumesTestJSON-1537374362 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dbee1489-bc45-43f3-a14a-fe497728c05a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:39:01 devstack cinder-volume[87444]: INFO cinder.volume.flows.manager.create_volume [None req-c2e70aea-51d2-4903-beaf-8def73a39ba8 tempest-VolumesTestJSON-1537374362 None] Volume volume-50c1a516-f07a-4a35-8b12-20d4a8dfe097 (50c1a516-f07a-4a35-8b12-20d4a8dfe097): created successfully Jul 10 04:39:01 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-c2e70aea-51d2-4903-beaf-8def73a39ba8 tempest-VolumesTestJSON-1537374362 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dbee1489-bc45-43f3-a14a-fe497728c05a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:39:01 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-c2e70aea-51d2-4903-beaf-8def73a39ba8 tempest-VolumesTestJSON-1537374362 None] Flow 'volume_create_manager' (bb0e5c84-da3c-4001-9d71-361250bbc0a6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87444) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 04:39:01 devstack cinder-volume[87444]: INFO cinder.volume.manager [None req-c2e70aea-51d2-4903-beaf-8def73a39ba8 tempest-VolumesTestJSON-1537374362 None] Created volume successfully. Jul 10 04:39:01 devstack sudo[95157]: pam_unix(sudo:session): session closed for user root Jul 10 04:39:01 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-3d47bcc6-de91-48c6-b737-29b8e37de4c8 tempest-GroupsV314Test-1240250205 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-e09f0338-cb01-4dcb-99b6-6d68ac989e0b" returned: 0 in 0.831s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:39:02 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-3d47bcc6-de91-48c6-b737-29b8e37de4c8 tempest-GroupsV314Test-1240250205 None] Lock "cinder-quobyte-e09f0338-cb01-4dcb-99b6-6d68ac989e0b" released by "delete_volume" :: held 1.715s {{(pid=87444) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 04:39:02 devstack cinder-volume[87444]: DEBUG cinder.quota [None req-3d47bcc6-de91-48c6-b737-29b8e37de4c8 tempest-GroupsV314Test-1240250205 None] Created reservations ['21f0fa15-df33-4645-a2ea-4d140b5f9b91'] {{(pid=87444) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 04:39:02 devstack cinder-volume[87444]: DEBUG cinder.quota [None req-3d47bcc6-de91-48c6-b737-29b8e37de4c8 tempest-GroupsV314Test-1240250205 None] Created reservations ['9acd6b86-d4ab-4f80-88c0-fdcd242d9a58', '6f987ae4-cdd6-4c72-9901-72aa2d3fce5c', '4bffbe9b-33ac-4dc4-82c5-0a955d010e27', '39621f21-3bb6-410e-83eb-c14015e2dce4'] {{(pid=87444) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 04:39:02 devstack sudo[95156]: pam_unix(sudo:session): session closed for user root Jul 10 04:39:02 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-54c98e0a-68ee-496b-a6d9-9da2ea967bca tempest-GroupSnapshotsTest-544795304 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-d022d806-0a29-46b8-b021-953c88761b25 1073741824" returned: 0 in 1.033s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:39:02 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-54c98e0a-68ee-496b-a6d9-9da2ea967bca tempest-GroupSnapshotsTest-544795304 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-d022d806-0a29-46b8-b021-953c88761b25 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:39:02 devstack sudo[95165]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-d022d806-0a29-46b8-b021-953c88761b25 Jul 10 04:39:02 devstack sudo[95165]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:39:02 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-3d47bcc6-de91-48c6-b737-29b8e37de4c8 tempest-GroupsV314Test-1240250205 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 04:39:02 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-3d47bcc6-de91-48c6-b737-29b8e37de4c8 tempest-GroupsV314Test-1240250205 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 04:39:02 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-3d47bcc6-de91-48c6-b737-29b8e37de4c8 tempest-GroupsV314Test-1240250205 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922': None} {{(pid=87444) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 04:39:02 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-3d47bcc6-de91-48c6-b737-29b8e37de4c8 tempest-GroupsV314Test-1240250205 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922'] {{(pid=87444) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 04:39:02 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-3d47bcc6-de91-48c6-b737-29b8e37de4c8 tempest-GroupsV314Test-1240250205 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 04:39:02 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-3d47bcc6-de91-48c6-b737-29b8e37de4c8 tempest-GroupsV314Test-1240250205 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:39:02 devstack sudo[95168]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097 Jul 10 04:39:02 devstack sudo[95168]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:39:02 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-a51879c6-e418-42b7-a4d4-d4747f7c6ece tempest-VolumesTestJSON-1537374362 None] Acquiring lock "cinder-50c1a516-f07a-4a35-8b12-20d4a8dfe097-delete_volume" by "delete_volume" {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 04:39:02 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-a51879c6-e418-42b7-a4d4-d4747f7c6ece tempest-VolumesTestJSON-1537374362 None] Lock "cinder-50c1a516-f07a-4a35-8b12-20d4a8dfe097-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 04:39:02 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-a51879c6-e418-42b7-a4d4-d4747f7c6ece tempest-VolumesTestJSON-1537374362 None] Acquiring lock "cinder-quobyte-50c1a516-f07a-4a35-8b12-20d4a8dfe097" by "delete_volume" {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 04:39:02 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-a51879c6-e418-42b7-a4d4-d4747f7c6ece tempest-VolumesTestJSON-1537374362 None] Lock "cinder-quobyte-50c1a516-f07a-4a35-8b12-20d4a8dfe097" acquired by "delete_volume" :: waited 0.025s {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 04:39:02 devstack cinder-volume[87444]: DEBUG oslo.privsep.daemon [-] privsep: reply[cfdac58d-0929-4cf2-a286-584a805901b9]: (4, 'qcow2') {{(pid=88499) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 04:39:02 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-a51879c6-e418-42b7-a4d4-d4747f7c6ece tempest-VolumesTestJSON-1537374362 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-50c1a516-f07a-4a35-8b12-20d4a8dfe097 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:39:03 devstack sudo[95173]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-50c1a516-f07a-4a35-8b12-20d4a8dfe097 Jul 10 04:39:03 devstack sudo[95173]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:39:03 devstack sudo[95168]: pam_unix(sudo:session): session closed for user root Jul 10 04:39:03 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-3d47bcc6-de91-48c6-b737-29b8e37de4c8 tempest-GroupsV314Test-1240250205 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097" returned: 0 in 0.934s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:39:03 devstack cinder-volume[87444]: DEBUG cinder.manager [None req-3d47bcc6-de91-48c6-b737-29b8e37de4c8 tempest-GroupsV314Test-1240250205 None] Notifying Schedulers of capabilities ... {{(pid=87444) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 04:39:03 devstack sudo[95165]: pam_unix(sudo:session): session closed for user root Jul 10 04:39:03 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-54c98e0a-68ee-496b-a6d9-9da2ea967bca tempest-GroupSnapshotsTest-544795304 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-d022d806-0a29-46b8-b021-953c88761b25" returned: 0 in 1.005s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:39:03 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-54c98e0a-68ee-496b-a6d9-9da2ea967bca tempest-GroupSnapshotsTest-544795304 None] <== create_volume: return (2094ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922'} {{(pid=87444) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 04:39:03 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-54c98e0a-68ee-496b-a6d9-9da2ea967bca tempest-GroupSnapshotsTest-544795304 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.097s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 04:39:03 devstack cinder-volume[87444]: INFO cinder.volume.manager [None req-3d47bcc6-de91-48c6-b737-29b8e37de4c8 tempest-GroupsV314Test-1240250205 None] Delete group completed successfully. Jul 10 04:39:03 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-54c98e0a-68ee-496b-a6d9-9da2ea967bca tempest-GroupSnapshotsTest-544795304 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fc9b5d37-88ad-456b-bb95-e0a7f03043fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d022d806-0a29-46b8-b021-953c88761b25', 'volume_size': 1}' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:39:03 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-54c98e0a-68ee-496b-a6d9-9da2ea967bca tempest-GroupSnapshotsTest-544795304 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a2644ddb-5c54-4dfb-9eb6-24a123312d04) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:39:03 devstack cinder-volume[87444]: INFO cinder.volume.flows.manager.create_volume [None req-54c98e0a-68ee-496b-a6d9-9da2ea967bca tempest-GroupSnapshotsTest-544795304 None] Volume volume-d022d806-0a29-46b8-b021-953c88761b25 (d022d806-0a29-46b8-b021-953c88761b25): created successfully Jul 10 04:39:03 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-54c98e0a-68ee-496b-a6d9-9da2ea967bca tempest-GroupSnapshotsTest-544795304 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a2644ddb-5c54-4dfb-9eb6-24a123312d04) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:39:03 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-54c98e0a-68ee-496b-a6d9-9da2ea967bca tempest-GroupSnapshotsTest-544795304 None] Flow 'volume_create_manager' (bafb63eb-1f93-4b9e-b652-a150c7e56a41) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87444) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 04:39:03 devstack cinder-volume[87444]: INFO cinder.volume.manager [None req-54c98e0a-68ee-496b-a6d9-9da2ea967bca tempest-GroupSnapshotsTest-544795304 None] Created volume successfully. Jul 10 04:39:03 devstack sudo[95173]: pam_unix(sudo:session): session closed for user root Jul 10 04:39:03 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-a51879c6-e418-42b7-a4d4-d4747f7c6ece tempest-VolumesTestJSON-1537374362 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-50c1a516-f07a-4a35-8b12-20d4a8dfe097" returned: 0 in 1.021s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:39:03 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-a51879c6-e418-42b7-a4d4-d4747f7c6ece tempest-VolumesTestJSON-1537374362 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-50c1a516-f07a-4a35-8b12-20d4a8dfe097 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:39:03 devstack sudo[95181]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-50c1a516-f07a-4a35-8b12-20d4a8dfe097 Jul 10 04:39:03 devstack sudo[95181]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:39:03 devstack cinder-volume[87444]: INFO cinder.volume.manager [None req-8d074fb8-2b1e-4a14-b3d1-3b1267292007 tempest-GroupSnapshotsTest-544795304 None] GroupSnapshot 08e53844-ccd5-418a-87f1-44189a3860d5: creating. Jul 10 04:39:03 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-8d074fb8-2b1e-4a14-b3d1-3b1267292007 tempest-GroupSnapshotsTest-544795304 None] Group snapshot 08e53844-ccd5-418a-87f1-44189a3860d5: creating. {{(pid=87444) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Jul 10 04:39:04 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-8d074fb8-2b1e-4a14-b3d1-3b1267292007 tempest-GroupSnapshotsTest-544795304 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 04:39:04 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-8d074fb8-2b1e-4a14-b3d1-3b1267292007 tempest-GroupSnapshotsTest-544795304 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 04:39:04 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.remotefs [None req-8d074fb8-2b1e-4a14-b3d1-3b1267292007 tempest-GroupSnapshotsTest-544795304 None] Creating offline snapshot 25d8fec9-ca34-4bb0-8113-544c54a1bece of volume d022d806-0a29-46b8-b021-953c88761b25 {{(pid=87444) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 10 04:39:04 devstack cinder-volume[87444]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd55e2b7-3aeb-4f50-8e78-209a8a1b72db]: (4, 'qcow2') {{(pid=88499) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 04:39:04 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-8d074fb8-2b1e-4a14-b3d1-3b1267292007 tempest-GroupSnapshotsTest-544795304 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-d022d806-0a29-46b8-b021-953c88761b25 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:39:04 devstack sudo[95183]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-d022d806-0a29-46b8-b021-953c88761b25 Jul 10 04:39:04 devstack sudo[95183]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:39:04 devstack sudo[95181]: pam_unix(sudo:session): session closed for user root Jul 10 04:39:04 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-a51879c6-e418-42b7-a4d4-d4747f7c6ece tempest-VolumesTestJSON-1537374362 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-50c1a516-f07a-4a35-8b12-20d4a8dfe097" returned: 0 in 0.918s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:39:04 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-a51879c6-e418-42b7-a4d4-d4747f7c6ece tempest-VolumesTestJSON-1537374362 None] Lock "cinder-quobyte-50c1a516-f07a-4a35-8b12-20d4a8dfe097" released by "delete_volume" :: held 2.008s {{(pid=87444) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 04:39:04 devstack cinder-volume[87444]: DEBUG cinder.quota [None req-a51879c6-e418-42b7-a4d4-d4747f7c6ece tempest-VolumesTestJSON-1537374362 None] Created reservations ['01c311cf-2076-49c6-b711-87af53422f4e', '75d1ed3f-8879-4e08-9b83-7a9973912b17', '403443a5-cf5c-425a-9d44-940e35c6a4ab', '6be8d6fc-4960-467f-9ac9-371a468fdab3'] {{(pid=87444) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 04:39:05 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-a51879c6-e418-42b7-a4d4-d4747f7c6ece tempest-VolumesTestJSON-1537374362 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 04:39:05 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-a51879c6-e418-42b7-a4d4-d4747f7c6ece tempest-VolumesTestJSON-1537374362 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 04:39:05 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-a51879c6-e418-42b7-a4d4-d4747f7c6ece tempest-VolumesTestJSON-1537374362 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922': None} {{(pid=87444) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 04:39:05 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-a51879c6-e418-42b7-a4d4-d4747f7c6ece tempest-VolumesTestJSON-1537374362 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922'] {{(pid=87444) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 04:39:05 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-a51879c6-e418-42b7-a4d4-d4747f7c6ece tempest-VolumesTestJSON-1537374362 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 04:39:05 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-a51879c6-e418-42b7-a4d4-d4747f7c6ece tempest-VolumesTestJSON-1537374362 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:39:05 devstack sudo[95183]: pam_unix(sudo:session): session closed for user root Jul 10 04:39:05 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-8d074fb8-2b1e-4a14-b3d1-3b1267292007 tempest-GroupSnapshotsTest-544795304 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-d022d806-0a29-46b8-b021-953c88761b25" returned: 0 in 1.072s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:39:05 devstack sudo[95190]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097 Jul 10 04:39:05 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-8d074fb8-2b1e-4a14-b3d1-3b1267292007 tempest-GroupSnapshotsTest-544795304 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-d022d806-0a29-46b8-b021-953c88761b25,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-d022d806-0a29-46b8-b021-953c88761b25.25d8fec9-ca34-4bb0-8113-544c54a1bece 1G {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:39:05 devstack sudo[95190]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:39:05 devstack sudo[95192]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-d022d806-0a29-46b8-b021-953c88761b25,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-d022d806-0a29-46b8-b021-953c88761b25.25d8fec9-ca34-4bb0-8113-544c54a1bece 1G Jul 10 04:39:05 devstack sudo[95192]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:39:05 devstack sudo[95190]: pam_unix(sudo:session): session closed for user root Jul 10 04:39:05 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-a51879c6-e418-42b7-a4d4-d4747f7c6ece tempest-VolumesTestJSON-1537374362 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097" returned: 0 in 0.829s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:39:05 devstack cinder-volume[87444]: DEBUG cinder.manager [None req-a51879c6-e418-42b7-a4d4-d4747f7c6ece tempest-VolumesTestJSON-1537374362 None] Notifying Schedulers of capabilities ... {{(pid=87444) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 04:39:05 devstack cinder-volume[87444]: INFO cinder.volume.manager [None req-a51879c6-e418-42b7-a4d4-d4747f7c6ece tempest-VolumesTestJSON-1537374362 None] Deleted volume successfully. Jul 10 04:39:05 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-a51879c6-e418-42b7-a4d4-d4747f7c6ece tempest-VolumesTestJSON-1537374362 None] Lock "cinder-50c1a516-f07a-4a35-8b12-20d4a8dfe097-delete_volume" released by "delete_volume" :: held 3.196s {{(pid=87444) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 04:39:06 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-14e979ac-75d4-4171-89b1-ab23112a7e91 tempest-VolumesTestJSON-1537374362 None] Acquiring lock "cinder-dfa576c6-ab3e-45f1-9f79-fbc394548985-delete_volume" by "delete_volume" {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 04:39:06 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-14e979ac-75d4-4171-89b1-ab23112a7e91 tempest-VolumesTestJSON-1537374362 None] Lock "cinder-dfa576c6-ab3e-45f1-9f79-fbc394548985-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 04:39:06 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-14e979ac-75d4-4171-89b1-ab23112a7e91 tempest-VolumesTestJSON-1537374362 None] Acquiring lock "cinder-quobyte-dfa576c6-ab3e-45f1-9f79-fbc394548985" by "delete_volume" {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 04:39:06 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-14e979ac-75d4-4171-89b1-ab23112a7e91 tempest-VolumesTestJSON-1537374362 None] Lock "cinder-quobyte-dfa576c6-ab3e-45f1-9f79-fbc394548985" acquired by "delete_volume" :: waited 0.029s {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 04:39:06 devstack sudo[95192]: pam_unix(sudo:session): session closed for user root Jul 10 04:39:06 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-8d074fb8-2b1e-4a14-b3d1-3b1267292007 tempest-GroupSnapshotsTest-544795304 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-d022d806-0a29-46b8-b021-953c88761b25,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-d022d806-0a29-46b8-b021-953c88761b25.25d8fec9-ca34-4bb0-8113-544c54a1bece 1G" returned: 0 in 1.151s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:39:06 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-8d074fb8-2b1e-4a14-b3d1-3b1267292007 tempest-GroupSnapshotsTest-544795304 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d022d806-0a29-46b8-b021-953c88761b25 -F qcow2 /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-d022d806-0a29-46b8-b021-953c88761b25.25d8fec9-ca34-4bb0-8113-544c54a1bece {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:39:06 devstack cinder-volume[87444]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1d7e249-e930-4204-8d73-9842cfa2cfdd]: (4, 'qcow2') {{(pid=88499) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 04:39:06 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-14e979ac-75d4-4171-89b1-ab23112a7e91 tempest-VolumesTestJSON-1537374362 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-dfa576c6-ab3e-45f1-9f79-fbc394548985 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:39:06 devstack sudo[95200]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d022d806-0a29-46b8-b021-953c88761b25 -F qcow2 /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-d022d806-0a29-46b8-b021-953c88761b25.25d8fec9-ca34-4bb0-8113-544c54a1bece Jul 10 04:39:06 devstack sudo[95200]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:39:06 devstack sudo[95202]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-dfa576c6-ab3e-45f1-9f79-fbc394548985 Jul 10 04:39:06 devstack sudo[95202]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:39:07 devstack sudo[95200]: pam_unix(sudo:session): session closed for user root Jul 10 04:39:07 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-8d074fb8-2b1e-4a14-b3d1-3b1267292007 tempest-GroupSnapshotsTest-544795304 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d022d806-0a29-46b8-b021-953c88761b25 -F qcow2 /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-d022d806-0a29-46b8-b021-953c88761b25.25d8fec9-ca34-4bb0-8113-544c54a1bece" returned: 0 in 0.948s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:39:07 devstack cinder-volume[87444]: WARNING cinder.volume.drivers.remotefs [None req-8d074fb8-2b1e-4a14-b3d1-3b1267292007 tempest-GroupSnapshotsTest-544795304 None] /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-d022d806-0a29-46b8-b021-953c88761b25.25d8fec9-ca34-4bb0-8113-544c54a1bece is being set with open permissions: ugo+rw: NotImplementedError Jul 10 04:39:07 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-8d074fb8-2b1e-4a14-b3d1-3b1267292007 tempest-GroupSnapshotsTest-544795304 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-d022d806-0a29-46b8-b021-953c88761b25.25d8fec9-ca34-4bb0-8113-544c54a1bece {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:39:07 devstack sudo[95202]: pam_unix(sudo:session): session closed for user root Jul 10 04:39:07 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-14e979ac-75d4-4171-89b1-ab23112a7e91 tempest-VolumesTestJSON-1537374362 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-dfa576c6-ab3e-45f1-9f79-fbc394548985" returned: 0 in 0.971s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:39:07 devstack sudo[95210]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-d022d806-0a29-46b8-b021-953c88761b25.25d8fec9-ca34-4bb0-8113-544c54a1bece Jul 10 04:39:07 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-14e979ac-75d4-4171-89b1-ab23112a7e91 tempest-VolumesTestJSON-1537374362 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-dfa576c6-ab3e-45f1-9f79-fbc394548985 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:39:07 devstack sudo[95210]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:39:07 devstack sudo[95212]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-dfa576c6-ab3e-45f1-9f79-fbc394548985 Jul 10 04:39:07 devstack sudo[95212]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:39:07 devstack sudo[95210]: pam_unix(sudo:session): session closed for user root Jul 10 04:39:07 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-8d074fb8-2b1e-4a14-b3d1-3b1267292007 tempest-GroupSnapshotsTest-544795304 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-d022d806-0a29-46b8-b021-953c88761b25.25d8fec9-ca34-4bb0-8113-544c54a1bece" returned: 0 in 0.723s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:39:07 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-8d074fb8-2b1e-4a14-b3d1-3b1267292007 tempest-GroupSnapshotsTest-544795304 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-d022d806-0a29-46b8-b021-953c88761b25.info {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:39:08 devstack sudo[95216]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-d022d806-0a29-46b8-b021-953c88761b25.info Jul 10 04:39:08 devstack sudo[95216]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:39:08 devstack sudo[95212]: pam_unix(sudo:session): session closed for user root Jul 10 04:39:08 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-14e979ac-75d4-4171-89b1-ab23112a7e91 tempest-VolumesTestJSON-1537374362 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-dfa576c6-ab3e-45f1-9f79-fbc394548985" returned: 0 in 0.768s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:39:08 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-14e979ac-75d4-4171-89b1-ab23112a7e91 tempest-VolumesTestJSON-1537374362 None] Lock "cinder-quobyte-dfa576c6-ab3e-45f1-9f79-fbc394548985" released by "delete_volume" :: held 1.813s {{(pid=87444) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 04:39:08 devstack cinder-volume[87444]: DEBUG cinder.quota [None req-14e979ac-75d4-4171-89b1-ab23112a7e91 tempest-VolumesTestJSON-1537374362 None] Created reservations ['0d0dbe0e-c7aa-4041-ad76-1dbecc2ca573', '88a83b18-47e8-4dd8-932a-035638081d86', '4bd20d41-59ce-42e4-bdbb-eab354ffe3c8', 'b0d6000c-42f2-43e6-a046-1c9b395107fe'] {{(pid=87444) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 04:39:08 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-14e979ac-75d4-4171-89b1-ab23112a7e91 tempest-VolumesTestJSON-1537374362 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 04:39:08 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-14e979ac-75d4-4171-89b1-ab23112a7e91 tempest-VolumesTestJSON-1537374362 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 04:39:08 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-14e979ac-75d4-4171-89b1-ab23112a7e91 tempest-VolumesTestJSON-1537374362 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922': None} {{(pid=87444) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 04:39:08 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-14e979ac-75d4-4171-89b1-ab23112a7e91 tempest-VolumesTestJSON-1537374362 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922'] {{(pid=87444) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 04:39:08 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-14e979ac-75d4-4171-89b1-ab23112a7e91 tempest-VolumesTestJSON-1537374362 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 04:39:08 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-14e979ac-75d4-4171-89b1-ab23112a7e91 tempest-VolumesTestJSON-1537374362 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:39:08 devstack sudo[95218]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097 Jul 10 04:39:08 devstack sudo[95218]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:39:08 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-105c4d78-eb8d-4a3d-97f6-753139500db0 tempest-VolumesTestJSON-1537374362 None] Acquiring lock "cinder-165bf717-01bd-4fdb-92d7-ba8e75c2a5ba-delete_volume" by "delete_volume" {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 04:39:08 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-105c4d78-eb8d-4a3d-97f6-753139500db0 tempest-VolumesTestJSON-1537374362 None] Lock "cinder-165bf717-01bd-4fdb-92d7-ba8e75c2a5ba-delete_volume" acquired by "delete_volume" :: waited 0.044s {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 04:39:08 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-105c4d78-eb8d-4a3d-97f6-753139500db0 tempest-VolumesTestJSON-1537374362 None] Acquiring lock "cinder-quobyte-165bf717-01bd-4fdb-92d7-ba8e75c2a5ba" by "delete_volume" {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 04:39:08 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-105c4d78-eb8d-4a3d-97f6-753139500db0 tempest-VolumesTestJSON-1537374362 None] Lock "cinder-quobyte-165bf717-01bd-4fdb-92d7-ba8e75c2a5ba" acquired by "delete_volume" :: waited 0.034s {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 04:39:08 devstack cinder-volume[87444]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a1ba960-7c11-4893-ae30-999357efbdc4]: (4, 'qcow2') {{(pid=88499) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 04:39:08 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-105c4d78-eb8d-4a3d-97f6-753139500db0 tempest-VolumesTestJSON-1537374362 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-165bf717-01bd-4fdb-92d7-ba8e75c2a5ba {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:39:08 devstack sudo[95220]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-165bf717-01bd-4fdb-92d7-ba8e75c2a5ba Jul 10 04:39:08 devstack sudo[95220]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:39:08 devstack sudo[95216]: pam_unix(sudo:session): session closed for user root Jul 10 04:39:08 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-8d074fb8-2b1e-4a14-b3d1-3b1267292007 tempest-GroupSnapshotsTest-544795304 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-d022d806-0a29-46b8-b021-953c88761b25.info" returned: 0 in 0.999s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:39:08 devstack cinder-volume[87444]: WARNING cinder.volume.drivers.remotefs [None req-8d074fb8-2b1e-4a14-b3d1-3b1267292007 tempest-GroupSnapshotsTest-544795304 None] /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-d022d806-0a29-46b8-b021-953c88761b25.info is being set with open permissions: ugo+rw: NotImplementedError Jul 10 04:39:08 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-8d074fb8-2b1e-4a14-b3d1-3b1267292007 tempest-GroupSnapshotsTest-544795304 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-d022d806-0a29-46b8-b021-953c88761b25.info {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:39:09 devstack sudo[95218]: pam_unix(sudo:session): session closed for user root Jul 10 04:39:09 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-14e979ac-75d4-4171-89b1-ab23112a7e91 tempest-VolumesTestJSON-1537374362 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097" returned: 0 in 0.785s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:39:09 devstack cinder-volume[87444]: DEBUG cinder.manager [None req-14e979ac-75d4-4171-89b1-ab23112a7e91 tempest-VolumesTestJSON-1537374362 None] Notifying Schedulers of capabilities ... {{(pid=87444) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 04:39:09 devstack cinder-volume[87444]: INFO cinder.volume.manager [None req-14e979ac-75d4-4171-89b1-ab23112a7e91 tempest-VolumesTestJSON-1537374362 None] Deleted volume successfully. Jul 10 04:39:09 devstack sudo[95224]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-d022d806-0a29-46b8-b021-953c88761b25.info Jul 10 04:39:09 devstack sudo[95224]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:39:09 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-14e979ac-75d4-4171-89b1-ab23112a7e91 tempest-VolumesTestJSON-1537374362 None] Lock "cinder-dfa576c6-ab3e-45f1-9f79-fbc394548985-delete_volume" released by "delete_volume" :: held 2.903s {{(pid=87444) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 04:39:09 devstack sudo[95220]: pam_unix(sudo:session): session closed for user root Jul 10 04:39:09 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-105c4d78-eb8d-4a3d-97f6-753139500db0 tempest-VolumesTestJSON-1537374362 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-165bf717-01bd-4fdb-92d7-ba8e75c2a5ba" returned: 0 in 1.044s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:39:09 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-105c4d78-eb8d-4a3d-97f6-753139500db0 tempest-VolumesTestJSON-1537374362 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-165bf717-01bd-4fdb-92d7-ba8e75c2a5ba {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:39:09 devstack sudo[95230]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-165bf717-01bd-4fdb-92d7-ba8e75c2a5ba Jul 10 04:39:09 devstack sudo[95230]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:39:09 devstack sudo[95224]: pam_unix(sudo:session): session closed for user root Jul 10 04:39:09 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-8d074fb8-2b1e-4a14-b3d1-3b1267292007 tempest-GroupSnapshotsTest-544795304 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-d022d806-0a29-46b8-b021-953c88761b25.info" returned: 0 in 0.822s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:39:09 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-8d074fb8-2b1e-4a14-b3d1-3b1267292007 tempest-GroupSnapshotsTest-544795304 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.830s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 04:39:09 devstack cinder-volume[87444]: INFO cinder.volume.manager [None req-8d074fb8-2b1e-4a14-b3d1-3b1267292007 tempest-GroupSnapshotsTest-544795304 None] group_snapshot 08e53844-ccd5-418a-87f1-44189a3860d5: created successfully Jul 10 04:39:10 devstack sudo[95230]: pam_unix(sudo:session): session closed for user root Jul 10 04:39:10 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-105c4d78-eb8d-4a3d-97f6-753139500db0 tempest-VolumesTestJSON-1537374362 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-165bf717-01bd-4fdb-92d7-ba8e75c2a5ba" returned: 0 in 0.685s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:39:10 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-105c4d78-eb8d-4a3d-97f6-753139500db0 tempest-VolumesTestJSON-1537374362 None] Lock "cinder-quobyte-165bf717-01bd-4fdb-92d7-ba8e75c2a5ba" released by "delete_volume" :: held 1.808s {{(pid=87444) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 04:39:10 devstack cinder-volume[87444]: DEBUG cinder.quota [None req-105c4d78-eb8d-4a3d-97f6-753139500db0 tempest-VolumesTestJSON-1537374362 None] Created reservations ['4691b419-b5fe-4783-b0d9-e7416ce1e5f6', '232ace31-6e61-46ad-a8eb-9dba4c8a9d1b', '97776096-6930-4a31-b6a4-c84e6112afc3', 'd124de96-3edf-4b3a-b5eb-4d8a85b98b53'] {{(pid=87444) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 04:39:10 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-105c4d78-eb8d-4a3d-97f6-753139500db0 tempest-VolumesTestJSON-1537374362 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 04:39:10 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-105c4d78-eb8d-4a3d-97f6-753139500db0 tempest-VolumesTestJSON-1537374362 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 04:39:10 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-105c4d78-eb8d-4a3d-97f6-753139500db0 tempest-VolumesTestJSON-1537374362 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922': None} {{(pid=87444) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 04:39:10 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-105c4d78-eb8d-4a3d-97f6-753139500db0 tempest-VolumesTestJSON-1537374362 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922'] {{(pid=87444) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 04:39:10 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-105c4d78-eb8d-4a3d-97f6-753139500db0 tempest-VolumesTestJSON-1537374362 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 04:39:10 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-105c4d78-eb8d-4a3d-97f6-753139500db0 tempest-VolumesTestJSON-1537374362 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:39:10 devstack sudo[95233]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097 Jul 10 04:39:10 devstack sudo[95233]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:39:11 devstack sudo[95233]: pam_unix(sudo:session): session closed for user root Jul 10 04:39:11 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-105c4d78-eb8d-4a3d-97f6-753139500db0 tempest-VolumesTestJSON-1537374362 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097" returned: 0 in 0.997s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:39:11 devstack cinder-volume[87444]: DEBUG cinder.manager [None req-105c4d78-eb8d-4a3d-97f6-753139500db0 tempest-VolumesTestJSON-1537374362 None] Notifying Schedulers of capabilities ... {{(pid=87444) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 04:39:11 devstack cinder-volume[87444]: INFO cinder.volume.manager [None req-105c4d78-eb8d-4a3d-97f6-753139500db0 tempest-VolumesTestJSON-1537374362 None] Deleted volume successfully. Jul 10 04:39:11 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-c38978de-ac90-4484-94f0-579fd056cfc2 tempest-GroupSnapshotsTest-544795304 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 04:39:11 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-c38978de-ac90-4484-94f0-579fd056cfc2 tempest-GroupSnapshotsTest-544795304 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 04:39:11 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-c38978de-ac90-4484-94f0-579fd056cfc2 tempest-GroupSnapshotsTest-544795304 None] Acquiring lock "cinder-quobyte-25d8fec9-ca34-4bb0-8113-544c54a1bece-34f0f9ae-2b72-4217-a700-b1a3e5524e41" by "_create_volume_from_snapshot" {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 04:39:11 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-105c4d78-eb8d-4a3d-97f6-753139500db0 tempest-VolumesTestJSON-1537374362 None] Lock "cinder-165bf717-01bd-4fdb-92d7-ba8e75c2a5ba-delete_volume" released by "delete_volume" :: held 3.176s {{(pid=87444) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 04:39:11 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-c38978de-ac90-4484-94f0-579fd056cfc2 tempest-GroupSnapshotsTest-544795304 None] Lock "cinder-quobyte-25d8fec9-ca34-4bb0-8113-544c54a1bece-34f0f9ae-2b72-4217-a700-b1a3e5524e41" acquired by "_create_volume_from_snapshot" :: waited 0.026s {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 04:39:11 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-c38978de-ac90-4484-94f0-579fd056cfc2 tempest-GroupSnapshotsTest-544795304 None] Creating volume 34f0f9ae-2b72-4217-a700-b1a3e5524e41 from snapshot 25d8fec9-ca34-4bb0-8113-544c54a1bece {{(pid=87444) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Jul 10 04:39:11 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-c38978de-ac90-4484-94f0-579fd056cfc2 tempest-GroupSnapshotsTest-544795304 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 04:39:11 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-c38978de-ac90-4484-94f0-579fd056cfc2 tempest-GroupSnapshotsTest-544795304 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 04:39:11 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-c38978de-ac90-4484-94f0-579fd056cfc2 tempest-GroupSnapshotsTest-544795304 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922': None} {{(pid=87444) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 04:39:11 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-c38978de-ac90-4484-94f0-579fd056cfc2 tempest-GroupSnapshotsTest-544795304 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922'] {{(pid=87444) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 04:39:11 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-c38978de-ac90-4484-94f0-579fd056cfc2 tempest-GroupSnapshotsTest-544795304 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 04:39:11 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-c38978de-ac90-4484-94f0-579fd056cfc2 tempest-GroupSnapshotsTest-544795304 None] Selected osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922 as target Quobyte volume. {{(pid=87444) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 04:39:11 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-c38978de-ac90-4484-94f0-579fd056cfc2 tempest-GroupSnapshotsTest-544795304 None] Acquiring lock "cinder-quobyte-34f0f9ae-2b72-4217-a700-b1a3e5524e41" by "_copy_volume_from_snapshot" {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 04:39:11 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-c38978de-ac90-4484-94f0-579fd056cfc2 tempest-GroupSnapshotsTest-544795304 None] Lock "cinder-quobyte-34f0f9ae-2b72-4217-a700-b1a3e5524e41" acquired by "_copy_volume_from_snapshot" :: waited 0.031s {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 04:39:11 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-c38978de-ac90-4484-94f0-579fd056cfc2 tempest-GroupSnapshotsTest-544795304 None] snapshot: 25d8fec9-ca34-4bb0-8113-544c54a1bece, volume: 34f0f9ae-2b72-4217-a700-b1a3e5524e41, {{(pid=87444) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jul 10 04:39:11 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-c38978de-ac90-4484-94f0-579fd056cfc2 tempest-GroupSnapshotsTest-544795304 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 04:39:11 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-c38978de-ac90-4484-94f0-579fd056cfc2 tempest-GroupSnapshotsTest-544795304 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 04:39:11 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-c38978de-ac90-4484-94f0-579fd056cfc2 tempest-GroupSnapshotsTest-544795304 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922': None} {{(pid=87444) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 04:39:11 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-c38978de-ac90-4484-94f0-579fd056cfc2 tempest-GroupSnapshotsTest-544795304 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922'] {{(pid=87444) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 04:39:11 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-c38978de-ac90-4484-94f0-579fd056cfc2 tempest-GroupSnapshotsTest-544795304 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 04:39:11 devstack cinder-volume[87444]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4dba33a-ffc5-4cfb-abe7-e56328ff71de]: (4, 'qcow2') {{(pid=88499) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 04:39:11 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-c38978de-ac90-4484-94f0-579fd056cfc2 tempest-GroupSnapshotsTest-544795304 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-d022d806-0a29-46b8-b021-953c88761b25.25d8fec9-ca34-4bb0-8113-544c54a1bece {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:39:11 devstack sudo[95236]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-d022d806-0a29-46b8-b021-953c88761b25.25d8fec9-ca34-4bb0-8113-544c54a1bece Jul 10 04:39:11 devstack sudo[95236]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:39:12 devstack sudo[95236]: pam_unix(sudo:session): session closed for user root Jul 10 04:39:12 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-c38978de-ac90-4484-94f0-579fd056cfc2 tempest-GroupSnapshotsTest-544795304 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-d022d806-0a29-46b8-b021-953c88761b25.25d8fec9-ca34-4bb0-8113-544c54a1bece" returned: 0 in 0.899s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:39:12 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.remotefs [None req-c38978de-ac90-4484-94f0-579fd056cfc2 tempest-GroupSnapshotsTest-544795304 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d022d806-0a29-46b8-b021-953c88761b25(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87444) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 10 04:39:12 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-c38978de-ac90-4484-94f0-579fd056cfc2 tempest-GroupSnapshotsTest-544795304 None] will copy from snapshot at /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-d022d806-0a29-46b8-b021-953c88761b25 {{(pid=87444) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jul 10 04:39:12 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-c38978de-ac90-4484-94f0-579fd056cfc2 tempest-GroupSnapshotsTest-544795304 None] Creating direct copy from snapshot {{(pid=87444) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jul 10 04:39:12 devstack cinder-volume[87444]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ec540f0-1240-4b9f-8344-140cf3e1747e]: (4, 'qcow2') {{(pid=88499) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 04:39:12 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-c38978de-ac90-4484-94f0-579fd056cfc2 tempest-GroupSnapshotsTest-544795304 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-d022d806-0a29-46b8-b021-953c88761b25 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:39:12 devstack sudo[95242]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-d022d806-0a29-46b8-b021-953c88761b25 Jul 10 04:39:12 devstack sudo[95242]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:39:13 devstack sudo[95242]: pam_unix(sudo:session): session closed for user root Jul 10 04:39:13 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-c38978de-ac90-4484-94f0-579fd056cfc2 tempest-GroupSnapshotsTest-544795304 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-d022d806-0a29-46b8-b021-953c88761b25" returned: 0 in 1.003s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:39:13 devstack cinder-volume[87444]: DEBUG cinder.utils [None req-c38978de-ac90-4484-94f0-579fd056cfc2 tempest-GroupSnapshotsTest-544795304 None] Path /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-34f0f9ae-2b72-4217-a700-b1a3e5524e41 not found in is_blk_device check {{(pid=87444) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 10 04:39:13 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-c38978de-ac90-4484-94f0-579fd056cfc2 tempest-GroupSnapshotsTest-544795304 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-d022d806-0a29-46b8-b021-953c88761b25 /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-34f0f9ae-2b72-4217-a700-b1a3e5524e41 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:39:13 devstack sudo[95248]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-d022d806-0a29-46b8-b021-953c88761b25 /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-34f0f9ae-2b72-4217-a700-b1a3e5524e41 Jul 10 04:39:13 devstack sudo[95248]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:39:16 devstack cinder-volume[87444]: DEBUG cinder.volume.flows.manager.create_volume [None req-212981bd-6b66-4d7b-acd4-bec625d7752f tempest-SnapshotsActionsTest-1538729065 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87444) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 04:39:16 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-212981bd-6b66-4d7b-acd4-bec625d7752f tempest-SnapshotsActionsTest-1538729065 None] Flow 'volume_create_manager' (1bf775c1-6dc0-47b8-a106-e4155c1557c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 04:39:16 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-212981bd-6b66-4d7b-acd4-bec625d7752f tempest-SnapshotsActionsTest-1538729065 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c269c4c3-3cf6-4f65-b098-570ddbfeaa98) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:39:16 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-212981bd-6b66-4d7b-acd4-bec625d7752f tempest-SnapshotsActionsTest-1538729065 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c269c4c3-3cf6-4f65-b098-570ddbfeaa98) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T02:39:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-406779574',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cb9ba17f-166a-487b-bda4-b5f9b80b656d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='204efa9fffca49838be9aa7c134342b3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T02:39:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T02:39:16Z,use_quota=True,user_id='95d8c70296c94b5ea7022c6af8257096',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(317e369e-1e06-434d-ae95-a335f0e6c903),volume_type_id=317e369e-1e06-434d-ae95-a335f0e6c903)' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:39:16 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-212981bd-6b66-4d7b-acd4-bec625d7752f tempest-SnapshotsActionsTest-1538729065 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3205c5bc-2c4a-46c5-b006-df67ad0d9617) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:39:16 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-212981bd-6b66-4d7b-acd4-bec625d7752f tempest-SnapshotsActionsTest-1538729065 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3205c5bc-2c4a-46c5-b006-df67ad0d9617) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:39:16 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-212981bd-6b66-4d7b-acd4-bec625d7752f tempest-SnapshotsActionsTest-1538729065 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a96039a8-65d0-4ed1-b461-fa391eb7dabb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:39:16 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-212981bd-6b66-4d7b-acd4-bec625d7752f tempest-SnapshotsActionsTest-1538729065 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a96039a8-65d0-4ed1-b461-fa391eb7dabb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cb9ba17f-166a-487b-bda4-b5f9b80b656d', 'volume_name': 'volume-cb9ba17f-166a-487b-bda4-b5f9b80b656d', 'volume_size': 1}' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:39:16 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-212981bd-6b66-4d7b-acd4-bec625d7752f tempest-SnapshotsActionsTest-1538729065 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f83f2edd-f932-4d28-b901-2ec59c580a8c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:39:16 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-212981bd-6b66-4d7b-acd4-bec625d7752f tempest-SnapshotsActionsTest-1538729065 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f83f2edd-f932-4d28-b901-2ec59c580a8c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:39:16 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-212981bd-6b66-4d7b-acd4-bec625d7752f tempest-SnapshotsActionsTest-1538729065 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0621bc06-ce31-4551-937f-a8b9d3b3f8e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:39:16 devstack cinder-volume[87444]: INFO cinder.volume.flows.manager.create_volume [None req-212981bd-6b66-4d7b-acd4-bec625d7752f tempest-SnapshotsActionsTest-1538729065 None] Volume cb9ba17f-166a-487b-bda4-b5f9b80b656d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cb9ba17f-166a-487b-bda4-b5f9b80b656d', 'volume_size': 1} Jul 10 04:39:16 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-212981bd-6b66-4d7b-acd4-bec625d7752f tempest-SnapshotsActionsTest-1538729065 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 04:39:19 devstack cinder-volume[87444]: INFO cinder.volume.manager [None req-dc200c06-a847-4b6f-a339-a5a8f4c85b53 tempest-GroupsV320Test-718188935 None] Group tempest-GroupsV320Test-Group-1949739388: creating Jul 10 04:39:19 devstack cinder-volume[87444]: INFO cinder.volume.manager [None req-dc200c06-a847-4b6f-a339-a5a8f4c85b53 tempest-GroupsV320Test-718188935 None] Group tempest-GroupsV320Test-Group-1949739388: created successfully Jul 10 04:39:19 devstack cinder-volume[87444]: INFO cinder.volume.manager [None req-dc200c06-a847-4b6f-a339-a5a8f4c85b53 tempest-GroupsV320Test-718188935 None] Create group completed successfully. Jul 10 04:39:19 devstack sudo[95248]: pam_unix(sudo:session): session closed for user root Jul 10 04:39:19 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-c38978de-ac90-4484-94f0-579fd056cfc2 tempest-GroupSnapshotsTest-544795304 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-d022d806-0a29-46b8-b021-953c88761b25 /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-34f0f9ae-2b72-4217-a700-b1a3e5524e41" returned: 0 in 6.164s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:39:19 devstack cinder-volume[87444]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a533ffc-0533-486c-91eb-37782f6ca89d]: (4, 'qcow2') {{(pid=88499) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 04:39:19 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-c38978de-ac90-4484-94f0-579fd056cfc2 tempest-GroupSnapshotsTest-544795304 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-d022d806-0a29-46b8-b021-953c88761b25 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:39:20 devstack sudo[95261]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-d022d806-0a29-46b8-b021-953c88761b25 Jul 10 04:39:20 devstack sudo[95261]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:39:20 devstack sudo[95261]: pam_unix(sudo:session): session closed for user root Jul 10 04:39:20 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-c38978de-ac90-4484-94f0-579fd056cfc2 tempest-GroupSnapshotsTest-544795304 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-d022d806-0a29-46b8-b021-953c88761b25" returned: 0 in 0.958s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:39:20 devstack cinder-volume[87444]: DEBUG cinder.image.image_utils [None req-c38978de-ac90-4484-94f0-579fd056cfc2 tempest-GroupSnapshotsTest-544795304 None] Image conversion details: src /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-d022d806-0a29-46b8-b021-953c88761b25, size 1024.00 MB, duration 6.16 sec, destination /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-34f0f9ae-2b72-4217-a700-b1a3e5524e41 {{(pid=87444) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:561}} Jul 10 04:39:20 devstack cinder-volume[87444]: INFO cinder.image.image_utils [None req-c38978de-ac90-4484-94f0-579fd056cfc2 tempest-GroupSnapshotsTest-544795304 None] Converted 1024.00 MB image at 166.11 MB/s Jul 10 04:39:20 devstack cinder-volume[87444]: WARNING cinder.volume.drivers.remotefs [None req-c38978de-ac90-4484-94f0-579fd056cfc2 tempest-GroupSnapshotsTest-544795304 None] /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-34f0f9ae-2b72-4217-a700-b1a3e5524e41 is being set with open permissions: ugo+rw: NotImplementedError Jul 10 04:39:20 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-c38978de-ac90-4484-94f0-579fd056cfc2 tempest-GroupSnapshotsTest-544795304 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-34f0f9ae-2b72-4217-a700-b1a3e5524e41 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:39:20 devstack sudo[95266]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-34f0f9ae-2b72-4217-a700-b1a3e5524e41 Jul 10 04:39:20 devstack sudo[95266]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:39:21 devstack cinder-volume[87444]: DEBUG cinder.quota [None req-09a86bdb-3ae1-49c6-b7dc-1ac6c156fe31 tempest-GroupsV320Test-718188935 None] Created reservations ['1505cbb4-fa76-4e42-9ba9-1b8d0ef39f7b'] {{(pid=87444) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 04:39:21 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-09a86bdb-3ae1-49c6-b7dc-1ac6c156fe31 tempest-GroupsV320Test-718188935 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 04:39:21 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-09a86bdb-3ae1-49c6-b7dc-1ac6c156fe31 tempest-GroupsV320Test-718188935 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 04:39:21 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-09a86bdb-3ae1-49c6-b7dc-1ac6c156fe31 tempest-GroupsV320Test-718188935 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922': None} {{(pid=87444) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 04:39:21 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-09a86bdb-3ae1-49c6-b7dc-1ac6c156fe31 tempest-GroupsV320Test-718188935 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922'] {{(pid=87444) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 04:39:21 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-09a86bdb-3ae1-49c6-b7dc-1ac6c156fe31 tempest-GroupsV320Test-718188935 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 04:39:21 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-09a86bdb-3ae1-49c6-b7dc-1ac6c156fe31 tempest-GroupsV320Test-718188935 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:39:21 devstack sudo[95268]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097 Jul 10 04:39:21 devstack sudo[95268]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:39:21 devstack sudo[95266]: pam_unix(sudo:session): session closed for user root Jul 10 04:39:21 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-c38978de-ac90-4484-94f0-579fd056cfc2 tempest-GroupSnapshotsTest-544795304 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-34f0f9ae-2b72-4217-a700-b1a3e5524e41" returned: 0 in 0.722s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:39:21 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-c38978de-ac90-4484-94f0-579fd056cfc2 tempest-GroupSnapshotsTest-544795304 None] Lock "cinder-quobyte-34f0f9ae-2b72-4217-a700-b1a3e5524e41" released by "_copy_volume_from_snapshot" :: held 9.909s {{(pid=87444) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 04:39:21 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-c38978de-ac90-4484-94f0-579fd056cfc2 tempest-GroupSnapshotsTest-544795304 None] Lock "cinder-quobyte-25d8fec9-ca34-4bb0-8113-544c54a1bece-34f0f9ae-2b72-4217-a700-b1a3e5524e41" released by "_create_volume_from_snapshot" :: held 9.963s {{(pid=87444) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 04:39:21 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-c38978de-ac90-4484-94f0-579fd056cfc2 tempest-GroupSnapshotsTest-544795304 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 9.990s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 04:39:21 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-212981bd-6b66-4d7b-acd4-bec625d7752f tempest-SnapshotsActionsTest-1538729065 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.994s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 04:39:21 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-212981bd-6b66-4d7b-acd4-bec625d7752f tempest-SnapshotsActionsTest-1538729065 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T02:39:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-406779574',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cb9ba17f-166a-487b-bda4-b5f9b80b656d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='204efa9fffca49838be9aa7c134342b3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T02:39:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T02:39:16Z,use_quota=True,user_id='95d8c70296c94b5ea7022c6af8257096',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(317e369e-1e06-434d-ae95-a335f0e6c903),volume_type_id=317e369e-1e06-434d-ae95-a335f0e6c903)}" {{(pid=87444) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 04:39:21 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.remotefs [None req-212981bd-6b66-4d7b-acd4-bec625d7752f tempest-SnapshotsActionsTest-1538729065 None] Creating volume cb9ba17f-166a-487b-bda4-b5f9b80b656d {{(pid=87444) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 04:39:21 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-212981bd-6b66-4d7b-acd4-bec625d7752f tempest-SnapshotsActionsTest-1538729065 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 04:39:21 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-212981bd-6b66-4d7b-acd4-bec625d7752f tempest-SnapshotsActionsTest-1538729065 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 04:39:21 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-212981bd-6b66-4d7b-acd4-bec625d7752f tempest-SnapshotsActionsTest-1538729065 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922': None} {{(pid=87444) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 04:39:21 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-212981bd-6b66-4d7b-acd4-bec625d7752f tempest-SnapshotsActionsTest-1538729065 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922'] {{(pid=87444) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 04:39:21 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-212981bd-6b66-4d7b-acd4-bec625d7752f tempest-SnapshotsActionsTest-1538729065 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 04:39:21 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-212981bd-6b66-4d7b-acd4-bec625d7752f tempest-SnapshotsActionsTest-1538729065 None] Selected osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922 as target Quobyte volume. {{(pid=87444) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 04:39:21 devstack cinder-volume[87444]: INFO cinder.volume.drivers.remotefs [None req-212981bd-6b66-4d7b-acd4-bec625d7752f tempest-SnapshotsActionsTest-1538729065 None] casted to osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922 Jul 10 04:39:21 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-212981bd-6b66-4d7b-acd4-bec625d7752f tempest-SnapshotsActionsTest-1538729065 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-cb9ba17f-166a-487b-bda4-b5f9b80b656d 1073741824 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:39:21 devstack sudo[95271]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-cb9ba17f-166a-487b-bda4-b5f9b80b656d 1073741824 Jul 10 04:39:21 devstack sudo[95271]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:39:21 devstack cinder-volume[87444]: INFO cinder.volume.manager [None req-c38978de-ac90-4484-94f0-579fd056cfc2 tempest-GroupSnapshotsTest-544795304 None] Create group from source-snapshot-08e53844-ccd5-418a-87f1-44189a3860d5 completed successfully. Jul 10 04:39:21 devstack sudo[95268]: pam_unix(sudo:session): session closed for user root Jul 10 04:39:21 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-09a86bdb-3ae1-49c6-b7dc-1ac6c156fe31 tempest-GroupsV320Test-718188935 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097" returned: 0 in 0.719s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:39:21 devstack cinder-volume[87444]: DEBUG cinder.manager [None req-09a86bdb-3ae1-49c6-b7dc-1ac6c156fe31 tempest-GroupsV320Test-718188935 None] Notifying Schedulers of capabilities ... {{(pid=87444) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 04:39:21 devstack cinder-volume[87444]: INFO cinder.volume.manager [None req-09a86bdb-3ae1-49c6-b7dc-1ac6c156fe31 tempest-GroupsV320Test-718188935 None] Delete group completed successfully. Jul 10 04:39:22 devstack cinder-volume[87444]: DEBUG cinder.volume.flows.manager.create_volume [None req-8af9a4f0-ea5c-4f56-aef6-494b20d39506 tempest-VolumeQuotasAdminTestJSON-198926584 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87444) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 04:39:22 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-8af9a4f0-ea5c-4f56-aef6-494b20d39506 tempest-VolumeQuotasAdminTestJSON-198926584 None] Flow 'volume_create_manager' (b8c198c4-56b1-4eec-a6aa-36b6b2e48393) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 04:39:22 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-8af9a4f0-ea5c-4f56-aef6-494b20d39506 tempest-VolumeQuotasAdminTestJSON-198926584 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (696d7818-2d3d-41dc-a77d-15ef6762a18e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:39:22 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-8af9a4f0-ea5c-4f56-aef6-494b20d39506 tempest-VolumeQuotasAdminTestJSON-198926584 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (696d7818-2d3d-41dc-a77d-15ef6762a18e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T02:39:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1460827798',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d23d9ffd-afe0-4386-acbc-c9427a619a1e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9f50a1e58b1a4ccbaac29719d4f67a46',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T02:39:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T02:39:22Z,use_quota=True,user_id='66d40fe417374be6b9a554333f7899dd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(317e369e-1e06-434d-ae95-a335f0e6c903),volume_type_id=317e369e-1e06-434d-ae95-a335f0e6c903)' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:39:22 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-8af9a4f0-ea5c-4f56-aef6-494b20d39506 tempest-VolumeQuotasAdminTestJSON-198926584 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b77dbd72-5e25-48f3-8425-8e1a438d0d42) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:39:22 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-8af9a4f0-ea5c-4f56-aef6-494b20d39506 tempest-VolumeQuotasAdminTestJSON-198926584 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b77dbd72-5e25-48f3-8425-8e1a438d0d42) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:39:22 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-8af9a4f0-ea5c-4f56-aef6-494b20d39506 tempest-VolumeQuotasAdminTestJSON-198926584 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (918ac319-f9f1-4f2d-b745-f9c29e8bd4f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:39:22 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-8af9a4f0-ea5c-4f56-aef6-494b20d39506 tempest-VolumeQuotasAdminTestJSON-198926584 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (918ac319-f9f1-4f2d-b745-f9c29e8bd4f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd23d9ffd-afe0-4386-acbc-c9427a619a1e', 'volume_name': 'volume-d23d9ffd-afe0-4386-acbc-c9427a619a1e', 'volume_size': 1}' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:39:22 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-8af9a4f0-ea5c-4f56-aef6-494b20d39506 tempest-VolumeQuotasAdminTestJSON-198926584 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6ff82f9e-966c-4a26-851e-d61eb5ad65bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:39:22 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-8af9a4f0-ea5c-4f56-aef6-494b20d39506 tempest-VolumeQuotasAdminTestJSON-198926584 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6ff82f9e-966c-4a26-851e-d61eb5ad65bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:39:22 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-8af9a4f0-ea5c-4f56-aef6-494b20d39506 tempest-VolumeQuotasAdminTestJSON-198926584 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eaf140ce-84bd-45ae-a4ed-7bcf707f5203) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:39:22 devstack cinder-volume[87444]: INFO cinder.volume.flows.manager.create_volume [None req-8af9a4f0-ea5c-4f56-aef6-494b20d39506 tempest-VolumeQuotasAdminTestJSON-198926584 None] Volume d23d9ffd-afe0-4386-acbc-c9427a619a1e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d23d9ffd-afe0-4386-acbc-c9427a619a1e', 'volume_size': 1} Jul 10 04:39:22 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-8af9a4f0-ea5c-4f56-aef6-494b20d39506 tempest-VolumeQuotasAdminTestJSON-198926584 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 04:39:22 devstack sudo[95271]: pam_unix(sudo:session): session closed for user root Jul 10 04:39:22 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-212981bd-6b66-4d7b-acd4-bec625d7752f tempest-SnapshotsActionsTest-1538729065 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-cb9ba17f-166a-487b-bda4-b5f9b80b656d 1073741824" returned: 0 in 0.919s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:39:22 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-212981bd-6b66-4d7b-acd4-bec625d7752f tempest-SnapshotsActionsTest-1538729065 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-cb9ba17f-166a-487b-bda4-b5f9b80b656d {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:39:22 devstack sudo[95278]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-cb9ba17f-166a-487b-bda4-b5f9b80b656d Jul 10 04:39:22 devstack sudo[95278]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:39:23 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-ff66ce93-da9c-4853-a9ef-d0ba8deca264 tempest-GroupSnapshotsTest-544795304 None] Acquiring lock "cinder-quobyte-34f0f9ae-2b72-4217-a700-b1a3e5524e41" by "delete_volume" {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 04:39:23 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-ff66ce93-da9c-4853-a9ef-d0ba8deca264 tempest-GroupSnapshotsTest-544795304 None] Lock "cinder-quobyte-34f0f9ae-2b72-4217-a700-b1a3e5524e41" acquired by "delete_volume" :: waited 0.023s {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 04:39:23 devstack cinder-volume[87444]: DEBUG oslo.privsep.daemon [-] privsep: reply[e57ce3ee-26b4-4eba-ab1e-022bdcf16807]: (4, 'qcow2') {{(pid=88499) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 04:39:23 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-ff66ce93-da9c-4853-a9ef-d0ba8deca264 tempest-GroupSnapshotsTest-544795304 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-34f0f9ae-2b72-4217-a700-b1a3e5524e41 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:39:23 devstack sudo[95281]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-34f0f9ae-2b72-4217-a700-b1a3e5524e41 Jul 10 04:39:23 devstack sudo[95281]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:39:23 devstack sudo[95278]: pam_unix(sudo:session): session closed for user root Jul 10 04:39:23 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-212981bd-6b66-4d7b-acd4-bec625d7752f tempest-SnapshotsActionsTest-1538729065 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-cb9ba17f-166a-487b-bda4-b5f9b80b656d" returned: 0 in 0.738s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:39:23 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-212981bd-6b66-4d7b-acd4-bec625d7752f tempest-SnapshotsActionsTest-1538729065 None] <== create_volume: return (1717ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922'} {{(pid=87444) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 04:39:23 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-212981bd-6b66-4d7b-acd4-bec625d7752f tempest-SnapshotsActionsTest-1538729065 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.720s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 04:39:23 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-8af9a4f0-ea5c-4f56-aef6-494b20d39506 tempest-VolumeQuotasAdminTestJSON-198926584 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.172s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 04:39:23 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-8af9a4f0-ea5c-4f56-aef6-494b20d39506 tempest-VolumeQuotasAdminTestJSON-198926584 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T02:39:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1460827798',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d23d9ffd-afe0-4386-acbc-c9427a619a1e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9f50a1e58b1a4ccbaac29719d4f67a46',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T02:39:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T02:39:22Z,use_quota=True,user_id='66d40fe417374be6b9a554333f7899dd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(317e369e-1e06-434d-ae95-a335f0e6c903),volume_type_id=317e369e-1e06-434d-ae95-a335f0e6c903)}" {{(pid=87444) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 04:39:23 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.remotefs [None req-8af9a4f0-ea5c-4f56-aef6-494b20d39506 tempest-VolumeQuotasAdminTestJSON-198926584 None] Creating volume d23d9ffd-afe0-4386-acbc-c9427a619a1e {{(pid=87444) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 04:39:23 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-8af9a4f0-ea5c-4f56-aef6-494b20d39506 tempest-VolumeQuotasAdminTestJSON-198926584 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 04:39:23 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-8af9a4f0-ea5c-4f56-aef6-494b20d39506 tempest-VolumeQuotasAdminTestJSON-198926584 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 04:39:23 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-8af9a4f0-ea5c-4f56-aef6-494b20d39506 tempest-VolumeQuotasAdminTestJSON-198926584 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922': None} {{(pid=87444) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 04:39:23 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-8af9a4f0-ea5c-4f56-aef6-494b20d39506 tempest-VolumeQuotasAdminTestJSON-198926584 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922'] {{(pid=87444) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 04:39:23 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-8af9a4f0-ea5c-4f56-aef6-494b20d39506 tempest-VolumeQuotasAdminTestJSON-198926584 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 04:39:23 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-8af9a4f0-ea5c-4f56-aef6-494b20d39506 tempest-VolumeQuotasAdminTestJSON-198926584 None] Selected osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922 as target Quobyte volume. {{(pid=87444) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 04:39:23 devstack cinder-volume[87444]: INFO cinder.volume.drivers.remotefs [None req-8af9a4f0-ea5c-4f56-aef6-494b20d39506 tempest-VolumeQuotasAdminTestJSON-198926584 None] casted to osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922 Jul 10 04:39:23 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-8af9a4f0-ea5c-4f56-aef6-494b20d39506 tempest-VolumeQuotasAdminTestJSON-198926584 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-d23d9ffd-afe0-4386-acbc-c9427a619a1e 1073741824 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:39:23 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-212981bd-6b66-4d7b-acd4-bec625d7752f tempest-SnapshotsActionsTest-1538729065 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0621bc06-ce31-4551-937f-a8b9d3b3f8e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cb9ba17f-166a-487b-bda4-b5f9b80b656d', 'volume_size': 1}' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:39:23 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-212981bd-6b66-4d7b-acd4-bec625d7752f tempest-SnapshotsActionsTest-1538729065 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f1db1940-ea9e-4450-8c17-bd67f978d0be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:39:23 devstack sudo[95284]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-d23d9ffd-afe0-4386-acbc-c9427a619a1e 1073741824 Jul 10 04:39:23 devstack sudo[95284]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:39:23 devstack cinder-volume[87444]: INFO cinder.volume.flows.manager.create_volume [None req-212981bd-6b66-4d7b-acd4-bec625d7752f tempest-SnapshotsActionsTest-1538729065 None] Volume volume-cb9ba17f-166a-487b-bda4-b5f9b80b656d (cb9ba17f-166a-487b-bda4-b5f9b80b656d): created successfully Jul 10 04:39:23 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-212981bd-6b66-4d7b-acd4-bec625d7752f tempest-SnapshotsActionsTest-1538729065 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f1db1940-ea9e-4450-8c17-bd67f978d0be) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:39:23 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-212981bd-6b66-4d7b-acd4-bec625d7752f tempest-SnapshotsActionsTest-1538729065 None] Flow 'volume_create_manager' (1bf775c1-6dc0-47b8-a106-e4155c1557c4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87444) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 04:39:23 devstack cinder-volume[87444]: INFO cinder.volume.manager [None req-212981bd-6b66-4d7b-acd4-bec625d7752f tempest-SnapshotsActionsTest-1538729065 None] Created volume successfully. Jul 10 04:39:24 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-3bfa2f79-3035-4396-9649-a55b483f0104 tempest-SnapshotsActionsTest-1538729065 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 04:39:24 devstack sudo[95281]: pam_unix(sudo:session): session closed for user root Jul 10 04:39:24 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-ff66ce93-da9c-4853-a9ef-d0ba8deca264 tempest-GroupSnapshotsTest-544795304 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-34f0f9ae-2b72-4217-a700-b1a3e5524e41" returned: 0 in 0.958s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:39:24 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-ff66ce93-da9c-4853-a9ef-d0ba8deca264 tempest-GroupSnapshotsTest-544795304 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-34f0f9ae-2b72-4217-a700-b1a3e5524e41 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:39:24 devstack sudo[95290]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-34f0f9ae-2b72-4217-a700-b1a3e5524e41 Jul 10 04:39:24 devstack sudo[95290]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:39:24 devstack sudo[95284]: pam_unix(sudo:session): session closed for user root Jul 10 04:39:24 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-8af9a4f0-ea5c-4f56-aef6-494b20d39506 tempest-VolumeQuotasAdminTestJSON-198926584 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-d23d9ffd-afe0-4386-acbc-c9427a619a1e 1073741824" returned: 0 in 1.077s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:39:24 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-8af9a4f0-ea5c-4f56-aef6-494b20d39506 tempest-VolumeQuotasAdminTestJSON-198926584 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-d23d9ffd-afe0-4386-acbc-c9427a619a1e {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:39:24 devstack sudo[95295]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-d23d9ffd-afe0-4386-acbc-c9427a619a1e Jul 10 04:39:24 devstack sudo[95295]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:39:24 devstack sudo[95290]: pam_unix(sudo:session): session closed for user root Jul 10 04:39:24 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-ff66ce93-da9c-4853-a9ef-d0ba8deca264 tempest-GroupSnapshotsTest-544795304 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-34f0f9ae-2b72-4217-a700-b1a3e5524e41" returned: 0 in 0.707s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:39:24 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-ff66ce93-da9c-4853-a9ef-d0ba8deca264 tempest-GroupSnapshotsTest-544795304 None] Lock "cinder-quobyte-34f0f9ae-2b72-4217-a700-b1a3e5524e41" released by "delete_volume" :: held 1.722s {{(pid=87444) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 04:39:24 devstack cinder-volume[87444]: DEBUG cinder.quota [None req-ff66ce93-da9c-4853-a9ef-d0ba8deca264 tempest-GroupSnapshotsTest-544795304 None] Created reservations ['02a23221-9f6a-4a61-b42b-dae3a5bcd2cb'] {{(pid=87444) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 04:39:24 devstack cinder-volume[87444]: WARNING cinder.quota [None req-ff66ce93-da9c-4853-a9ef-d0ba8deca264 tempest-GroupSnapshotsTest-544795304 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-575622372 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-575622372, it is now deprecated. Please use the default quota class for default quota. Jul 10 04:39:24 devstack cinder-volume[87444]: WARNING cinder.quota [None req-ff66ce93-da9c-4853-a9ef-d0ba8deca264 tempest-GroupSnapshotsTest-544795304 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-575622372 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-575622372, it is now deprecated. Please use the default quota class for default quota. Jul 10 04:39:24 devstack cinder-volume[87444]: DEBUG cinder.quota [None req-ff66ce93-da9c-4853-a9ef-d0ba8deca264 tempest-GroupSnapshotsTest-544795304 None] Created reservations ['b155af98-a9bb-4d5c-bdad-6cb2cae43d7c', 'f7fb5e5a-f192-4a4f-8971-4fccfd7515aa', '5290ec96-4a55-4222-8c66-f9a628624c46', '1459cbb9-1022-4254-8732-82ffaa0f8384'] {{(pid=87444) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 04:39:25 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-ff66ce93-da9c-4853-a9ef-d0ba8deca264 tempest-GroupSnapshotsTest-544795304 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 04:39:25 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-ff66ce93-da9c-4853-a9ef-d0ba8deca264 tempest-GroupSnapshotsTest-544795304 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 04:39:25 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-ff66ce93-da9c-4853-a9ef-d0ba8deca264 tempest-GroupSnapshotsTest-544795304 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922': None} {{(pid=87444) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 04:39:25 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-ff66ce93-da9c-4853-a9ef-d0ba8deca264 tempest-GroupSnapshotsTest-544795304 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922'] {{(pid=87444) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 04:39:25 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-ff66ce93-da9c-4853-a9ef-d0ba8deca264 tempest-GroupSnapshotsTest-544795304 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 04:39:25 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-ff66ce93-da9c-4853-a9ef-d0ba8deca264 tempest-GroupSnapshotsTest-544795304 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:39:25 devstack sudo[95299]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097 Jul 10 04:39:25 devstack sudo[95299]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:39:25 devstack sudo[95295]: pam_unix(sudo:session): session closed for user root Jul 10 04:39:25 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-8af9a4f0-ea5c-4f56-aef6-494b20d39506 tempest-VolumeQuotasAdminTestJSON-198926584 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-d23d9ffd-afe0-4386-acbc-c9427a619a1e" returned: 0 in 0.733s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:39:25 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-8af9a4f0-ea5c-4f56-aef6-494b20d39506 tempest-VolumeQuotasAdminTestJSON-198926584 None] <== create_volume: return (1868ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922'} {{(pid=87444) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 04:39:25 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-8af9a4f0-ea5c-4f56-aef6-494b20d39506 tempest-VolumeQuotasAdminTestJSON-198926584 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.873s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 04:39:25 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-3bfa2f79-3035-4396-9649-a55b483f0104 tempest-SnapshotsActionsTest-1538729065 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.249s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 04:39:25 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-8af9a4f0-ea5c-4f56-aef6-494b20d39506 tempest-VolumeQuotasAdminTestJSON-198926584 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eaf140ce-84bd-45ae-a4ed-7bcf707f5203) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d23d9ffd-afe0-4386-acbc-c9427a619a1e', 'volume_size': 1}' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:39:25 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-8af9a4f0-ea5c-4f56-aef6-494b20d39506 tempest-VolumeQuotasAdminTestJSON-198926584 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7082b4bc-2178-4f47-9e4d-e850edbcefe7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:39:25 devstack cinder-volume[87444]: INFO cinder.volume.flows.manager.create_volume [None req-8af9a4f0-ea5c-4f56-aef6-494b20d39506 tempest-VolumeQuotasAdminTestJSON-198926584 None] Volume volume-d23d9ffd-afe0-4386-acbc-c9427a619a1e (d23d9ffd-afe0-4386-acbc-c9427a619a1e): created successfully Jul 10 04:39:25 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-8af9a4f0-ea5c-4f56-aef6-494b20d39506 tempest-VolumeQuotasAdminTestJSON-198926584 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7082b4bc-2178-4f47-9e4d-e850edbcefe7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:39:25 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-8af9a4f0-ea5c-4f56-aef6-494b20d39506 tempest-VolumeQuotasAdminTestJSON-198926584 None] Flow 'volume_create_manager' (b8c198c4-56b1-4eec-a6aa-36b6b2e48393) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87444) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 04:39:25 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.remotefs [None req-3bfa2f79-3035-4396-9649-a55b483f0104 tempest-SnapshotsActionsTest-1538729065 None] Creating offline snapshot ee8c454a-c0ff-4b09-826b-830aa5ec0536 of volume cb9ba17f-166a-487b-bda4-b5f9b80b656d {{(pid=87444) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 10 04:39:25 devstack cinder-volume[87444]: INFO cinder.volume.manager [None req-8af9a4f0-ea5c-4f56-aef6-494b20d39506 tempest-VolumeQuotasAdminTestJSON-198926584 None] Created volume successfully. Jul 10 04:39:25 devstack cinder-volume[87444]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec72b1fc-bdf9-410f-b983-be804048bb5a]: (4, 'qcow2') {{(pid=88499) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 04:39:25 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-3bfa2f79-3035-4396-9649-a55b483f0104 tempest-SnapshotsActionsTest-1538729065 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-cb9ba17f-166a-487b-bda4-b5f9b80b656d {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:39:25 devstack sudo[95301]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-cb9ba17f-166a-487b-bda4-b5f9b80b656d Jul 10 04:39:25 devstack sudo[95301]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:39:25 devstack cinder-volume[87444]: INFO cinder.volume.manager [None req-216e6a3c-7d65-40b6-a30c-00fdbe57d819 tempest-GroupSnapshotsTest-544795304 None] group_snapshot 08e53844-ccd5-418a-87f1-44189a3860d5: deleting Jul 10 04:39:25 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-216e6a3c-7d65-40b6-a30c-00fdbe57d819 tempest-GroupSnapshotsTest-544795304 None] group_snapshot 08e53844-ccd5-418a-87f1-44189a3860d5: deleting {{(pid=87444) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Jul 10 04:39:25 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-216e6a3c-7d65-40b6-a30c-00fdbe57d819 tempest-GroupSnapshotsTest-544795304 None] Acquiring lock "cinder-quobyte-d022d806-0a29-46b8-b021-953c88761b25" by "delete_snapshot" {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 04:39:25 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-216e6a3c-7d65-40b6-a30c-00fdbe57d819 tempest-GroupSnapshotsTest-544795304 None] Lock "cinder-quobyte-d022d806-0a29-46b8-b021-953c88761b25" acquired by "delete_snapshot" :: waited 0.032s {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 04:39:25 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-216e6a3c-7d65-40b6-a30c-00fdbe57d819 tempest-GroupSnapshotsTest-544795304 None] Acquiring lock "cinder-quobyte-25d8fec9-ca34-4bb0-8113-544c54a1bece" by "_delete_snapshot" {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 04:39:25 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-216e6a3c-7d65-40b6-a30c-00fdbe57d819 tempest-GroupSnapshotsTest-544795304 None] Lock "cinder-quobyte-25d8fec9-ca34-4bb0-8113-544c54a1bece" acquired by "_delete_snapshot" :: waited 0.027s {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 04:39:25 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.remotefs [None req-216e6a3c-7d65-40b6-a30c-00fdbe57d819 tempest-GroupSnapshotsTest-544795304 None] Deleting offline snapshot 25d8fec9-ca34-4bb0-8113-544c54a1bece of volume d022d806-0a29-46b8-b021-953c88761b25 {{(pid=87444) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 10 04:39:25 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.remotefs [None req-216e6a3c-7d65-40b6-a30c-00fdbe57d819 tempest-GroupSnapshotsTest-544795304 None] snapshot_file for this snap is: volume-d022d806-0a29-46b8-b021-953c88761b25.25d8fec9-ca34-4bb0-8113-544c54a1bece {{(pid=87444) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 10 04:39:25 devstack cinder-volume[87444]: DEBUG oslo.privsep.daemon [-] privsep: reply[564b2eef-bc1a-408e-9688-d655b904e2e6]: (4, 'qcow2') {{(pid=88499) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 04:39:25 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-216e6a3c-7d65-40b6-a30c-00fdbe57d819 tempest-GroupSnapshotsTest-544795304 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-d022d806-0a29-46b8-b021-953c88761b25.25d8fec9-ca34-4bb0-8113-544c54a1bece {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:39:25 devstack sudo[95299]: pam_unix(sudo:session): session closed for user root Jul 10 04:39:25 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-ff66ce93-da9c-4853-a9ef-d0ba8deca264 tempest-GroupSnapshotsTest-544795304 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097" returned: 0 in 0.813s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:39:25 devstack cinder-volume[87444]: DEBUG cinder.manager [None req-ff66ce93-da9c-4853-a9ef-d0ba8deca264 tempest-GroupSnapshotsTest-544795304 None] Notifying Schedulers of capabilities ... {{(pid=87444) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 04:39:25 devstack cinder-volume[87444]: INFO cinder.volume.manager [None req-ff66ce93-da9c-4853-a9ef-d0ba8deca264 tempest-GroupSnapshotsTest-544795304 None] Delete group completed successfully. Jul 10 04:39:26 devstack sudo[95304]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-d022d806-0a29-46b8-b021-953c88761b25.25d8fec9-ca34-4bb0-8113-544c54a1bece Jul 10 04:39:26 devstack sudo[95304]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:39:26 devstack sudo[95301]: pam_unix(sudo:session): session closed for user root Jul 10 04:39:26 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-3bfa2f79-3035-4396-9649-a55b483f0104 tempest-SnapshotsActionsTest-1538729065 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-cb9ba17f-166a-487b-bda4-b5f9b80b656d" returned: 0 in 0.949s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:39:26 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-3bfa2f79-3035-4396-9649-a55b483f0104 tempest-SnapshotsActionsTest-1538729065 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-cb9ba17f-166a-487b-bda4-b5f9b80b656d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-cb9ba17f-166a-487b-bda4-b5f9b80b656d.ee8c454a-c0ff-4b09-826b-830aa5ec0536 1G {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:39:26 devstack sudo[95309]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-cb9ba17f-166a-487b-bda4-b5f9b80b656d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-cb9ba17f-166a-487b-bda4-b5f9b80b656d.ee8c454a-c0ff-4b09-826b-830aa5ec0536 1G Jul 10 04:39:26 devstack sudo[95309]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:39:26 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-3a926a39-7717-49d0-8f76-a7a8845ccc63 tempest-VolumeQuotasAdminTestJSON-198926584 None] Acquiring lock "cinder-d23d9ffd-afe0-4386-acbc-c9427a619a1e-delete_volume" by "delete_volume" {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 04:39:26 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-3a926a39-7717-49d0-8f76-a7a8845ccc63 tempest-VolumeQuotasAdminTestJSON-198926584 None] Lock "cinder-d23d9ffd-afe0-4386-acbc-c9427a619a1e-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 04:39:26 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-3a926a39-7717-49d0-8f76-a7a8845ccc63 tempest-VolumeQuotasAdminTestJSON-198926584 None] Acquiring lock "cinder-quobyte-d23d9ffd-afe0-4386-acbc-c9427a619a1e" by "delete_volume" {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 04:39:26 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-3a926a39-7717-49d0-8f76-a7a8845ccc63 tempest-VolumeQuotasAdminTestJSON-198926584 None] Lock "cinder-quobyte-d23d9ffd-afe0-4386-acbc-c9427a619a1e" acquired by "delete_volume" :: waited 0.026s {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 04:39:26 devstack cinder-volume[87444]: DEBUG oslo.privsep.daemon [-] privsep: reply[738d1aec-d6c6-4632-b9e7-b64d77765200]: (4, 'qcow2') {{(pid=88499) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 04:39:26 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-3a926a39-7717-49d0-8f76-a7a8845ccc63 tempest-VolumeQuotasAdminTestJSON-198926584 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-d23d9ffd-afe0-4386-acbc-c9427a619a1e {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:39:26 devstack sudo[95313]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-d23d9ffd-afe0-4386-acbc-c9427a619a1e Jul 10 04:39:26 devstack sudo[95313]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:39:26 devstack sudo[95304]: pam_unix(sudo:session): session closed for user root Jul 10 04:39:26 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-216e6a3c-7d65-40b6-a30c-00fdbe57d819 tempest-GroupSnapshotsTest-544795304 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-d022d806-0a29-46b8-b021-953c88761b25.25d8fec9-ca34-4bb0-8113-544c54a1bece" returned: 0 in 0.974s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:39:26 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.remotefs [None req-216e6a3c-7d65-40b6-a30c-00fdbe57d819 tempest-GroupSnapshotsTest-544795304 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d022d806-0a29-46b8-b021-953c88761b25(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87444) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 10 04:39:26 devstack cinder-volume[87444]: DEBUG oslo.privsep.daemon [-] privsep: reply[2fcb7293-2d6f-43e8-9f8f-f1d1853d136b]: (4, 'qcow2') {{(pid=88499) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 04:39:26 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-216e6a3c-7d65-40b6-a30c-00fdbe57d819 tempest-GroupSnapshotsTest-544795304 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-d022d806-0a29-46b8-b021-953c88761b25 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:39:26 devstack sudo[95316]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-d022d806-0a29-46b8-b021-953c88761b25 Jul 10 04:39:26 devstack sudo[95316]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:39:27 devstack sudo[95309]: pam_unix(sudo:session): session closed for user root Jul 10 04:39:27 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-3bfa2f79-3035-4396-9649-a55b483f0104 tempest-SnapshotsActionsTest-1538729065 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-cb9ba17f-166a-487b-bda4-b5f9b80b656d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-cb9ba17f-166a-487b-bda4-b5f9b80b656d.ee8c454a-c0ff-4b09-826b-830aa5ec0536 1G" returned: 0 in 0.980s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:39:27 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-3bfa2f79-3035-4396-9649-a55b483f0104 tempest-SnapshotsActionsTest-1538729065 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cb9ba17f-166a-487b-bda4-b5f9b80b656d -F qcow2 /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-cb9ba17f-166a-487b-bda4-b5f9b80b656d.ee8c454a-c0ff-4b09-826b-830aa5ec0536 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:39:27 devstack sudo[95322]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cb9ba17f-166a-487b-bda4-b5f9b80b656d -F qcow2 /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-cb9ba17f-166a-487b-bda4-b5f9b80b656d.ee8c454a-c0ff-4b09-826b-830aa5ec0536 Jul 10 04:39:27 devstack sudo[95322]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:39:27 devstack sudo[95313]: pam_unix(sudo:session): session closed for user root Jul 10 04:39:27 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-3a926a39-7717-49d0-8f76-a7a8845ccc63 tempest-VolumeQuotasAdminTestJSON-198926584 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-d23d9ffd-afe0-4386-acbc-c9427a619a1e" returned: 0 in 0.901s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:39:27 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-3a926a39-7717-49d0-8f76-a7a8845ccc63 tempest-VolumeQuotasAdminTestJSON-198926584 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-d23d9ffd-afe0-4386-acbc-c9427a619a1e {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:39:27 devstack sudo[95327]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-d23d9ffd-afe0-4386-acbc-c9427a619a1e Jul 10 04:39:27 devstack sudo[95327]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:39:27 devstack sudo[95316]: pam_unix(sudo:session): session closed for user root Jul 10 04:39:27 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-216e6a3c-7d65-40b6-a30c-00fdbe57d819 tempest-GroupSnapshotsTest-544795304 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-d022d806-0a29-46b8-b021-953c88761b25" returned: 0 in 0.959s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:39:27 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-216e6a3c-7d65-40b6-a30c-00fdbe57d819 tempest-GroupSnapshotsTest-544795304 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-d022d806-0a29-46b8-b021-953c88761b25.25d8fec9-ca34-4bb0-8113-544c54a1bece {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:39:27 devstack sudo[95332]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-d022d806-0a29-46b8-b021-953c88761b25.25d8fec9-ca34-4bb0-8113-544c54a1bece Jul 10 04:39:27 devstack sudo[95332]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:39:28 devstack sudo[95322]: pam_unix(sudo:session): session closed for user root Jul 10 04:39:28 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-3bfa2f79-3035-4396-9649-a55b483f0104 tempest-SnapshotsActionsTest-1538729065 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cb9ba17f-166a-487b-bda4-b5f9b80b656d -F qcow2 /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-cb9ba17f-166a-487b-bda4-b5f9b80b656d.ee8c454a-c0ff-4b09-826b-830aa5ec0536" returned: 0 in 0.814s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:39:28 devstack cinder-volume[87444]: WARNING cinder.volume.drivers.remotefs [None req-3bfa2f79-3035-4396-9649-a55b483f0104 tempest-SnapshotsActionsTest-1538729065 None] /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-cb9ba17f-166a-487b-bda4-b5f9b80b656d.ee8c454a-c0ff-4b09-826b-830aa5ec0536 is being set with open permissions: ugo+rw Jul 10 04:39:28 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-3bfa2f79-3035-4396-9649-a55b483f0104 tempest-SnapshotsActionsTest-1538729065 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-cb9ba17f-166a-487b-bda4-b5f9b80b656d.ee8c454a-c0ff-4b09-826b-830aa5ec0536 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:39:28 devstack sudo[95337]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-cb9ba17f-166a-487b-bda4-b5f9b80b656d.ee8c454a-c0ff-4b09-826b-830aa5ec0536 Jul 10 04:39:28 devstack sudo[95337]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:39:28 devstack sudo[95327]: pam_unix(sudo:session): session closed for user root Jul 10 04:39:28 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-3a926a39-7717-49d0-8f76-a7a8845ccc63 tempest-VolumeQuotasAdminTestJSON-198926584 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-d23d9ffd-afe0-4386-acbc-c9427a619a1e" returned: 0 in 0.840s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:39:28 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-3a926a39-7717-49d0-8f76-a7a8845ccc63 tempest-VolumeQuotasAdminTestJSON-198926584 None] Lock "cinder-quobyte-d23d9ffd-afe0-4386-acbc-c9427a619a1e" released by "delete_volume" :: held 1.799s {{(pid=87444) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 04:39:28 devstack cinder-volume[87444]: DEBUG cinder.quota [None req-3a926a39-7717-49d0-8f76-a7a8845ccc63 tempest-VolumeQuotasAdminTestJSON-198926584 None] Created reservations ['e7ee4d43-ff06-4a08-bc48-80c28daffcc6', '4d412e70-5499-4111-a050-cc06ec5cab08', '20d53875-d575-4640-9e13-0e15fd4b8d42', '37bc3c87-f4e9-43f6-a12e-388883370136'] {{(pid=87444) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 04:39:28 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-3a926a39-7717-49d0-8f76-a7a8845ccc63 tempest-VolumeQuotasAdminTestJSON-198926584 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 04:39:28 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-3a926a39-7717-49d0-8f76-a7a8845ccc63 tempest-VolumeQuotasAdminTestJSON-198926584 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 04:39:28 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-3a926a39-7717-49d0-8f76-a7a8845ccc63 tempest-VolumeQuotasAdminTestJSON-198926584 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922': None} {{(pid=87444) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 04:39:28 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-3a926a39-7717-49d0-8f76-a7a8845ccc63 tempest-VolumeQuotasAdminTestJSON-198926584 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922'] {{(pid=87444) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 04:39:28 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-3a926a39-7717-49d0-8f76-a7a8845ccc63 tempest-VolumeQuotasAdminTestJSON-198926584 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 04:39:28 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-3a926a39-7717-49d0-8f76-a7a8845ccc63 tempest-VolumeQuotasAdminTestJSON-198926584 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:39:28 devstack sudo[95378]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097 Jul 10 04:39:28 devstack sudo[95378]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:39:28 devstack sudo[95332]: pam_unix(sudo:session): session closed for user root Jul 10 04:39:28 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-216e6a3c-7d65-40b6-a30c-00fdbe57d819 tempest-GroupSnapshotsTest-544795304 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-d022d806-0a29-46b8-b021-953c88761b25.25d8fec9-ca34-4bb0-8113-544c54a1bece" returned: 0 in 1.054s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:39:28 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-216e6a3c-7d65-40b6-a30c-00fdbe57d819 tempest-GroupSnapshotsTest-544795304 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-d022d806-0a29-46b8-b021-953c88761b25.25d8fec9-ca34-4bb0-8113-544c54a1bece {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:39:28 devstack sudo[95382]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-d022d806-0a29-46b8-b021-953c88761b25.25d8fec9-ca34-4bb0-8113-544c54a1bece Jul 10 04:39:28 devstack sudo[95382]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:39:29 devstack sudo[95337]: pam_unix(sudo:session): session closed for user root Jul 10 04:39:29 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-3bfa2f79-3035-4396-9649-a55b483f0104 tempest-SnapshotsActionsTest-1538729065 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-cb9ba17f-166a-487b-bda4-b5f9b80b656d.ee8c454a-c0ff-4b09-826b-830aa5ec0536" returned: 0 in 0.932s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:39:29 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-3bfa2f79-3035-4396-9649-a55b483f0104 tempest-SnapshotsActionsTest-1538729065 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-cb9ba17f-166a-487b-bda4-b5f9b80b656d.info {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:39:29 devstack sudo[95385]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-cb9ba17f-166a-487b-bda4-b5f9b80b656d.info Jul 10 04:39:29 devstack sudo[95385]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:39:29 devstack sudo[95378]: pam_unix(sudo:session): session closed for user root Jul 10 04:39:29 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-3a926a39-7717-49d0-8f76-a7a8845ccc63 tempest-VolumeQuotasAdminTestJSON-198926584 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097" returned: 0 in 0.879s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:39:29 devstack cinder-volume[87444]: DEBUG cinder.manager [None req-3a926a39-7717-49d0-8f76-a7a8845ccc63 tempest-VolumeQuotasAdminTestJSON-198926584 None] Notifying Schedulers of capabilities ... {{(pid=87444) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 04:39:29 devstack cinder-volume[87444]: INFO cinder.volume.manager [None req-3a926a39-7717-49d0-8f76-a7a8845ccc63 tempest-VolumeQuotasAdminTestJSON-198926584 None] Deleted volume successfully. Jul 10 04:39:29 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-3a926a39-7717-49d0-8f76-a7a8845ccc63 tempest-VolumeQuotasAdminTestJSON-198926584 None] Lock "cinder-d23d9ffd-afe0-4386-acbc-c9427a619a1e-delete_volume" released by "delete_volume" :: held 3.034s {{(pid=87444) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 04:39:29 devstack cinder-volume[87444]: DEBUG cinder.volume.flows.manager.create_volume [None req-9b1a1bab-8c68-4c18-ab47-75a5f2988f78 tempest-VolumeQuotasAdminTestJSON-198926584 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87444) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 04:39:29 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-9b1a1bab-8c68-4c18-ab47-75a5f2988f78 tempest-VolumeQuotasAdminTestJSON-198926584 None] Flow 'volume_create_manager' (fb1daccf-2aff-4c69-9bbd-74653453b13f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 04:39:29 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-9b1a1bab-8c68-4c18-ab47-75a5f2988f78 tempest-VolumeQuotasAdminTestJSON-198926584 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (58ed93eb-2636-4321-a3fc-78d12617eb0d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:39:29 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-9b1a1bab-8c68-4c18-ab47-75a5f2988f78 tempest-VolumeQuotasAdminTestJSON-198926584 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (58ed93eb-2636-4321-a3fc-78d12617eb0d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T02:39:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-150864968',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=36347467-e8c8-4bfa-9c52-8ebb3deda41a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9f50a1e58b1a4ccbaac29719d4f67a46',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T02:39:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T02:39:30Z,use_quota=True,user_id='66d40fe417374be6b9a554333f7899dd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(317e369e-1e06-434d-ae95-a335f0e6c903),volume_type_id=317e369e-1e06-434d-ae95-a335f0e6c903)' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:39:29 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-9b1a1bab-8c68-4c18-ab47-75a5f2988f78 tempest-VolumeQuotasAdminTestJSON-198926584 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ee98272c-1c06-4653-a758-4ab457653310) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:39:29 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-9b1a1bab-8c68-4c18-ab47-75a5f2988f78 tempest-VolumeQuotasAdminTestJSON-198926584 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ee98272c-1c06-4653-a758-4ab457653310) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:39:29 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-9b1a1bab-8c68-4c18-ab47-75a5f2988f78 tempest-VolumeQuotasAdminTestJSON-198926584 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (775f2be6-757b-4acb-b93e-1e744fa80bef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:39:29 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-9b1a1bab-8c68-4c18-ab47-75a5f2988f78 tempest-VolumeQuotasAdminTestJSON-198926584 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (775f2be6-757b-4acb-b93e-1e744fa80bef) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '36347467-e8c8-4bfa-9c52-8ebb3deda41a', 'volume_name': 'volume-36347467-e8c8-4bfa-9c52-8ebb3deda41a', 'volume_size': 1}' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:39:29 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-9b1a1bab-8c68-4c18-ab47-75a5f2988f78 tempest-VolumeQuotasAdminTestJSON-198926584 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6cdfbdc2-45db-48e2-91e7-c34fb2b49c5a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:39:29 devstack sudo[95382]: pam_unix(sudo:session): session closed for user root Jul 10 04:39:29 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-9b1a1bab-8c68-4c18-ab47-75a5f2988f78 tempest-VolumeQuotasAdminTestJSON-198926584 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6cdfbdc2-45db-48e2-91e7-c34fb2b49c5a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:39:29 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-9b1a1bab-8c68-4c18-ab47-75a5f2988f78 tempest-VolumeQuotasAdminTestJSON-198926584 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6cee4213-3818-4d2f-935e-d3058facc82f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:39:29 devstack cinder-volume[87444]: INFO cinder.volume.flows.manager.create_volume [None req-9b1a1bab-8c68-4c18-ab47-75a5f2988f78 tempest-VolumeQuotasAdminTestJSON-198926584 None] Volume 36347467-e8c8-4bfa-9c52-8ebb3deda41a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-36347467-e8c8-4bfa-9c52-8ebb3deda41a', 'volume_size': 1} Jul 10 04:39:29 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-9b1a1bab-8c68-4c18-ab47-75a5f2988f78 tempest-VolumeQuotasAdminTestJSON-198926584 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 04:39:29 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-216e6a3c-7d65-40b6-a30c-00fdbe57d819 tempest-GroupSnapshotsTest-544795304 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-d022d806-0a29-46b8-b021-953c88761b25.25d8fec9-ca34-4bb0-8113-544c54a1bece" returned: 0 in 1.035s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:39:29 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-216e6a3c-7d65-40b6-a30c-00fdbe57d819 tempest-GroupSnapshotsTest-544795304 None] Lock "cinder-quobyte-25d8fec9-ca34-4bb0-8113-544c54a1bece" released by "_delete_snapshot" :: held 4.151s {{(pid=87444) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 04:39:29 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-216e6a3c-7d65-40b6-a30c-00fdbe57d819 tempest-GroupSnapshotsTest-544795304 None] Lock "cinder-quobyte-d022d806-0a29-46b8-b021-953c88761b25" released by "delete_snapshot" :: held 4.185s {{(pid=87444) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 04:39:30 devstack cinder-volume[87444]: WARNING cinder.quota [None req-216e6a3c-7d65-40b6-a30c-00fdbe57d819 tempest-GroupSnapshotsTest-544795304 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-575622372 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-575622372, it is now deprecated. Please use the default quota class for default quota. Jul 10 04:39:30 devstack cinder-volume[87444]: DEBUG cinder.quota [None req-216e6a3c-7d65-40b6-a30c-00fdbe57d819 tempest-GroupSnapshotsTest-544795304 None] Created reservations ['119e6fea-2063-4701-89fe-84a23fff7967', '54133722-97ab-443d-bfbe-8b90b7d04a08', '96b43e87-026b-401d-b0e0-4c2a6231f2ad', 'd4a3a3e3-a5c3-4ba7-8123-78cf668a43b6'] {{(pid=87444) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 04:39:30 devstack sudo[95385]: pam_unix(sudo:session): session closed for user root Jul 10 04:39:30 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-3bfa2f79-3035-4396-9649-a55b483f0104 tempest-SnapshotsActionsTest-1538729065 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-cb9ba17f-166a-487b-bda4-b5f9b80b656d.info" returned: 0 in 1.001s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:39:30 devstack cinder-volume[87444]: WARNING cinder.volume.drivers.remotefs [None req-3bfa2f79-3035-4396-9649-a55b483f0104 tempest-SnapshotsActionsTest-1538729065 None] /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-cb9ba17f-166a-487b-bda4-b5f9b80b656d.info is being set with open permissions: ugo+rw Jul 10 04:39:30 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-3bfa2f79-3035-4396-9649-a55b483f0104 tempest-SnapshotsActionsTest-1538729065 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-cb9ba17f-166a-487b-bda4-b5f9b80b656d.info {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:39:30 devstack cinder-volume[87444]: INFO cinder.volume.manager [None req-216e6a3c-7d65-40b6-a30c-00fdbe57d819 tempest-GroupSnapshotsTest-544795304 None] group_snapshot 08e53844-ccd5-418a-87f1-44189a3860d5: deleted successfully Jul 10 04:39:30 devstack sudo[95390]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-cb9ba17f-166a-487b-bda4-b5f9b80b656d.info Jul 10 04:39:30 devstack sudo[95390]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:39:30 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-a4a16d89-cae0-4984-843e-ef1cd97d65ef tempest-GroupSnapshotsTest-544795304 None] Acquiring lock "cinder-quobyte-d022d806-0a29-46b8-b021-953c88761b25" by "delete_volume" {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 04:39:30 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-a4a16d89-cae0-4984-843e-ef1cd97d65ef tempest-GroupSnapshotsTest-544795304 None] Lock "cinder-quobyte-d022d806-0a29-46b8-b021-953c88761b25" acquired by "delete_volume" :: waited 0.020s {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 04:39:30 devstack cinder-volume[87444]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e4a2a7a-1735-4b19-b2e9-dd4c705ba158]: (4, 'qcow2') {{(pid=88499) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 04:39:30 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-a4a16d89-cae0-4984-843e-ef1cd97d65ef tempest-GroupSnapshotsTest-544795304 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-d022d806-0a29-46b8-b021-953c88761b25 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:39:30 devstack sudo[95392]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-d022d806-0a29-46b8-b021-953c88761b25 Jul 10 04:39:30 devstack sudo[95392]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:39:30 devstack sudo[95390]: pam_unix(sudo:session): session closed for user root Jul 10 04:39:30 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-3bfa2f79-3035-4396-9649-a55b483f0104 tempest-SnapshotsActionsTest-1538729065 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-cb9ba17f-166a-487b-bda4-b5f9b80b656d.info" returned: 0 in 0.752s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:39:30 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-3bfa2f79-3035-4396-9649-a55b483f0104 tempest-SnapshotsActionsTest-1538729065 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.588s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 04:39:30 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-9b1a1bab-8c68-4c18-ab47-75a5f2988f78 tempest-VolumeQuotasAdminTestJSON-198926584 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.969s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 04:39:30 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-9b1a1bab-8c68-4c18-ab47-75a5f2988f78 tempest-VolumeQuotasAdminTestJSON-198926584 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T02:39:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-150864968',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=36347467-e8c8-4bfa-9c52-8ebb3deda41a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9f50a1e58b1a4ccbaac29719d4f67a46',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T02:39:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T02:39:30Z,use_quota=True,user_id='66d40fe417374be6b9a554333f7899dd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(317e369e-1e06-434d-ae95-a335f0e6c903),volume_type_id=317e369e-1e06-434d-ae95-a335f0e6c903)}" {{(pid=87444) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 04:39:30 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.remotefs [None req-9b1a1bab-8c68-4c18-ab47-75a5f2988f78 tempest-VolumeQuotasAdminTestJSON-198926584 None] Creating volume 36347467-e8c8-4bfa-9c52-8ebb3deda41a {{(pid=87444) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 04:39:30 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-9b1a1bab-8c68-4c18-ab47-75a5f2988f78 tempest-VolumeQuotasAdminTestJSON-198926584 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 04:39:30 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-9b1a1bab-8c68-4c18-ab47-75a5f2988f78 tempest-VolumeQuotasAdminTestJSON-198926584 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 04:39:30 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-9b1a1bab-8c68-4c18-ab47-75a5f2988f78 tempest-VolumeQuotasAdminTestJSON-198926584 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922': None} {{(pid=87444) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 04:39:30 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-9b1a1bab-8c68-4c18-ab47-75a5f2988f78 tempest-VolumeQuotasAdminTestJSON-198926584 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922'] {{(pid=87444) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 04:39:30 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-9b1a1bab-8c68-4c18-ab47-75a5f2988f78 tempest-VolumeQuotasAdminTestJSON-198926584 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 04:39:30 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-9b1a1bab-8c68-4c18-ab47-75a5f2988f78 tempest-VolumeQuotasAdminTestJSON-198926584 None] Selected osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922 as target Quobyte volume. {{(pid=87444) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 04:39:30 devstack cinder-volume[87444]: INFO cinder.volume.drivers.remotefs [None req-9b1a1bab-8c68-4c18-ab47-75a5f2988f78 tempest-VolumeQuotasAdminTestJSON-198926584 None] casted to osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922 Jul 10 04:39:30 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-9b1a1bab-8c68-4c18-ab47-75a5f2988f78 tempest-VolumeQuotasAdminTestJSON-198926584 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-36347467-e8c8-4bfa-9c52-8ebb3deda41a 1073741824 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:39:30 devstack sudo[95395]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-36347467-e8c8-4bfa-9c52-8ebb3deda41a 1073741824 Jul 10 04:39:30 devstack sudo[95395]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:39:30 devstack cinder-volume[87444]: INFO cinder.volume.manager [None req-3bfa2f79-3035-4396-9649-a55b483f0104 tempest-SnapshotsActionsTest-1538729065 None] Create snapshot completed successfully Jul 10 04:39:31 devstack sudo[95392]: pam_unix(sudo:session): session closed for user root Jul 10 04:39:31 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-a4a16d89-cae0-4984-843e-ef1cd97d65ef tempest-GroupSnapshotsTest-544795304 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-d022d806-0a29-46b8-b021-953c88761b25" returned: 0 in 0.906s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:39:31 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-a4a16d89-cae0-4984-843e-ef1cd97d65ef tempest-GroupSnapshotsTest-544795304 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-d022d806-0a29-46b8-b021-953c88761b25 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:39:31 devstack sudo[95400]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-d022d806-0a29-46b8-b021-953c88761b25 Jul 10 04:39:31 devstack sudo[95400]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:39:31 devstack sudo[95395]: pam_unix(sudo:session): session closed for user root Jul 10 04:39:31 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-9b1a1bab-8c68-4c18-ab47-75a5f2988f78 tempest-VolumeQuotasAdminTestJSON-198926584 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-36347467-e8c8-4bfa-9c52-8ebb3deda41a 1073741824" returned: 0 in 1.000s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:39:31 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-9b1a1bab-8c68-4c18-ab47-75a5f2988f78 tempest-VolumeQuotasAdminTestJSON-198926584 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-36347467-e8c8-4bfa-9c52-8ebb3deda41a {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:39:31 devstack sudo[95407]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-36347467-e8c8-4bfa-9c52-8ebb3deda41a Jul 10 04:39:31 devstack sudo[95407]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:39:32 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-3d8f7f4d-6a0d-474a-83fe-4bf20fbe354e tempest-SnapshotsActionsTest-1538729065 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 04:39:32 devstack sudo[95400]: pam_unix(sudo:session): session closed for user root Jul 10 04:39:32 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-a4a16d89-cae0-4984-843e-ef1cd97d65ef tempest-GroupSnapshotsTest-544795304 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-d022d806-0a29-46b8-b021-953c88761b25" returned: 0 in 0.888s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:39:32 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-a4a16d89-cae0-4984-843e-ef1cd97d65ef tempest-GroupSnapshotsTest-544795304 None] Lock "cinder-quobyte-d022d806-0a29-46b8-b021-953c88761b25" released by "delete_volume" :: held 1.857s {{(pid=87444) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 04:39:32 devstack cinder-volume[87444]: DEBUG cinder.quota [None req-a4a16d89-cae0-4984-843e-ef1cd97d65ef tempest-GroupSnapshotsTest-544795304 None] Created reservations ['2522194e-3600-407d-b71b-c4ce7f82e87f'] {{(pid=87444) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 04:39:32 devstack cinder-volume[87444]: WARNING cinder.db.api [None req-a4a16d89-cae0-4984-843e-ef1cd97d65ef tempest-GroupSnapshotsTest-544795304 None] Reservation would make usage less than 0 for the following resources, so on commit they will be limited to prevent going below 0: ['gigabytes', 'gigabytes_tempest-GroupSnapshotsTest-volume-type-575622372'] Jul 10 04:39:32 devstack cinder-volume[87444]: DEBUG cinder.quota [None req-a4a16d89-cae0-4984-843e-ef1cd97d65ef tempest-GroupSnapshotsTest-544795304 None] Created reservations ['35926026-e8a6-4eca-9ba3-14fde70af8db', '24f7854e-89d2-4d8b-a6e0-f43f5da4ffd8', '2db03ec8-c1d7-45fb-9bd2-724c0826ca91', '7ce3c230-0b79-48d7-85a4-68734de6cb17'] {{(pid=87444) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 04:39:32 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-a4a16d89-cae0-4984-843e-ef1cd97d65ef tempest-GroupSnapshotsTest-544795304 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 04:39:32 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-a4a16d89-cae0-4984-843e-ef1cd97d65ef tempest-GroupSnapshotsTest-544795304 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 04:39:32 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-a4a16d89-cae0-4984-843e-ef1cd97d65ef tempest-GroupSnapshotsTest-544795304 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922': None} {{(pid=87444) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 04:39:32 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-a4a16d89-cae0-4984-843e-ef1cd97d65ef tempest-GroupSnapshotsTest-544795304 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922'] {{(pid=87444) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 04:39:32 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-a4a16d89-cae0-4984-843e-ef1cd97d65ef tempest-GroupSnapshotsTest-544795304 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 04:39:32 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-a4a16d89-cae0-4984-843e-ef1cd97d65ef tempest-GroupSnapshotsTest-544795304 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:39:32 devstack sudo[95411]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097 Jul 10 04:39:32 devstack sudo[95411]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:39:32 devstack sudo[95407]: pam_unix(sudo:session): session closed for user root Jul 10 04:39:32 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-9b1a1bab-8c68-4c18-ab47-75a5f2988f78 tempest-VolumeQuotasAdminTestJSON-198926584 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-36347467-e8c8-4bfa-9c52-8ebb3deda41a" returned: 0 in 0.760s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:39:32 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-9b1a1bab-8c68-4c18-ab47-75a5f2988f78 tempest-VolumeQuotasAdminTestJSON-198926584 None] <== create_volume: return (1808ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922'} {{(pid=87444) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 04:39:32 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-9b1a1bab-8c68-4c18-ab47-75a5f2988f78 tempest-VolumeQuotasAdminTestJSON-198926584 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.811s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 04:39:32 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-3d8f7f4d-6a0d-474a-83fe-4bf20fbe354e tempest-SnapshotsActionsTest-1538729065 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.417s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 04:39:32 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-9b1a1bab-8c68-4c18-ab47-75a5f2988f78 tempest-VolumeQuotasAdminTestJSON-198926584 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6cee4213-3818-4d2f-935e-d3058facc82f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-36347467-e8c8-4bfa-9c52-8ebb3deda41a', 'volume_size': 1}' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:39:32 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-9b1a1bab-8c68-4c18-ab47-75a5f2988f78 tempest-VolumeQuotasAdminTestJSON-198926584 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a5d996a5-1a8d-47c0-8f80-feed41bebf86) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:39:32 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.remotefs [None req-3d8f7f4d-6a0d-474a-83fe-4bf20fbe354e tempest-SnapshotsActionsTest-1538729065 None] Creating offline snapshot b43d6030-3066-4ee0-bb7d-3e3105ed44ff of volume cb9ba17f-166a-487b-bda4-b5f9b80b656d {{(pid=87444) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 10 04:39:32 devstack cinder-volume[87444]: INFO cinder.volume.flows.manager.create_volume [None req-9b1a1bab-8c68-4c18-ab47-75a5f2988f78 tempest-VolumeQuotasAdminTestJSON-198926584 None] Volume volume-36347467-e8c8-4bfa-9c52-8ebb3deda41a (36347467-e8c8-4bfa-9c52-8ebb3deda41a): created successfully Jul 10 04:39:32 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-9b1a1bab-8c68-4c18-ab47-75a5f2988f78 tempest-VolumeQuotasAdminTestJSON-198926584 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a5d996a5-1a8d-47c0-8f80-feed41bebf86) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:39:32 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-9b1a1bab-8c68-4c18-ab47-75a5f2988f78 tempest-VolumeQuotasAdminTestJSON-198926584 None] Flow 'volume_create_manager' (fb1daccf-2aff-4c69-9bbd-74653453b13f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87444) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 04:39:32 devstack cinder-volume[87444]: DEBUG oslo.privsep.daemon [-] privsep: reply[c51dc959-2458-4bf7-b594-f820f90056ff]: (4, 'qcow2') {{(pid=88499) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 04:39:32 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-3d8f7f4d-6a0d-474a-83fe-4bf20fbe354e tempest-SnapshotsActionsTest-1538729065 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-cb9ba17f-166a-487b-bda4-b5f9b80b656d.ee8c454a-c0ff-4b09-826b-830aa5ec0536 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:39:32 devstack cinder-volume[87444]: INFO cinder.volume.manager [None req-9b1a1bab-8c68-4c18-ab47-75a5f2988f78 tempest-VolumeQuotasAdminTestJSON-198926584 None] Created volume successfully. Jul 10 04:39:32 devstack sudo[95414]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-cb9ba17f-166a-487b-bda4-b5f9b80b656d.ee8c454a-c0ff-4b09-826b-830aa5ec0536 Jul 10 04:39:32 devstack sudo[95414]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:39:32 devstack cinder-volume[87444]: DEBUG oslo_service.periodic_task [None req-01f0ce3e-6850-4e14-881d-e40d3c4ad6e5 None None] Running periodic task VolumeManager._thread_info {{(pid=87444) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 10 04:39:32 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-01f0ce3e-6850-4e14-881d-e40d3c4ad6e5 None None] thread count: 8 {{(pid=87444) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 10 04:39:32 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-01f0ce3e-6850-4e14-881d-e40d3c4ad6e5 None None] thread info: [<_MainThread(MainThread, started 126839257915520)>, , , , , , , ] {{(pid=87444) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 10 04:39:33 devstack sudo[95411]: pam_unix(sudo:session): session closed for user root Jul 10 04:39:33 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-a4a16d89-cae0-4984-843e-ef1cd97d65ef tempest-GroupSnapshotsTest-544795304 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097" returned: 0 in 0.950s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:39:33 devstack cinder-volume[87444]: DEBUG cinder.manager [None req-a4a16d89-cae0-4984-843e-ef1cd97d65ef tempest-GroupSnapshotsTest-544795304 None] Notifying Schedulers of capabilities ... {{(pid=87444) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 04:39:33 devstack cinder-volume[87444]: INFO cinder.volume.manager [None req-a4a16d89-cae0-4984-843e-ef1cd97d65ef tempest-GroupSnapshotsTest-544795304 None] Delete group completed successfully. Jul 10 04:39:33 devstack cinder-volume[87444]: INFO cinder.volume.manager [None req-cfaaf9bf-a14d-48b5-b740-f00f7072dce0 tempest-GroupSnapshotsTest-544795304 None] Group tempest-GroupSnapshotsTest-Group-1392331171: creating Jul 10 04:39:33 devstack cinder-volume[87444]: INFO cinder.volume.manager [None req-cfaaf9bf-a14d-48b5-b740-f00f7072dce0 tempest-GroupSnapshotsTest-544795304 None] Group tempest-GroupSnapshotsTest-Group-1392331171: created successfully Jul 10 04:39:33 devstack cinder-volume[87444]: INFO cinder.volume.manager [None req-cfaaf9bf-a14d-48b5-b740-f00f7072dce0 tempest-GroupSnapshotsTest-544795304 None] Create group completed successfully. Jul 10 04:39:33 devstack sudo[95414]: pam_unix(sudo:session): session closed for user root Jul 10 04:39:33 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-3d8f7f4d-6a0d-474a-83fe-4bf20fbe354e tempest-SnapshotsActionsTest-1538729065 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-cb9ba17f-166a-487b-bda4-b5f9b80b656d.ee8c454a-c0ff-4b09-826b-830aa5ec0536" returned: 0 in 0.964s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:39:33 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.remotefs [None req-3d8f7f4d-6a0d-474a-83fe-4bf20fbe354e tempest-SnapshotsActionsTest-1538729065 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-cb9ba17f-166a-487b-bda4-b5f9b80b656d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87444) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 10 04:39:33 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-3d8f7f4d-6a0d-474a-83fe-4bf20fbe354e tempest-SnapshotsActionsTest-1538729065 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-cb9ba17f-166a-487b-bda4-b5f9b80b656d.ee8c454a-c0ff-4b09-826b-830aa5ec0536,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-cb9ba17f-166a-487b-bda4-b5f9b80b656d.b43d6030-3066-4ee0-bb7d-3e3105ed44ff 1G {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:39:33 devstack sudo[95420]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-cb9ba17f-166a-487b-bda4-b5f9b80b656d.ee8c454a-c0ff-4b09-826b-830aa5ec0536,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-cb9ba17f-166a-487b-bda4-b5f9b80b656d.b43d6030-3066-4ee0-bb7d-3e3105ed44ff 1G Jul 10 04:39:33 devstack sudo[95420]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:39:34 devstack cinder-volume[87444]: INFO cinder.volume.manager [None req-c71f4e45-1842-4d37-b238-eba37c6f0436 tempest-VolumeQuotasAdminTestJSON-1844507508 None] Transfer volume completed successfully. Jul 10 04:39:34 devstack sudo[95420]: pam_unix(sudo:session): session closed for user root Jul 10 04:39:34 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-3d8f7f4d-6a0d-474a-83fe-4bf20fbe354e tempest-SnapshotsActionsTest-1538729065 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-cb9ba17f-166a-487b-bda4-b5f9b80b656d.ee8c454a-c0ff-4b09-826b-830aa5ec0536,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-cb9ba17f-166a-487b-bda4-b5f9b80b656d.b43d6030-3066-4ee0-bb7d-3e3105ed44ff 1G" returned: 0 in 0.918s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:39:34 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-3d8f7f4d-6a0d-474a-83fe-4bf20fbe354e tempest-SnapshotsActionsTest-1538729065 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cb9ba17f-166a-487b-bda4-b5f9b80b656d.ee8c454a-c0ff-4b09-826b-830aa5ec0536 -F qcow2 /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-cb9ba17f-166a-487b-bda4-b5f9b80b656d.b43d6030-3066-4ee0-bb7d-3e3105ed44ff {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:39:34 devstack sudo[95426]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cb9ba17f-166a-487b-bda4-b5f9b80b656d.ee8c454a-c0ff-4b09-826b-830aa5ec0536 -F qcow2 /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-cb9ba17f-166a-487b-bda4-b5f9b80b656d.b43d6030-3066-4ee0-bb7d-3e3105ed44ff Jul 10 04:39:34 devstack sudo[95426]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:39:35 devstack cinder-volume[87444]: DEBUG cinder.volume.flows.manager.create_volume [None req-4cbd8f23-947e-4f4b-81df-0aa2c35d2aed tempest-GroupSnapshotsTest-544795304 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87444) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 04:39:35 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-4cbd8f23-947e-4f4b-81df-0aa2c35d2aed tempest-GroupSnapshotsTest-544795304 None] Flow 'volume_create_manager' (45b991a4-7492-46fb-a841-cfa844d07132) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 04:39:35 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-4cbd8f23-947e-4f4b-81df-0aa2c35d2aed tempest-GroupSnapshotsTest-544795304 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e8fecaa6-834a-436a-8758-3b6a85dab152) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:39:35 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-4cbd8f23-947e-4f4b-81df-0aa2c35d2aed tempest-GroupSnapshotsTest-544795304 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e8fecaa6-834a-436a-8758-3b6a85dab152) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T02:39:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-759186445',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=5a265142-8159-4b24-acfe-68f229b8526f,host='devstack@QuobyteHD#QuobyteHD',id=ae5ee9ab-4457-42a0-be80-8e471bdb12a2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='37897128afdc4de48f884e9b940e625f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T02:39:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T02:39:35Z,use_quota=True,user_id='720d99c11f4b4f88b1559d0cc385025d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c1af02ca-dbe8-4d97-9b1b-f66312c98972),volume_type_id=c1af02ca-dbe8-4d97-9b1b-f66312c98972)' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:39:35 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-4cbd8f23-947e-4f4b-81df-0aa2c35d2aed tempest-GroupSnapshotsTest-544795304 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b1c3aef2-5948-493e-a46b-e5a4a7832174) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:39:35 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-4cbd8f23-947e-4f4b-81df-0aa2c35d2aed tempest-GroupSnapshotsTest-544795304 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b1c3aef2-5948-493e-a46b-e5a4a7832174) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:39:35 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-4cbd8f23-947e-4f4b-81df-0aa2c35d2aed tempest-GroupSnapshotsTest-544795304 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (37dc561a-b937-475b-809c-55113471c9b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:39:35 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-4cbd8f23-947e-4f4b-81df-0aa2c35d2aed tempest-GroupSnapshotsTest-544795304 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (37dc561a-b937-475b-809c-55113471c9b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ae5ee9ab-4457-42a0-be80-8e471bdb12a2', 'volume_name': 'volume-ae5ee9ab-4457-42a0-be80-8e471bdb12a2', 'volume_size': 1}' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:39:35 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-4cbd8f23-947e-4f4b-81df-0aa2c35d2aed tempest-GroupSnapshotsTest-544795304 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (93bf3a46-7d04-4461-9dad-92a153c7f1f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:39:35 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-4cbd8f23-947e-4f4b-81df-0aa2c35d2aed tempest-GroupSnapshotsTest-544795304 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (93bf3a46-7d04-4461-9dad-92a153c7f1f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:39:35 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-4cbd8f23-947e-4f4b-81df-0aa2c35d2aed tempest-GroupSnapshotsTest-544795304 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6b0c1bcf-7a20-49a1-ae17-0e525db00db4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:39:35 devstack cinder-volume[87444]: INFO cinder.volume.flows.manager.create_volume [None req-4cbd8f23-947e-4f4b-81df-0aa2c35d2aed tempest-GroupSnapshotsTest-544795304 None] Volume ae5ee9ab-4457-42a0-be80-8e471bdb12a2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ae5ee9ab-4457-42a0-be80-8e471bdb12a2', 'volume_size': 1} Jul 10 04:39:35 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-4cbd8f23-947e-4f4b-81df-0aa2c35d2aed tempest-GroupSnapshotsTest-544795304 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 04:39:35 devstack sudo[95426]: pam_unix(sudo:session): session closed for user root Jul 10 04:39:35 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-3d8f7f4d-6a0d-474a-83fe-4bf20fbe354e tempest-SnapshotsActionsTest-1538729065 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cb9ba17f-166a-487b-bda4-b5f9b80b656d.ee8c454a-c0ff-4b09-826b-830aa5ec0536 -F qcow2 /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-cb9ba17f-166a-487b-bda4-b5f9b80b656d.b43d6030-3066-4ee0-bb7d-3e3105ed44ff" returned: 0 in 0.799s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:39:35 devstack cinder-volume[87444]: WARNING cinder.volume.drivers.remotefs [None req-3d8f7f4d-6a0d-474a-83fe-4bf20fbe354e tempest-SnapshotsActionsTest-1538729065 None] /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-cb9ba17f-166a-487b-bda4-b5f9b80b656d.b43d6030-3066-4ee0-bb7d-3e3105ed44ff is being set with open permissions: ugo+rw Jul 10 04:39:35 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-3d8f7f4d-6a0d-474a-83fe-4bf20fbe354e tempest-SnapshotsActionsTest-1538729065 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-cb9ba17f-166a-487b-bda4-b5f9b80b656d.b43d6030-3066-4ee0-bb7d-3e3105ed44ff {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:39:35 devstack sudo[95434]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-cb9ba17f-166a-487b-bda4-b5f9b80b656d.b43d6030-3066-4ee0-bb7d-3e3105ed44ff Jul 10 04:39:35 devstack sudo[95434]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:39:35 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-5c6cea61-5bbd-497d-9ef8-0be35bc65771 tempest-VolumeQuotasAdminTestJSON-54379228 None] Acquiring lock "cinder-36347467-e8c8-4bfa-9c52-8ebb3deda41a-delete_volume" by "delete_volume" {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 04:39:35 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-5c6cea61-5bbd-497d-9ef8-0be35bc65771 tempest-VolumeQuotasAdminTestJSON-54379228 None] Lock "cinder-36347467-e8c8-4bfa-9c52-8ebb3deda41a-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 04:39:35 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-5c6cea61-5bbd-497d-9ef8-0be35bc65771 tempest-VolumeQuotasAdminTestJSON-54379228 None] Acquiring lock "cinder-quobyte-36347467-e8c8-4bfa-9c52-8ebb3deda41a" by "delete_volume" {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 04:39:35 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-5c6cea61-5bbd-497d-9ef8-0be35bc65771 tempest-VolumeQuotasAdminTestJSON-54379228 None] Lock "cinder-quobyte-36347467-e8c8-4bfa-9c52-8ebb3deda41a" acquired by "delete_volume" :: waited 0.015s {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 04:39:35 devstack cinder-volume[87444]: DEBUG oslo.privsep.daemon [-] privsep: reply[21fea69e-8e45-4429-991a-7a1a0384940c]: (4, 'qcow2') {{(pid=88499) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 04:39:35 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-5c6cea61-5bbd-497d-9ef8-0be35bc65771 tempest-VolumeQuotasAdminTestJSON-54379228 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-36347467-e8c8-4bfa-9c52-8ebb3deda41a {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:39:35 devstack sudo[95436]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-36347467-e8c8-4bfa-9c52-8ebb3deda41a Jul 10 04:39:35 devstack sudo[95436]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:39:36 devstack sudo[95434]: pam_unix(sudo:session): session closed for user root Jul 10 04:39:36 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-3d8f7f4d-6a0d-474a-83fe-4bf20fbe354e tempest-SnapshotsActionsTest-1538729065 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-cb9ba17f-166a-487b-bda4-b5f9b80b656d.b43d6030-3066-4ee0-bb7d-3e3105ed44ff" returned: 0 in 0.655s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:39:36 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-3d8f7f4d-6a0d-474a-83fe-4bf20fbe354e tempest-SnapshotsActionsTest-1538729065 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.479s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 04:39:36 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-4cbd8f23-947e-4f4b-81df-0aa2c35d2aed tempest-GroupSnapshotsTest-544795304 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.896s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 04:39:36 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-4cbd8f23-947e-4f4b-81df-0aa2c35d2aed tempest-GroupSnapshotsTest-544795304 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=5a265142-8159-4b24-acfe-68f229b8526f,created_at=2026-07-10T02:39:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-759186445',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=5a265142-8159-4b24-acfe-68f229b8526f,host='devstack@QuobyteHD#QuobyteHD',id=ae5ee9ab-4457-42a0-be80-8e471bdb12a2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='37897128afdc4de48f884e9b940e625f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T02:39:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T02:39:35Z,use_quota=True,user_id='720d99c11f4b4f88b1559d0cc385025d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c1af02ca-dbe8-4d97-9b1b-f66312c98972),volume_type_id=c1af02ca-dbe8-4d97-9b1b-f66312c98972)}" {{(pid=87444) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 04:39:36 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.remotefs [None req-4cbd8f23-947e-4f4b-81df-0aa2c35d2aed tempest-GroupSnapshotsTest-544795304 None] Creating volume ae5ee9ab-4457-42a0-be80-8e471bdb12a2 {{(pid=87444) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 04:39:36 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-4cbd8f23-947e-4f4b-81df-0aa2c35d2aed tempest-GroupSnapshotsTest-544795304 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 04:39:36 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-4cbd8f23-947e-4f4b-81df-0aa2c35d2aed tempest-GroupSnapshotsTest-544795304 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 04:39:36 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-4cbd8f23-947e-4f4b-81df-0aa2c35d2aed tempest-GroupSnapshotsTest-544795304 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922': None} {{(pid=87444) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 04:39:36 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-4cbd8f23-947e-4f4b-81df-0aa2c35d2aed tempest-GroupSnapshotsTest-544795304 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922'] {{(pid=87444) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 04:39:36 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-4cbd8f23-947e-4f4b-81df-0aa2c35d2aed tempest-GroupSnapshotsTest-544795304 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 04:39:36 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-4cbd8f23-947e-4f4b-81df-0aa2c35d2aed tempest-GroupSnapshotsTest-544795304 None] Selected osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922 as target Quobyte volume. {{(pid=87444) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 04:39:36 devstack cinder-volume[87444]: INFO cinder.volume.drivers.remotefs [None req-4cbd8f23-947e-4f4b-81df-0aa2c35d2aed tempest-GroupSnapshotsTest-544795304 None] casted to osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922 Jul 10 04:39:36 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-4cbd8f23-947e-4f4b-81df-0aa2c35d2aed tempest-GroupSnapshotsTest-544795304 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-ae5ee9ab-4457-42a0-be80-8e471bdb12a2 1073741824 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:39:36 devstack sudo[95439]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-ae5ee9ab-4457-42a0-be80-8e471bdb12a2 1073741824 Jul 10 04:39:36 devstack sudo[95439]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:39:36 devstack cinder-volume[87444]: INFO cinder.volume.manager [None req-3d8f7f4d-6a0d-474a-83fe-4bf20fbe354e tempest-SnapshotsActionsTest-1538729065 None] Create snapshot completed successfully Jul 10 04:39:36 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-854d7441-3b66-4fce-ba43-058ca001768a tempest-SnapshotsActionsTest-1017379468 None] Acquiring lock "cinder-b43d6030-3066-4ee0-bb7d-3e3105ed44ff-delete_snapshot" by "delete_snapshot" {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 04:39:36 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-854d7441-3b66-4fce-ba43-058ca001768a tempest-SnapshotsActionsTest-1017379468 None] Lock "cinder-b43d6030-3066-4ee0-bb7d-3e3105ed44ff-delete_snapshot" acquired by "delete_snapshot" :: waited 0.027s {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 04:39:36 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-854d7441-3b66-4fce-ba43-058ca001768a tempest-SnapshotsActionsTest-1017379468 None] Acquiring lock "cinder-quobyte-cb9ba17f-166a-487b-bda4-b5f9b80b656d" by "delete_snapshot" {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 04:39:36 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-854d7441-3b66-4fce-ba43-058ca001768a tempest-SnapshotsActionsTest-1017379468 None] Lock "cinder-quobyte-cb9ba17f-166a-487b-bda4-b5f9b80b656d" acquired by "delete_snapshot" :: waited 0.032s {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 04:39:36 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-854d7441-3b66-4fce-ba43-058ca001768a tempest-SnapshotsActionsTest-1017379468 None] Acquiring lock "cinder-quobyte-b43d6030-3066-4ee0-bb7d-3e3105ed44ff" by "_delete_snapshot" {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 04:39:36 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-854d7441-3b66-4fce-ba43-058ca001768a tempest-SnapshotsActionsTest-1017379468 None] Lock "cinder-quobyte-b43d6030-3066-4ee0-bb7d-3e3105ed44ff" acquired by "_delete_snapshot" :: waited 0.022s {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 04:39:36 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.remotefs [None req-854d7441-3b66-4fce-ba43-058ca001768a tempest-SnapshotsActionsTest-1017379468 None] Deleting offline snapshot b43d6030-3066-4ee0-bb7d-3e3105ed44ff of volume cb9ba17f-166a-487b-bda4-b5f9b80b656d {{(pid=87444) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 10 04:39:36 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.remotefs [None req-854d7441-3b66-4fce-ba43-058ca001768a tempest-SnapshotsActionsTest-1017379468 None] snapshot_file for this snap is: volume-cb9ba17f-166a-487b-bda4-b5f9b80b656d.b43d6030-3066-4ee0-bb7d-3e3105ed44ff {{(pid=87444) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 10 04:39:36 devstack cinder-volume[87444]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c8aaf13-cc26-4747-a163-730cda5ef37f]: (4, 'qcow2') {{(pid=88499) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 04:39:36 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-854d7441-3b66-4fce-ba43-058ca001768a tempest-SnapshotsActionsTest-1017379468 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-cb9ba17f-166a-487b-bda4-b5f9b80b656d.b43d6030-3066-4ee0-bb7d-3e3105ed44ff {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:39:36 devstack sudo[95436]: pam_unix(sudo:session): session closed for user root Jul 10 04:39:36 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-5c6cea61-5bbd-497d-9ef8-0be35bc65771 tempest-VolumeQuotasAdminTestJSON-54379228 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-36347467-e8c8-4bfa-9c52-8ebb3deda41a" returned: 0 in 0.963s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:39:36 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-5c6cea61-5bbd-497d-9ef8-0be35bc65771 tempest-VolumeQuotasAdminTestJSON-54379228 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-36347467-e8c8-4bfa-9c52-8ebb3deda41a {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:39:36 devstack sudo[95445]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-36347467-e8c8-4bfa-9c52-8ebb3deda41a Jul 10 04:39:36 devstack sudo[95445]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:39:36 devstack sudo[95444]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-cb9ba17f-166a-487b-bda4-b5f9b80b656d.b43d6030-3066-4ee0-bb7d-3e3105ed44ff Jul 10 04:39:36 devstack sudo[95444]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:39:37 devstack sudo[95439]: pam_unix(sudo:session): session closed for user root Jul 10 04:39:37 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-4cbd8f23-947e-4f4b-81df-0aa2c35d2aed tempest-GroupSnapshotsTest-544795304 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-ae5ee9ab-4457-42a0-be80-8e471bdb12a2 1073741824" returned: 0 in 1.164s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:39:37 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-4cbd8f23-947e-4f4b-81df-0aa2c35d2aed tempest-GroupSnapshotsTest-544795304 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-ae5ee9ab-4457-42a0-be80-8e471bdb12a2 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:39:37 devstack sudo[95451]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-ae5ee9ab-4457-42a0-be80-8e471bdb12a2 Jul 10 04:39:37 devstack sudo[95451]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:39:37 devstack sudo[95445]: pam_unix(sudo:session): session closed for user root Jul 10 04:39:37 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-5c6cea61-5bbd-497d-9ef8-0be35bc65771 tempest-VolumeQuotasAdminTestJSON-54379228 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-36347467-e8c8-4bfa-9c52-8ebb3deda41a" returned: 0 in 0.901s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:39:37 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-5c6cea61-5bbd-497d-9ef8-0be35bc65771 tempest-VolumeQuotasAdminTestJSON-54379228 None] Lock "cinder-quobyte-36347467-e8c8-4bfa-9c52-8ebb3deda41a" released by "delete_volume" :: held 1.917s {{(pid=87444) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 04:39:37 devstack cinder-volume[87444]: DEBUG cinder.quota [None req-5c6cea61-5bbd-497d-9ef8-0be35bc65771 tempest-VolumeQuotasAdminTestJSON-54379228 None] Created reservations ['ee810a5e-6ab7-4cff-ab3c-77bf59336afb', 'aace0c63-b510-4621-8ea7-bd63296b0558', '8108d2b3-fddb-4b32-b209-8523e99d9128', '6b08185c-328f-43bc-8d68-2dd84ece5e91'] {{(pid=87444) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 04:39:37 devstack sudo[95444]: pam_unix(sudo:session): session closed for user root Jul 10 04:39:37 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-854d7441-3b66-4fce-ba43-058ca001768a tempest-SnapshotsActionsTest-1017379468 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-cb9ba17f-166a-487b-bda4-b5f9b80b656d.b43d6030-3066-4ee0-bb7d-3e3105ed44ff" returned: 0 in 1.141s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:39:37 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.remotefs [None req-854d7441-3b66-4fce-ba43-058ca001768a tempest-SnapshotsActionsTest-1017379468 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-cb9ba17f-166a-487b-bda4-b5f9b80b656d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87444) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 10 04:39:37 devstack cinder-volume[87444]: DEBUG oslo.privsep.daemon [-] privsep: reply[90c96cc3-5448-4ae6-a9a2-ef6820685eac]: (4, 'qcow2') {{(pid=88499) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 04:39:37 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-854d7441-3b66-4fce-ba43-058ca001768a tempest-SnapshotsActionsTest-1017379468 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-cb9ba17f-166a-487b-bda4-b5f9b80b656d.ee8c454a-c0ff-4b09-826b-830aa5ec0536 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:39:38 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-5c6cea61-5bbd-497d-9ef8-0be35bc65771 tempest-VolumeQuotasAdminTestJSON-54379228 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 04:39:38 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-5c6cea61-5bbd-497d-9ef8-0be35bc65771 tempest-VolumeQuotasAdminTestJSON-54379228 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 04:39:38 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-5c6cea61-5bbd-497d-9ef8-0be35bc65771 tempest-VolumeQuotasAdminTestJSON-54379228 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922': None} {{(pid=87444) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 04:39:38 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-5c6cea61-5bbd-497d-9ef8-0be35bc65771 tempest-VolumeQuotasAdminTestJSON-54379228 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922'] {{(pid=87444) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 04:39:38 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-5c6cea61-5bbd-497d-9ef8-0be35bc65771 tempest-VolumeQuotasAdminTestJSON-54379228 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 04:39:38 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-5c6cea61-5bbd-497d-9ef8-0be35bc65771 tempest-VolumeQuotasAdminTestJSON-54379228 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:39:38 devstack sudo[95458]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097 Jul 10 04:39:38 devstack sudo[95458]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:39:38 devstack sudo[95457]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-cb9ba17f-166a-487b-bda4-b5f9b80b656d.ee8c454a-c0ff-4b09-826b-830aa5ec0536 Jul 10 04:39:38 devstack sudo[95457]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:39:38 devstack sudo[95451]: pam_unix(sudo:session): session closed for user root Jul 10 04:39:38 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-4cbd8f23-947e-4f4b-81df-0aa2c35d2aed tempest-GroupSnapshotsTest-544795304 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-ae5ee9ab-4457-42a0-be80-8e471bdb12a2" returned: 0 in 0.807s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:39:38 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-4cbd8f23-947e-4f4b-81df-0aa2c35d2aed tempest-GroupSnapshotsTest-544795304 None] <== create_volume: return (2035ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922'} {{(pid=87444) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 04:39:38 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-4cbd8f23-947e-4f4b-81df-0aa2c35d2aed tempest-GroupSnapshotsTest-544795304 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.038s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 04:39:38 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-4cbd8f23-947e-4f4b-81df-0aa2c35d2aed tempest-GroupSnapshotsTest-544795304 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6b0c1bcf-7a20-49a1-ae17-0e525db00db4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ae5ee9ab-4457-42a0-be80-8e471bdb12a2', 'volume_size': 1}' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:39:38 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-4cbd8f23-947e-4f4b-81df-0aa2c35d2aed tempest-GroupSnapshotsTest-544795304 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6bc20ce8-9558-4ead-8d3f-a93df76cfc8e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:39:38 devstack cinder-volume[87444]: INFO cinder.volume.flows.manager.create_volume [None req-4cbd8f23-947e-4f4b-81df-0aa2c35d2aed tempest-GroupSnapshotsTest-544795304 None] Volume volume-ae5ee9ab-4457-42a0-be80-8e471bdb12a2 (ae5ee9ab-4457-42a0-be80-8e471bdb12a2): created successfully Jul 10 04:39:38 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-4cbd8f23-947e-4f4b-81df-0aa2c35d2aed tempest-GroupSnapshotsTest-544795304 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6bc20ce8-9558-4ead-8d3f-a93df76cfc8e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:39:38 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-4cbd8f23-947e-4f4b-81df-0aa2c35d2aed tempest-GroupSnapshotsTest-544795304 None] Flow 'volume_create_manager' (45b991a4-7492-46fb-a841-cfa844d07132) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87444) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 04:39:38 devstack cinder-volume[87444]: INFO cinder.volume.manager [None req-4cbd8f23-947e-4f4b-81df-0aa2c35d2aed tempest-GroupSnapshotsTest-544795304 None] Created volume successfully. Jul 10 04:39:38 devstack sudo[95458]: pam_unix(sudo:session): session closed for user root Jul 10 04:39:38 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-5c6cea61-5bbd-497d-9ef8-0be35bc65771 tempest-VolumeQuotasAdminTestJSON-54379228 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097" returned: 0 in 0.770s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:39:38 devstack cinder-volume[87444]: DEBUG cinder.manager [None req-5c6cea61-5bbd-497d-9ef8-0be35bc65771 tempest-VolumeQuotasAdminTestJSON-54379228 None] Notifying Schedulers of capabilities ... {{(pid=87444) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 04:39:38 devstack cinder-volume[87444]: INFO cinder.volume.manager [None req-5c6cea61-5bbd-497d-9ef8-0be35bc65771 tempest-VolumeQuotasAdminTestJSON-54379228 None] Deleted volume successfully. Jul 10 04:39:38 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-5c6cea61-5bbd-497d-9ef8-0be35bc65771 tempest-VolumeQuotasAdminTestJSON-54379228 None] Lock "cinder-36347467-e8c8-4bfa-9c52-8ebb3deda41a-delete_volume" released by "delete_volume" :: held 3.093s {{(pid=87444) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 04:39:38 devstack sudo[95457]: pam_unix(sudo:session): session closed for user root Jul 10 04:39:38 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-854d7441-3b66-4fce-ba43-058ca001768a tempest-SnapshotsActionsTest-1017379468 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-cb9ba17f-166a-487b-bda4-b5f9b80b656d.ee8c454a-c0ff-4b09-826b-830aa5ec0536" returned: 0 in 0.923s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:39:38 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.remotefs [None req-854d7441-3b66-4fce-ba43-058ca001768a tempest-SnapshotsActionsTest-1017379468 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-cb9ba17f-166a-487b-bda4-b5f9b80b656d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87444) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 10 04:39:38 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-854d7441-3b66-4fce-ba43-058ca001768a tempest-SnapshotsActionsTest-1017379468 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-cb9ba17f-166a-487b-bda4-b5f9b80b656d.b43d6030-3066-4ee0-bb7d-3e3105ed44ff {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:39:38 devstack sudo[95466]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-cb9ba17f-166a-487b-bda4-b5f9b80b656d.b43d6030-3066-4ee0-bb7d-3e3105ed44ff Jul 10 04:39:38 devstack sudo[95466]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:39:39 devstack cinder-volume[87444]: DEBUG cinder.volume.flows.manager.create_volume [None req-411c26b0-75ff-431b-ac2e-1b45e4557824 tempest-GroupSnapshotsTest-544795304 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87444) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 04:39:39 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-411c26b0-75ff-431b-ac2e-1b45e4557824 tempest-GroupSnapshotsTest-544795304 None] Flow 'volume_create_manager' (5f61e864-2912-4ee5-ae4d-fa30fcec1af4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 04:39:39 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-411c26b0-75ff-431b-ac2e-1b45e4557824 tempest-GroupSnapshotsTest-544795304 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2e90b425-a5a8-4213-b97c-8d8b8e251583) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:39:39 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-411c26b0-75ff-431b-ac2e-1b45e4557824 tempest-GroupSnapshotsTest-544795304 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2e90b425-a5a8-4213-b97c-8d8b8e251583) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T02:39:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1958715355',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=5a265142-8159-4b24-acfe-68f229b8526f,host='devstack@QuobyteHD#QuobyteHD',id=37f9eb8a-5d23-4485-8e1c-9d3b65f0c944,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='37897128afdc4de48f884e9b940e625f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T02:39:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T02:39:40Z,use_quota=True,user_id='720d99c11f4b4f88b1559d0cc385025d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c1af02ca-dbe8-4d97-9b1b-f66312c98972),volume_type_id=c1af02ca-dbe8-4d97-9b1b-f66312c98972)' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:39:39 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-411c26b0-75ff-431b-ac2e-1b45e4557824 tempest-GroupSnapshotsTest-544795304 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c2953450-6e73-45b8-8ad0-6812ab3c7493) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:39:39 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-411c26b0-75ff-431b-ac2e-1b45e4557824 tempest-GroupSnapshotsTest-544795304 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c2953450-6e73-45b8-8ad0-6812ab3c7493) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:39:39 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-411c26b0-75ff-431b-ac2e-1b45e4557824 tempest-GroupSnapshotsTest-544795304 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (23d46728-2333-4353-9564-003287da046a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:39:39 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-411c26b0-75ff-431b-ac2e-1b45e4557824 tempest-GroupSnapshotsTest-544795304 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (23d46728-2333-4353-9564-003287da046a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '37f9eb8a-5d23-4485-8e1c-9d3b65f0c944', 'volume_name': 'volume-37f9eb8a-5d23-4485-8e1c-9d3b65f0c944', 'volume_size': 1}' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:39:39 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-411c26b0-75ff-431b-ac2e-1b45e4557824 tempest-GroupSnapshotsTest-544795304 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dab27dcf-2251-4d2a-8137-6239d0ef4a3d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:39:39 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-411c26b0-75ff-431b-ac2e-1b45e4557824 tempest-GroupSnapshotsTest-544795304 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dab27dcf-2251-4d2a-8137-6239d0ef4a3d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:39:39 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-411c26b0-75ff-431b-ac2e-1b45e4557824 tempest-GroupSnapshotsTest-544795304 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e28dfa48-5cd9-4728-9061-9da49c7cb929) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:39:39 devstack cinder-volume[87444]: INFO cinder.volume.flows.manager.create_volume [None req-411c26b0-75ff-431b-ac2e-1b45e4557824 tempest-GroupSnapshotsTest-544795304 None] Volume 37f9eb8a-5d23-4485-8e1c-9d3b65f0c944: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-37f9eb8a-5d23-4485-8e1c-9d3b65f0c944', 'volume_size': 1} Jul 10 04:39:39 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-411c26b0-75ff-431b-ac2e-1b45e4557824 tempest-GroupSnapshotsTest-544795304 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 04:39:39 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-411c26b0-75ff-431b-ac2e-1b45e4557824 tempest-GroupSnapshotsTest-544795304 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 04:39:39 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-411c26b0-75ff-431b-ac2e-1b45e4557824 tempest-GroupSnapshotsTest-544795304 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=5a265142-8159-4b24-acfe-68f229b8526f,created_at=2026-07-10T02:39:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1958715355',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=5a265142-8159-4b24-acfe-68f229b8526f,host='devstack@QuobyteHD#QuobyteHD',id=37f9eb8a-5d23-4485-8e1c-9d3b65f0c944,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='37897128afdc4de48f884e9b940e625f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T02:39:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T02:39:40Z,use_quota=True,user_id='720d99c11f4b4f88b1559d0cc385025d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c1af02ca-dbe8-4d97-9b1b-f66312c98972),volume_type_id=c1af02ca-dbe8-4d97-9b1b-f66312c98972)}" {{(pid=87444) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 04:39:39 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.remotefs [None req-411c26b0-75ff-431b-ac2e-1b45e4557824 tempest-GroupSnapshotsTest-544795304 None] Creating volume 37f9eb8a-5d23-4485-8e1c-9d3b65f0c944 {{(pid=87444) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 04:39:39 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-411c26b0-75ff-431b-ac2e-1b45e4557824 tempest-GroupSnapshotsTest-544795304 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 04:39:39 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-411c26b0-75ff-431b-ac2e-1b45e4557824 tempest-GroupSnapshotsTest-544795304 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 04:39:39 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-411c26b0-75ff-431b-ac2e-1b45e4557824 tempest-GroupSnapshotsTest-544795304 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922': None} {{(pid=87444) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 04:39:39 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-411c26b0-75ff-431b-ac2e-1b45e4557824 tempest-GroupSnapshotsTest-544795304 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922'] {{(pid=87444) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 04:39:39 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-411c26b0-75ff-431b-ac2e-1b45e4557824 tempest-GroupSnapshotsTest-544795304 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 04:39:39 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-411c26b0-75ff-431b-ac2e-1b45e4557824 tempest-GroupSnapshotsTest-544795304 None] Selected osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922 as target Quobyte volume. {{(pid=87444) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 04:39:39 devstack cinder-volume[87444]: INFO cinder.volume.drivers.remotefs [None req-411c26b0-75ff-431b-ac2e-1b45e4557824 tempest-GroupSnapshotsTest-544795304 None] casted to osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922 Jul 10 04:39:39 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-411c26b0-75ff-431b-ac2e-1b45e4557824 tempest-GroupSnapshotsTest-544795304 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-37f9eb8a-5d23-4485-8e1c-9d3b65f0c944 1073741824 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:39:39 devstack sudo[95466]: pam_unix(sudo:session): session closed for user root Jul 10 04:39:39 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-854d7441-3b66-4fce-ba43-058ca001768a tempest-SnapshotsActionsTest-1017379468 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-cb9ba17f-166a-487b-bda4-b5f9b80b656d.b43d6030-3066-4ee0-bb7d-3e3105ed44ff" returned: 0 in 1.040s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:39:39 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-854d7441-3b66-4fce-ba43-058ca001768a tempest-SnapshotsActionsTest-1017379468 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-cb9ba17f-166a-487b-bda4-b5f9b80b656d.b43d6030-3066-4ee0-bb7d-3e3105ed44ff {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:39:39 devstack sudo[95471]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-37f9eb8a-5d23-4485-8e1c-9d3b65f0c944 1073741824 Jul 10 04:39:39 devstack sudo[95471]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:39:39 devstack sudo[95473]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-cb9ba17f-166a-487b-bda4-b5f9b80b656d.b43d6030-3066-4ee0-bb7d-3e3105ed44ff Jul 10 04:39:39 devstack sudo[95473]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:39:40 devstack sudo[95473]: pam_unix(sudo:session): session closed for user root Jul 10 04:39:40 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-854d7441-3b66-4fce-ba43-058ca001768a tempest-SnapshotsActionsTest-1017379468 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-cb9ba17f-166a-487b-bda4-b5f9b80b656d.b43d6030-3066-4ee0-bb7d-3e3105ed44ff" returned: 0 in 0.721s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:39:40 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-854d7441-3b66-4fce-ba43-058ca001768a tempest-SnapshotsActionsTest-1017379468 None] Lock "cinder-quobyte-b43d6030-3066-4ee0-bb7d-3e3105ed44ff" released by "_delete_snapshot" :: held 3.976s {{(pid=87444) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 04:39:40 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-854d7441-3b66-4fce-ba43-058ca001768a tempest-SnapshotsActionsTest-1017379468 None] Lock "cinder-quobyte-cb9ba17f-166a-487b-bda4-b5f9b80b656d" released by "delete_snapshot" :: held 4.009s {{(pid=87444) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 04:39:40 devstack cinder-volume[87444]: DEBUG cinder.quota [None req-854d7441-3b66-4fce-ba43-058ca001768a tempest-SnapshotsActionsTest-1017379468 None] Created reservations ['9eda68e4-88fa-4d02-aa74-a8ce85ebffd7', '15d8760b-1c22-4076-8cf0-ca28966313a2', '9f945ff2-1155-43aa-aab1-5d1a1b9e92e2', '7a3a7ce0-4a61-4070-8300-44cb4bde1052'] {{(pid=87444) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 04:39:40 devstack cinder-volume[87444]: INFO cinder.volume.manager [None req-854d7441-3b66-4fce-ba43-058ca001768a tempest-SnapshotsActionsTest-1017379468 None] Delete snapshot completed successfully. Jul 10 04:39:40 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-854d7441-3b66-4fce-ba43-058ca001768a tempest-SnapshotsActionsTest-1017379468 None] Lock "cinder-b43d6030-3066-4ee0-bb7d-3e3105ed44ff-delete_snapshot" released by "delete_snapshot" :: held 4.193s {{(pid=87444) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 04:39:40 devstack sudo[95471]: pam_unix(sudo:session): session closed for user root Jul 10 04:39:40 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-411c26b0-75ff-431b-ac2e-1b45e4557824 tempest-GroupSnapshotsTest-544795304 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-37f9eb8a-5d23-4485-8e1c-9d3b65f0c944 1073741824" returned: 0 in 1.016s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:39:40 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-411c26b0-75ff-431b-ac2e-1b45e4557824 tempest-GroupSnapshotsTest-544795304 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-37f9eb8a-5d23-4485-8e1c-9d3b65f0c944 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:39:41 devstack sudo[95480]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-37f9eb8a-5d23-4485-8e1c-9d3b65f0c944 Jul 10 04:39:41 devstack sudo[95480]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:39:41 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-80e9c01f-d427-410e-bc0e-7044f033121c tempest-SnapshotsActionsTest-1538729065 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 04:39:41 devstack sudo[95480]: pam_unix(sudo:session): session closed for user root Jul 10 04:39:41 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-411c26b0-75ff-431b-ac2e-1b45e4557824 tempest-GroupSnapshotsTest-544795304 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-37f9eb8a-5d23-4485-8e1c-9d3b65f0c944" returned: 0 in 0.794s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:39:41 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-411c26b0-75ff-431b-ac2e-1b45e4557824 tempest-GroupSnapshotsTest-544795304 None] <== create_volume: return (1880ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922'} {{(pid=87444) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 04:39:41 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-411c26b0-75ff-431b-ac2e-1b45e4557824 tempest-GroupSnapshotsTest-544795304 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.882s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 04:39:41 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-80e9c01f-d427-410e-bc0e-7044f033121c tempest-SnapshotsActionsTest-1538729065 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.403s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 04:39:41 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.remotefs [None req-80e9c01f-d427-410e-bc0e-7044f033121c tempest-SnapshotsActionsTest-1538729065 None] Creating offline snapshot d0116d04-61ae-41f4-88b3-cf7f2b8626cd of volume cb9ba17f-166a-487b-bda4-b5f9b80b656d {{(pid=87444) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 10 04:39:41 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-411c26b0-75ff-431b-ac2e-1b45e4557824 tempest-GroupSnapshotsTest-544795304 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e28dfa48-5cd9-4728-9061-9da49c7cb929) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-37f9eb8a-5d23-4485-8e1c-9d3b65f0c944', 'volume_size': 1}' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:39:41 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-411c26b0-75ff-431b-ac2e-1b45e4557824 tempest-GroupSnapshotsTest-544795304 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f54463c9-4cc3-432d-b2c4-fd7715978763) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:39:41 devstack cinder-volume[87444]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2c2a77f-6893-4e95-bc3c-4cf49d5a522a]: (4, 'qcow2') {{(pid=88499) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 04:39:41 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-80e9c01f-d427-410e-bc0e-7044f033121c tempest-SnapshotsActionsTest-1538729065 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-cb9ba17f-166a-487b-bda4-b5f9b80b656d.ee8c454a-c0ff-4b09-826b-830aa5ec0536 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:39:41 devstack cinder-volume[87444]: INFO cinder.volume.flows.manager.create_volume [None req-411c26b0-75ff-431b-ac2e-1b45e4557824 tempest-GroupSnapshotsTest-544795304 None] Volume volume-37f9eb8a-5d23-4485-8e1c-9d3b65f0c944 (37f9eb8a-5d23-4485-8e1c-9d3b65f0c944): created successfully Jul 10 04:39:41 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-411c26b0-75ff-431b-ac2e-1b45e4557824 tempest-GroupSnapshotsTest-544795304 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f54463c9-4cc3-432d-b2c4-fd7715978763) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:39:41 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-411c26b0-75ff-431b-ac2e-1b45e4557824 tempest-GroupSnapshotsTest-544795304 None] Flow 'volume_create_manager' (5f61e864-2912-4ee5-ae4d-fa30fcec1af4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87444) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 04:39:41 devstack cinder-volume[87444]: INFO cinder.volume.manager [None req-411c26b0-75ff-431b-ac2e-1b45e4557824 tempest-GroupSnapshotsTest-544795304 None] Created volume successfully. Jul 10 04:39:41 devstack sudo[95483]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-cb9ba17f-166a-487b-bda4-b5f9b80b656d.ee8c454a-c0ff-4b09-826b-830aa5ec0536 Jul 10 04:39:41 devstack sudo[95483]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:39:42 devstack cinder-volume[87444]: INFO cinder.volume.manager [None req-ac9666f0-0985-4e47-b8d2-02f5734989cd tempest-GroupSnapshotsTest-544795304 None] Update group completed successfully. Jul 10 04:39:42 devstack cinder-volume[87444]: DEBUG cinder.volume.flows.manager.create_volume [None req-119138fc-f8fc-4d39-a0d9-384975712b8b tempest-VolumeSnapshotQuotasNegativeTestJSON-181807343 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87444) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 04:39:42 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-119138fc-f8fc-4d39-a0d9-384975712b8b tempest-VolumeSnapshotQuotasNegativeTestJSON-181807343 None] Flow 'volume_create_manager' (23551d69-7dd9-43dc-92a5-6e61e2efafb7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 04:39:42 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-119138fc-f8fc-4d39-a0d9-384975712b8b tempest-VolumeSnapshotQuotasNegativeTestJSON-181807343 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (10df83e0-45ac-4ab3-8b7e-a3b5f0614601) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:39:42 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-119138fc-f8fc-4d39-a0d9-384975712b8b tempest-VolumeSnapshotQuotasNegativeTestJSON-181807343 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (10df83e0-45ac-4ab3-8b7e-a3b5f0614601) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T02:39:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-834433212',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9614de62-b2d8-4683-ae8a-ab76916738ea,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c0203176384a422a8e61e7e60f250338',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T02:39:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T02:39:43Z,use_quota=True,user_id='3a1446c4f53c4cbd8b5f92009360c2bb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(317e369e-1e06-434d-ae95-a335f0e6c903),volume_type_id=317e369e-1e06-434d-ae95-a335f0e6c903)' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:39:42 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-119138fc-f8fc-4d39-a0d9-384975712b8b tempest-VolumeSnapshotQuotasNegativeTestJSON-181807343 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3101e018-96f3-4afd-badb-7e7e39d84e7d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:39:42 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-119138fc-f8fc-4d39-a0d9-384975712b8b tempest-VolumeSnapshotQuotasNegativeTestJSON-181807343 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3101e018-96f3-4afd-badb-7e7e39d84e7d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:39:42 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-119138fc-f8fc-4d39-a0d9-384975712b8b tempest-VolumeSnapshotQuotasNegativeTestJSON-181807343 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (51ead3a6-70b1-401b-94d7-96b7f7a67705) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:39:42 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-119138fc-f8fc-4d39-a0d9-384975712b8b tempest-VolumeSnapshotQuotasNegativeTestJSON-181807343 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (51ead3a6-70b1-401b-94d7-96b7f7a67705) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9614de62-b2d8-4683-ae8a-ab76916738ea', 'volume_name': 'volume-9614de62-b2d8-4683-ae8a-ab76916738ea', 'volume_size': 1}' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:39:42 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-119138fc-f8fc-4d39-a0d9-384975712b8b tempest-VolumeSnapshotQuotasNegativeTestJSON-181807343 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f5c4d18d-322a-4647-9e40-ef63822bd9c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:39:42 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-119138fc-f8fc-4d39-a0d9-384975712b8b tempest-VolumeSnapshotQuotasNegativeTestJSON-181807343 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f5c4d18d-322a-4647-9e40-ef63822bd9c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:39:42 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-119138fc-f8fc-4d39-a0d9-384975712b8b tempest-VolumeSnapshotQuotasNegativeTestJSON-181807343 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (595edfc5-aade-4759-beed-4a5db18c5735) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:39:42 devstack cinder-volume[87444]: INFO cinder.volume.flows.manager.create_volume [None req-119138fc-f8fc-4d39-a0d9-384975712b8b tempest-VolumeSnapshotQuotasNegativeTestJSON-181807343 None] Volume 9614de62-b2d8-4683-ae8a-ab76916738ea: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9614de62-b2d8-4683-ae8a-ab76916738ea', 'volume_size': 1} Jul 10 04:39:42 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-119138fc-f8fc-4d39-a0d9-384975712b8b tempest-VolumeSnapshotQuotasNegativeTestJSON-181807343 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 04:39:42 devstack sudo[95483]: pam_unix(sudo:session): session closed for user root Jul 10 04:39:42 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-80e9c01f-d427-410e-bc0e-7044f033121c tempest-SnapshotsActionsTest-1538729065 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-cb9ba17f-166a-487b-bda4-b5f9b80b656d.ee8c454a-c0ff-4b09-826b-830aa5ec0536" returned: 0 in 0.949s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:39:42 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.remotefs [None req-80e9c01f-d427-410e-bc0e-7044f033121c tempest-SnapshotsActionsTest-1538729065 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-cb9ba17f-166a-487b-bda4-b5f9b80b656d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87444) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 10 04:39:42 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-80e9c01f-d427-410e-bc0e-7044f033121c tempest-SnapshotsActionsTest-1538729065 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-cb9ba17f-166a-487b-bda4-b5f9b80b656d.ee8c454a-c0ff-4b09-826b-830aa5ec0536,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-cb9ba17f-166a-487b-bda4-b5f9b80b656d.d0116d04-61ae-41f4-88b3-cf7f2b8626cd 1G {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:39:42 devstack sudo[95489]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-cb9ba17f-166a-487b-bda4-b5f9b80b656d.ee8c454a-c0ff-4b09-826b-830aa5ec0536,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-cb9ba17f-166a-487b-bda4-b5f9b80b656d.d0116d04-61ae-41f4-88b3-cf7f2b8626cd 1G Jul 10 04:39:42 devstack sudo[95489]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:39:43 devstack sudo[95489]: pam_unix(sudo:session): session closed for user root Jul 10 04:39:43 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-80e9c01f-d427-410e-bc0e-7044f033121c tempest-SnapshotsActionsTest-1538729065 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-cb9ba17f-166a-487b-bda4-b5f9b80b656d.ee8c454a-c0ff-4b09-826b-830aa5ec0536,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-cb9ba17f-166a-487b-bda4-b5f9b80b656d.d0116d04-61ae-41f4-88b3-cf7f2b8626cd 1G" returned: 0 in 0.924s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:39:43 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-80e9c01f-d427-410e-bc0e-7044f033121c tempest-SnapshotsActionsTest-1538729065 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cb9ba17f-166a-487b-bda4-b5f9b80b656d.ee8c454a-c0ff-4b09-826b-830aa5ec0536 -F qcow2 /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-cb9ba17f-166a-487b-bda4-b5f9b80b656d.d0116d04-61ae-41f4-88b3-cf7f2b8626cd {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:39:43 devstack sudo[95496]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cb9ba17f-166a-487b-bda4-b5f9b80b656d.ee8c454a-c0ff-4b09-826b-830aa5ec0536 -F qcow2 /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-cb9ba17f-166a-487b-bda4-b5f9b80b656d.d0116d04-61ae-41f4-88b3-cf7f2b8626cd Jul 10 04:39:43 devstack sudo[95496]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:39:43 devstack cinder-volume[87444]: INFO cinder.volume.manager [None req-2d2bbcdd-d887-46dd-9b41-317caf0d5c1c tempest-GroupSnapshotsTest-544795304 None] Update group completed successfully. Jul 10 04:39:44 devstack sudo[95496]: pam_unix(sudo:session): session closed for user root Jul 10 04:39:44 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-80e9c01f-d427-410e-bc0e-7044f033121c tempest-SnapshotsActionsTest-1538729065 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cb9ba17f-166a-487b-bda4-b5f9b80b656d.ee8c454a-c0ff-4b09-826b-830aa5ec0536 -F qcow2 /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-cb9ba17f-166a-487b-bda4-b5f9b80b656d.d0116d04-61ae-41f4-88b3-cf7f2b8626cd" returned: 0 in 0.742s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:39:44 devstack cinder-volume[87444]: WARNING cinder.volume.drivers.remotefs [None req-80e9c01f-d427-410e-bc0e-7044f033121c tempest-SnapshotsActionsTest-1538729065 None] /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-cb9ba17f-166a-487b-bda4-b5f9b80b656d.d0116d04-61ae-41f4-88b3-cf7f2b8626cd is being set with open permissions: ugo+rw Jul 10 04:39:44 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-80e9c01f-d427-410e-bc0e-7044f033121c tempest-SnapshotsActionsTest-1538729065 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-cb9ba17f-166a-487b-bda4-b5f9b80b656d.d0116d04-61ae-41f4-88b3-cf7f2b8626cd {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:39:44 devstack sudo[95501]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-cb9ba17f-166a-487b-bda4-b5f9b80b656d.d0116d04-61ae-41f4-88b3-cf7f2b8626cd Jul 10 04:39:44 devstack sudo[95501]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:39:44 devstack cinder-volume[87444]: INFO cinder.volume.manager [None req-194056aa-aab1-4bc2-8e45-0c3c9d0fcb89 tempest-GroupSnapshotsTest-544795304 None] Update group completed successfully. Jul 10 04:39:45 devstack sudo[95501]: pam_unix(sudo:session): session closed for user root Jul 10 04:39:45 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-80e9c01f-d427-410e-bc0e-7044f033121c tempest-SnapshotsActionsTest-1538729065 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-cb9ba17f-166a-487b-bda4-b5f9b80b656d.d0116d04-61ae-41f4-88b3-cf7f2b8626cd" returned: 0 in 0.671s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:39:45 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-80e9c01f-d427-410e-bc0e-7044f033121c tempest-SnapshotsActionsTest-1538729065 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.400s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 04:39:45 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-119138fc-f8fc-4d39-a0d9-384975712b8b tempest-VolumeSnapshotQuotasNegativeTestJSON-181807343 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.422s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 04:39:45 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-119138fc-f8fc-4d39-a0d9-384975712b8b tempest-VolumeSnapshotQuotasNegativeTestJSON-181807343 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T02:39:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-834433212',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9614de62-b2d8-4683-ae8a-ab76916738ea,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c0203176384a422a8e61e7e60f250338',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T02:39:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T02:39:43Z,use_quota=True,user_id='3a1446c4f53c4cbd8b5f92009360c2bb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(317e369e-1e06-434d-ae95-a335f0e6c903),volume_type_id=317e369e-1e06-434d-ae95-a335f0e6c903)}" {{(pid=87444) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 04:39:45 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.remotefs [None req-119138fc-f8fc-4d39-a0d9-384975712b8b tempest-VolumeSnapshotQuotasNegativeTestJSON-181807343 None] Creating volume 9614de62-b2d8-4683-ae8a-ab76916738ea {{(pid=87444) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 04:39:45 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-119138fc-f8fc-4d39-a0d9-384975712b8b tempest-VolumeSnapshotQuotasNegativeTestJSON-181807343 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 04:39:45 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-119138fc-f8fc-4d39-a0d9-384975712b8b tempest-VolumeSnapshotQuotasNegativeTestJSON-181807343 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 04:39:45 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-119138fc-f8fc-4d39-a0d9-384975712b8b tempest-VolumeSnapshotQuotasNegativeTestJSON-181807343 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922': None} {{(pid=87444) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 04:39:45 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-119138fc-f8fc-4d39-a0d9-384975712b8b tempest-VolumeSnapshotQuotasNegativeTestJSON-181807343 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922'] {{(pid=87444) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 04:39:45 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-119138fc-f8fc-4d39-a0d9-384975712b8b tempest-VolumeSnapshotQuotasNegativeTestJSON-181807343 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 04:39:45 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-119138fc-f8fc-4d39-a0d9-384975712b8b tempest-VolumeSnapshotQuotasNegativeTestJSON-181807343 None] Selected osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922 as target Quobyte volume. {{(pid=87444) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 04:39:45 devstack cinder-volume[87444]: INFO cinder.volume.drivers.remotefs [None req-119138fc-f8fc-4d39-a0d9-384975712b8b tempest-VolumeSnapshotQuotasNegativeTestJSON-181807343 None] casted to osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922 Jul 10 04:39:45 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-119138fc-f8fc-4d39-a0d9-384975712b8b tempest-VolumeSnapshotQuotasNegativeTestJSON-181807343 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-9614de62-b2d8-4683-ae8a-ab76916738ea 1073741824 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:39:45 devstack sudo[95510]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-9614de62-b2d8-4683-ae8a-ab76916738ea 1073741824 Jul 10 04:39:45 devstack sudo[95510]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:39:45 devstack cinder-volume[87444]: INFO cinder.volume.manager [None req-80e9c01f-d427-410e-bc0e-7044f033121c tempest-SnapshotsActionsTest-1538729065 None] Create snapshot completed successfully Jul 10 04:39:45 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-74ad1086-32d2-4c90-b028-ef1224c7f7d3 tempest-SnapshotsActionsTest-1017379468 None] Acquiring lock "cinder-d0116d04-61ae-41f4-88b3-cf7f2b8626cd-delete_snapshot" by "delete_snapshot" {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 04:39:45 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-74ad1086-32d2-4c90-b028-ef1224c7f7d3 tempest-SnapshotsActionsTest-1017379468 None] Lock "cinder-d0116d04-61ae-41f4-88b3-cf7f2b8626cd-delete_snapshot" acquired by "delete_snapshot" :: waited 0.022s {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 04:39:45 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-74ad1086-32d2-4c90-b028-ef1224c7f7d3 tempest-SnapshotsActionsTest-1017379468 None] Acquiring lock "cinder-quobyte-cb9ba17f-166a-487b-bda4-b5f9b80b656d" by "delete_snapshot" {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 04:39:45 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-74ad1086-32d2-4c90-b028-ef1224c7f7d3 tempest-SnapshotsActionsTest-1017379468 None] Lock "cinder-quobyte-cb9ba17f-166a-487b-bda4-b5f9b80b656d" acquired by "delete_snapshot" :: waited 0.025s {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 04:39:45 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-74ad1086-32d2-4c90-b028-ef1224c7f7d3 tempest-SnapshotsActionsTest-1017379468 None] Acquiring lock "cinder-quobyte-d0116d04-61ae-41f4-88b3-cf7f2b8626cd" by "_delete_snapshot" {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 04:39:45 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-74ad1086-32d2-4c90-b028-ef1224c7f7d3 tempest-SnapshotsActionsTest-1017379468 None] Lock "cinder-quobyte-d0116d04-61ae-41f4-88b3-cf7f2b8626cd" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 04:39:45 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.remotefs [None req-74ad1086-32d2-4c90-b028-ef1224c7f7d3 tempest-SnapshotsActionsTest-1017379468 None] Deleting offline snapshot d0116d04-61ae-41f4-88b3-cf7f2b8626cd of volume cb9ba17f-166a-487b-bda4-b5f9b80b656d {{(pid=87444) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 10 04:39:45 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.remotefs [None req-74ad1086-32d2-4c90-b028-ef1224c7f7d3 tempest-SnapshotsActionsTest-1017379468 None] snapshot_file for this snap is: volume-cb9ba17f-166a-487b-bda4-b5f9b80b656d.d0116d04-61ae-41f4-88b3-cf7f2b8626cd {{(pid=87444) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 10 04:39:45 devstack cinder-volume[87444]: DEBUG oslo.privsep.daemon [-] privsep: reply[41ce6140-883c-450f-a132-9f524668ff49]: (4, 'qcow2') {{(pid=88499) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 04:39:45 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-74ad1086-32d2-4c90-b028-ef1224c7f7d3 tempest-SnapshotsActionsTest-1017379468 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-cb9ba17f-166a-487b-bda4-b5f9b80b656d.d0116d04-61ae-41f4-88b3-cf7f2b8626cd {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:39:45 devstack sudo[95515]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-cb9ba17f-166a-487b-bda4-b5f9b80b656d.d0116d04-61ae-41f4-88b3-cf7f2b8626cd Jul 10 04:39:45 devstack sudo[95515]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:39:46 devstack sudo[95510]: pam_unix(sudo:session): session closed for user root Jul 10 04:39:46 devstack cinder-volume[87444]: DEBUG dbcounter [-] [87444] Writing DB stats cinder:UPDATE=141,cinder:SELECT=135,cinder:DELETE=5,cinder:INSERT=22 {{(pid=87444) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 10 04:39:46 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-119138fc-f8fc-4d39-a0d9-384975712b8b tempest-VolumeSnapshotQuotasNegativeTestJSON-181807343 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-9614de62-b2d8-4683-ae8a-ab76916738ea 1073741824" returned: 0 in 0.997s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:39:46 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-119138fc-f8fc-4d39-a0d9-384975712b8b tempest-VolumeSnapshotQuotasNegativeTestJSON-181807343 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-9614de62-b2d8-4683-ae8a-ab76916738ea {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:39:46 devstack cinder-volume[87444]: INFO cinder.volume.manager [None req-038403f1-2cc2-4058-932f-f00b2c695350 tempest-GroupSnapshotsTest-544795304 None] Update group completed successfully. Jul 10 04:39:46 devstack sudo[95518]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-9614de62-b2d8-4683-ae8a-ab76916738ea Jul 10 04:39:46 devstack sudo[95518]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:39:46 devstack sudo[95515]: pam_unix(sudo:session): session closed for user root Jul 10 04:39:46 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-74ad1086-32d2-4c90-b028-ef1224c7f7d3 tempest-SnapshotsActionsTest-1017379468 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-cb9ba17f-166a-487b-bda4-b5f9b80b656d.d0116d04-61ae-41f4-88b3-cf7f2b8626cd" returned: 0 in 0.882s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:39:46 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.remotefs [None req-74ad1086-32d2-4c90-b028-ef1224c7f7d3 tempest-SnapshotsActionsTest-1017379468 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-cb9ba17f-166a-487b-bda4-b5f9b80b656d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87444) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 10 04:39:46 devstack cinder-volume[87444]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3cf354d-ef53-4a4c-90e5-4cb522e73bad]: (4, 'qcow2') {{(pid=88499) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 04:39:46 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-74ad1086-32d2-4c90-b028-ef1224c7f7d3 tempest-SnapshotsActionsTest-1017379468 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-cb9ba17f-166a-487b-bda4-b5f9b80b656d.ee8c454a-c0ff-4b09-826b-830aa5ec0536 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:39:46 devstack sudo[95523]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-cb9ba17f-166a-487b-bda4-b5f9b80b656d.ee8c454a-c0ff-4b09-826b-830aa5ec0536 Jul 10 04:39:46 devstack sudo[95523]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:39:46 devstack sudo[95518]: pam_unix(sudo:session): session closed for user root Jul 10 04:39:46 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-119138fc-f8fc-4d39-a0d9-384975712b8b tempest-VolumeSnapshotQuotasNegativeTestJSON-181807343 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-9614de62-b2d8-4683-ae8a-ab76916738ea" returned: 0 in 0.724s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:39:46 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-119138fc-f8fc-4d39-a0d9-384975712b8b tempest-VolumeSnapshotQuotasNegativeTestJSON-181807343 None] <== create_volume: return (1786ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922'} {{(pid=87444) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 04:39:46 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-119138fc-f8fc-4d39-a0d9-384975712b8b tempest-VolumeSnapshotQuotasNegativeTestJSON-181807343 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.788s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 04:39:47 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-119138fc-f8fc-4d39-a0d9-384975712b8b tempest-VolumeSnapshotQuotasNegativeTestJSON-181807343 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (595edfc5-aade-4759-beed-4a5db18c5735) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9614de62-b2d8-4683-ae8a-ab76916738ea', 'volume_size': 1}' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:39:47 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-119138fc-f8fc-4d39-a0d9-384975712b8b tempest-VolumeSnapshotQuotasNegativeTestJSON-181807343 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (26bde870-69fb-41e8-b194-c421232fda0b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:39:47 devstack cinder-volume[87444]: INFO cinder.volume.flows.manager.create_volume [None req-119138fc-f8fc-4d39-a0d9-384975712b8b tempest-VolumeSnapshotQuotasNegativeTestJSON-181807343 None] Volume volume-9614de62-b2d8-4683-ae8a-ab76916738ea (9614de62-b2d8-4683-ae8a-ab76916738ea): created successfully Jul 10 04:39:47 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-119138fc-f8fc-4d39-a0d9-384975712b8b tempest-VolumeSnapshotQuotasNegativeTestJSON-181807343 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (26bde870-69fb-41e8-b194-c421232fda0b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:39:47 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-119138fc-f8fc-4d39-a0d9-384975712b8b tempest-VolumeSnapshotQuotasNegativeTestJSON-181807343 None] Flow 'volume_create_manager' (23551d69-7dd9-43dc-92a5-6e61e2efafb7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87444) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 04:39:47 devstack cinder-volume[87444]: INFO cinder.volume.manager [None req-119138fc-f8fc-4d39-a0d9-384975712b8b tempest-VolumeSnapshotQuotasNegativeTestJSON-181807343 None] Created volume successfully. Jul 10 04:39:47 devstack cinder-volume[87444]: DEBUG cinder.volume.flows.manager.create_volume [None req-e7c1b4f4-3861-401c-acad-b63f35a89321 tempest-VolumesServicesTestJSON-1896668493 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87444) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 04:39:47 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-e7c1b4f4-3861-401c-acad-b63f35a89321 tempest-VolumesServicesTestJSON-1896668493 None] Flow 'volume_create_manager' (d90059aa-ed4d-4052-bad6-b587416dd475) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 04:39:47 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-e7c1b4f4-3861-401c-acad-b63f35a89321 tempest-VolumesServicesTestJSON-1896668493 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cbb38e67-9a5b-418b-b8f0-636515fa7f1a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:39:47 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-e7c1b4f4-3861-401c-acad-b63f35a89321 tempest-VolumesServicesTestJSON-1896668493 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cbb38e67-9a5b-418b-b8f0-636515fa7f1a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T02:39:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-800413446',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=94f71db6-7e72-45b1-9646-2ef82552c78e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='92223adf956b4fc2a12d7b7a7b953b49',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T02:39:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T02:39:47Z,use_quota=True,user_id='cfda57e1fd55410da9efcbf533432994',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(317e369e-1e06-434d-ae95-a335f0e6c903),volume_type_id=317e369e-1e06-434d-ae95-a335f0e6c903)' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:39:47 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-e7c1b4f4-3861-401c-acad-b63f35a89321 tempest-VolumesServicesTestJSON-1896668493 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (530f85d3-768d-4e14-8748-a62abc16192b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:39:47 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-e7c1b4f4-3861-401c-acad-b63f35a89321 tempest-VolumesServicesTestJSON-1896668493 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (530f85d3-768d-4e14-8748-a62abc16192b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:39:47 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-e7c1b4f4-3861-401c-acad-b63f35a89321 tempest-VolumesServicesTestJSON-1896668493 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (51ed08e4-c607-4057-b5a2-b9d9995f5ed2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:39:47 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-e7c1b4f4-3861-401c-acad-b63f35a89321 tempest-VolumesServicesTestJSON-1896668493 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (51ed08e4-c607-4057-b5a2-b9d9995f5ed2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '94f71db6-7e72-45b1-9646-2ef82552c78e', 'volume_name': 'volume-94f71db6-7e72-45b1-9646-2ef82552c78e', 'volume_size': 1}' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:39:47 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-e7c1b4f4-3861-401c-acad-b63f35a89321 tempest-VolumesServicesTestJSON-1896668493 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (891df6ff-13e1-4b07-ab25-44325d9e21cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:39:47 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-e7c1b4f4-3861-401c-acad-b63f35a89321 tempest-VolumesServicesTestJSON-1896668493 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (891df6ff-13e1-4b07-ab25-44325d9e21cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:39:47 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-e7c1b4f4-3861-401c-acad-b63f35a89321 tempest-VolumesServicesTestJSON-1896668493 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0b21aa47-7be6-4244-aac2-a2b19068ef2a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:39:47 devstack cinder-volume[87444]: INFO cinder.volume.flows.manager.create_volume [None req-e7c1b4f4-3861-401c-acad-b63f35a89321 tempest-VolumesServicesTestJSON-1896668493 None] Volume 94f71db6-7e72-45b1-9646-2ef82552c78e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-94f71db6-7e72-45b1-9646-2ef82552c78e', 'volume_size': 1} Jul 10 04:39:47 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-e7c1b4f4-3861-401c-acad-b63f35a89321 tempest-VolumesServicesTestJSON-1896668493 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 04:39:47 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-e7c1b4f4-3861-401c-acad-b63f35a89321 tempest-VolumesServicesTestJSON-1896668493 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 04:39:47 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-e7c1b4f4-3861-401c-acad-b63f35a89321 tempest-VolumesServicesTestJSON-1896668493 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T02:39:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-800413446',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=94f71db6-7e72-45b1-9646-2ef82552c78e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='92223adf956b4fc2a12d7b7a7b953b49',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T02:39:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T02:39:47Z,use_quota=True,user_id='cfda57e1fd55410da9efcbf533432994',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(317e369e-1e06-434d-ae95-a335f0e6c903),volume_type_id=317e369e-1e06-434d-ae95-a335f0e6c903)}" {{(pid=87444) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 04:39:47 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.remotefs [None req-e7c1b4f4-3861-401c-acad-b63f35a89321 tempest-VolumesServicesTestJSON-1896668493 None] Creating volume 94f71db6-7e72-45b1-9646-2ef82552c78e {{(pid=87444) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 04:39:47 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-e7c1b4f4-3861-401c-acad-b63f35a89321 tempest-VolumesServicesTestJSON-1896668493 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 04:39:47 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-e7c1b4f4-3861-401c-acad-b63f35a89321 tempest-VolumesServicesTestJSON-1896668493 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 04:39:47 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-e7c1b4f4-3861-401c-acad-b63f35a89321 tempest-VolumesServicesTestJSON-1896668493 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922': None} {{(pid=87444) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 04:39:47 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-e7c1b4f4-3861-401c-acad-b63f35a89321 tempest-VolumesServicesTestJSON-1896668493 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922'] {{(pid=87444) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 04:39:47 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-e7c1b4f4-3861-401c-acad-b63f35a89321 tempest-VolumesServicesTestJSON-1896668493 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 04:39:47 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-e7c1b4f4-3861-401c-acad-b63f35a89321 tempest-VolumesServicesTestJSON-1896668493 None] Selected osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922 as target Quobyte volume. {{(pid=87444) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 04:39:47 devstack cinder-volume[87444]: INFO cinder.volume.drivers.remotefs [None req-e7c1b4f4-3861-401c-acad-b63f35a89321 tempest-VolumesServicesTestJSON-1896668493 None] casted to osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922 Jul 10 04:39:47 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-e7c1b4f4-3861-401c-acad-b63f35a89321 tempest-VolumesServicesTestJSON-1896668493 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-94f71db6-7e72-45b1-9646-2ef82552c78e 1073741824 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:39:47 devstack sudo[95527]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-94f71db6-7e72-45b1-9646-2ef82552c78e 1073741824 Jul 10 04:39:47 devstack sudo[95527]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:39:47 devstack sudo[95523]: pam_unix(sudo:session): session closed for user root Jul 10 04:39:47 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-74ad1086-32d2-4c90-b028-ef1224c7f7d3 tempest-SnapshotsActionsTest-1017379468 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-cb9ba17f-166a-487b-bda4-b5f9b80b656d.ee8c454a-c0ff-4b09-826b-830aa5ec0536" returned: 0 in 0.847s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:39:47 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.remotefs [None req-74ad1086-32d2-4c90-b028-ef1224c7f7d3 tempest-SnapshotsActionsTest-1017379468 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-cb9ba17f-166a-487b-bda4-b5f9b80b656d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87444) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 10 04:39:47 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-74ad1086-32d2-4c90-b028-ef1224c7f7d3 tempest-SnapshotsActionsTest-1017379468 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-cb9ba17f-166a-487b-bda4-b5f9b80b656d.d0116d04-61ae-41f4-88b3-cf7f2b8626cd {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:39:47 devstack sudo[95532]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-cb9ba17f-166a-487b-bda4-b5f9b80b656d.d0116d04-61ae-41f4-88b3-cf7f2b8626cd Jul 10 04:39:47 devstack sudo[95532]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:39:47 devstack cinder-volume[87444]: INFO cinder.volume.manager [None req-9b69b00a-eaeb-45a9-a593-a8b2284b4364 tempest-GroupSnapshotsTest-544795304 None] GroupSnapshot d7d6df08-26e3-4ea2-bad5-4b6bda121c06: creating. Jul 10 04:39:47 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-9b69b00a-eaeb-45a9-a593-a8b2284b4364 tempest-GroupSnapshotsTest-544795304 None] Group snapshot d7d6df08-26e3-4ea2-bad5-4b6bda121c06: creating. {{(pid=87444) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Jul 10 04:39:47 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-9b69b00a-eaeb-45a9-a593-a8b2284b4364 tempest-GroupSnapshotsTest-544795304 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 04:39:48 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-3e248218-639d-4052-b05e-4ce47bae84dc tempest-VolumeSnapshotQuotasNegativeTestJSON-181807343 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 04:39:48 devstack sudo[95527]: pam_unix(sudo:session): session closed for user root Jul 10 04:39:48 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-e7c1b4f4-3861-401c-acad-b63f35a89321 tempest-VolumesServicesTestJSON-1896668493 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-94f71db6-7e72-45b1-9646-2ef82552c78e 1073741824" returned: 0 in 0.941s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:39:48 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-e7c1b4f4-3861-401c-acad-b63f35a89321 tempest-VolumesServicesTestJSON-1896668493 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-94f71db6-7e72-45b1-9646-2ef82552c78e {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:39:48 devstack sudo[95541]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-94f71db6-7e72-45b1-9646-2ef82552c78e Jul 10 04:39:48 devstack sudo[95541]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:39:48 devstack sudo[95532]: pam_unix(sudo:session): session closed for user root Jul 10 04:39:48 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-74ad1086-32d2-4c90-b028-ef1224c7f7d3 tempest-SnapshotsActionsTest-1017379468 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-cb9ba17f-166a-487b-bda4-b5f9b80b656d.d0116d04-61ae-41f4-88b3-cf7f2b8626cd" returned: 0 in 0.870s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:39:48 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-74ad1086-32d2-4c90-b028-ef1224c7f7d3 tempest-SnapshotsActionsTest-1017379468 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-cb9ba17f-166a-487b-bda4-b5f9b80b656d.d0116d04-61ae-41f4-88b3-cf7f2b8626cd {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:39:48 devstack sudo[95543]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-cb9ba17f-166a-487b-bda4-b5f9b80b656d.d0116d04-61ae-41f4-88b3-cf7f2b8626cd Jul 10 04:39:48 devstack sudo[95543]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:39:49 devstack sudo[95541]: pam_unix(sudo:session): session closed for user root Jul 10 04:39:49 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-e7c1b4f4-3861-401c-acad-b63f35a89321 tempest-VolumesServicesTestJSON-1896668493 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-94f71db6-7e72-45b1-9646-2ef82552c78e" returned: 0 in 0.710s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:39:49 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-e7c1b4f4-3861-401c-acad-b63f35a89321 tempest-VolumesServicesTestJSON-1896668493 None] <== create_volume: return (1691ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922'} {{(pid=87444) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 04:39:49 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-e7c1b4f4-3861-401c-acad-b63f35a89321 tempest-VolumesServicesTestJSON-1896668493 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.694s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 04:39:49 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-9b69b00a-eaeb-45a9-a593-a8b2284b4364 tempest-GroupSnapshotsTest-544795304 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.305s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 04:39:49 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.remotefs [None req-9b69b00a-eaeb-45a9-a593-a8b2284b4364 tempest-GroupSnapshotsTest-544795304 None] Creating offline snapshot 00283e97-3cf0-40b3-9eb4-6183b44eeb2c of volume 37f9eb8a-5d23-4485-8e1c-9d3b65f0c944 {{(pid=87444) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 10 04:39:49 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-e7c1b4f4-3861-401c-acad-b63f35a89321 tempest-VolumesServicesTestJSON-1896668493 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0b21aa47-7be6-4244-aac2-a2b19068ef2a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-94f71db6-7e72-45b1-9646-2ef82552c78e', 'volume_size': 1}' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:39:49 devstack sudo[95543]: pam_unix(sudo:session): session closed for user root Jul 10 04:39:49 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-e7c1b4f4-3861-401c-acad-b63f35a89321 tempest-VolumesServicesTestJSON-1896668493 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3680d735-354e-4b19-926a-7f1e2e513250) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:39:49 devstack cinder-volume[87444]: DEBUG oslo.privsep.daemon [-] privsep: reply[9bac3d59-40ae-4c61-a3c8-485e888690d7]: (4, 'qcow2') {{(pid=88499) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 04:39:49 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-9b69b00a-eaeb-45a9-a593-a8b2284b4364 tempest-GroupSnapshotsTest-544795304 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-37f9eb8a-5d23-4485-8e1c-9d3b65f0c944 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:39:49 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-74ad1086-32d2-4c90-b028-ef1224c7f7d3 tempest-SnapshotsActionsTest-1017379468 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-cb9ba17f-166a-487b-bda4-b5f9b80b656d.d0116d04-61ae-41f4-88b3-cf7f2b8626cd" returned: 0 in 0.680s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:39:49 devstack cinder-volume[87444]: INFO cinder.volume.flows.manager.create_volume [None req-e7c1b4f4-3861-401c-acad-b63f35a89321 tempest-VolumesServicesTestJSON-1896668493 None] Volume volume-94f71db6-7e72-45b1-9646-2ef82552c78e (94f71db6-7e72-45b1-9646-2ef82552c78e): created successfully Jul 10 04:39:49 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-e7c1b4f4-3861-401c-acad-b63f35a89321 tempest-VolumesServicesTestJSON-1896668493 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3680d735-354e-4b19-926a-7f1e2e513250) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:39:49 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-e7c1b4f4-3861-401c-acad-b63f35a89321 tempest-VolumesServicesTestJSON-1896668493 None] Flow 'volume_create_manager' (d90059aa-ed4d-4052-bad6-b587416dd475) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87444) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 04:39:49 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-74ad1086-32d2-4c90-b028-ef1224c7f7d3 tempest-SnapshotsActionsTest-1017379468 None] Lock "cinder-quobyte-d0116d04-61ae-41f4-88b3-cf7f2b8626cd" released by "_delete_snapshot" :: held 3.411s {{(pid=87444) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 04:39:49 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-74ad1086-32d2-4c90-b028-ef1224c7f7d3 tempest-SnapshotsActionsTest-1017379468 None] Lock "cinder-quobyte-cb9ba17f-166a-487b-bda4-b5f9b80b656d" released by "delete_snapshot" :: held 3.444s {{(pid=87444) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 04:39:49 devstack cinder-volume[87444]: INFO cinder.volume.manager [None req-e7c1b4f4-3861-401c-acad-b63f35a89321 tempest-VolumesServicesTestJSON-1896668493 None] Created volume successfully. Jul 10 04:39:49 devstack sudo[95547]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-37f9eb8a-5d23-4485-8e1c-9d3b65f0c944 Jul 10 04:39:49 devstack sudo[95547]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:39:49 devstack cinder-volume[87444]: DEBUG cinder.quota [None req-74ad1086-32d2-4c90-b028-ef1224c7f7d3 tempest-SnapshotsActionsTest-1017379468 None] Created reservations ['9d321c53-49f4-4e88-915d-426dd9712b2a', '10cecc46-80d8-426b-810c-2d924ea63f72', 'bac5478d-4f88-4133-8b8a-da019111550f', 'c0e94831-f9e5-4edd-87d5-dfda3f56fe0c'] {{(pid=87444) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 04:39:49 devstack cinder-volume[87444]: INFO cinder.volume.manager [None req-74ad1086-32d2-4c90-b028-ef1224c7f7d3 tempest-SnapshotsActionsTest-1017379468 None] Delete snapshot completed successfully. Jul 10 04:39:49 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-74ad1086-32d2-4c90-b028-ef1224c7f7d3 tempest-SnapshotsActionsTest-1017379468 None] Lock "cinder-d0116d04-61ae-41f4-88b3-cf7f2b8626cd-delete_snapshot" released by "delete_snapshot" :: held 3.607s {{(pid=87444) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 04:39:49 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-abd47fe3-adf3-4eac-a158-46b8bb26a356 tempest-VolumesServicesTestJSON-1896668493 None] Acquiring lock "cinder-94f71db6-7e72-45b1-9646-2ef82552c78e-delete_volume" by "delete_volume" {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 04:39:49 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-abd47fe3-adf3-4eac-a158-46b8bb26a356 tempest-VolumesServicesTestJSON-1896668493 None] Lock "cinder-94f71db6-7e72-45b1-9646-2ef82552c78e-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 04:39:49 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-abd47fe3-adf3-4eac-a158-46b8bb26a356 tempest-VolumesServicesTestJSON-1896668493 None] Acquiring lock "cinder-quobyte-94f71db6-7e72-45b1-9646-2ef82552c78e" by "delete_volume" {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 04:39:49 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-abd47fe3-adf3-4eac-a158-46b8bb26a356 tempest-VolumesServicesTestJSON-1896668493 None] Lock "cinder-quobyte-94f71db6-7e72-45b1-9646-2ef82552c78e" acquired by "delete_volume" :: waited 0.021s {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 04:39:49 devstack cinder-volume[87444]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f7d2d85-fe6c-4598-b1d9-af3c6463dfe3]: (4, 'qcow2') {{(pid=88499) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 04:39:49 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-abd47fe3-adf3-4eac-a158-46b8bb26a356 tempest-VolumesServicesTestJSON-1896668493 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-94f71db6-7e72-45b1-9646-2ef82552c78e {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:39:49 devstack sudo[95549]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-94f71db6-7e72-45b1-9646-2ef82552c78e Jul 10 04:39:49 devstack sudo[95549]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:39:49 devstack sudo[95547]: pam_unix(sudo:session): session closed for user root Jul 10 04:39:49 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-9b69b00a-eaeb-45a9-a593-a8b2284b4364 tempest-GroupSnapshotsTest-544795304 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-37f9eb8a-5d23-4485-8e1c-9d3b65f0c944" returned: 0 in 0.813s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:39:49 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-9b69b00a-eaeb-45a9-a593-a8b2284b4364 tempest-GroupSnapshotsTest-544795304 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-37f9eb8a-5d23-4485-8e1c-9d3b65f0c944,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-37f9eb8a-5d23-4485-8e1c-9d3b65f0c944.00283e97-3cf0-40b3-9eb4-6183b44eeb2c 1G {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:39:49 devstack sudo[95554]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-37f9eb8a-5d23-4485-8e1c-9d3b65f0c944,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-37f9eb8a-5d23-4485-8e1c-9d3b65f0c944.00283e97-3cf0-40b3-9eb4-6183b44eeb2c 1G Jul 10 04:39:50 devstack sudo[95554]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:39:50 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-c0e5d5fd-8e25-4e8c-ba1c-c0357e594012 tempest-SnapshotsActionsTest-1538729065 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 04:39:50 devstack sudo[95549]: pam_unix(sudo:session): session closed for user root Jul 10 04:39:50 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-abd47fe3-adf3-4eac-a158-46b8bb26a356 tempest-VolumesServicesTestJSON-1896668493 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-94f71db6-7e72-45b1-9646-2ef82552c78e" returned: 0 in 0.789s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:39:50 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-abd47fe3-adf3-4eac-a158-46b8bb26a356 tempest-VolumesServicesTestJSON-1896668493 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-94f71db6-7e72-45b1-9646-2ef82552c78e {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:39:50 devstack sudo[95559]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-94f71db6-7e72-45b1-9646-2ef82552c78e Jul 10 04:39:50 devstack sudo[95559]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:39:50 devstack sudo[95554]: pam_unix(sudo:session): session closed for user root Jul 10 04:39:50 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-9b69b00a-eaeb-45a9-a593-a8b2284b4364 tempest-GroupSnapshotsTest-544795304 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-37f9eb8a-5d23-4485-8e1c-9d3b65f0c944,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-37f9eb8a-5d23-4485-8e1c-9d3b65f0c944.00283e97-3cf0-40b3-9eb4-6183b44eeb2c 1G" returned: 0 in 0.841s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:39:50 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-9b69b00a-eaeb-45a9-a593-a8b2284b4364 tempest-GroupSnapshotsTest-544795304 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-37f9eb8a-5d23-4485-8e1c-9d3b65f0c944 -F qcow2 /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-37f9eb8a-5d23-4485-8e1c-9d3b65f0c944.00283e97-3cf0-40b3-9eb4-6183b44eeb2c {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:39:50 devstack sudo[95564]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-37f9eb8a-5d23-4485-8e1c-9d3b65f0c944 -F qcow2 /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-37f9eb8a-5d23-4485-8e1c-9d3b65f0c944.00283e97-3cf0-40b3-9eb4-6183b44eeb2c Jul 10 04:39:50 devstack sudo[95564]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:39:51 devstack sudo[95559]: pam_unix(sudo:session): session closed for user root Jul 10 04:39:51 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-abd47fe3-adf3-4eac-a158-46b8bb26a356 tempest-VolumesServicesTestJSON-1896668493 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-94f71db6-7e72-45b1-9646-2ef82552c78e" returned: 0 in 0.667s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:39:51 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-abd47fe3-adf3-4eac-a158-46b8bb26a356 tempest-VolumesServicesTestJSON-1896668493 None] Lock "cinder-quobyte-94f71db6-7e72-45b1-9646-2ef82552c78e" released by "delete_volume" :: held 1.496s {{(pid=87444) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 04:39:51 devstack cinder-volume[87444]: DEBUG cinder.quota [None req-abd47fe3-adf3-4eac-a158-46b8bb26a356 tempest-VolumesServicesTestJSON-1896668493 None] Created reservations ['8251c052-871c-474c-8c55-afcd3698b274', '18aaaecc-6a9b-469a-8c28-df25251662ff', 'f99f97df-598b-41f3-9b30-75f98917f581', 'b0b5cea3-0156-486c-8421-aa84e00017a8'] {{(pid=87444) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 04:39:51 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-abd47fe3-adf3-4eac-a158-46b8bb26a356 tempest-VolumesServicesTestJSON-1896668493 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 04:39:51 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-abd47fe3-adf3-4eac-a158-46b8bb26a356 tempest-VolumesServicesTestJSON-1896668493 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 04:39:51 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-abd47fe3-adf3-4eac-a158-46b8bb26a356 tempest-VolumesServicesTestJSON-1896668493 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922': None} {{(pid=87444) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 04:39:51 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-abd47fe3-adf3-4eac-a158-46b8bb26a356 tempest-VolumesServicesTestJSON-1896668493 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922'] {{(pid=87444) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 04:39:51 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-abd47fe3-adf3-4eac-a158-46b8bb26a356 tempest-VolumesServicesTestJSON-1896668493 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 04:39:51 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-abd47fe3-adf3-4eac-a158-46b8bb26a356 tempest-VolumesServicesTestJSON-1896668493 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:39:51 devstack sudo[95567]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097 Jul 10 04:39:51 devstack sudo[95567]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:39:51 devstack sudo[95564]: pam_unix(sudo:session): session closed for user root Jul 10 04:39:51 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-9b69b00a-eaeb-45a9-a593-a8b2284b4364 tempest-GroupSnapshotsTest-544795304 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-37f9eb8a-5d23-4485-8e1c-9d3b65f0c944 -F qcow2 /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-37f9eb8a-5d23-4485-8e1c-9d3b65f0c944.00283e97-3cf0-40b3-9eb4-6183b44eeb2c" returned: 0 in 0.700s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:39:51 devstack cinder-volume[87444]: WARNING cinder.volume.drivers.remotefs [None req-9b69b00a-eaeb-45a9-a593-a8b2284b4364 tempest-GroupSnapshotsTest-544795304 None] /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-37f9eb8a-5d23-4485-8e1c-9d3b65f0c944.00283e97-3cf0-40b3-9eb4-6183b44eeb2c is being set with open permissions: ugo+rw: NotImplementedError Jul 10 04:39:51 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-9b69b00a-eaeb-45a9-a593-a8b2284b4364 tempest-GroupSnapshotsTest-544795304 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-37f9eb8a-5d23-4485-8e1c-9d3b65f0c944.00283e97-3cf0-40b3-9eb4-6183b44eeb2c {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:39:51 devstack sudo[95572]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-37f9eb8a-5d23-4485-8e1c-9d3b65f0c944.00283e97-3cf0-40b3-9eb4-6183b44eeb2c Jul 10 04:39:51 devstack sudo[95572]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:39:51 devstack sudo[95567]: pam_unix(sudo:session): session closed for user root Jul 10 04:39:51 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-abd47fe3-adf3-4eac-a158-46b8bb26a356 tempest-VolumesServicesTestJSON-1896668493 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097" returned: 0 in 0.682s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:39:51 devstack cinder-volume[87444]: DEBUG cinder.manager [None req-abd47fe3-adf3-4eac-a158-46b8bb26a356 tempest-VolumesServicesTestJSON-1896668493 None] Notifying Schedulers of capabilities ... {{(pid=87444) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 04:39:51 devstack cinder-volume[87444]: INFO cinder.volume.manager [None req-abd47fe3-adf3-4eac-a158-46b8bb26a356 tempest-VolumesServicesTestJSON-1896668493 None] Deleted volume successfully. Jul 10 04:39:51 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-abd47fe3-adf3-4eac-a158-46b8bb26a356 tempest-VolumesServicesTestJSON-1896668493 None] Lock "cinder-94f71db6-7e72-45b1-9646-2ef82552c78e-delete_volume" released by "delete_volume" :: held 2.399s {{(pid=87444) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 04:39:52 devstack sudo[95572]: pam_unix(sudo:session): session closed for user root Jul 10 04:39:52 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-9b69b00a-eaeb-45a9-a593-a8b2284b4364 tempest-GroupSnapshotsTest-544795304 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-37f9eb8a-5d23-4485-8e1c-9d3b65f0c944.00283e97-3cf0-40b3-9eb4-6183b44eeb2c" returned: 0 in 0.662s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:39:52 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-9b69b00a-eaeb-45a9-a593-a8b2284b4364 tempest-GroupSnapshotsTest-544795304 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-37f9eb8a-5d23-4485-8e1c-9d3b65f0c944.info {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:39:52 devstack sudo[95576]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-37f9eb8a-5d23-4485-8e1c-9d3b65f0c944.info Jul 10 04:39:52 devstack sudo[95576]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:39:52 devstack sudo[95576]: pam_unix(sudo:session): session closed for user root Jul 10 04:39:52 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-9b69b00a-eaeb-45a9-a593-a8b2284b4364 tempest-GroupSnapshotsTest-544795304 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-37f9eb8a-5d23-4485-8e1c-9d3b65f0c944.info" returned: 0 in 0.700s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:39:52 devstack cinder-volume[87444]: WARNING cinder.volume.drivers.remotefs [None req-9b69b00a-eaeb-45a9-a593-a8b2284b4364 tempest-GroupSnapshotsTest-544795304 None] /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-37f9eb8a-5d23-4485-8e1c-9d3b65f0c944.info is being set with open permissions: ugo+rw: NotImplementedError Jul 10 04:39:52 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-9b69b00a-eaeb-45a9-a593-a8b2284b4364 tempest-GroupSnapshotsTest-544795304 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-37f9eb8a-5d23-4485-8e1c-9d3b65f0c944.info {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:39:52 devstack sudo[95580]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-37f9eb8a-5d23-4485-8e1c-9d3b65f0c944.info Jul 10 04:39:52 devstack sudo[95580]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:39:53 devstack sudo[95580]: pam_unix(sudo:session): session closed for user root Jul 10 04:39:53 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-9b69b00a-eaeb-45a9-a593-a8b2284b4364 tempest-GroupSnapshotsTest-544795304 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-37f9eb8a-5d23-4485-8e1c-9d3b65f0c944.info" returned: 0 in 0.705s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:39:53 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-9b69b00a-eaeb-45a9-a593-a8b2284b4364 tempest-GroupSnapshotsTest-544795304 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.517s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 04:39:53 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-9b69b00a-eaeb-45a9-a593-a8b2284b4364 tempest-GroupSnapshotsTest-544795304 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 04:39:53 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-9b69b00a-eaeb-45a9-a593-a8b2284b4364 tempest-GroupSnapshotsTest-544795304 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.000s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 04:39:53 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.remotefs [None req-9b69b00a-eaeb-45a9-a593-a8b2284b4364 tempest-GroupSnapshotsTest-544795304 None] Creating offline snapshot a6c936c7-8be4-40b1-a917-0e65e7760283 of volume ae5ee9ab-4457-42a0-be80-8e471bdb12a2 {{(pid=87444) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 10 04:39:53 devstack cinder-volume[87444]: DEBUG oslo.privsep.daemon [-] privsep: reply[e636b47a-cef3-4489-aba3-e6a07cbf7195]: (4, 'qcow2') {{(pid=88499) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 04:39:53 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-9b69b00a-eaeb-45a9-a593-a8b2284b4364 tempest-GroupSnapshotsTest-544795304 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-ae5ee9ab-4457-42a0-be80-8e471bdb12a2 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:39:53 devstack sudo[95583]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-ae5ee9ab-4457-42a0-be80-8e471bdb12a2 Jul 10 04:39:53 devstack sudo[95583]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:39:54 devstack sudo[95583]: pam_unix(sudo:session): session closed for user root Jul 10 04:39:54 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-9b69b00a-eaeb-45a9-a593-a8b2284b4364 tempest-GroupSnapshotsTest-544795304 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-ae5ee9ab-4457-42a0-be80-8e471bdb12a2" returned: 0 in 0.809s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:39:54 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-9b69b00a-eaeb-45a9-a593-a8b2284b4364 tempest-GroupSnapshotsTest-544795304 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-ae5ee9ab-4457-42a0-be80-8e471bdb12a2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-ae5ee9ab-4457-42a0-be80-8e471bdb12a2.a6c936c7-8be4-40b1-a917-0e65e7760283 1G {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:39:54 devstack sudo[95588]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-ae5ee9ab-4457-42a0-be80-8e471bdb12a2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-ae5ee9ab-4457-42a0-be80-8e471bdb12a2.a6c936c7-8be4-40b1-a917-0e65e7760283 1G Jul 10 04:39:54 devstack sudo[95588]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:39:55 devstack sudo[95588]: pam_unix(sudo:session): session closed for user root Jul 10 04:39:55 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-9b69b00a-eaeb-45a9-a593-a8b2284b4364 tempest-GroupSnapshotsTest-544795304 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-ae5ee9ab-4457-42a0-be80-8e471bdb12a2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-ae5ee9ab-4457-42a0-be80-8e471bdb12a2.a6c936c7-8be4-40b1-a917-0e65e7760283 1G" returned: 0 in 0.809s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:39:55 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-9b69b00a-eaeb-45a9-a593-a8b2284b4364 tempest-GroupSnapshotsTest-544795304 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ae5ee9ab-4457-42a0-be80-8e471bdb12a2 -F qcow2 /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-ae5ee9ab-4457-42a0-be80-8e471bdb12a2.a6c936c7-8be4-40b1-a917-0e65e7760283 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:39:55 devstack sudo[95594]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ae5ee9ab-4457-42a0-be80-8e471bdb12a2 -F qcow2 /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-ae5ee9ab-4457-42a0-be80-8e471bdb12a2.a6c936c7-8be4-40b1-a917-0e65e7760283 Jul 10 04:39:55 devstack sudo[95594]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:39:56 devstack sudo[95594]: pam_unix(sudo:session): session closed for user root Jul 10 04:39:56 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-9b69b00a-eaeb-45a9-a593-a8b2284b4364 tempest-GroupSnapshotsTest-544795304 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ae5ee9ab-4457-42a0-be80-8e471bdb12a2 -F qcow2 /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-ae5ee9ab-4457-42a0-be80-8e471bdb12a2.a6c936c7-8be4-40b1-a917-0e65e7760283" returned: 0 in 0.724s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:39:56 devstack cinder-volume[87444]: WARNING cinder.volume.drivers.remotefs [None req-9b69b00a-eaeb-45a9-a593-a8b2284b4364 tempest-GroupSnapshotsTest-544795304 None] /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-ae5ee9ab-4457-42a0-be80-8e471bdb12a2.a6c936c7-8be4-40b1-a917-0e65e7760283 is being set with open permissions: ugo+rw: NotImplementedError Jul 10 04:39:56 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-9b69b00a-eaeb-45a9-a593-a8b2284b4364 tempest-GroupSnapshotsTest-544795304 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-ae5ee9ab-4457-42a0-be80-8e471bdb12a2.a6c936c7-8be4-40b1-a917-0e65e7760283 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:39:56 devstack sudo[95599]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-ae5ee9ab-4457-42a0-be80-8e471bdb12a2.a6c936c7-8be4-40b1-a917-0e65e7760283 Jul 10 04:39:56 devstack sudo[95599]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:39:56 devstack sudo[95599]: pam_unix(sudo:session): session closed for user root Jul 10 04:39:56 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-9b69b00a-eaeb-45a9-a593-a8b2284b4364 tempest-GroupSnapshotsTest-544795304 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-ae5ee9ab-4457-42a0-be80-8e471bdb12a2.a6c936c7-8be4-40b1-a917-0e65e7760283" returned: 0 in 0.731s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:39:56 devstack cinder-volume[87444]: DEBUG dbcounter [-] [87444] Writing DB stats cinder:UPDATE=169,cinder:SELECT=136,cinder:DELETE=13,cinder:INSERT=40 {{(pid=87444) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 10 04:39:56 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-9b69b00a-eaeb-45a9-a593-a8b2284b4364 tempest-GroupSnapshotsTest-544795304 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-ae5ee9ab-4457-42a0-be80-8e471bdb12a2.info {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:39:56 devstack sudo[95603]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-ae5ee9ab-4457-42a0-be80-8e471bdb12a2.info Jul 10 04:39:56 devstack sudo[95603]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:39:57 devstack sudo[95603]: pam_unix(sudo:session): session closed for user root Jul 10 04:39:57 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-9b69b00a-eaeb-45a9-a593-a8b2284b4364 tempest-GroupSnapshotsTest-544795304 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-ae5ee9ab-4457-42a0-be80-8e471bdb12a2.info" returned: 0 in 0.653s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:39:57 devstack cinder-volume[87444]: WARNING cinder.volume.drivers.remotefs [None req-9b69b00a-eaeb-45a9-a593-a8b2284b4364 tempest-GroupSnapshotsTest-544795304 None] /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-ae5ee9ab-4457-42a0-be80-8e471bdb12a2.info is being set with open permissions: ugo+rw: NotImplementedError Jul 10 04:39:57 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-9b69b00a-eaeb-45a9-a593-a8b2284b4364 tempest-GroupSnapshotsTest-544795304 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-ae5ee9ab-4457-42a0-be80-8e471bdb12a2.info {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:39:57 devstack sudo[95606]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-ae5ee9ab-4457-42a0-be80-8e471bdb12a2.info Jul 10 04:39:57 devstack sudo[95606]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:39:58 devstack sudo[95606]: pam_unix(sudo:session): session closed for user root Jul 10 04:39:58 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-9b69b00a-eaeb-45a9-a593-a8b2284b4364 tempest-GroupSnapshotsTest-544795304 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-ae5ee9ab-4457-42a0-be80-8e471bdb12a2.info" returned: 0 in 0.649s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:39:58 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-9b69b00a-eaeb-45a9-a593-a8b2284b4364 tempest-GroupSnapshotsTest-544795304 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.464s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 04:39:58 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-c0e5d5fd-8e25-4e8c-ba1c-c0357e594012 tempest-SnapshotsActionsTest-1538729065 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 7.773s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 04:39:58 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.remotefs [None req-c0e5d5fd-8e25-4e8c-ba1c-c0357e594012 tempest-SnapshotsActionsTest-1538729065 None] Creating offline snapshot a4dd17c8-71ae-4461-9f2f-6fde7d129be8 of volume cb9ba17f-166a-487b-bda4-b5f9b80b656d {{(pid=87444) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 10 04:39:58 devstack cinder-volume[87444]: DEBUG oslo.privsep.daemon [-] privsep: reply[3774796b-b76d-4914-9d21-79a9c4e4d65a]: (4, 'qcow2') {{(pid=88499) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 04:39:58 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-c0e5d5fd-8e25-4e8c-ba1c-c0357e594012 tempest-SnapshotsActionsTest-1538729065 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-cb9ba17f-166a-487b-bda4-b5f9b80b656d.ee8c454a-c0ff-4b09-826b-830aa5ec0536 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:39:58 devstack cinder-volume[87444]: INFO cinder.volume.manager [None req-9b69b00a-eaeb-45a9-a593-a8b2284b4364 tempest-GroupSnapshotsTest-544795304 None] group_snapshot d7d6df08-26e3-4ea2-bad5-4b6bda121c06: created successfully Jul 10 04:39:58 devstack sudo[95609]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-cb9ba17f-166a-487b-bda4-b5f9b80b656d.ee8c454a-c0ff-4b09-826b-830aa5ec0536 Jul 10 04:39:58 devstack sudo[95609]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:39:58 devstack sudo[95609]: pam_unix(sudo:session): session closed for user root Jul 10 04:39:58 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-c0e5d5fd-8e25-4e8c-ba1c-c0357e594012 tempest-SnapshotsActionsTest-1538729065 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-cb9ba17f-166a-487b-bda4-b5f9b80b656d.ee8c454a-c0ff-4b09-826b-830aa5ec0536" returned: 0 in 0.778s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:39:58 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.remotefs [None req-c0e5d5fd-8e25-4e8c-ba1c-c0357e594012 tempest-SnapshotsActionsTest-1538729065 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-cb9ba17f-166a-487b-bda4-b5f9b80b656d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87444) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 10 04:39:58 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-c0e5d5fd-8e25-4e8c-ba1c-c0357e594012 tempest-SnapshotsActionsTest-1538729065 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-cb9ba17f-166a-487b-bda4-b5f9b80b656d.ee8c454a-c0ff-4b09-826b-830aa5ec0536,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-cb9ba17f-166a-487b-bda4-b5f9b80b656d.a4dd17c8-71ae-4461-9f2f-6fde7d129be8 1G {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:39:58 devstack sudo[95614]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-cb9ba17f-166a-487b-bda4-b5f9b80b656d.ee8c454a-c0ff-4b09-826b-830aa5ec0536,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-cb9ba17f-166a-487b-bda4-b5f9b80b656d.a4dd17c8-71ae-4461-9f2f-6fde7d129be8 1G Jul 10 04:39:58 devstack sudo[95614]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:39:59 devstack cinder-volume[87444]: INFO cinder.volume.manager [None req-0a585068-2731-45a2-ab8c-effa11ef26f1 tempest-GroupSnapshotsTest-544795304 None] group_snapshot d7d6df08-26e3-4ea2-bad5-4b6bda121c06: deleting Jul 10 04:39:59 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-0a585068-2731-45a2-ab8c-effa11ef26f1 tempest-GroupSnapshotsTest-544795304 None] group_snapshot d7d6df08-26e3-4ea2-bad5-4b6bda121c06: deleting {{(pid=87444) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Jul 10 04:39:59 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-0a585068-2731-45a2-ab8c-effa11ef26f1 tempest-GroupSnapshotsTest-544795304 None] Acquiring lock "cinder-quobyte-37f9eb8a-5d23-4485-8e1c-9d3b65f0c944" by "delete_snapshot" {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 04:39:59 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-0a585068-2731-45a2-ab8c-effa11ef26f1 tempest-GroupSnapshotsTest-544795304 None] Lock "cinder-quobyte-37f9eb8a-5d23-4485-8e1c-9d3b65f0c944" acquired by "delete_snapshot" :: waited 0.019s {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 04:39:59 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-0a585068-2731-45a2-ab8c-effa11ef26f1 tempest-GroupSnapshotsTest-544795304 None] Acquiring lock "cinder-quobyte-00283e97-3cf0-40b3-9eb4-6183b44eeb2c" by "_delete_snapshot" {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 04:39:59 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-0a585068-2731-45a2-ab8c-effa11ef26f1 tempest-GroupSnapshotsTest-544795304 None] Lock "cinder-quobyte-00283e97-3cf0-40b3-9eb4-6183b44eeb2c" acquired by "_delete_snapshot" :: waited 0.035s {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 04:39:59 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.remotefs [None req-0a585068-2731-45a2-ab8c-effa11ef26f1 tempest-GroupSnapshotsTest-544795304 None] Deleting offline snapshot 00283e97-3cf0-40b3-9eb4-6183b44eeb2c of volume 37f9eb8a-5d23-4485-8e1c-9d3b65f0c944 {{(pid=87444) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 10 04:39:59 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.remotefs [None req-0a585068-2731-45a2-ab8c-effa11ef26f1 tempest-GroupSnapshotsTest-544795304 None] snapshot_file for this snap is: volume-37f9eb8a-5d23-4485-8e1c-9d3b65f0c944.00283e97-3cf0-40b3-9eb4-6183b44eeb2c {{(pid=87444) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 10 04:39:59 devstack cinder-volume[87444]: DEBUG oslo.privsep.daemon [-] privsep: reply[a09bbe7f-213a-4554-9732-5f1a6961fe71]: (4, 'qcow2') {{(pid=88499) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 04:39:59 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-0a585068-2731-45a2-ab8c-effa11ef26f1 tempest-GroupSnapshotsTest-544795304 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-37f9eb8a-5d23-4485-8e1c-9d3b65f0c944.00283e97-3cf0-40b3-9eb4-6183b44eeb2c {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:39:59 devstack sudo[95620]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-37f9eb8a-5d23-4485-8e1c-9d3b65f0c944.00283e97-3cf0-40b3-9eb4-6183b44eeb2c Jul 10 04:39:59 devstack sudo[95620]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:40:00 devstack sudo[95614]: pam_unix(sudo:session): session closed for user root Jul 10 04:40:00 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-c0e5d5fd-8e25-4e8c-ba1c-c0357e594012 tempest-SnapshotsActionsTest-1538729065 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-cb9ba17f-166a-487b-bda4-b5f9b80b656d.ee8c454a-c0ff-4b09-826b-830aa5ec0536,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-cb9ba17f-166a-487b-bda4-b5f9b80b656d.a4dd17c8-71ae-4461-9f2f-6fde7d129be8 1G" returned: 0 in 1.064s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:40:00 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-c0e5d5fd-8e25-4e8c-ba1c-c0357e594012 tempest-SnapshotsActionsTest-1538729065 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cb9ba17f-166a-487b-bda4-b5f9b80b656d.ee8c454a-c0ff-4b09-826b-830aa5ec0536 -F qcow2 /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-cb9ba17f-166a-487b-bda4-b5f9b80b656d.a4dd17c8-71ae-4461-9f2f-6fde7d129be8 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:40:00 devstack sudo[95623]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cb9ba17f-166a-487b-bda4-b5f9b80b656d.ee8c454a-c0ff-4b09-826b-830aa5ec0536 -F qcow2 /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-cb9ba17f-166a-487b-bda4-b5f9b80b656d.a4dd17c8-71ae-4461-9f2f-6fde7d129be8 Jul 10 04:40:00 devstack sudo[95623]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:40:00 devstack sudo[95620]: pam_unix(sudo:session): session closed for user root Jul 10 04:40:00 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-0a585068-2731-45a2-ab8c-effa11ef26f1 tempest-GroupSnapshotsTest-544795304 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-37f9eb8a-5d23-4485-8e1c-9d3b65f0c944.00283e97-3cf0-40b3-9eb4-6183b44eeb2c" returned: 0 in 0.945s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:40:00 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.remotefs [None req-0a585068-2731-45a2-ab8c-effa11ef26f1 tempest-GroupSnapshotsTest-544795304 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-37f9eb8a-5d23-4485-8e1c-9d3b65f0c944(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87444) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 10 04:40:00 devstack cinder-volume[87444]: DEBUG oslo.privsep.daemon [-] privsep: reply[29bf2308-802c-43d7-9e45-cbbfb49b9a9a]: (4, 'qcow2') {{(pid=88499) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 04:40:00 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-0a585068-2731-45a2-ab8c-effa11ef26f1 tempest-GroupSnapshotsTest-544795304 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-37f9eb8a-5d23-4485-8e1c-9d3b65f0c944 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:40:00 devstack sudo[95628]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-37f9eb8a-5d23-4485-8e1c-9d3b65f0c944 Jul 10 04:40:00 devstack sudo[95628]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:40:00 devstack sudo[95623]: pam_unix(sudo:session): session closed for user root Jul 10 04:40:00 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-c0e5d5fd-8e25-4e8c-ba1c-c0357e594012 tempest-SnapshotsActionsTest-1538729065 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cb9ba17f-166a-487b-bda4-b5f9b80b656d.ee8c454a-c0ff-4b09-826b-830aa5ec0536 -F qcow2 /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-cb9ba17f-166a-487b-bda4-b5f9b80b656d.a4dd17c8-71ae-4461-9f2f-6fde7d129be8" returned: 0 in 0.873s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:40:00 devstack cinder-volume[87444]: WARNING cinder.volume.drivers.remotefs [None req-c0e5d5fd-8e25-4e8c-ba1c-c0357e594012 tempest-SnapshotsActionsTest-1538729065 None] /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-cb9ba17f-166a-487b-bda4-b5f9b80b656d.a4dd17c8-71ae-4461-9f2f-6fde7d129be8 is being set with open permissions: ugo+rw Jul 10 04:40:00 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-c0e5d5fd-8e25-4e8c-ba1c-c0357e594012 tempest-SnapshotsActionsTest-1538729065 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-cb9ba17f-166a-487b-bda4-b5f9b80b656d.a4dd17c8-71ae-4461-9f2f-6fde7d129be8 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:40:00 devstack sudo[95633]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-cb9ba17f-166a-487b-bda4-b5f9b80b656d.a4dd17c8-71ae-4461-9f2f-6fde7d129be8 Jul 10 04:40:00 devstack sudo[95633]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:40:01 devstack sudo[95628]: pam_unix(sudo:session): session closed for user root Jul 10 04:40:01 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-0a585068-2731-45a2-ab8c-effa11ef26f1 tempest-GroupSnapshotsTest-544795304 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-37f9eb8a-5d23-4485-8e1c-9d3b65f0c944" returned: 0 in 0.988s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:40:01 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-0a585068-2731-45a2-ab8c-effa11ef26f1 tempest-GroupSnapshotsTest-544795304 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-37f9eb8a-5d23-4485-8e1c-9d3b65f0c944.00283e97-3cf0-40b3-9eb4-6183b44eeb2c {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:40:01 devstack sudo[95633]: pam_unix(sudo:session): session closed for user root Jul 10 04:40:01 devstack sudo[95640]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-37f9eb8a-5d23-4485-8e1c-9d3b65f0c944.00283e97-3cf0-40b3-9eb4-6183b44eeb2c Jul 10 04:40:01 devstack sudo[95640]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:40:01 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-c0e5d5fd-8e25-4e8c-ba1c-c0357e594012 tempest-SnapshotsActionsTest-1538729065 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-cb9ba17f-166a-487b-bda4-b5f9b80b656d.a4dd17c8-71ae-4461-9f2f-6fde7d129be8" returned: 0 in 0.805s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:40:01 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-c0e5d5fd-8e25-4e8c-ba1c-c0357e594012 tempest-SnapshotsActionsTest-1538729065 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.681s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 04:40:01 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-3e248218-639d-4052-b05e-4ce47bae84dc tempest-VolumeSnapshotQuotasNegativeTestJSON-181807343 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 13.659s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 04:40:01 devstack cinder-volume[87444]: INFO cinder.volume.manager [None req-c0e5d5fd-8e25-4e8c-ba1c-c0357e594012 tempest-SnapshotsActionsTest-1538729065 None] Create snapshot completed successfully Jul 10 04:40:01 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.remotefs [None req-3e248218-639d-4052-b05e-4ce47bae84dc tempest-VolumeSnapshotQuotasNegativeTestJSON-181807343 None] Creating offline snapshot 8fd276b8-e8cf-435c-ac2d-d92eb5701f66 of volume 9614de62-b2d8-4683-ae8a-ab76916738ea {{(pid=87444) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 10 04:40:01 devstack cinder-volume[87444]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c6b7b0f-8091-427e-8d6b-5b0b364226b4]: (4, 'qcow2') {{(pid=88499) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 04:40:01 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-3e248218-639d-4052-b05e-4ce47bae84dc tempest-VolumeSnapshotQuotasNegativeTestJSON-181807343 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-9614de62-b2d8-4683-ae8a-ab76916738ea {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:40:01 devstack sudo[95642]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-9614de62-b2d8-4683-ae8a-ab76916738ea Jul 10 04:40:01 devstack sudo[95642]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:40:02 devstack sudo[95640]: pam_unix(sudo:session): session closed for user root Jul 10 04:40:02 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-0a585068-2731-45a2-ab8c-effa11ef26f1 tempest-GroupSnapshotsTest-544795304 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-37f9eb8a-5d23-4485-8e1c-9d3b65f0c944.00283e97-3cf0-40b3-9eb4-6183b44eeb2c" returned: 0 in 1.045s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:40:02 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-0a585068-2731-45a2-ab8c-effa11ef26f1 tempest-GroupSnapshotsTest-544795304 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-37f9eb8a-5d23-4485-8e1c-9d3b65f0c944.00283e97-3cf0-40b3-9eb4-6183b44eeb2c {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:40:02 devstack sudo[95657]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-37f9eb8a-5d23-4485-8e1c-9d3b65f0c944.00283e97-3cf0-40b3-9eb4-6183b44eeb2c Jul 10 04:40:02 devstack sudo[95657]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:40:02 devstack sudo[95642]: pam_unix(sudo:session): session closed for user root Jul 10 04:40:02 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-3e248218-639d-4052-b05e-4ce47bae84dc tempest-VolumeSnapshotQuotasNegativeTestJSON-181807343 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-9614de62-b2d8-4683-ae8a-ab76916738ea" returned: 0 in 0.976s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:40:02 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-3e248218-639d-4052-b05e-4ce47bae84dc tempest-VolumeSnapshotQuotasNegativeTestJSON-181807343 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-9614de62-b2d8-4683-ae8a-ab76916738ea,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-9614de62-b2d8-4683-ae8a-ab76916738ea.8fd276b8-e8cf-435c-ac2d-d92eb5701f66 1G {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:40:02 devstack sudo[95659]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-9614de62-b2d8-4683-ae8a-ab76916738ea,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-9614de62-b2d8-4683-ae8a-ab76916738ea.8fd276b8-e8cf-435c-ac2d-d92eb5701f66 1G Jul 10 04:40:02 devstack sudo[95659]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:40:03 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-a80782c9-d45e-4070-8a19-83db4f4eb9f7 tempest-SnapshotsActionsTest-1017379468 None] Acquiring lock "cinder-a4dd17c8-71ae-4461-9f2f-6fde7d129be8-delete_snapshot" by "delete_snapshot" {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 04:40:03 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-a80782c9-d45e-4070-8a19-83db4f4eb9f7 tempest-SnapshotsActionsTest-1017379468 None] Lock "cinder-a4dd17c8-71ae-4461-9f2f-6fde7d129be8-delete_snapshot" acquired by "delete_snapshot" :: waited 0.035s {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 04:40:03 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-a80782c9-d45e-4070-8a19-83db4f4eb9f7 tempest-SnapshotsActionsTest-1017379468 None] Acquiring lock "cinder-quobyte-cb9ba17f-166a-487b-bda4-b5f9b80b656d" by "delete_snapshot" {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 04:40:03 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-a80782c9-d45e-4070-8a19-83db4f4eb9f7 tempest-SnapshotsActionsTest-1017379468 None] Lock "cinder-quobyte-cb9ba17f-166a-487b-bda4-b5f9b80b656d" acquired by "delete_snapshot" :: waited 0.031s {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 04:40:03 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-a80782c9-d45e-4070-8a19-83db4f4eb9f7 tempest-SnapshotsActionsTest-1017379468 None] Acquiring lock "cinder-quobyte-a4dd17c8-71ae-4461-9f2f-6fde7d129be8" by "_delete_snapshot" {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 04:40:03 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-a80782c9-d45e-4070-8a19-83db4f4eb9f7 tempest-SnapshotsActionsTest-1017379468 None] Lock "cinder-quobyte-a4dd17c8-71ae-4461-9f2f-6fde7d129be8" acquired by "_delete_snapshot" :: waited 0.023s {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 04:40:03 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.remotefs [None req-a80782c9-d45e-4070-8a19-83db4f4eb9f7 tempest-SnapshotsActionsTest-1017379468 None] Deleting offline snapshot a4dd17c8-71ae-4461-9f2f-6fde7d129be8 of volume cb9ba17f-166a-487b-bda4-b5f9b80b656d {{(pid=87444) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 10 04:40:03 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.remotefs [None req-a80782c9-d45e-4070-8a19-83db4f4eb9f7 tempest-SnapshotsActionsTest-1017379468 None] snapshot_file for this snap is: volume-cb9ba17f-166a-487b-bda4-b5f9b80b656d.a4dd17c8-71ae-4461-9f2f-6fde7d129be8 {{(pid=87444) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 10 04:40:03 devstack cinder-volume[87444]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1168356-0c83-471b-ac54-3fea670265fe]: (4, 'qcow2') {{(pid=88499) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 04:40:03 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-a80782c9-d45e-4070-8a19-83db4f4eb9f7 tempest-SnapshotsActionsTest-1017379468 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-cb9ba17f-166a-487b-bda4-b5f9b80b656d.a4dd17c8-71ae-4461-9f2f-6fde7d129be8 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:40:03 devstack sudo[95661]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-cb9ba17f-166a-487b-bda4-b5f9b80b656d.a4dd17c8-71ae-4461-9f2f-6fde7d129be8 Jul 10 04:40:03 devstack sudo[95661]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:40:03 devstack sudo[95657]: pam_unix(sudo:session): session closed for user root Jul 10 04:40:03 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-0a585068-2731-45a2-ab8c-effa11ef26f1 tempest-GroupSnapshotsTest-544795304 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-37f9eb8a-5d23-4485-8e1c-9d3b65f0c944.00283e97-3cf0-40b3-9eb4-6183b44eeb2c" returned: 0 in 0.912s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:40:03 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-0a585068-2731-45a2-ab8c-effa11ef26f1 tempest-GroupSnapshotsTest-544795304 None] Lock "cinder-quobyte-00283e97-3cf0-40b3-9eb4-6183b44eeb2c" released by "_delete_snapshot" :: held 4.097s {{(pid=87444) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 04:40:03 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-0a585068-2731-45a2-ab8c-effa11ef26f1 tempest-GroupSnapshotsTest-544795304 None] Lock "cinder-quobyte-37f9eb8a-5d23-4485-8e1c-9d3b65f0c944" released by "delete_snapshot" :: held 4.150s {{(pid=87444) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 04:40:03 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-0a585068-2731-45a2-ab8c-effa11ef26f1 tempest-GroupSnapshotsTest-544795304 None] Acquiring lock "cinder-quobyte-ae5ee9ab-4457-42a0-be80-8e471bdb12a2" by "delete_snapshot" {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 04:40:03 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-0a585068-2731-45a2-ab8c-effa11ef26f1 tempest-GroupSnapshotsTest-544795304 None] Lock "cinder-quobyte-ae5ee9ab-4457-42a0-be80-8e471bdb12a2" acquired by "delete_snapshot" :: waited 0.051s {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 04:40:03 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-0a585068-2731-45a2-ab8c-effa11ef26f1 tempest-GroupSnapshotsTest-544795304 None] Acquiring lock "cinder-quobyte-a6c936c7-8be4-40b1-a917-0e65e7760283" by "_delete_snapshot" {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 04:40:03 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-0a585068-2731-45a2-ab8c-effa11ef26f1 tempest-GroupSnapshotsTest-544795304 None] Lock "cinder-quobyte-a6c936c7-8be4-40b1-a917-0e65e7760283" acquired by "_delete_snapshot" :: waited 0.029s {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 04:40:03 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.remotefs [None req-0a585068-2731-45a2-ab8c-effa11ef26f1 tempest-GroupSnapshotsTest-544795304 None] Deleting offline snapshot a6c936c7-8be4-40b1-a917-0e65e7760283 of volume ae5ee9ab-4457-42a0-be80-8e471bdb12a2 {{(pid=87444) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 10 04:40:03 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.remotefs [None req-0a585068-2731-45a2-ab8c-effa11ef26f1 tempest-GroupSnapshotsTest-544795304 None] snapshot_file for this snap is: volume-ae5ee9ab-4457-42a0-be80-8e471bdb12a2.a6c936c7-8be4-40b1-a917-0e65e7760283 {{(pid=87444) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 10 04:40:03 devstack cinder-volume[87444]: DEBUG oslo.privsep.daemon [-] privsep: reply[c18349aa-ac89-4ba6-950a-2d92c27acaff]: (4, 'qcow2') {{(pid=88499) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 04:40:03 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-0a585068-2731-45a2-ab8c-effa11ef26f1 tempest-GroupSnapshotsTest-544795304 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-ae5ee9ab-4457-42a0-be80-8e471bdb12a2.a6c936c7-8be4-40b1-a917-0e65e7760283 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:40:04 devstack sudo[95659]: pam_unix(sudo:session): session closed for user root Jul 10 04:40:04 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-3e248218-639d-4052-b05e-4ce47bae84dc tempest-VolumeSnapshotQuotasNegativeTestJSON-181807343 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-9614de62-b2d8-4683-ae8a-ab76916738ea,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-9614de62-b2d8-4683-ae8a-ab76916738ea.8fd276b8-e8cf-435c-ac2d-d92eb5701f66 1G" returned: 0 in 1.222s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:40:04 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-3e248218-639d-4052-b05e-4ce47bae84dc tempest-VolumeSnapshotQuotasNegativeTestJSON-181807343 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9614de62-b2d8-4683-ae8a-ab76916738ea -F qcow2 /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-9614de62-b2d8-4683-ae8a-ab76916738ea.8fd276b8-e8cf-435c-ac2d-d92eb5701f66 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:40:04 devstack sudo[95667]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-ae5ee9ab-4457-42a0-be80-8e471bdb12a2.a6c936c7-8be4-40b1-a917-0e65e7760283 Jul 10 04:40:04 devstack sudo[95667]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:40:04 devstack sudo[95668]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9614de62-b2d8-4683-ae8a-ab76916738ea -F qcow2 /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-9614de62-b2d8-4683-ae8a-ab76916738ea.8fd276b8-e8cf-435c-ac2d-d92eb5701f66 Jul 10 04:40:04 devstack sudo[95668]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:40:04 devstack sudo[95661]: pam_unix(sudo:session): session closed for user root Jul 10 04:40:04 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-a80782c9-d45e-4070-8a19-83db4f4eb9f7 tempest-SnapshotsActionsTest-1017379468 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-cb9ba17f-166a-487b-bda4-b5f9b80b656d.a4dd17c8-71ae-4461-9f2f-6fde7d129be8" returned: 0 in 1.178s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:40:04 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.remotefs [None req-a80782c9-d45e-4070-8a19-83db4f4eb9f7 tempest-SnapshotsActionsTest-1017379468 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-cb9ba17f-166a-487b-bda4-b5f9b80b656d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87444) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 10 04:40:04 devstack cinder-volume[87444]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd26b13e-601c-44fc-be71-0e790b5fea6e]: (4, 'qcow2') {{(pid=88499) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 04:40:04 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-a80782c9-d45e-4070-8a19-83db4f4eb9f7 tempest-SnapshotsActionsTest-1017379468 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-cb9ba17f-166a-487b-bda4-b5f9b80b656d.ee8c454a-c0ff-4b09-826b-830aa5ec0536 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:40:04 devstack sudo[95674]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-cb9ba17f-166a-487b-bda4-b5f9b80b656d.ee8c454a-c0ff-4b09-826b-830aa5ec0536 Jul 10 04:40:04 devstack sudo[95674]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:40:04 devstack sudo[95667]: pam_unix(sudo:session): session closed for user root Jul 10 04:40:04 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-0a585068-2731-45a2-ab8c-effa11ef26f1 tempest-GroupSnapshotsTest-544795304 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-ae5ee9ab-4457-42a0-be80-8e471bdb12a2.a6c936c7-8be4-40b1-a917-0e65e7760283" returned: 0 in 0.985s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:40:04 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.remotefs [None req-0a585068-2731-45a2-ab8c-effa11ef26f1 tempest-GroupSnapshotsTest-544795304 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ae5ee9ab-4457-42a0-be80-8e471bdb12a2(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87444) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 10 04:40:04 devstack cinder-volume[87444]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b75da4d-a57c-4615-a33a-39a683351b99]: (4, 'qcow2') {{(pid=88499) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 04:40:04 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-0a585068-2731-45a2-ab8c-effa11ef26f1 tempest-GroupSnapshotsTest-544795304 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-ae5ee9ab-4457-42a0-be80-8e471bdb12a2 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:40:04 devstack sudo[95668]: pam_unix(sudo:session): session closed for user root Jul 10 04:40:04 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-3e248218-639d-4052-b05e-4ce47bae84dc tempest-VolumeSnapshotQuotasNegativeTestJSON-181807343 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9614de62-b2d8-4683-ae8a-ab76916738ea -F qcow2 /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-9614de62-b2d8-4683-ae8a-ab76916738ea.8fd276b8-e8cf-435c-ac2d-d92eb5701f66" returned: 0 in 0.905s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:40:04 devstack cinder-volume[87444]: WARNING cinder.volume.drivers.remotefs [None req-3e248218-639d-4052-b05e-4ce47bae84dc tempest-VolumeSnapshotQuotasNegativeTestJSON-181807343 None] /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-9614de62-b2d8-4683-ae8a-ab76916738ea.8fd276b8-e8cf-435c-ac2d-d92eb5701f66 is being set with open permissions: ugo+rw Jul 10 04:40:04 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-3e248218-639d-4052-b05e-4ce47bae84dc tempest-VolumeSnapshotQuotasNegativeTestJSON-181807343 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-9614de62-b2d8-4683-ae8a-ab76916738ea.8fd276b8-e8cf-435c-ac2d-d92eb5701f66 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:40:04 devstack sudo[95684]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-9614de62-b2d8-4683-ae8a-ab76916738ea.8fd276b8-e8cf-435c-ac2d-d92eb5701f66 Jul 10 04:40:04 devstack sudo[95684]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:40:05 devstack sudo[95683]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-ae5ee9ab-4457-42a0-be80-8e471bdb12a2 Jul 10 04:40:05 devstack sudo[95683]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:40:05 devstack sudo[95674]: pam_unix(sudo:session): session closed for user root Jul 10 04:40:05 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-a80782c9-d45e-4070-8a19-83db4f4eb9f7 tempest-SnapshotsActionsTest-1017379468 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-cb9ba17f-166a-487b-bda4-b5f9b80b656d.ee8c454a-c0ff-4b09-826b-830aa5ec0536" returned: 0 in 0.937s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:40:05 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.remotefs [None req-a80782c9-d45e-4070-8a19-83db4f4eb9f7 tempest-SnapshotsActionsTest-1017379468 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-cb9ba17f-166a-487b-bda4-b5f9b80b656d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87444) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 10 04:40:05 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-a80782c9-d45e-4070-8a19-83db4f4eb9f7 tempest-SnapshotsActionsTest-1017379468 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-cb9ba17f-166a-487b-bda4-b5f9b80b656d.a4dd17c8-71ae-4461-9f2f-6fde7d129be8 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:40:05 devstack sudo[95690]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-cb9ba17f-166a-487b-bda4-b5f9b80b656d.a4dd17c8-71ae-4461-9f2f-6fde7d129be8 Jul 10 04:40:05 devstack sudo[95690]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:40:05 devstack sudo[95684]: pam_unix(sudo:session): session closed for user root Jul 10 04:40:05 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-3e248218-639d-4052-b05e-4ce47bae84dc tempest-VolumeSnapshotQuotasNegativeTestJSON-181807343 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-9614de62-b2d8-4683-ae8a-ab76916738ea.8fd276b8-e8cf-435c-ac2d-d92eb5701f66" returned: 0 in 0.805s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:40:05 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-3e248218-639d-4052-b05e-4ce47bae84dc tempest-VolumeSnapshotQuotasNegativeTestJSON-181807343 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-9614de62-b2d8-4683-ae8a-ab76916738ea.info {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:40:05 devstack sudo[95695]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-9614de62-b2d8-4683-ae8a-ab76916738ea.info Jul 10 04:40:05 devstack sudo[95695]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:40:05 devstack sudo[95683]: pam_unix(sudo:session): session closed for user root Jul 10 04:40:05 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-0a585068-2731-45a2-ab8c-effa11ef26f1 tempest-GroupSnapshotsTest-544795304 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-ae5ee9ab-4457-42a0-be80-8e471bdb12a2" returned: 0 in 1.083s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:40:05 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-0a585068-2731-45a2-ab8c-effa11ef26f1 tempest-GroupSnapshotsTest-544795304 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-ae5ee9ab-4457-42a0-be80-8e471bdb12a2.a6c936c7-8be4-40b1-a917-0e65e7760283 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:40:06 devstack sudo[95698]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-ae5ee9ab-4457-42a0-be80-8e471bdb12a2.a6c936c7-8be4-40b1-a917-0e65e7760283 Jul 10 04:40:06 devstack sudo[95698]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:40:06 devstack sudo[95690]: pam_unix(sudo:session): session closed for user root Jul 10 04:40:06 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-a80782c9-d45e-4070-8a19-83db4f4eb9f7 tempest-SnapshotsActionsTest-1017379468 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-cb9ba17f-166a-487b-bda4-b5f9b80b656d.a4dd17c8-71ae-4461-9f2f-6fde7d129be8" returned: 0 in 1.020s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:40:06 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-a80782c9-d45e-4070-8a19-83db4f4eb9f7 tempest-SnapshotsActionsTest-1017379468 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-cb9ba17f-166a-487b-bda4-b5f9b80b656d.a4dd17c8-71ae-4461-9f2f-6fde7d129be8 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:40:06 devstack sudo[95704]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-cb9ba17f-166a-487b-bda4-b5f9b80b656d.a4dd17c8-71ae-4461-9f2f-6fde7d129be8 Jul 10 04:40:06 devstack sudo[95704]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:40:06 devstack sudo[95695]: pam_unix(sudo:session): session closed for user root Jul 10 04:40:06 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-3e248218-639d-4052-b05e-4ce47bae84dc tempest-VolumeSnapshotQuotasNegativeTestJSON-181807343 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-9614de62-b2d8-4683-ae8a-ab76916738ea.info" returned: 0 in 0.738s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:40:06 devstack cinder-volume[87444]: WARNING cinder.volume.drivers.remotefs [None req-3e248218-639d-4052-b05e-4ce47bae84dc tempest-VolumeSnapshotQuotasNegativeTestJSON-181807343 None] /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-9614de62-b2d8-4683-ae8a-ab76916738ea.info is being set with open permissions: ugo+rw Jul 10 04:40:06 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-3e248218-639d-4052-b05e-4ce47bae84dc tempest-VolumeSnapshotQuotasNegativeTestJSON-181807343 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-9614de62-b2d8-4683-ae8a-ab76916738ea.info {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:40:06 devstack sudo[95706]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-9614de62-b2d8-4683-ae8a-ab76916738ea.info Jul 10 04:40:06 devstack sudo[95706]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:40:06 devstack sudo[95698]: pam_unix(sudo:session): session closed for user root Jul 10 04:40:07 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-0a585068-2731-45a2-ab8c-effa11ef26f1 tempest-GroupSnapshotsTest-544795304 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-ae5ee9ab-4457-42a0-be80-8e471bdb12a2.a6c936c7-8be4-40b1-a917-0e65e7760283" returned: 0 in 1.020s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:40:07 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-0a585068-2731-45a2-ab8c-effa11ef26f1 tempest-GroupSnapshotsTest-544795304 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-ae5ee9ab-4457-42a0-be80-8e471bdb12a2.a6c936c7-8be4-40b1-a917-0e65e7760283 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:40:07 devstack sudo[95711]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-ae5ee9ab-4457-42a0-be80-8e471bdb12a2.a6c936c7-8be4-40b1-a917-0e65e7760283 Jul 10 04:40:07 devstack sudo[95711]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:40:07 devstack sudo[95704]: pam_unix(sudo:session): session closed for user root Jul 10 04:40:07 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-a80782c9-d45e-4070-8a19-83db4f4eb9f7 tempest-SnapshotsActionsTest-1017379468 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-cb9ba17f-166a-487b-bda4-b5f9b80b656d.a4dd17c8-71ae-4461-9f2f-6fde7d129be8" returned: 0 in 0.739s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:40:07 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-a80782c9-d45e-4070-8a19-83db4f4eb9f7 tempest-SnapshotsActionsTest-1017379468 None] Lock "cinder-quobyte-a4dd17c8-71ae-4461-9f2f-6fde7d129be8" released by "_delete_snapshot" :: held 4.018s {{(pid=87444) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 04:40:07 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-a80782c9-d45e-4070-8a19-83db4f4eb9f7 tempest-SnapshotsActionsTest-1017379468 None] Lock "cinder-quobyte-cb9ba17f-166a-487b-bda4-b5f9b80b656d" released by "delete_snapshot" :: held 4.052s {{(pid=87444) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 04:40:07 devstack cinder-volume[87444]: DEBUG cinder.quota [None req-a80782c9-d45e-4070-8a19-83db4f4eb9f7 tempest-SnapshotsActionsTest-1017379468 None] Created reservations ['0768c6e9-e6b3-4b7e-ad4d-edfa159f9e62', 'fcc41930-29f0-4022-8375-e7ad8836693b', '55831ada-ec94-4b3e-9293-3ca1310021d3', 'adff9855-6137-4fe4-b8f8-936cfb0bcdc6'] {{(pid=87444) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 04:40:07 devstack sudo[95706]: pam_unix(sudo:session): session closed for user root Jul 10 04:40:07 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-3e248218-639d-4052-b05e-4ce47bae84dc tempest-VolumeSnapshotQuotasNegativeTestJSON-181807343 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-9614de62-b2d8-4683-ae8a-ab76916738ea.info" returned: 0 in 0.832s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:40:07 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-3e248218-639d-4052-b05e-4ce47bae84dc tempest-VolumeSnapshotQuotasNegativeTestJSON-181807343 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.601s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 04:40:07 devstack cinder-volume[87444]: INFO cinder.volume.manager [None req-3e248218-639d-4052-b05e-4ce47bae84dc tempest-VolumeSnapshotQuotasNegativeTestJSON-181807343 None] Create snapshot completed successfully Jul 10 04:40:07 devstack cinder-volume[87444]: INFO cinder.volume.manager [None req-a80782c9-d45e-4070-8a19-83db4f4eb9f7 tempest-SnapshotsActionsTest-1017379468 None] Delete snapshot completed successfully. Jul 10 04:40:07 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-a80782c9-d45e-4070-8a19-83db4f4eb9f7 tempest-SnapshotsActionsTest-1017379468 None] Lock "cinder-a4dd17c8-71ae-4461-9f2f-6fde7d129be8-delete_snapshot" released by "delete_snapshot" :: held 4.298s {{(pid=87444) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 04:40:07 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-af3bc409-c2ae-4e3e-bff6-6a13f2ea83b6 tempest-SnapshotsActionsTest-1538729065 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 04:40:07 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-af3bc409-c2ae-4e3e-bff6-6a13f2ea83b6 tempest-SnapshotsActionsTest-1538729065 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 04:40:07 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.remotefs [None req-af3bc409-c2ae-4e3e-bff6-6a13f2ea83b6 tempest-SnapshotsActionsTest-1538729065 None] Creating offline snapshot 36576e5b-0ae6-42cf-b588-9727aa156df2 of volume cb9ba17f-166a-487b-bda4-b5f9b80b656d {{(pid=87444) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 10 04:40:07 devstack cinder-volume[87444]: DEBUG oslo.privsep.daemon [-] privsep: reply[76b5b0d9-4db3-4929-a58a-236f2fe6be07]: (4, 'qcow2') {{(pid=88499) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 04:40:07 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-af3bc409-c2ae-4e3e-bff6-6a13f2ea83b6 tempest-SnapshotsActionsTest-1538729065 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-cb9ba17f-166a-487b-bda4-b5f9b80b656d.ee8c454a-c0ff-4b09-826b-830aa5ec0536 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:40:07 devstack sudo[95711]: pam_unix(sudo:session): session closed for user root Jul 10 04:40:07 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-0a585068-2731-45a2-ab8c-effa11ef26f1 tempest-GroupSnapshotsTest-544795304 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-ae5ee9ab-4457-42a0-be80-8e471bdb12a2.a6c936c7-8be4-40b1-a917-0e65e7760283" returned: 0 in 0.882s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:40:07 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-0a585068-2731-45a2-ab8c-effa11ef26f1 tempest-GroupSnapshotsTest-544795304 None] Lock "cinder-quobyte-a6c936c7-8be4-40b1-a917-0e65e7760283" released by "_delete_snapshot" :: held 4.097s {{(pid=87444) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 04:40:07 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-0a585068-2731-45a2-ab8c-effa11ef26f1 tempest-GroupSnapshotsTest-544795304 None] Lock "cinder-quobyte-ae5ee9ab-4457-42a0-be80-8e471bdb12a2" released by "delete_snapshot" :: held 4.133s {{(pid=87444) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 04:40:08 devstack sudo[95716]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-cb9ba17f-166a-487b-bda4-b5f9b80b656d.ee8c454a-c0ff-4b09-826b-830aa5ec0536 Jul 10 04:40:08 devstack sudo[95716]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:40:08 devstack cinder-volume[87444]: WARNING cinder.quota [None req-0a585068-2731-45a2-ab8c-effa11ef26f1 tempest-GroupSnapshotsTest-544795304 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-289573887 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-289573887, it is now deprecated. Please use the default quota class for default quota. Jul 10 04:40:08 devstack cinder-volume[87444]: WARNING cinder.quota [None req-0a585068-2731-45a2-ab8c-effa11ef26f1 tempest-GroupSnapshotsTest-544795304 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-289573887 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-289573887, it is now deprecated. Please use the default quota class for default quota. Jul 10 04:40:08 devstack cinder-volume[87444]: DEBUG cinder.quota [None req-0a585068-2731-45a2-ab8c-effa11ef26f1 tempest-GroupSnapshotsTest-544795304 None] Created reservations ['7dfb38a2-7a78-4ff7-b58c-d44c3950ad70', '3f1316f9-5534-44f6-bd32-67a4293fb011', '486a1e43-8ad7-41c7-a54b-2f2700bda74d', '2ddf86b1-110c-4a68-b858-eb5b2a8676f4'] {{(pid=87444) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 04:40:08 devstack cinder-volume[87444]: DEBUG cinder.quota [None req-0a585068-2731-45a2-ab8c-effa11ef26f1 tempest-GroupSnapshotsTest-544795304 None] Created reservations ['db8521fc-8a7b-421f-bd91-2cfcdee79690', 'b63991da-e30b-4820-8bd7-75decef75984', '10d87b17-2a82-4ded-bf8c-886c9de295aa', '7fba2684-93ea-487a-8e63-1c68edb3e615'] {{(pid=87444) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 04:40:08 devstack cinder-volume[87444]: INFO cinder.volume.manager [None req-0a585068-2731-45a2-ab8c-effa11ef26f1 tempest-GroupSnapshotsTest-544795304 None] group_snapshot d7d6df08-26e3-4ea2-bad5-4b6bda121c06: deleted successfully Jul 10 04:40:08 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-a5835897-76ee-4cfd-8dbb-df30e5da9f54 tempest-VolumeSnapshotQuotasNegativeTestJSON-181807343 None] Acquiring lock "cinder-8fd276b8-e8cf-435c-ac2d-d92eb5701f66-delete_snapshot" by "delete_snapshot" {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 04:40:08 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-a5835897-76ee-4cfd-8dbb-df30e5da9f54 tempest-VolumeSnapshotQuotasNegativeTestJSON-181807343 None] Lock "cinder-8fd276b8-e8cf-435c-ac2d-d92eb5701f66-delete_snapshot" acquired by "delete_snapshot" :: waited 0.035s {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 04:40:08 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-a5835897-76ee-4cfd-8dbb-df30e5da9f54 tempest-VolumeSnapshotQuotasNegativeTestJSON-181807343 None] Acquiring lock "cinder-quobyte-9614de62-b2d8-4683-ae8a-ab76916738ea" by "delete_snapshot" {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 04:40:08 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-a5835897-76ee-4cfd-8dbb-df30e5da9f54 tempest-VolumeSnapshotQuotasNegativeTestJSON-181807343 None] Lock "cinder-quobyte-9614de62-b2d8-4683-ae8a-ab76916738ea" acquired by "delete_snapshot" :: waited 0.022s {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 04:40:08 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-a5835897-76ee-4cfd-8dbb-df30e5da9f54 tempest-VolumeSnapshotQuotasNegativeTestJSON-181807343 None] Acquiring lock "cinder-quobyte-8fd276b8-e8cf-435c-ac2d-d92eb5701f66" by "_delete_snapshot" {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 04:40:08 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-a5835897-76ee-4cfd-8dbb-df30e5da9f54 tempest-VolumeSnapshotQuotasNegativeTestJSON-181807343 None] Lock "cinder-quobyte-8fd276b8-e8cf-435c-ac2d-d92eb5701f66" acquired by "_delete_snapshot" :: waited 0.023s {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 04:40:08 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.remotefs [None req-a5835897-76ee-4cfd-8dbb-df30e5da9f54 tempest-VolumeSnapshotQuotasNegativeTestJSON-181807343 None] Deleting offline snapshot 8fd276b8-e8cf-435c-ac2d-d92eb5701f66 of volume 9614de62-b2d8-4683-ae8a-ab76916738ea {{(pid=87444) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 10 04:40:08 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.remotefs [None req-a5835897-76ee-4cfd-8dbb-df30e5da9f54 tempest-VolumeSnapshotQuotasNegativeTestJSON-181807343 None] snapshot_file for this snap is: volume-9614de62-b2d8-4683-ae8a-ab76916738ea.8fd276b8-e8cf-435c-ac2d-d92eb5701f66 {{(pid=87444) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 10 04:40:08 devstack cinder-volume[87444]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6d757b5-7691-4d19-ad38-9eaef7f6034d]: (4, 'qcow2') {{(pid=88499) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 04:40:08 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-a5835897-76ee-4cfd-8dbb-df30e5da9f54 tempest-VolumeSnapshotQuotasNegativeTestJSON-181807343 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-9614de62-b2d8-4683-ae8a-ab76916738ea.8fd276b8-e8cf-435c-ac2d-d92eb5701f66 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:40:08 devstack sudo[95722]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-9614de62-b2d8-4683-ae8a-ab76916738ea.8fd276b8-e8cf-435c-ac2d-d92eb5701f66 Jul 10 04:40:08 devstack sudo[95722]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:40:08 devstack sudo[95716]: pam_unix(sudo:session): session closed for user root Jul 10 04:40:08 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-af3bc409-c2ae-4e3e-bff6-6a13f2ea83b6 tempest-SnapshotsActionsTest-1538729065 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-cb9ba17f-166a-487b-bda4-b5f9b80b656d.ee8c454a-c0ff-4b09-826b-830aa5ec0536" returned: 0 in 0.954s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:40:08 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.remotefs [None req-af3bc409-c2ae-4e3e-bff6-6a13f2ea83b6 tempest-SnapshotsActionsTest-1538729065 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-cb9ba17f-166a-487b-bda4-b5f9b80b656d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87444) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 10 04:40:08 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-af3bc409-c2ae-4e3e-bff6-6a13f2ea83b6 tempest-SnapshotsActionsTest-1538729065 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-cb9ba17f-166a-487b-bda4-b5f9b80b656d.ee8c454a-c0ff-4b09-826b-830aa5ec0536,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-cb9ba17f-166a-487b-bda4-b5f9b80b656d.36576e5b-0ae6-42cf-b588-9727aa156df2 1G {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:40:08 devstack sudo[95724]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-cb9ba17f-166a-487b-bda4-b5f9b80b656d.ee8c454a-c0ff-4b09-826b-830aa5ec0536,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-cb9ba17f-166a-487b-bda4-b5f9b80b656d.36576e5b-0ae6-42cf-b588-9727aa156df2 1G Jul 10 04:40:08 devstack sudo[95724]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:40:09 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-1c591ad1-5508-4e84-9a2d-3d9236cc08ab tempest-GroupSnapshotsTest-544795304 None] Acquiring lock "cinder-quobyte-37f9eb8a-5d23-4485-8e1c-9d3b65f0c944" by "delete_volume" {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 04:40:09 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-1c591ad1-5508-4e84-9a2d-3d9236cc08ab tempest-GroupSnapshotsTest-544795304 None] Lock "cinder-quobyte-37f9eb8a-5d23-4485-8e1c-9d3b65f0c944" acquired by "delete_volume" :: waited 0.029s {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 04:40:09 devstack cinder-volume[87444]: DEBUG oslo.privsep.daemon [-] privsep: reply[39677de6-02f0-47e1-a5d7-52b0c98e16d5]: (4, 'qcow2') {{(pid=88499) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 04:40:09 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-1c591ad1-5508-4e84-9a2d-3d9236cc08ab tempest-GroupSnapshotsTest-544795304 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-37f9eb8a-5d23-4485-8e1c-9d3b65f0c944 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:40:09 devstack sudo[95726]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-37f9eb8a-5d23-4485-8e1c-9d3b65f0c944 Jul 10 04:40:09 devstack sudo[95726]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:40:09 devstack sudo[95722]: pam_unix(sudo:session): session closed for user root Jul 10 04:40:09 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-a5835897-76ee-4cfd-8dbb-df30e5da9f54 tempest-VolumeSnapshotQuotasNegativeTestJSON-181807343 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-9614de62-b2d8-4683-ae8a-ab76916738ea.8fd276b8-e8cf-435c-ac2d-d92eb5701f66" returned: 0 in 1.036s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:40:09 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.remotefs [None req-a5835897-76ee-4cfd-8dbb-df30e5da9f54 tempest-VolumeSnapshotQuotasNegativeTestJSON-181807343 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9614de62-b2d8-4683-ae8a-ab76916738ea(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87444) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 10 04:40:09 devstack cinder-volume[87444]: DEBUG oslo.privsep.daemon [-] privsep: reply[c430d51d-58ad-4650-a454-e65b577daed3]: (4, 'qcow2') {{(pid=88499) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 04:40:09 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-a5835897-76ee-4cfd-8dbb-df30e5da9f54 tempest-VolumeSnapshotQuotasNegativeTestJSON-181807343 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-9614de62-b2d8-4683-ae8a-ab76916738ea {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:40:09 devstack sudo[95736]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-9614de62-b2d8-4683-ae8a-ab76916738ea Jul 10 04:40:09 devstack sudo[95736]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:40:09 devstack sudo[95724]: pam_unix(sudo:session): session closed for user root Jul 10 04:40:09 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-af3bc409-c2ae-4e3e-bff6-6a13f2ea83b6 tempest-SnapshotsActionsTest-1538729065 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-cb9ba17f-166a-487b-bda4-b5f9b80b656d.ee8c454a-c0ff-4b09-826b-830aa5ec0536,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-cb9ba17f-166a-487b-bda4-b5f9b80b656d.36576e5b-0ae6-42cf-b588-9727aa156df2 1G" returned: 0 in 1.059s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:40:09 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-af3bc409-c2ae-4e3e-bff6-6a13f2ea83b6 tempest-SnapshotsActionsTest-1538729065 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cb9ba17f-166a-487b-bda4-b5f9b80b656d.ee8c454a-c0ff-4b09-826b-830aa5ec0536 -F qcow2 /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-cb9ba17f-166a-487b-bda4-b5f9b80b656d.36576e5b-0ae6-42cf-b588-9727aa156df2 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:40:09 devstack sudo[95738]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cb9ba17f-166a-487b-bda4-b5f9b80b656d.ee8c454a-c0ff-4b09-826b-830aa5ec0536 -F qcow2 /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-cb9ba17f-166a-487b-bda4-b5f9b80b656d.36576e5b-0ae6-42cf-b588-9727aa156df2 Jul 10 04:40:09 devstack sudo[95738]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:40:10 devstack sudo[95726]: pam_unix(sudo:session): session closed for user root Jul 10 04:40:10 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-1c591ad1-5508-4e84-9a2d-3d9236cc08ab tempest-GroupSnapshotsTest-544795304 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-37f9eb8a-5d23-4485-8e1c-9d3b65f0c944" returned: 0 in 1.161s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:40:10 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-1c591ad1-5508-4e84-9a2d-3d9236cc08ab tempest-GroupSnapshotsTest-544795304 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-37f9eb8a-5d23-4485-8e1c-9d3b65f0c944 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:40:10 devstack sudo[95743]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-37f9eb8a-5d23-4485-8e1c-9d3b65f0c944 Jul 10 04:40:10 devstack sudo[95743]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:40:10 devstack sudo[95736]: pam_unix(sudo:session): session closed for user root Jul 10 04:40:10 devstack sudo[95738]: pam_unix(sudo:session): session closed for user root Jul 10 04:40:10 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-a5835897-76ee-4cfd-8dbb-df30e5da9f54 tempest-VolumeSnapshotQuotasNegativeTestJSON-181807343 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-9614de62-b2d8-4683-ae8a-ab76916738ea" returned: 0 in 1.071s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:40:10 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-a5835897-76ee-4cfd-8dbb-df30e5da9f54 tempest-VolumeSnapshotQuotasNegativeTestJSON-181807343 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-9614de62-b2d8-4683-ae8a-ab76916738ea.8fd276b8-e8cf-435c-ac2d-d92eb5701f66 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:40:10 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-af3bc409-c2ae-4e3e-bff6-6a13f2ea83b6 tempest-SnapshotsActionsTest-1538729065 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cb9ba17f-166a-487b-bda4-b5f9b80b656d.ee8c454a-c0ff-4b09-826b-830aa5ec0536 -F qcow2 /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-cb9ba17f-166a-487b-bda4-b5f9b80b656d.36576e5b-0ae6-42cf-b588-9727aa156df2" returned: 0 in 0.944s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:40:10 devstack cinder-volume[87444]: WARNING cinder.volume.drivers.remotefs [None req-af3bc409-c2ae-4e3e-bff6-6a13f2ea83b6 tempest-SnapshotsActionsTest-1538729065 None] /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-cb9ba17f-166a-487b-bda4-b5f9b80b656d.36576e5b-0ae6-42cf-b588-9727aa156df2 is being set with open permissions: ugo+rw Jul 10 04:40:10 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-af3bc409-c2ae-4e3e-bff6-6a13f2ea83b6 tempest-SnapshotsActionsTest-1538729065 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-cb9ba17f-166a-487b-bda4-b5f9b80b656d.36576e5b-0ae6-42cf-b588-9727aa156df2 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:40:10 devstack sudo[95753]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-9614de62-b2d8-4683-ae8a-ab76916738ea.8fd276b8-e8cf-435c-ac2d-d92eb5701f66 Jul 10 04:40:10 devstack sudo[95753]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:40:10 devstack sudo[95754]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-cb9ba17f-166a-487b-bda4-b5f9b80b656d.36576e5b-0ae6-42cf-b588-9727aa156df2 Jul 10 04:40:10 devstack sudo[95754]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:40:11 devstack sudo[95743]: pam_unix(sudo:session): session closed for user root Jul 10 04:40:11 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-1c591ad1-5508-4e84-9a2d-3d9236cc08ab tempest-GroupSnapshotsTest-544795304 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-37f9eb8a-5d23-4485-8e1c-9d3b65f0c944" returned: 0 in 1.030s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:40:11 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-1c591ad1-5508-4e84-9a2d-3d9236cc08ab tempest-GroupSnapshotsTest-544795304 None] Lock "cinder-quobyte-37f9eb8a-5d23-4485-8e1c-9d3b65f0c944" released by "delete_volume" :: held 2.312s {{(pid=87444) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 04:40:11 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-1c591ad1-5508-4e84-9a2d-3d9236cc08ab tempest-GroupSnapshotsTest-544795304 None] Acquiring lock "cinder-quobyte-ae5ee9ab-4457-42a0-be80-8e471bdb12a2" by "delete_volume" {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 04:40:11 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-1c591ad1-5508-4e84-9a2d-3d9236cc08ab tempest-GroupSnapshotsTest-544795304 None] Lock "cinder-quobyte-ae5ee9ab-4457-42a0-be80-8e471bdb12a2" acquired by "delete_volume" :: waited 0.024s {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 04:40:11 devstack cinder-volume[87444]: DEBUG oslo.privsep.daemon [-] privsep: reply[42357806-582b-430e-8f05-2cd2c2c7ba65]: (4, 'qcow2') {{(pid=88499) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 04:40:11 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-1c591ad1-5508-4e84-9a2d-3d9236cc08ab tempest-GroupSnapshotsTest-544795304 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-ae5ee9ab-4457-42a0-be80-8e471bdb12a2 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:40:11 devstack sudo[95758]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-ae5ee9ab-4457-42a0-be80-8e471bdb12a2 Jul 10 04:40:11 devstack sudo[95758]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:40:11 devstack sudo[95754]: pam_unix(sudo:session): session closed for user root Jul 10 04:40:11 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-af3bc409-c2ae-4e3e-bff6-6a13f2ea83b6 tempest-SnapshotsActionsTest-1538729065 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-cb9ba17f-166a-487b-bda4-b5f9b80b656d.36576e5b-0ae6-42cf-b588-9727aa156df2" returned: 0 in 0.959s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:40:11 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-af3bc409-c2ae-4e3e-bff6-6a13f2ea83b6 tempest-SnapshotsActionsTest-1538729065 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.046s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 04:40:11 devstack sudo[95753]: pam_unix(sudo:session): session closed for user root Jul 10 04:40:11 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-a5835897-76ee-4cfd-8dbb-df30e5da9f54 tempest-VolumeSnapshotQuotasNegativeTestJSON-181807343 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-9614de62-b2d8-4683-ae8a-ab76916738ea.8fd276b8-e8cf-435c-ac2d-d92eb5701f66" returned: 0 in 1.045s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:40:11 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-a5835897-76ee-4cfd-8dbb-df30e5da9f54 tempest-VolumeSnapshotQuotasNegativeTestJSON-181807343 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-9614de62-b2d8-4683-ae8a-ab76916738ea.8fd276b8-e8cf-435c-ac2d-d92eb5701f66 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:40:11 devstack sudo[95764]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-9614de62-b2d8-4683-ae8a-ab76916738ea.8fd276b8-e8cf-435c-ac2d-d92eb5701f66 Jul 10 04:40:11 devstack sudo[95764]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:40:11 devstack cinder-volume[87444]: INFO cinder.volume.manager [None req-af3bc409-c2ae-4e3e-bff6-6a13f2ea83b6 tempest-SnapshotsActionsTest-1538729065 None] Create snapshot completed successfully Jul 10 04:40:12 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-e1faef0a-bb8c-4d53-aafe-1f5eeb14557f tempest-SnapshotsActionsTest-1017379468 None] Acquiring lock "cinder-36576e5b-0ae6-42cf-b588-9727aa156df2-delete_snapshot" by "delete_snapshot" {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 04:40:12 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-e1faef0a-bb8c-4d53-aafe-1f5eeb14557f tempest-SnapshotsActionsTest-1017379468 None] Lock "cinder-36576e5b-0ae6-42cf-b588-9727aa156df2-delete_snapshot" acquired by "delete_snapshot" :: waited 0.031s {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 04:40:12 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-e1faef0a-bb8c-4d53-aafe-1f5eeb14557f tempest-SnapshotsActionsTest-1017379468 None] Acquiring lock "cinder-quobyte-cb9ba17f-166a-487b-bda4-b5f9b80b656d" by "delete_snapshot" {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 04:40:12 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-e1faef0a-bb8c-4d53-aafe-1f5eeb14557f tempest-SnapshotsActionsTest-1017379468 None] Lock "cinder-quobyte-cb9ba17f-166a-487b-bda4-b5f9b80b656d" acquired by "delete_snapshot" :: waited 0.024s {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 04:40:12 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-e1faef0a-bb8c-4d53-aafe-1f5eeb14557f tempest-SnapshotsActionsTest-1017379468 None] Acquiring lock "cinder-quobyte-36576e5b-0ae6-42cf-b588-9727aa156df2" by "_delete_snapshot" {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 04:40:12 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-e1faef0a-bb8c-4d53-aafe-1f5eeb14557f tempest-SnapshotsActionsTest-1017379468 None] Lock "cinder-quobyte-36576e5b-0ae6-42cf-b588-9727aa156df2" acquired by "_delete_snapshot" :: waited 0.022s {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 04:40:12 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.remotefs [None req-e1faef0a-bb8c-4d53-aafe-1f5eeb14557f tempest-SnapshotsActionsTest-1017379468 None] Deleting offline snapshot 36576e5b-0ae6-42cf-b588-9727aa156df2 of volume cb9ba17f-166a-487b-bda4-b5f9b80b656d {{(pid=87444) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 10 04:40:12 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.remotefs [None req-e1faef0a-bb8c-4d53-aafe-1f5eeb14557f tempest-SnapshotsActionsTest-1017379468 None] snapshot_file for this snap is: volume-cb9ba17f-166a-487b-bda4-b5f9b80b656d.36576e5b-0ae6-42cf-b588-9727aa156df2 {{(pid=87444) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 10 04:40:12 devstack cinder-volume[87444]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7979020-cbff-496f-9eec-dc978fa807cb]: (4, 'qcow2') {{(pid=88499) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 04:40:12 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-e1faef0a-bb8c-4d53-aafe-1f5eeb14557f tempest-SnapshotsActionsTest-1017379468 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-cb9ba17f-166a-487b-bda4-b5f9b80b656d.36576e5b-0ae6-42cf-b588-9727aa156df2 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:40:12 devstack sudo[95758]: pam_unix(sudo:session): session closed for user root Jul 10 04:40:12 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-1c591ad1-5508-4e84-9a2d-3d9236cc08ab tempest-GroupSnapshotsTest-544795304 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-ae5ee9ab-4457-42a0-be80-8e471bdb12a2" returned: 0 in 1.058s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:40:12 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-1c591ad1-5508-4e84-9a2d-3d9236cc08ab tempest-GroupSnapshotsTest-544795304 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-ae5ee9ab-4457-42a0-be80-8e471bdb12a2 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:40:12 devstack sudo[95770]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-ae5ee9ab-4457-42a0-be80-8e471bdb12a2 Jul 10 04:40:12 devstack sudo[95770]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:40:12 devstack sudo[95769]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-cb9ba17f-166a-487b-bda4-b5f9b80b656d.36576e5b-0ae6-42cf-b588-9727aa156df2 Jul 10 04:40:12 devstack sudo[95769]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:40:12 devstack sudo[95764]: pam_unix(sudo:session): session closed for user root Jul 10 04:40:12 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-a5835897-76ee-4cfd-8dbb-df30e5da9f54 tempest-VolumeSnapshotQuotasNegativeTestJSON-181807343 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-9614de62-b2d8-4683-ae8a-ab76916738ea.8fd276b8-e8cf-435c-ac2d-d92eb5701f66" returned: 0 in 1.010s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:40:12 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-a5835897-76ee-4cfd-8dbb-df30e5da9f54 tempest-VolumeSnapshotQuotasNegativeTestJSON-181807343 None] Lock "cinder-quobyte-8fd276b8-e8cf-435c-ac2d-d92eb5701f66" released by "_delete_snapshot" :: held 4.315s {{(pid=87444) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 04:40:12 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-a5835897-76ee-4cfd-8dbb-df30e5da9f54 tempest-VolumeSnapshotQuotasNegativeTestJSON-181807343 None] Lock "cinder-quobyte-9614de62-b2d8-4683-ae8a-ab76916738ea" released by "delete_snapshot" :: held 4.351s {{(pid=87444) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 04:40:13 devstack cinder-volume[87444]: DEBUG cinder.quota [None req-a5835897-76ee-4cfd-8dbb-df30e5da9f54 tempest-VolumeSnapshotQuotasNegativeTestJSON-181807343 None] Created reservations ['f93e1875-14a5-4974-af8a-23a0825dcb96', 'b6ffad5f-a16a-47c2-9f0e-d691ba1d6041', '3833298e-1dd9-4dac-bb93-1ceb67778cb6', '58575da7-7247-4500-965d-3bd6e6d945b0'] {{(pid=87444) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 04:40:13 devstack cinder-volume[87444]: INFO cinder.volume.manager [None req-a5835897-76ee-4cfd-8dbb-df30e5da9f54 tempest-VolumeSnapshotQuotasNegativeTestJSON-181807343 None] Delete snapshot completed successfully. Jul 10 04:40:13 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-a5835897-76ee-4cfd-8dbb-df30e5da9f54 tempest-VolumeSnapshotQuotasNegativeTestJSON-181807343 None] Lock "cinder-8fd276b8-e8cf-435c-ac2d-d92eb5701f66-delete_snapshot" released by "delete_snapshot" :: held 4.618s {{(pid=87444) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 04:40:13 devstack sudo[95770]: pam_unix(sudo:session): session closed for user root Jul 10 04:40:13 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-1c591ad1-5508-4e84-9a2d-3d9236cc08ab tempest-GroupSnapshotsTest-544795304 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-ae5ee9ab-4457-42a0-be80-8e471bdb12a2" returned: 0 in 0.934s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:40:13 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-1c591ad1-5508-4e84-9a2d-3d9236cc08ab tempest-GroupSnapshotsTest-544795304 None] Lock "cinder-quobyte-ae5ee9ab-4457-42a0-be80-8e471bdb12a2" released by "delete_volume" :: held 2.086s {{(pid=87444) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 04:40:13 devstack cinder-volume[87444]: DEBUG cinder.quota [None req-1c591ad1-5508-4e84-9a2d-3d9236cc08ab tempest-GroupSnapshotsTest-544795304 None] Created reservations ['d834a45b-d03f-42ac-853a-2b188117ed83'] {{(pid=87444) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 04:40:13 devstack cinder-volume[87444]: WARNING cinder.quota [None req-1c591ad1-5508-4e84-9a2d-3d9236cc08ab tempest-GroupSnapshotsTest-544795304 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-289573887 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-289573887, it is now deprecated. Please use the default quota class for default quota. Jul 10 04:40:13 devstack cinder-volume[87444]: DEBUG cinder.quota [None req-1c591ad1-5508-4e84-9a2d-3d9236cc08ab tempest-GroupSnapshotsTest-544795304 None] Created reservations ['0539210e-d847-46d4-8440-0c0a36a8d3e7', '07c5e10a-fb9a-4adf-94e5-c5233d1345e5', 'ebcddcfa-c77a-4764-86d0-b1cd40288280', 'd7ca5033-3d23-4692-b5b2-393eaaf6ff6e'] {{(pid=87444) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 04:40:13 devstack sudo[95769]: pam_unix(sudo:session): session closed for user root Jul 10 04:40:13 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-e1faef0a-bb8c-4d53-aafe-1f5eeb14557f tempest-SnapshotsActionsTest-1017379468 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-cb9ba17f-166a-487b-bda4-b5f9b80b656d.36576e5b-0ae6-42cf-b588-9727aa156df2" returned: 0 in 1.205s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:40:13 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.remotefs [None req-e1faef0a-bb8c-4d53-aafe-1f5eeb14557f tempest-SnapshotsActionsTest-1017379468 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-cb9ba17f-166a-487b-bda4-b5f9b80b656d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87444) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 10 04:40:13 devstack cinder-volume[87444]: DEBUG oslo.privsep.daemon [-] privsep: reply[a08a3382-da7f-47a5-bf78-912422101c0a]: (4, 'qcow2') {{(pid=88499) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 04:40:13 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-e1faef0a-bb8c-4d53-aafe-1f5eeb14557f tempest-SnapshotsActionsTest-1017379468 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-cb9ba17f-166a-487b-bda4-b5f9b80b656d.ee8c454a-c0ff-4b09-826b-830aa5ec0536 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:40:13 devstack cinder-volume[87444]: DEBUG cinder.quota [None req-1c591ad1-5508-4e84-9a2d-3d9236cc08ab tempest-GroupSnapshotsTest-544795304 None] Created reservations ['4acb404a-aa56-439b-aba8-f460a8cf093a', '6880a84b-420f-4c18-8672-46c28cf25c0f', 'abbf6c2c-59b8-4e34-980c-09f471892161', 'ff90985c-0f8c-4941-a6f1-179bbc50cfe7'] {{(pid=87444) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 04:40:13 devstack sudo[95779]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-cb9ba17f-166a-487b-bda4-b5f9b80b656d.ee8c454a-c0ff-4b09-826b-830aa5ec0536 Jul 10 04:40:13 devstack sudo[95779]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:40:13 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-1c591ad1-5508-4e84-9a2d-3d9236cc08ab tempest-GroupSnapshotsTest-544795304 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 04:40:13 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-1c591ad1-5508-4e84-9a2d-3d9236cc08ab tempest-GroupSnapshotsTest-544795304 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 04:40:13 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-1c591ad1-5508-4e84-9a2d-3d9236cc08ab tempest-GroupSnapshotsTest-544795304 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922': None} {{(pid=87444) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 04:40:13 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-1c591ad1-5508-4e84-9a2d-3d9236cc08ab tempest-GroupSnapshotsTest-544795304 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922'] {{(pid=87444) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 04:40:13 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-1c591ad1-5508-4e84-9a2d-3d9236cc08ab tempest-GroupSnapshotsTest-544795304 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 04:40:13 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-1c591ad1-5508-4e84-9a2d-3d9236cc08ab tempest-GroupSnapshotsTest-544795304 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:40:14 devstack sudo[95781]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097 Jul 10 04:40:14 devstack sudo[95781]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:40:14 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-22cd898e-0d8d-4b04-aa41-e547b098b6c1 tempest-VolumeSnapshotQuotasNegativeTestJSON-181807343 None] Acquiring lock "cinder-9614de62-b2d8-4683-ae8a-ab76916738ea-delete_volume" by "delete_volume" {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 04:40:14 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-22cd898e-0d8d-4b04-aa41-e547b098b6c1 tempest-VolumeSnapshotQuotasNegativeTestJSON-181807343 None] Lock "cinder-9614de62-b2d8-4683-ae8a-ab76916738ea-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 04:40:14 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-22cd898e-0d8d-4b04-aa41-e547b098b6c1 tempest-VolumeSnapshotQuotasNegativeTestJSON-181807343 None] Acquiring lock "cinder-quobyte-9614de62-b2d8-4683-ae8a-ab76916738ea" by "delete_volume" {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 04:40:14 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-22cd898e-0d8d-4b04-aa41-e547b098b6c1 tempest-VolumeSnapshotQuotasNegativeTestJSON-181807343 None] Lock "cinder-quobyte-9614de62-b2d8-4683-ae8a-ab76916738ea" acquired by "delete_volume" :: waited 0.028s {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 04:40:14 devstack cinder-volume[87444]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b77c027-e232-4329-9435-fdea0617ab92]: (4, 'qcow2') {{(pid=88499) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 04:40:14 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-22cd898e-0d8d-4b04-aa41-e547b098b6c1 tempest-VolumeSnapshotQuotasNegativeTestJSON-181807343 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-9614de62-b2d8-4683-ae8a-ab76916738ea {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:40:14 devstack sudo[95783]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-9614de62-b2d8-4683-ae8a-ab76916738ea Jul 10 04:40:14 devstack sudo[95783]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:40:14 devstack sudo[95779]: pam_unix(sudo:session): session closed for user root Jul 10 04:40:14 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-e1faef0a-bb8c-4d53-aafe-1f5eeb14557f tempest-SnapshotsActionsTest-1017379468 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-cb9ba17f-166a-487b-bda4-b5f9b80b656d.ee8c454a-c0ff-4b09-826b-830aa5ec0536" returned: 0 in 1.194s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:40:14 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.remotefs [None req-e1faef0a-bb8c-4d53-aafe-1f5eeb14557f tempest-SnapshotsActionsTest-1017379468 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-cb9ba17f-166a-487b-bda4-b5f9b80b656d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87444) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 10 04:40:14 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-e1faef0a-bb8c-4d53-aafe-1f5eeb14557f tempest-SnapshotsActionsTest-1017379468 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-cb9ba17f-166a-487b-bda4-b5f9b80b656d.36576e5b-0ae6-42cf-b588-9727aa156df2 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:40:14 devstack cinder-volume[87444]: INFO cinder.volume.manager [None req-8bbe68a4-96b9-4357-bba9-5ff3af1f77d8 tempest-GroupSnapshotsTest-544795304 None] Group tempest-GroupSnapshotsTest-Group-455473126: creating Jul 10 04:40:14 devstack sudo[95789]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-cb9ba17f-166a-487b-bda4-b5f9b80b656d.36576e5b-0ae6-42cf-b588-9727aa156df2 Jul 10 04:40:14 devstack sudo[95789]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:40:14 devstack cinder-volume[87444]: INFO cinder.volume.manager [None req-8bbe68a4-96b9-4357-bba9-5ff3af1f77d8 tempest-GroupSnapshotsTest-544795304 None] Group tempest-GroupSnapshotsTest-Group-455473126: created successfully Jul 10 04:40:14 devstack cinder-volume[87444]: INFO cinder.volume.manager [None req-8bbe68a4-96b9-4357-bba9-5ff3af1f77d8 tempest-GroupSnapshotsTest-544795304 None] Create group completed successfully. Jul 10 04:40:15 devstack sudo[95781]: pam_unix(sudo:session): session closed for user root Jul 10 04:40:15 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-1c591ad1-5508-4e84-9a2d-3d9236cc08ab tempest-GroupSnapshotsTest-544795304 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097" returned: 0 in 1.080s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:40:15 devstack cinder-volume[87444]: DEBUG cinder.manager [None req-1c591ad1-5508-4e84-9a2d-3d9236cc08ab tempest-GroupSnapshotsTest-544795304 None] Notifying Schedulers of capabilities ... {{(pid=87444) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 04:40:15 devstack cinder-volume[87444]: INFO cinder.volume.manager [None req-1c591ad1-5508-4e84-9a2d-3d9236cc08ab tempest-GroupSnapshotsTest-544795304 None] Delete group completed successfully. Jul 10 04:40:15 devstack sudo[95783]: pam_unix(sudo:session): session closed for user root Jul 10 04:40:15 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-22cd898e-0d8d-4b04-aa41-e547b098b6c1 tempest-VolumeSnapshotQuotasNegativeTestJSON-181807343 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-9614de62-b2d8-4683-ae8a-ab76916738ea" returned: 0 in 1.090s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:40:15 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-22cd898e-0d8d-4b04-aa41-e547b098b6c1 tempest-VolumeSnapshotQuotasNegativeTestJSON-181807343 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-9614de62-b2d8-4683-ae8a-ab76916738ea {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:40:15 devstack sudo[95798]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-9614de62-b2d8-4683-ae8a-ab76916738ea Jul 10 04:40:15 devstack sudo[95798]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:40:15 devstack sudo[95789]: pam_unix(sudo:session): session closed for user root Jul 10 04:40:15 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-e1faef0a-bb8c-4d53-aafe-1f5eeb14557f tempest-SnapshotsActionsTest-1017379468 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-cb9ba17f-166a-487b-bda4-b5f9b80b656d.36576e5b-0ae6-42cf-b588-9727aa156df2" returned: 0 in 1.018s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:40:15 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-e1faef0a-bb8c-4d53-aafe-1f5eeb14557f tempest-SnapshotsActionsTest-1017379468 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-cb9ba17f-166a-487b-bda4-b5f9b80b656d.36576e5b-0ae6-42cf-b588-9727aa156df2 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:40:15 devstack sudo[95808]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-cb9ba17f-166a-487b-bda4-b5f9b80b656d.36576e5b-0ae6-42cf-b588-9727aa156df2 Jul 10 04:40:15 devstack sudo[95808]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:40:16 devstack sudo[95798]: pam_unix(sudo:session): session closed for user root Jul 10 04:40:16 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-22cd898e-0d8d-4b04-aa41-e547b098b6c1 tempest-VolumeSnapshotQuotasNegativeTestJSON-181807343 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-9614de62-b2d8-4683-ae8a-ab76916738ea" returned: 0 in 0.823s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:40:16 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-22cd898e-0d8d-4b04-aa41-e547b098b6c1 tempest-VolumeSnapshotQuotasNegativeTestJSON-181807343 None] Lock "cinder-quobyte-9614de62-b2d8-4683-ae8a-ab76916738ea" released by "delete_volume" :: held 2.026s {{(pid=87444) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 04:40:16 devstack cinder-volume[87444]: DEBUG cinder.quota [None req-22cd898e-0d8d-4b04-aa41-e547b098b6c1 tempest-VolumeSnapshotQuotasNegativeTestJSON-181807343 None] Created reservations ['7a889fc6-909d-4355-94a7-626b53ac93a3', '65e1dfac-45e1-4bdd-b9bc-a9523f80d5a1', '57f2c733-f03a-465f-a606-9d8cc7c7c9ec', 'a9c93fa1-11ae-4c08-a008-2f26a71d4281'] {{(pid=87444) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 04:40:16 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-22cd898e-0d8d-4b04-aa41-e547b098b6c1 tempest-VolumeSnapshotQuotasNegativeTestJSON-181807343 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 04:40:16 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-22cd898e-0d8d-4b04-aa41-e547b098b6c1 tempest-VolumeSnapshotQuotasNegativeTestJSON-181807343 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 04:40:16 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-22cd898e-0d8d-4b04-aa41-e547b098b6c1 tempest-VolumeSnapshotQuotasNegativeTestJSON-181807343 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922': None} {{(pid=87444) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 04:40:16 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-22cd898e-0d8d-4b04-aa41-e547b098b6c1 tempest-VolumeSnapshotQuotasNegativeTestJSON-181807343 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922'] {{(pid=87444) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 04:40:16 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-22cd898e-0d8d-4b04-aa41-e547b098b6c1 tempest-VolumeSnapshotQuotasNegativeTestJSON-181807343 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 04:40:16 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-22cd898e-0d8d-4b04-aa41-e547b098b6c1 tempest-VolumeSnapshotQuotasNegativeTestJSON-181807343 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:40:16 devstack sudo[95811]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097 Jul 10 04:40:16 devstack sudo[95811]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:40:16 devstack cinder-volume[87444]: DEBUG cinder.volume.flows.manager.create_volume [None req-97b523c3-63b4-409d-a355-13e8411c6d90 tempest-GroupSnapshotsTest-544795304 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87444) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 04:40:16 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-97b523c3-63b4-409d-a355-13e8411c6d90 tempest-GroupSnapshotsTest-544795304 None] Flow 'volume_create_manager' (2e081f45-5f9f-4e7d-9330-890ca561d29e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 04:40:16 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-97b523c3-63b4-409d-a355-13e8411c6d90 tempest-GroupSnapshotsTest-544795304 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6850e37b-492e-4c66-8431-07ab3c565681) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:40:17 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-97b523c3-63b4-409d-a355-13e8411c6d90 tempest-GroupSnapshotsTest-544795304 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6850e37b-492e-4c66-8431-07ab3c565681) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T02:40:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1087996764',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=bdc17f44-98a2-44c9-b569-a9e3ca13f813,host='devstack@QuobyteHD#QuobyteHD',id=93d7a24a-fb3e-4e4f-8763-c877812011be,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='37897128afdc4de48f884e9b940e625f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T02:40:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T02:40:17Z,use_quota=True,user_id='720d99c11f4b4f88b1559d0cc385025d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(61380939-0648-4fa0-ba68-ff99a11af09a),volume_type_id=61380939-0648-4fa0-ba68-ff99a11af09a)' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:40:17 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-97b523c3-63b4-409d-a355-13e8411c6d90 tempest-GroupSnapshotsTest-544795304 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9877c406-40d6-4a08-ac5c-75730d048fbd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:40:17 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-97b523c3-63b4-409d-a355-13e8411c6d90 tempest-GroupSnapshotsTest-544795304 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9877c406-40d6-4a08-ac5c-75730d048fbd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:40:17 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-97b523c3-63b4-409d-a355-13e8411c6d90 tempest-GroupSnapshotsTest-544795304 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eec69977-2af1-485c-b623-45f7cc71a7c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:40:17 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-97b523c3-63b4-409d-a355-13e8411c6d90 tempest-GroupSnapshotsTest-544795304 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eec69977-2af1-485c-b623-45f7cc71a7c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '93d7a24a-fb3e-4e4f-8763-c877812011be', 'volume_name': 'volume-93d7a24a-fb3e-4e4f-8763-c877812011be', 'volume_size': 1}' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:40:17 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-97b523c3-63b4-409d-a355-13e8411c6d90 tempest-GroupSnapshotsTest-544795304 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (acdde013-e5f9-4052-a7ed-aa9d0546c088) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:40:17 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-97b523c3-63b4-409d-a355-13e8411c6d90 tempest-GroupSnapshotsTest-544795304 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (acdde013-e5f9-4052-a7ed-aa9d0546c088) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:40:17 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-97b523c3-63b4-409d-a355-13e8411c6d90 tempest-GroupSnapshotsTest-544795304 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (50afa6ae-7346-4be2-86d3-b9d3147c1efe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:40:17 devstack cinder-volume[87444]: INFO cinder.volume.flows.manager.create_volume [None req-97b523c3-63b4-409d-a355-13e8411c6d90 tempest-GroupSnapshotsTest-544795304 None] Volume 93d7a24a-fb3e-4e4f-8763-c877812011be: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-93d7a24a-fb3e-4e4f-8763-c877812011be', 'volume_size': 1} Jul 10 04:40:17 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-97b523c3-63b4-409d-a355-13e8411c6d90 tempest-GroupSnapshotsTest-544795304 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 04:40:17 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-97b523c3-63b4-409d-a355-13e8411c6d90 tempest-GroupSnapshotsTest-544795304 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 04:40:17 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-97b523c3-63b4-409d-a355-13e8411c6d90 tempest-GroupSnapshotsTest-544795304 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=bdc17f44-98a2-44c9-b569-a9e3ca13f813,created_at=2026-07-10T02:40:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1087996764',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=bdc17f44-98a2-44c9-b569-a9e3ca13f813,host='devstack@QuobyteHD#QuobyteHD',id=93d7a24a-fb3e-4e4f-8763-c877812011be,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='37897128afdc4de48f884e9b940e625f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T02:40:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T02:40:17Z,use_quota=True,user_id='720d99c11f4b4f88b1559d0cc385025d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(61380939-0648-4fa0-ba68-ff99a11af09a),volume_type_id=61380939-0648-4fa0-ba68-ff99a11af09a)}" {{(pid=87444) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 04:40:17 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.remotefs [None req-97b523c3-63b4-409d-a355-13e8411c6d90 tempest-GroupSnapshotsTest-544795304 None] Creating volume 93d7a24a-fb3e-4e4f-8763-c877812011be {{(pid=87444) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 04:40:17 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-97b523c3-63b4-409d-a355-13e8411c6d90 tempest-GroupSnapshotsTest-544795304 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 04:40:17 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-97b523c3-63b4-409d-a355-13e8411c6d90 tempest-GroupSnapshotsTest-544795304 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 04:40:17 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-97b523c3-63b4-409d-a355-13e8411c6d90 tempest-GroupSnapshotsTest-544795304 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922': None} {{(pid=87444) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 04:40:17 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-97b523c3-63b4-409d-a355-13e8411c6d90 tempest-GroupSnapshotsTest-544795304 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922'] {{(pid=87444) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 04:40:17 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-97b523c3-63b4-409d-a355-13e8411c6d90 tempest-GroupSnapshotsTest-544795304 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 04:40:17 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-97b523c3-63b4-409d-a355-13e8411c6d90 tempest-GroupSnapshotsTest-544795304 None] Selected osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922 as target Quobyte volume. {{(pid=87444) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 04:40:17 devstack cinder-volume[87444]: INFO cinder.volume.drivers.remotefs [None req-97b523c3-63b4-409d-a355-13e8411c6d90 tempest-GroupSnapshotsTest-544795304 None] casted to osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922 Jul 10 04:40:17 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-97b523c3-63b4-409d-a355-13e8411c6d90 tempest-GroupSnapshotsTest-544795304 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-93d7a24a-fb3e-4e4f-8763-c877812011be 1073741824 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:40:17 devstack sudo[95814]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-93d7a24a-fb3e-4e4f-8763-c877812011be 1073741824 Jul 10 04:40:17 devstack sudo[95814]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:40:17 devstack sudo[95808]: pam_unix(sudo:session): session closed for user root Jul 10 04:40:17 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-e1faef0a-bb8c-4d53-aafe-1f5eeb14557f tempest-SnapshotsActionsTest-1017379468 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-cb9ba17f-166a-487b-bda4-b5f9b80b656d.36576e5b-0ae6-42cf-b588-9727aa156df2" returned: 0 in 1.251s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:40:17 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-e1faef0a-bb8c-4d53-aafe-1f5eeb14557f tempest-SnapshotsActionsTest-1017379468 None] Lock "cinder-quobyte-36576e5b-0ae6-42cf-b588-9727aa156df2" released by "_delete_snapshot" :: held 4.841s {{(pid=87444) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 04:40:17 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-e1faef0a-bb8c-4d53-aafe-1f5eeb14557f tempest-SnapshotsActionsTest-1017379468 None] Lock "cinder-quobyte-cb9ba17f-166a-487b-bda4-b5f9b80b656d" released by "delete_snapshot" :: held 4.879s {{(pid=87444) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 04:40:17 devstack cinder-volume[87444]: DEBUG cinder.quota [None req-e1faef0a-bb8c-4d53-aafe-1f5eeb14557f tempest-SnapshotsActionsTest-1017379468 None] Created reservations ['07424d9d-a80b-4204-9e7e-4751e07dc503', 'debf8e71-5667-40df-b8c6-276db5623cfe', '2a0f31df-248c-4725-a87f-837be1e351e5', '0357c4af-d90c-4c2e-b79c-2436b7eec17e'] {{(pid=87444) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 04:40:17 devstack cinder-volume[87444]: INFO cinder.volume.manager [None req-e1faef0a-bb8c-4d53-aafe-1f5eeb14557f tempest-SnapshotsActionsTest-1017379468 None] Delete snapshot completed successfully. Jul 10 04:40:17 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-e1faef0a-bb8c-4d53-aafe-1f5eeb14557f tempest-SnapshotsActionsTest-1017379468 None] Lock "cinder-36576e5b-0ae6-42cf-b588-9727aa156df2-delete_snapshot" released by "delete_snapshot" :: held 5.100s {{(pid=87444) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 04:40:17 devstack sudo[95811]: pam_unix(sudo:session): session closed for user root Jul 10 04:40:17 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-22cd898e-0d8d-4b04-aa41-e547b098b6c1 tempest-VolumeSnapshotQuotasNegativeTestJSON-181807343 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097" returned: 0 in 1.168s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:40:17 devstack cinder-volume[87444]: DEBUG cinder.manager [None req-22cd898e-0d8d-4b04-aa41-e547b098b6c1 tempest-VolumeSnapshotQuotasNegativeTestJSON-181807343 None] Notifying Schedulers of capabilities ... {{(pid=87444) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 04:40:17 devstack cinder-volume[87444]: INFO cinder.volume.manager [None req-22cd898e-0d8d-4b04-aa41-e547b098b6c1 tempest-VolumeSnapshotQuotasNegativeTestJSON-181807343 None] Deleted volume successfully. Jul 10 04:40:17 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-22cd898e-0d8d-4b04-aa41-e547b098b6c1 tempest-VolumeSnapshotQuotasNegativeTestJSON-181807343 None] Lock "cinder-9614de62-b2d8-4683-ae8a-ab76916738ea-delete_volume" released by "delete_volume" :: held 3.535s {{(pid=87444) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 04:40:18 devstack sudo[95814]: pam_unix(sudo:session): session closed for user root Jul 10 04:40:18 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-97b523c3-63b4-409d-a355-13e8411c6d90 tempest-GroupSnapshotsTest-544795304 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-93d7a24a-fb3e-4e4f-8763-c877812011be 1073741824" returned: 0 in 1.165s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:40:18 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-97b523c3-63b4-409d-a355-13e8411c6d90 tempest-GroupSnapshotsTest-544795304 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-93d7a24a-fb3e-4e4f-8763-c877812011be {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:40:18 devstack sudo[95823]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-93d7a24a-fb3e-4e4f-8763-c877812011be Jul 10 04:40:18 devstack sudo[95823]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:40:18 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-c9657ff7-d4ee-4b54-bafd-fcbd034921e2 tempest-SnapshotsActionsTest-1538729065 None] Acquiring lock "cinder-ee8c454a-c0ff-4b09-826b-830aa5ec0536-delete_snapshot" by "delete_snapshot" {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 04:40:18 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-c9657ff7-d4ee-4b54-bafd-fcbd034921e2 tempest-SnapshotsActionsTest-1538729065 None] Lock "cinder-ee8c454a-c0ff-4b09-826b-830aa5ec0536-delete_snapshot" acquired by "delete_snapshot" :: waited 0.031s {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 04:40:18 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-c9657ff7-d4ee-4b54-bafd-fcbd034921e2 tempest-SnapshotsActionsTest-1538729065 None] Acquiring lock "cinder-quobyte-cb9ba17f-166a-487b-bda4-b5f9b80b656d" by "delete_snapshot" {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 04:40:18 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-c9657ff7-d4ee-4b54-bafd-fcbd034921e2 tempest-SnapshotsActionsTest-1538729065 None] Lock "cinder-quobyte-cb9ba17f-166a-487b-bda4-b5f9b80b656d" acquired by "delete_snapshot" :: waited 0.038s {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 04:40:18 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-c9657ff7-d4ee-4b54-bafd-fcbd034921e2 tempest-SnapshotsActionsTest-1538729065 None] Acquiring lock "cinder-quobyte-ee8c454a-c0ff-4b09-826b-830aa5ec0536" by "_delete_snapshot" {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 04:40:18 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-c9657ff7-d4ee-4b54-bafd-fcbd034921e2 tempest-SnapshotsActionsTest-1538729065 None] Lock "cinder-quobyte-ee8c454a-c0ff-4b09-826b-830aa5ec0536" acquired by "_delete_snapshot" :: waited 0.025s {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 04:40:18 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.remotefs [None req-c9657ff7-d4ee-4b54-bafd-fcbd034921e2 tempest-SnapshotsActionsTest-1538729065 None] Deleting offline snapshot ee8c454a-c0ff-4b09-826b-830aa5ec0536 of volume cb9ba17f-166a-487b-bda4-b5f9b80b656d {{(pid=87444) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 10 04:40:18 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.remotefs [None req-c9657ff7-d4ee-4b54-bafd-fcbd034921e2 tempest-SnapshotsActionsTest-1538729065 None] snapshot_file for this snap is: volume-cb9ba17f-166a-487b-bda4-b5f9b80b656d.ee8c454a-c0ff-4b09-826b-830aa5ec0536 {{(pid=87444) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 10 04:40:18 devstack cinder-volume[87444]: DEBUG oslo.privsep.daemon [-] privsep: reply[c93fef2d-39dc-4c60-80bc-2f027b03a11d]: (4, 'qcow2') {{(pid=88499) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 04:40:18 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-c9657ff7-d4ee-4b54-bafd-fcbd034921e2 tempest-SnapshotsActionsTest-1538729065 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-cb9ba17f-166a-487b-bda4-b5f9b80b656d.ee8c454a-c0ff-4b09-826b-830aa5ec0536 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:40:18 devstack sudo[95825]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-cb9ba17f-166a-487b-bda4-b5f9b80b656d.ee8c454a-c0ff-4b09-826b-830aa5ec0536 Jul 10 04:40:18 devstack sudo[95825]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:40:19 devstack sudo[95823]: pam_unix(sudo:session): session closed for user root Jul 10 04:40:19 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-97b523c3-63b4-409d-a355-13e8411c6d90 tempest-GroupSnapshotsTest-544795304 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-93d7a24a-fb3e-4e4f-8763-c877812011be" returned: 0 in 0.859s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:40:19 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-97b523c3-63b4-409d-a355-13e8411c6d90 tempest-GroupSnapshotsTest-544795304 None] <== create_volume: return (2094ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922'} {{(pid=87444) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 04:40:19 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-97b523c3-63b4-409d-a355-13e8411c6d90 tempest-GroupSnapshotsTest-544795304 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.097s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 04:40:19 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-97b523c3-63b4-409d-a355-13e8411c6d90 tempest-GroupSnapshotsTest-544795304 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (50afa6ae-7346-4be2-86d3-b9d3147c1efe) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-93d7a24a-fb3e-4e4f-8763-c877812011be', 'volume_size': 1}' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:40:19 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-97b523c3-63b4-409d-a355-13e8411c6d90 tempest-GroupSnapshotsTest-544795304 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b77fdbaf-0e86-43d2-9cf1-f508c5790fc9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:40:19 devstack cinder-volume[87444]: INFO cinder.volume.flows.manager.create_volume [None req-97b523c3-63b4-409d-a355-13e8411c6d90 tempest-GroupSnapshotsTest-544795304 None] Volume volume-93d7a24a-fb3e-4e4f-8763-c877812011be (93d7a24a-fb3e-4e4f-8763-c877812011be): created successfully Jul 10 04:40:19 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-97b523c3-63b4-409d-a355-13e8411c6d90 tempest-GroupSnapshotsTest-544795304 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b77fdbaf-0e86-43d2-9cf1-f508c5790fc9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:40:19 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-97b523c3-63b4-409d-a355-13e8411c6d90 tempest-GroupSnapshotsTest-544795304 None] Flow 'volume_create_manager' (2e081f45-5f9f-4e7d-9330-890ca561d29e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87444) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 04:40:19 devstack cinder-volume[87444]: INFO cinder.volume.manager [None req-97b523c3-63b4-409d-a355-13e8411c6d90 tempest-GroupSnapshotsTest-544795304 None] Created volume successfully. Jul 10 04:40:19 devstack sudo[95825]: pam_unix(sudo:session): session closed for user root Jul 10 04:40:19 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-c9657ff7-d4ee-4b54-bafd-fcbd034921e2 tempest-SnapshotsActionsTest-1538729065 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-cb9ba17f-166a-487b-bda4-b5f9b80b656d.ee8c454a-c0ff-4b09-826b-830aa5ec0536" returned: 0 in 0.836s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:40:19 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.remotefs [None req-c9657ff7-d4ee-4b54-bafd-fcbd034921e2 tempest-SnapshotsActionsTest-1538729065 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-cb9ba17f-166a-487b-bda4-b5f9b80b656d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87444) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 10 04:40:19 devstack cinder-volume[87444]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1aec8f2-7e1a-4edf-8044-c60366081c0d]: (4, 'qcow2') {{(pid=88499) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 04:40:19 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-c9657ff7-d4ee-4b54-bafd-fcbd034921e2 tempest-SnapshotsActionsTest-1538729065 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-cb9ba17f-166a-487b-bda4-b5f9b80b656d {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:40:19 devstack sudo[95832]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-cb9ba17f-166a-487b-bda4-b5f9b80b656d Jul 10 04:40:19 devstack sudo[95832]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:40:20 devstack sudo[95832]: pam_unix(sudo:session): session closed for user root Jul 10 04:40:20 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-c9657ff7-d4ee-4b54-bafd-fcbd034921e2 tempest-SnapshotsActionsTest-1538729065 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-cb9ba17f-166a-487b-bda4-b5f9b80b656d" returned: 0 in 0.821s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:40:20 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-c9657ff7-d4ee-4b54-bafd-fcbd034921e2 tempest-SnapshotsActionsTest-1538729065 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-cb9ba17f-166a-487b-bda4-b5f9b80b656d.ee8c454a-c0ff-4b09-826b-830aa5ec0536 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:40:20 devstack sudo[95837]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-cb9ba17f-166a-487b-bda4-b5f9b80b656d.ee8c454a-c0ff-4b09-826b-830aa5ec0536 Jul 10 04:40:20 devstack sudo[95837]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:40:20 devstack cinder-volume[87444]: INFO cinder.volume.manager [None req-1a92d987-d1e9-4445-b8eb-e3f5c725e383 tempest-GroupSnapshotsTest-544795304 None] GroupSnapshot c040aece-f363-46cb-9ac2-e06939e72d96: creating. Jul 10 04:40:20 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-1a92d987-d1e9-4445-b8eb-e3f5c725e383 tempest-GroupSnapshotsTest-544795304 None] Group snapshot c040aece-f363-46cb-9ac2-e06939e72d96: creating. {{(pid=87444) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Jul 10 04:40:20 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-1a92d987-d1e9-4445-b8eb-e3f5c725e383 tempest-GroupSnapshotsTest-544795304 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 04:40:20 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-1a92d987-d1e9-4445-b8eb-e3f5c725e383 tempest-GroupSnapshotsTest-544795304 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 04:40:20 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.remotefs [None req-1a92d987-d1e9-4445-b8eb-e3f5c725e383 tempest-GroupSnapshotsTest-544795304 None] Creating offline snapshot 74eb307e-da88-4b53-a7a1-497fc7c74f28 of volume 93d7a24a-fb3e-4e4f-8763-c877812011be {{(pid=87444) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 10 04:40:20 devstack cinder-volume[87444]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7538604-ab9e-4ed9-959c-702e6e7f0176]: (4, 'qcow2') {{(pid=88499) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 04:40:20 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-1a92d987-d1e9-4445-b8eb-e3f5c725e383 tempest-GroupSnapshotsTest-544795304 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-93d7a24a-fb3e-4e4f-8763-c877812011be {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:40:20 devstack sudo[95842]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-93d7a24a-fb3e-4e4f-8763-c877812011be Jul 10 04:40:20 devstack sudo[95842]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:40:21 devstack sudo[95837]: pam_unix(sudo:session): session closed for user root Jul 10 04:40:21 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-c9657ff7-d4ee-4b54-bafd-fcbd034921e2 tempest-SnapshotsActionsTest-1538729065 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-cb9ba17f-166a-487b-bda4-b5f9b80b656d.ee8c454a-c0ff-4b09-826b-830aa5ec0536" returned: 0 in 0.843s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:40:21 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-c9657ff7-d4ee-4b54-bafd-fcbd034921e2 tempest-SnapshotsActionsTest-1538729065 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-cb9ba17f-166a-487b-bda4-b5f9b80b656d.ee8c454a-c0ff-4b09-826b-830aa5ec0536 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:40:21 devstack sudo[95845]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-cb9ba17f-166a-487b-bda4-b5f9b80b656d.ee8c454a-c0ff-4b09-826b-830aa5ec0536 Jul 10 04:40:21 devstack sudo[95845]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:40:21 devstack sudo[95842]: pam_unix(sudo:session): session closed for user root Jul 10 04:40:21 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-1a92d987-d1e9-4445-b8eb-e3f5c725e383 tempest-GroupSnapshotsTest-544795304 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-93d7a24a-fb3e-4e4f-8763-c877812011be" returned: 0 in 0.849s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:40:21 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-1a92d987-d1e9-4445-b8eb-e3f5c725e383 tempest-GroupSnapshotsTest-544795304 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-93d7a24a-fb3e-4e4f-8763-c877812011be,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-93d7a24a-fb3e-4e4f-8763-c877812011be.74eb307e-da88-4b53-a7a1-497fc7c74f28 1G {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:40:21 devstack sudo[95851]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-93d7a24a-fb3e-4e4f-8763-c877812011be,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-93d7a24a-fb3e-4e4f-8763-c877812011be.74eb307e-da88-4b53-a7a1-497fc7c74f28 1G Jul 10 04:40:21 devstack sudo[95851]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:40:21 devstack sudo[95845]: pam_unix(sudo:session): session closed for user root Jul 10 04:40:21 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-c9657ff7-d4ee-4b54-bafd-fcbd034921e2 tempest-SnapshotsActionsTest-1538729065 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-cb9ba17f-166a-487b-bda4-b5f9b80b656d.ee8c454a-c0ff-4b09-826b-830aa5ec0536" returned: 0 in 0.710s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:40:21 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-c9657ff7-d4ee-4b54-bafd-fcbd034921e2 tempest-SnapshotsActionsTest-1538729065 None] Lock "cinder-quobyte-ee8c454a-c0ff-4b09-826b-830aa5ec0536" released by "_delete_snapshot" :: held 3.353s {{(pid=87444) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 04:40:21 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-c9657ff7-d4ee-4b54-bafd-fcbd034921e2 tempest-SnapshotsActionsTest-1538729065 None] Lock "cinder-quobyte-cb9ba17f-166a-487b-bda4-b5f9b80b656d" released by "delete_snapshot" :: held 3.390s {{(pid=87444) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 04:40:21 devstack cinder-volume[87444]: DEBUG cinder.quota [None req-c9657ff7-d4ee-4b54-bafd-fcbd034921e2 tempest-SnapshotsActionsTest-1538729065 None] Created reservations ['d623e848-b5ae-4a8a-8f69-0c53cfd3e544', 'bea442ea-2d47-468f-b66b-2861a559a157', '32b4d3e7-dbe1-407d-b01a-3e2d962aac21', '703a11a1-5369-4625-ae94-7dc1ac85ef98'] {{(pid=87444) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 04:40:21 devstack cinder-volume[87444]: INFO cinder.volume.manager [None req-c9657ff7-d4ee-4b54-bafd-fcbd034921e2 tempest-SnapshotsActionsTest-1538729065 None] Delete snapshot completed successfully. Jul 10 04:40:21 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-c9657ff7-d4ee-4b54-bafd-fcbd034921e2 tempest-SnapshotsActionsTest-1538729065 None] Lock "cinder-ee8c454a-c0ff-4b09-826b-830aa5ec0536-delete_snapshot" released by "delete_snapshot" :: held 3.553s {{(pid=87444) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 04:40:22 devstack sudo[95851]: pam_unix(sudo:session): session closed for user root Jul 10 04:40:22 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-1a92d987-d1e9-4445-b8eb-e3f5c725e383 tempest-GroupSnapshotsTest-544795304 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-93d7a24a-fb3e-4e4f-8763-c877812011be,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-93d7a24a-fb3e-4e4f-8763-c877812011be.74eb307e-da88-4b53-a7a1-497fc7c74f28 1G" returned: 0 in 0.850s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:40:22 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-1a92d987-d1e9-4445-b8eb-e3f5c725e383 tempest-GroupSnapshotsTest-544795304 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-93d7a24a-fb3e-4e4f-8763-c877812011be -F qcow2 /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-93d7a24a-fb3e-4e4f-8763-c877812011be.74eb307e-da88-4b53-a7a1-497fc7c74f28 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:40:22 devstack sudo[95857]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-93d7a24a-fb3e-4e4f-8763-c877812011be -F qcow2 /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-93d7a24a-fb3e-4e4f-8763-c877812011be.74eb307e-da88-4b53-a7a1-497fc7c74f28 Jul 10 04:40:22 devstack sudo[95857]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:40:22 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-cc97be51-52d0-4cc3-a906-c55b78454b56 tempest-SnapshotsActionsTest-1538729065 None] Acquiring lock "cinder-cb9ba17f-166a-487b-bda4-b5f9b80b656d-delete_volume" by "delete_volume" {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 04:40:22 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-cc97be51-52d0-4cc3-a906-c55b78454b56 tempest-SnapshotsActionsTest-1538729065 None] Lock "cinder-cb9ba17f-166a-487b-bda4-b5f9b80b656d-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 04:40:22 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-cc97be51-52d0-4cc3-a906-c55b78454b56 tempest-SnapshotsActionsTest-1538729065 None] Acquiring lock "cinder-quobyte-cb9ba17f-166a-487b-bda4-b5f9b80b656d" by "delete_volume" {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 04:40:23 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-cc97be51-52d0-4cc3-a906-c55b78454b56 tempest-SnapshotsActionsTest-1538729065 None] Lock "cinder-quobyte-cb9ba17f-166a-487b-bda4-b5f9b80b656d" acquired by "delete_volume" :: waited 0.036s {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 04:40:23 devstack cinder-volume[87444]: DEBUG oslo.privsep.daemon [-] privsep: reply[e80de518-8c49-48f3-99c0-f2692664f25f]: (4, 'qcow2') {{(pid=88499) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 04:40:23 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-cc97be51-52d0-4cc3-a906-c55b78454b56 tempest-SnapshotsActionsTest-1538729065 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-cb9ba17f-166a-487b-bda4-b5f9b80b656d {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:40:23 devstack sudo[95860]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-cb9ba17f-166a-487b-bda4-b5f9b80b656d Jul 10 04:40:23 devstack sudo[95860]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:40:23 devstack sudo[95857]: pam_unix(sudo:session): session closed for user root Jul 10 04:40:23 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-1a92d987-d1e9-4445-b8eb-e3f5c725e383 tempest-GroupSnapshotsTest-544795304 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-93d7a24a-fb3e-4e4f-8763-c877812011be -F qcow2 /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-93d7a24a-fb3e-4e4f-8763-c877812011be.74eb307e-da88-4b53-a7a1-497fc7c74f28" returned: 0 in 0.865s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:40:23 devstack cinder-volume[87444]: WARNING cinder.volume.drivers.remotefs [None req-1a92d987-d1e9-4445-b8eb-e3f5c725e383 tempest-GroupSnapshotsTest-544795304 None] /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-93d7a24a-fb3e-4e4f-8763-c877812011be.74eb307e-da88-4b53-a7a1-497fc7c74f28 is being set with open permissions: ugo+rw: NotImplementedError Jul 10 04:40:23 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-1a92d987-d1e9-4445-b8eb-e3f5c725e383 tempest-GroupSnapshotsTest-544795304 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-93d7a24a-fb3e-4e4f-8763-c877812011be.74eb307e-da88-4b53-a7a1-497fc7c74f28 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:40:23 devstack sudo[95866]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-93d7a24a-fb3e-4e4f-8763-c877812011be.74eb307e-da88-4b53-a7a1-497fc7c74f28 Jul 10 04:40:23 devstack sudo[95866]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:40:24 devstack sudo[95860]: pam_unix(sudo:session): session closed for user root Jul 10 04:40:24 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-cc97be51-52d0-4cc3-a906-c55b78454b56 tempest-SnapshotsActionsTest-1538729065 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-cb9ba17f-166a-487b-bda4-b5f9b80b656d" returned: 0 in 1.194s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:40:24 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-cc97be51-52d0-4cc3-a906-c55b78454b56 tempest-SnapshotsActionsTest-1538729065 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-cb9ba17f-166a-487b-bda4-b5f9b80b656d {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:40:24 devstack sudo[95874]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-cb9ba17f-166a-487b-bda4-b5f9b80b656d Jul 10 04:40:24 devstack sudo[95874]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:40:24 devstack sudo[95866]: pam_unix(sudo:session): session closed for user root Jul 10 04:40:24 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-1a92d987-d1e9-4445-b8eb-e3f5c725e383 tempest-GroupSnapshotsTest-544795304 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-93d7a24a-fb3e-4e4f-8763-c877812011be.74eb307e-da88-4b53-a7a1-497fc7c74f28" returned: 0 in 0.942s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:40:24 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-1a92d987-d1e9-4445-b8eb-e3f5c725e383 tempest-GroupSnapshotsTest-544795304 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-93d7a24a-fb3e-4e4f-8763-c877812011be.info {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:40:24 devstack sudo[95876]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-93d7a24a-fb3e-4e4f-8763-c877812011be.info Jul 10 04:40:24 devstack sudo[95876]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:40:25 devstack sudo[95874]: pam_unix(sudo:session): session closed for user root Jul 10 04:40:25 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-cc97be51-52d0-4cc3-a906-c55b78454b56 tempest-SnapshotsActionsTest-1538729065 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-cb9ba17f-166a-487b-bda4-b5f9b80b656d" returned: 0 in 0.966s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:40:25 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-cc97be51-52d0-4cc3-a906-c55b78454b56 tempest-SnapshotsActionsTest-1538729065 None] Lock "cinder-quobyte-cb9ba17f-166a-487b-bda4-b5f9b80b656d" released by "delete_volume" :: held 2.291s {{(pid=87444) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 04:40:25 devstack cinder-volume[87444]: DEBUG cinder.quota [None req-cc97be51-52d0-4cc3-a906-c55b78454b56 tempest-SnapshotsActionsTest-1538729065 None] Created reservations ['563cead3-d10f-4751-9535-a689ee7f113c', '532a0d19-968f-43e8-b14d-c71c562b6b48', 'f6c38adc-3879-4897-abf3-7a2fef7aa09f', 'e2089205-acc5-4636-95e8-101315def6e3'] {{(pid=87444) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 04:40:25 devstack sudo[95876]: pam_unix(sudo:session): session closed for user root Jul 10 04:40:25 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-1a92d987-d1e9-4445-b8eb-e3f5c725e383 tempest-GroupSnapshotsTest-544795304 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-93d7a24a-fb3e-4e4f-8763-c877812011be.info" returned: 0 in 1.055s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:40:25 devstack cinder-volume[87444]: WARNING cinder.volume.drivers.remotefs [None req-1a92d987-d1e9-4445-b8eb-e3f5c725e383 tempest-GroupSnapshotsTest-544795304 None] /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-93d7a24a-fb3e-4e4f-8763-c877812011be.info is being set with open permissions: ugo+rw: NotImplementedError Jul 10 04:40:25 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-1a92d987-d1e9-4445-b8eb-e3f5c725e383 tempest-GroupSnapshotsTest-544795304 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-93d7a24a-fb3e-4e4f-8763-c877812011be.info {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:40:25 devstack sudo[95894]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-93d7a24a-fb3e-4e4f-8763-c877812011be.info Jul 10 04:40:25 devstack sudo[95894]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:40:25 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-cc97be51-52d0-4cc3-a906-c55b78454b56 tempest-SnapshotsActionsTest-1538729065 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 04:40:25 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-cc97be51-52d0-4cc3-a906-c55b78454b56 tempest-SnapshotsActionsTest-1538729065 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 04:40:25 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-cc97be51-52d0-4cc3-a906-c55b78454b56 tempest-SnapshotsActionsTest-1538729065 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922': None} {{(pid=87444) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 04:40:25 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-cc97be51-52d0-4cc3-a906-c55b78454b56 tempest-SnapshotsActionsTest-1538729065 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922'] {{(pid=87444) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 04:40:25 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-cc97be51-52d0-4cc3-a906-c55b78454b56 tempest-SnapshotsActionsTest-1538729065 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 04:40:25 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-cc97be51-52d0-4cc3-a906-c55b78454b56 tempest-SnapshotsActionsTest-1538729065 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:40:25 devstack sudo[95896]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097 Jul 10 04:40:25 devstack sudo[95896]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:40:26 devstack sudo[95894]: pam_unix(sudo:session): session closed for user root Jul 10 04:40:26 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-1a92d987-d1e9-4445-b8eb-e3f5c725e383 tempest-GroupSnapshotsTest-544795304 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-93d7a24a-fb3e-4e4f-8763-c877812011be.info" returned: 0 in 0.807s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:40:26 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-1a92d987-d1e9-4445-b8eb-e3f5c725e383 tempest-GroupSnapshotsTest-544795304 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.470s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 04:40:26 devstack sudo[95896]: pam_unix(sudo:session): session closed for user root Jul 10 04:40:26 devstack cinder-volume[87444]: INFO cinder.volume.manager [None req-1a92d987-d1e9-4445-b8eb-e3f5c725e383 tempest-GroupSnapshotsTest-544795304 None] group_snapshot c040aece-f363-46cb-9ac2-e06939e72d96: created successfully Jul 10 04:40:26 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-cc97be51-52d0-4cc3-a906-c55b78454b56 tempest-SnapshotsActionsTest-1538729065 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097" returned: 0 in 0.812s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:40:26 devstack cinder-volume[87444]: DEBUG cinder.manager [None req-cc97be51-52d0-4cc3-a906-c55b78454b56 tempest-SnapshotsActionsTest-1538729065 None] Notifying Schedulers of capabilities ... {{(pid=87444) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 04:40:26 devstack cinder-volume[87444]: INFO cinder.volume.manager [None req-cc97be51-52d0-4cc3-a906-c55b78454b56 tempest-SnapshotsActionsTest-1538729065 None] Deleted volume successfully. Jul 10 04:40:26 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-cc97be51-52d0-4cc3-a906-c55b78454b56 tempest-SnapshotsActionsTest-1538729065 None] Lock "cinder-cb9ba17f-166a-487b-bda4-b5f9b80b656d-delete_volume" released by "delete_volume" :: held 3.500s {{(pid=87444) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 04:40:27 devstack cinder-volume[87444]: INFO cinder.volume.manager [None req-25439069-f10b-49ac-82ee-39c37c9015ea tempest-GroupSnapshotsTest-544795304 None] group_snapshot c040aece-f363-46cb-9ac2-e06939e72d96: deleting Jul 10 04:40:27 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-25439069-f10b-49ac-82ee-39c37c9015ea tempest-GroupSnapshotsTest-544795304 None] group_snapshot c040aece-f363-46cb-9ac2-e06939e72d96: deleting {{(pid=87444) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Jul 10 04:40:27 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-25439069-f10b-49ac-82ee-39c37c9015ea tempest-GroupSnapshotsTest-544795304 None] Acquiring lock "cinder-quobyte-93d7a24a-fb3e-4e4f-8763-c877812011be" by "delete_snapshot" {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 04:40:27 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-25439069-f10b-49ac-82ee-39c37c9015ea tempest-GroupSnapshotsTest-544795304 None] Lock "cinder-quobyte-93d7a24a-fb3e-4e4f-8763-c877812011be" acquired by "delete_snapshot" :: waited 0.024s {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 04:40:27 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-25439069-f10b-49ac-82ee-39c37c9015ea tempest-GroupSnapshotsTest-544795304 None] Acquiring lock "cinder-quobyte-74eb307e-da88-4b53-a7a1-497fc7c74f28" by "_delete_snapshot" {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 04:40:27 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-25439069-f10b-49ac-82ee-39c37c9015ea tempest-GroupSnapshotsTest-544795304 None] Lock "cinder-quobyte-74eb307e-da88-4b53-a7a1-497fc7c74f28" acquired by "_delete_snapshot" :: waited 0.029s {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 04:40:27 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.remotefs [None req-25439069-f10b-49ac-82ee-39c37c9015ea tempest-GroupSnapshotsTest-544795304 None] Deleting offline snapshot 74eb307e-da88-4b53-a7a1-497fc7c74f28 of volume 93d7a24a-fb3e-4e4f-8763-c877812011be {{(pid=87444) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 10 04:40:27 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.remotefs [None req-25439069-f10b-49ac-82ee-39c37c9015ea tempest-GroupSnapshotsTest-544795304 None] snapshot_file for this snap is: volume-93d7a24a-fb3e-4e4f-8763-c877812011be.74eb307e-da88-4b53-a7a1-497fc7c74f28 {{(pid=87444) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 10 04:40:27 devstack cinder-volume[87444]: DEBUG oslo.privsep.daemon [-] privsep: reply[167e1340-eba8-44f0-8862-6ca1273d0459]: (4, 'qcow2') {{(pid=88499) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 04:40:27 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-25439069-f10b-49ac-82ee-39c37c9015ea tempest-GroupSnapshotsTest-544795304 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-93d7a24a-fb3e-4e4f-8763-c877812011be.74eb307e-da88-4b53-a7a1-497fc7c74f28 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:40:27 devstack sudo[95902]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-93d7a24a-fb3e-4e4f-8763-c877812011be.74eb307e-da88-4b53-a7a1-497fc7c74f28 Jul 10 04:40:27 devstack sudo[95902]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:40:28 devstack sudo[95902]: pam_unix(sudo:session): session closed for user root Jul 10 04:40:28 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-25439069-f10b-49ac-82ee-39c37c9015ea tempest-GroupSnapshotsTest-544795304 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-93d7a24a-fb3e-4e4f-8763-c877812011be.74eb307e-da88-4b53-a7a1-497fc7c74f28" returned: 0 in 0.958s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:40:28 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.remotefs [None req-25439069-f10b-49ac-82ee-39c37c9015ea tempest-GroupSnapshotsTest-544795304 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-93d7a24a-fb3e-4e4f-8763-c877812011be(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87444) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 10 04:40:28 devstack cinder-volume[87444]: DEBUG oslo.privsep.daemon [-] privsep: reply[f713dd08-aea9-4b21-b62e-cb831a7f72d1]: (4, 'qcow2') {{(pid=88499) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 04:40:28 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-25439069-f10b-49ac-82ee-39c37c9015ea tempest-GroupSnapshotsTest-544795304 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-93d7a24a-fb3e-4e4f-8763-c877812011be {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:40:28 devstack sudo[95907]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-93d7a24a-fb3e-4e4f-8763-c877812011be Jul 10 04:40:28 devstack sudo[95907]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:40:30 devstack sudo[95907]: pam_unix(sudo:session): session closed for user root Jul 10 04:40:30 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-25439069-f10b-49ac-82ee-39c37c9015ea tempest-GroupSnapshotsTest-544795304 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-93d7a24a-fb3e-4e4f-8763-c877812011be" returned: 0 in 1.544s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:40:30 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-25439069-f10b-49ac-82ee-39c37c9015ea tempest-GroupSnapshotsTest-544795304 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-93d7a24a-fb3e-4e4f-8763-c877812011be.74eb307e-da88-4b53-a7a1-497fc7c74f28 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:40:30 devstack sudo[95992]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-93d7a24a-fb3e-4e4f-8763-c877812011be.74eb307e-da88-4b53-a7a1-497fc7c74f28 Jul 10 04:40:30 devstack sudo[95992]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:40:31 devstack sudo[95992]: pam_unix(sudo:session): session closed for user root Jul 10 04:40:31 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-25439069-f10b-49ac-82ee-39c37c9015ea tempest-GroupSnapshotsTest-544795304 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-93d7a24a-fb3e-4e4f-8763-c877812011be.74eb307e-da88-4b53-a7a1-497fc7c74f28" returned: 0 in 1.046s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:40:31 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-25439069-f10b-49ac-82ee-39c37c9015ea tempest-GroupSnapshotsTest-544795304 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-93d7a24a-fb3e-4e4f-8763-c877812011be.74eb307e-da88-4b53-a7a1-497fc7c74f28 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:40:31 devstack sudo[96020]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-93d7a24a-fb3e-4e4f-8763-c877812011be.74eb307e-da88-4b53-a7a1-497fc7c74f28 Jul 10 04:40:31 devstack sudo[96020]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:40:32 devstack sudo[96020]: pam_unix(sudo:session): session closed for user root Jul 10 04:40:32 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-25439069-f10b-49ac-82ee-39c37c9015ea tempest-GroupSnapshotsTest-544795304 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-93d7a24a-fb3e-4e4f-8763-c877812011be.74eb307e-da88-4b53-a7a1-497fc7c74f28" returned: 0 in 0.849s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:40:32 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-25439069-f10b-49ac-82ee-39c37c9015ea tempest-GroupSnapshotsTest-544795304 None] Lock "cinder-quobyte-74eb307e-da88-4b53-a7a1-497fc7c74f28" released by "_delete_snapshot" :: held 4.561s {{(pid=87444) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 04:40:32 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-25439069-f10b-49ac-82ee-39c37c9015ea tempest-GroupSnapshotsTest-544795304 None] Lock "cinder-quobyte-93d7a24a-fb3e-4e4f-8763-c877812011be" released by "delete_snapshot" :: held 4.605s {{(pid=87444) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 04:40:32 devstack cinder-volume[87444]: WARNING cinder.quota [None req-25439069-f10b-49ac-82ee-39c37c9015ea tempest-GroupSnapshotsTest-544795304 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-952844543 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-952844543, it is now deprecated. Please use the default quota class for default quota. Jul 10 04:40:32 devstack cinder-volume[87444]: WARNING cinder.quota [None req-25439069-f10b-49ac-82ee-39c37c9015ea tempest-GroupSnapshotsTest-544795304 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-952844543 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-952844543, it is now deprecated. Please use the default quota class for default quota. Jul 10 04:40:32 devstack cinder-volume[87444]: DEBUG cinder.quota [None req-25439069-f10b-49ac-82ee-39c37c9015ea tempest-GroupSnapshotsTest-544795304 None] Created reservations ['461798e8-bd51-4e0f-bbc2-d2f3d30d8147', 'babe114c-ffa8-4c3d-a91a-065e3cde770b', '27bec634-aa41-49f9-8e17-8ba0ee4437ee', 'f044437f-ef46-48d3-84ac-50379fd31f51'] {{(pid=87444) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 04:40:32 devstack cinder-volume[87444]: INFO cinder.volume.manager [None req-25439069-f10b-49ac-82ee-39c37c9015ea tempest-GroupSnapshotsTest-544795304 None] group_snapshot c040aece-f363-46cb-9ac2-e06939e72d96: deleted successfully Jul 10 04:40:32 devstack cinder-volume[87444]: DEBUG oslo_service.periodic_task [None req-01f0ce3e-6850-4e14-881d-e40d3c4ad6e5 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87444) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 10 04:40:32 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-01f0ce3e-6850-4e14-881d-e40d3c4ad6e5 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 04:40:33 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-01f0ce3e-6850-4e14-881d-e40d3c4ad6e5 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 04:40:33 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-01f0ce3e-6850-4e14-881d-e40d3c4ad6e5 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922': None} {{(pid=87444) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 04:40:33 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-01f0ce3e-6850-4e14-881d-e40d3c4ad6e5 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922'] {{(pid=87444) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 04:40:33 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-01f0ce3e-6850-4e14-881d-e40d3c4ad6e5 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 04:40:33 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-01f0ce3e-6850-4e14-881d-e40d3c4ad6e5 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:40:33 devstack sudo[96026]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097 Jul 10 04:40:33 devstack sudo[96026]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:40:33 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-518a0862-ee71-4646-bfe3-0a3249e67570 tempest-GroupSnapshotsTest-544795304 None] Acquiring lock "cinder-quobyte-93d7a24a-fb3e-4e4f-8763-c877812011be" by "delete_volume" {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 04:40:33 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-518a0862-ee71-4646-bfe3-0a3249e67570 tempest-GroupSnapshotsTest-544795304 None] Lock "cinder-quobyte-93d7a24a-fb3e-4e4f-8763-c877812011be" acquired by "delete_volume" :: waited 0.020s {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 04:40:33 devstack cinder-volume[87444]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a76cdc6-0598-48fb-ba12-1aa528911749]: (4, 'qcow2') {{(pid=88499) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 04:40:33 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-518a0862-ee71-4646-bfe3-0a3249e67570 tempest-GroupSnapshotsTest-544795304 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-93d7a24a-fb3e-4e4f-8763-c877812011be {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:40:34 devstack sudo[96028]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-93d7a24a-fb3e-4e4f-8763-c877812011be Jul 10 04:40:34 devstack sudo[96028]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:40:34 devstack sudo[96026]: pam_unix(sudo:session): session closed for user root Jul 10 04:40:34 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-01f0ce3e-6850-4e14-881d-e40d3c4ad6e5 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097" returned: 0 in 1.506s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:40:34 devstack cinder-volume[87444]: DEBUG cinder.manager [None req-01f0ce3e-6850-4e14-881d-e40d3c4ad6e5 None None] Notifying Schedulers of capabilities ... {{(pid=87444) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 04:40:34 devstack cinder-volume[87444]: DEBUG oslo_service.periodic_task [None req-01f0ce3e-6850-4e14-881d-e40d3c4ad6e5 None None] Running periodic task VolumeManager._thread_info {{(pid=87444) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 10 04:40:34 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-01f0ce3e-6850-4e14-881d-e40d3c4ad6e5 None None] thread count: 8 {{(pid=87444) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 10 04:40:34 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-01f0ce3e-6850-4e14-881d-e40d3c4ad6e5 None None] thread info: [<_MainThread(MainThread, started 126839257915520)>, , , , , , , ] {{(pid=87444) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 10 04:40:35 devstack sudo[96028]: pam_unix(sudo:session): session closed for user root Jul 10 04:40:35 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-518a0862-ee71-4646-bfe3-0a3249e67570 tempest-GroupSnapshotsTest-544795304 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-93d7a24a-fb3e-4e4f-8763-c877812011be" returned: 0 in 1.538s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:40:35 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-518a0862-ee71-4646-bfe3-0a3249e67570 tempest-GroupSnapshotsTest-544795304 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-93d7a24a-fb3e-4e4f-8763-c877812011be {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:40:35 devstack sudo[96035]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-93d7a24a-fb3e-4e4f-8763-c877812011be Jul 10 04:40:35 devstack sudo[96035]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:40:35 devstack cinder-volume[87444]: DEBUG cinder.volume.flows.manager.create_volume [None req-531ca2be-8b39-40cf-b94c-a66b8b195ff3 tempest-VolumesActionsTest-249281332 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87444) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 04:40:35 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-531ca2be-8b39-40cf-b94c-a66b8b195ff3 tempest-VolumesActionsTest-249281332 None] Flow 'volume_create_manager' (5957196f-9857-4832-91c7-586cf82f1164) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 04:40:35 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-531ca2be-8b39-40cf-b94c-a66b8b195ff3 tempest-VolumesActionsTest-249281332 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (845289cd-ad61-45ac-8b2f-dfda28c9434a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:40:35 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-531ca2be-8b39-40cf-b94c-a66b8b195ff3 tempest-VolumesActionsTest-249281332 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (845289cd-ad61-45ac-8b2f-dfda28c9434a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T02:40:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-834994545',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=505938b1-7c42-4d37-a4cd-c9a23268684c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8896182fdfb44908ba0a8d3405add17a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T02:40:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T02:40:35Z,use_quota=True,user_id='439be0ce5a464a3c827a628503ea0e00',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(317e369e-1e06-434d-ae95-a335f0e6c903),volume_type_id=317e369e-1e06-434d-ae95-a335f0e6c903)' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:40:35 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-531ca2be-8b39-40cf-b94c-a66b8b195ff3 tempest-VolumesActionsTest-249281332 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d0d5eb1c-1920-4237-a545-090da1fe94d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:40:35 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-531ca2be-8b39-40cf-b94c-a66b8b195ff3 tempest-VolumesActionsTest-249281332 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d0d5eb1c-1920-4237-a545-090da1fe94d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:40:35 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-531ca2be-8b39-40cf-b94c-a66b8b195ff3 tempest-VolumesActionsTest-249281332 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ec747115-faaf-4532-86cb-261e4f4a7943) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:40:35 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-531ca2be-8b39-40cf-b94c-a66b8b195ff3 tempest-VolumesActionsTest-249281332 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ec747115-faaf-4532-86cb-261e4f4a7943) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '505938b1-7c42-4d37-a4cd-c9a23268684c', 'volume_name': 'volume-505938b1-7c42-4d37-a4cd-c9a23268684c', 'volume_size': 1}' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:40:35 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-531ca2be-8b39-40cf-b94c-a66b8b195ff3 tempest-VolumesActionsTest-249281332 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c8210f13-d529-4ee6-86e9-02393678e61e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:40:35 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-531ca2be-8b39-40cf-b94c-a66b8b195ff3 tempest-VolumesActionsTest-249281332 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c8210f13-d529-4ee6-86e9-02393678e61e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:40:35 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-531ca2be-8b39-40cf-b94c-a66b8b195ff3 tempest-VolumesActionsTest-249281332 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fe5b6879-af8a-4174-aac9-6e8a0a2f7614) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:40:35 devstack cinder-volume[87444]: INFO cinder.volume.flows.manager.create_volume [None req-531ca2be-8b39-40cf-b94c-a66b8b195ff3 tempest-VolumesActionsTest-249281332 None] Volume 505938b1-7c42-4d37-a4cd-c9a23268684c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-505938b1-7c42-4d37-a4cd-c9a23268684c', 'volume_size': 1} Jul 10 04:40:35 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-531ca2be-8b39-40cf-b94c-a66b8b195ff3 tempest-VolumesActionsTest-249281332 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 04:40:35 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-531ca2be-8b39-40cf-b94c-a66b8b195ff3 tempest-VolumesActionsTest-249281332 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 04:40:35 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-531ca2be-8b39-40cf-b94c-a66b8b195ff3 tempest-VolumesActionsTest-249281332 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T02:40:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-834994545',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=505938b1-7c42-4d37-a4cd-c9a23268684c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8896182fdfb44908ba0a8d3405add17a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T02:40:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T02:40:35Z,use_quota=True,user_id='439be0ce5a464a3c827a628503ea0e00',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(317e369e-1e06-434d-ae95-a335f0e6c903),volume_type_id=317e369e-1e06-434d-ae95-a335f0e6c903)}" {{(pid=87444) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 04:40:35 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.remotefs [None req-531ca2be-8b39-40cf-b94c-a66b8b195ff3 tempest-VolumesActionsTest-249281332 None] Creating volume 505938b1-7c42-4d37-a4cd-c9a23268684c {{(pid=87444) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 04:40:35 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-531ca2be-8b39-40cf-b94c-a66b8b195ff3 tempest-VolumesActionsTest-249281332 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 04:40:35 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-531ca2be-8b39-40cf-b94c-a66b8b195ff3 tempest-VolumesActionsTest-249281332 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 04:40:35 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-531ca2be-8b39-40cf-b94c-a66b8b195ff3 tempest-VolumesActionsTest-249281332 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922': None} {{(pid=87444) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 04:40:35 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-531ca2be-8b39-40cf-b94c-a66b8b195ff3 tempest-VolumesActionsTest-249281332 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922'] {{(pid=87444) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 04:40:35 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-531ca2be-8b39-40cf-b94c-a66b8b195ff3 tempest-VolumesActionsTest-249281332 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 04:40:35 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-531ca2be-8b39-40cf-b94c-a66b8b195ff3 tempest-VolumesActionsTest-249281332 None] Selected osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922 as target Quobyte volume. {{(pid=87444) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 04:40:35 devstack cinder-volume[87444]: INFO cinder.volume.drivers.remotefs [None req-531ca2be-8b39-40cf-b94c-a66b8b195ff3 tempest-VolumesActionsTest-249281332 None] casted to osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922 Jul 10 04:40:35 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-531ca2be-8b39-40cf-b94c-a66b8b195ff3 tempest-VolumesActionsTest-249281332 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-505938b1-7c42-4d37-a4cd-c9a23268684c 1073741824 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:40:35 devstack sudo[96037]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-505938b1-7c42-4d37-a4cd-c9a23268684c 1073741824 Jul 10 04:40:35 devstack sudo[96037]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:40:36 devstack sudo[96035]: pam_unix(sudo:session): session closed for user root Jul 10 04:40:36 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-518a0862-ee71-4646-bfe3-0a3249e67570 tempest-GroupSnapshotsTest-544795304 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-93d7a24a-fb3e-4e4f-8763-c877812011be" returned: 0 in 1.118s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:40:36 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-518a0862-ee71-4646-bfe3-0a3249e67570 tempest-GroupSnapshotsTest-544795304 None] Lock "cinder-quobyte-93d7a24a-fb3e-4e4f-8763-c877812011be" released by "delete_volume" :: held 2.841s {{(pid=87444) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 04:40:36 devstack cinder-volume[87444]: DEBUG cinder.quota [None req-518a0862-ee71-4646-bfe3-0a3249e67570 tempest-GroupSnapshotsTest-544795304 None] Created reservations ['ab368147-772b-4cd1-8c30-6fbdb53df6a2'] {{(pid=87444) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 04:40:36 devstack cinder-volume[87444]: WARNING cinder.quota [None req-518a0862-ee71-4646-bfe3-0a3249e67570 tempest-GroupSnapshotsTest-544795304 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-952844543 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-952844543, it is now deprecated. Please use the default quota class for default quota. Jul 10 04:40:36 devstack cinder-volume[87444]: DEBUG cinder.quota [None req-518a0862-ee71-4646-bfe3-0a3249e67570 tempest-GroupSnapshotsTest-544795304 None] Created reservations ['23cfe0a5-cec5-4d81-a44f-66616eb1412d', '911f4838-b7af-4217-a7aa-807f6b33ad38', '3224804e-21a8-42aa-afae-c2c8c7b6a682', 'a7b32ad3-993f-4c45-ab9e-73f86ffb12cf'] {{(pid=87444) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 04:40:36 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-518a0862-ee71-4646-bfe3-0a3249e67570 tempest-GroupSnapshotsTest-544795304 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 04:40:36 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-518a0862-ee71-4646-bfe3-0a3249e67570 tempest-GroupSnapshotsTest-544795304 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 04:40:36 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-518a0862-ee71-4646-bfe3-0a3249e67570 tempest-GroupSnapshotsTest-544795304 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922': None} {{(pid=87444) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 04:40:36 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-518a0862-ee71-4646-bfe3-0a3249e67570 tempest-GroupSnapshotsTest-544795304 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922'] {{(pid=87444) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 04:40:36 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-518a0862-ee71-4646-bfe3-0a3249e67570 tempest-GroupSnapshotsTest-544795304 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 04:40:36 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-518a0862-ee71-4646-bfe3-0a3249e67570 tempest-GroupSnapshotsTest-544795304 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:40:36 devstack sudo[96044]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097 Jul 10 04:40:36 devstack sudo[96044]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:40:36 devstack sudo[96037]: pam_unix(sudo:session): session closed for user root Jul 10 04:40:36 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-531ca2be-8b39-40cf-b94c-a66b8b195ff3 tempest-VolumesActionsTest-249281332 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-505938b1-7c42-4d37-a4cd-c9a23268684c 1073741824" returned: 0 in 1.402s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:40:36 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-531ca2be-8b39-40cf-b94c-a66b8b195ff3 tempest-VolumesActionsTest-249281332 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-505938b1-7c42-4d37-a4cd-c9a23268684c {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:40:37 devstack sudo[96046]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-505938b1-7c42-4d37-a4cd-c9a23268684c Jul 10 04:40:37 devstack sudo[96046]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:40:37 devstack sudo[96044]: pam_unix(sudo:session): session closed for user root Jul 10 04:40:37 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-518a0862-ee71-4646-bfe3-0a3249e67570 tempest-GroupSnapshotsTest-544795304 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097" returned: 0 in 1.019s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:40:37 devstack cinder-volume[87444]: DEBUG cinder.manager [None req-518a0862-ee71-4646-bfe3-0a3249e67570 tempest-GroupSnapshotsTest-544795304 None] Notifying Schedulers of capabilities ... {{(pid=87444) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 04:40:37 devstack cinder-volume[87444]: INFO cinder.volume.manager [None req-518a0862-ee71-4646-bfe3-0a3249e67570 tempest-GroupSnapshotsTest-544795304 None] Delete group completed successfully. Jul 10 04:40:38 devstack sudo[96046]: pam_unix(sudo:session): session closed for user root Jul 10 04:40:38 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-531ca2be-8b39-40cf-b94c-a66b8b195ff3 tempest-VolumesActionsTest-249281332 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-505938b1-7c42-4d37-a4cd-c9a23268684c" returned: 0 in 1.179s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:40:38 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-531ca2be-8b39-40cf-b94c-a66b8b195ff3 tempest-VolumesActionsTest-249281332 None] <== create_volume: return (2661ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922'} {{(pid=87444) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 04:40:38 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-531ca2be-8b39-40cf-b94c-a66b8b195ff3 tempest-VolumesActionsTest-249281332 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.665s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 04:40:38 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-531ca2be-8b39-40cf-b94c-a66b8b195ff3 tempest-VolumesActionsTest-249281332 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fe5b6879-af8a-4174-aac9-6e8a0a2f7614) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-505938b1-7c42-4d37-a4cd-c9a23268684c', 'volume_size': 1}' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:40:38 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-531ca2be-8b39-40cf-b94c-a66b8b195ff3 tempest-VolumesActionsTest-249281332 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (beeec72c-085b-4a6f-b3a0-276e8f2b3e4a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:40:38 devstack cinder-volume[87444]: INFO cinder.volume.flows.manager.create_volume [None req-531ca2be-8b39-40cf-b94c-a66b8b195ff3 tempest-VolumesActionsTest-249281332 None] Volume volume-505938b1-7c42-4d37-a4cd-c9a23268684c (505938b1-7c42-4d37-a4cd-c9a23268684c): created successfully Jul 10 04:40:38 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-531ca2be-8b39-40cf-b94c-a66b8b195ff3 tempest-VolumesActionsTest-249281332 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (beeec72c-085b-4a6f-b3a0-276e8f2b3e4a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:40:38 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-531ca2be-8b39-40cf-b94c-a66b8b195ff3 tempest-VolumesActionsTest-249281332 None] Flow 'volume_create_manager' (5957196f-9857-4832-91c7-586cf82f1164) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87444) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 04:40:38 devstack cinder-volume[87444]: INFO cinder.volume.manager [None req-531ca2be-8b39-40cf-b94c-a66b8b195ff3 tempest-VolumesActionsTest-249281332 None] Created volume successfully. Jul 10 04:40:38 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-652445af-f225-4d6a-810e-b4ee83cf8ff7 tempest-VolumesActionsTest-249281332 None] Acquiring lock "cinder-505938b1-7c42-4d37-a4cd-c9a23268684c" by "attach_volume" {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 04:40:38 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-652445af-f225-4d6a-810e-b4ee83cf8ff7 tempest-VolumesActionsTest-249281332 None] Lock "cinder-505938b1-7c42-4d37-a4cd-c9a23268684c" acquired by "attach_volume" :: waited 0.023s {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 04:40:38 devstack cinder-volume[87444]: INFO cinder.volume.manager [None req-652445af-f225-4d6a-810e-b4ee83cf8ff7 tempest-VolumesActionsTest-249281332 None] Attaching volume 505938b1-7c42-4d37-a4cd-c9a23268684c to instance 7b630857-87c5-4695-a8a5-40ca2c870409 at mountpoint /dev/vdb on host None. Jul 10 04:40:38 devstack cinder-volume[87444]: INFO cinder.volume.manager [None req-652445af-f225-4d6a-810e-b4ee83cf8ff7 tempest-VolumesActionsTest-249281332 None] Attach volume completed successfully. Jul 10 04:40:38 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-652445af-f225-4d6a-810e-b4ee83cf8ff7 tempest-VolumesActionsTest-249281332 None] Lock "cinder-505938b1-7c42-4d37-a4cd-c9a23268684c" released by "attach_volume" :: held 0.212s {{(pid=87444) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 04:40:40 devstack cinder-volume[87444]: INFO cinder.volume.manager [None req-a418d85d-c4aa-4e9d-a546-a5f35b9cc1da tempest-VolumesActionsTest-1960720823 None] Terminate volume connection completed successfully. Jul 10 04:40:41 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-a418d85d-c4aa-4e9d-a546-a5f35b9cc1da tempest-VolumesActionsTest-1960720823 None] Acquiring lock "cinder-505938b1-7c42-4d37-a4cd-c9a23268684c-detach_volume" by "detach_volume" {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 04:40:41 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-a418d85d-c4aa-4e9d-a546-a5f35b9cc1da tempest-VolumesActionsTest-1960720823 None] Lock "cinder-505938b1-7c42-4d37-a4cd-c9a23268684c-detach_volume" acquired by "detach_volume" :: waited 0.038s {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 04:40:41 devstack cinder-volume[87444]: INFO cinder.volume.manager [None req-a418d85d-c4aa-4e9d-a546-a5f35b9cc1da tempest-VolumesActionsTest-1960720823 None] Detaching volume 505938b1-7c42-4d37-a4cd-c9a23268684c from instance 7b630857-87c5-4695-a8a5-40ca2c870409. Jul 10 04:40:41 devstack cinder-volume[87444]: INFO cinder.volume.manager [None req-a418d85d-c4aa-4e9d-a546-a5f35b9cc1da tempest-VolumesActionsTest-1960720823 None] Detach volume completed successfully. Jul 10 04:40:41 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-a418d85d-c4aa-4e9d-a546-a5f35b9cc1da tempest-VolumesActionsTest-1960720823 None] Lock "cinder-505938b1-7c42-4d37-a4cd-c9a23268684c-detach_volume" released by "detach_volume" :: held 0.094s {{(pid=87444) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 04:40:42 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-68c22794-d203-4c0a-bc41-5185748d97a2 tempest-VolumesActionsTest-249281332 None] Acquiring lock "cinder-505938b1-7c42-4d37-a4cd-c9a23268684c-detach_volume" by "detach_volume" {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 04:40:42 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-68c22794-d203-4c0a-bc41-5185748d97a2 tempest-VolumesActionsTest-249281332 None] Lock "cinder-505938b1-7c42-4d37-a4cd-c9a23268684c-detach_volume" acquired by "detach_volume" :: waited 0.024s {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 04:40:42 devstack cinder-volume[87444]: INFO cinder.volume.manager [None req-68c22794-d203-4c0a-bc41-5185748d97a2 tempest-VolumesActionsTest-249281332 None] Volume detach called, but volume not attached. Jul 10 04:40:42 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-68c22794-d203-4c0a-bc41-5185748d97a2 tempest-VolumesActionsTest-249281332 None] Lock "cinder-505938b1-7c42-4d37-a4cd-c9a23268684c-detach_volume" released by "detach_volume" :: held 0.038s {{(pid=87444) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 04:40:42 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-d32c8aa0-10ea-4dec-b3c6-ef0d500996db tempest-VolumesActionsTest-249281332 None] Acquiring lock "cinder-505938b1-7c42-4d37-a4cd-c9a23268684c-delete_volume" by "delete_volume" {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 04:40:42 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-d32c8aa0-10ea-4dec-b3c6-ef0d500996db tempest-VolumesActionsTest-249281332 None] Lock "cinder-505938b1-7c42-4d37-a4cd-c9a23268684c-delete_volume" acquired by "delete_volume" :: waited 0.074s {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 04:40:43 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-d32c8aa0-10ea-4dec-b3c6-ef0d500996db tempest-VolumesActionsTest-249281332 None] Acquiring lock "cinder-quobyte-505938b1-7c42-4d37-a4cd-c9a23268684c" by "delete_volume" {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 04:40:43 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-d32c8aa0-10ea-4dec-b3c6-ef0d500996db tempest-VolumesActionsTest-249281332 None] Lock "cinder-quobyte-505938b1-7c42-4d37-a4cd-c9a23268684c" acquired by "delete_volume" :: waited 0.022s {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 04:40:43 devstack cinder-volume[87444]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c25914c-b754-4292-bd71-151b5010fa45]: (4, 'qcow2') {{(pid=88499) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 04:40:43 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-d32c8aa0-10ea-4dec-b3c6-ef0d500996db tempest-VolumesActionsTest-249281332 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-505938b1-7c42-4d37-a4cd-c9a23268684c {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:40:43 devstack cinder-volume[87444]: DEBUG cinder.volume.flows.manager.create_volume [None req-0c101c04-3e11-4f10-9c85-e4455b83b339 tempest-SnapshotMetadataTestJSON-1035999281 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87444) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 04:40:43 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-0c101c04-3e11-4f10-9c85-e4455b83b339 tempest-SnapshotMetadataTestJSON-1035999281 None] Flow 'volume_create_manager' (1afa50fe-3092-4850-9d15-cbd2560fd49d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 04:40:43 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-0c101c04-3e11-4f10-9c85-e4455b83b339 tempest-SnapshotMetadataTestJSON-1035999281 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1de4416e-d30e-4e1e-be8a-8833adf1691d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:40:43 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-0c101c04-3e11-4f10-9c85-e4455b83b339 tempest-SnapshotMetadataTestJSON-1035999281 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1de4416e-d30e-4e1e-be8a-8833adf1691d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T02:40:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-1356392203',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=34674eea-c59f-4b1f-af59-fd99f066830e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7980075b51d14906bd2db17ac982ee1a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T02:40:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T02:40:43Z,use_quota=True,user_id='98f6abb38940497e97999fa0963391ed',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(317e369e-1e06-434d-ae95-a335f0e6c903),volume_type_id=317e369e-1e06-434d-ae95-a335f0e6c903)' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:40:43 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-0c101c04-3e11-4f10-9c85-e4455b83b339 tempest-SnapshotMetadataTestJSON-1035999281 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4baa50c4-8122-4314-a9ff-f57b0d9b8ed9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:40:43 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-0c101c04-3e11-4f10-9c85-e4455b83b339 tempest-SnapshotMetadataTestJSON-1035999281 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4baa50c4-8122-4314-a9ff-f57b0d9b8ed9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:40:43 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-0c101c04-3e11-4f10-9c85-e4455b83b339 tempest-SnapshotMetadataTestJSON-1035999281 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e497cb67-2c23-4b5c-aee9-32228249fbf4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:40:43 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-0c101c04-3e11-4f10-9c85-e4455b83b339 tempest-SnapshotMetadataTestJSON-1035999281 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e497cb67-2c23-4b5c-aee9-32228249fbf4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '34674eea-c59f-4b1f-af59-fd99f066830e', 'volume_name': 'volume-34674eea-c59f-4b1f-af59-fd99f066830e', 'volume_size': 1}' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:40:43 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-0c101c04-3e11-4f10-9c85-e4455b83b339 tempest-SnapshotMetadataTestJSON-1035999281 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (719caace-00fe-435e-ba8c-e3a53c1c6084) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:40:43 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-0c101c04-3e11-4f10-9c85-e4455b83b339 tempest-SnapshotMetadataTestJSON-1035999281 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (719caace-00fe-435e-ba8c-e3a53c1c6084) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:40:43 devstack sudo[96059]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-505938b1-7c42-4d37-a4cd-c9a23268684c Jul 10 04:40:43 devstack sudo[96059]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:40:43 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-0c101c04-3e11-4f10-9c85-e4455b83b339 tempest-SnapshotMetadataTestJSON-1035999281 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5798dc42-c2db-498f-aa94-2448808ec8be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:40:43 devstack cinder-volume[87444]: INFO cinder.volume.flows.manager.create_volume [None req-0c101c04-3e11-4f10-9c85-e4455b83b339 tempest-SnapshotMetadataTestJSON-1035999281 None] Volume 34674eea-c59f-4b1f-af59-fd99f066830e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-34674eea-c59f-4b1f-af59-fd99f066830e', 'volume_size': 1} Jul 10 04:40:43 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-0c101c04-3e11-4f10-9c85-e4455b83b339 tempest-SnapshotMetadataTestJSON-1035999281 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 04:40:43 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-0c101c04-3e11-4f10-9c85-e4455b83b339 tempest-SnapshotMetadataTestJSON-1035999281 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 04:40:43 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-0c101c04-3e11-4f10-9c85-e4455b83b339 tempest-SnapshotMetadataTestJSON-1035999281 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T02:40:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-1356392203',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=34674eea-c59f-4b1f-af59-fd99f066830e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7980075b51d14906bd2db17ac982ee1a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T02:40:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T02:40:43Z,use_quota=True,user_id='98f6abb38940497e97999fa0963391ed',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(317e369e-1e06-434d-ae95-a335f0e6c903),volume_type_id=317e369e-1e06-434d-ae95-a335f0e6c903)}" {{(pid=87444) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 04:40:43 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.remotefs [None req-0c101c04-3e11-4f10-9c85-e4455b83b339 tempest-SnapshotMetadataTestJSON-1035999281 None] Creating volume 34674eea-c59f-4b1f-af59-fd99f066830e {{(pid=87444) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 04:40:43 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-0c101c04-3e11-4f10-9c85-e4455b83b339 tempest-SnapshotMetadataTestJSON-1035999281 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 04:40:43 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-0c101c04-3e11-4f10-9c85-e4455b83b339 tempest-SnapshotMetadataTestJSON-1035999281 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 04:40:43 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-0c101c04-3e11-4f10-9c85-e4455b83b339 tempest-SnapshotMetadataTestJSON-1035999281 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922': None} {{(pid=87444) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 04:40:43 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-0c101c04-3e11-4f10-9c85-e4455b83b339 tempest-SnapshotMetadataTestJSON-1035999281 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922'] {{(pid=87444) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 04:40:43 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-0c101c04-3e11-4f10-9c85-e4455b83b339 tempest-SnapshotMetadataTestJSON-1035999281 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 04:40:43 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-0c101c04-3e11-4f10-9c85-e4455b83b339 tempest-SnapshotMetadataTestJSON-1035999281 None] Selected osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922 as target Quobyte volume. {{(pid=87444) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 04:40:43 devstack cinder-volume[87444]: INFO cinder.volume.drivers.remotefs [None req-0c101c04-3e11-4f10-9c85-e4455b83b339 tempest-SnapshotMetadataTestJSON-1035999281 None] casted to osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922 Jul 10 04:40:43 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-0c101c04-3e11-4f10-9c85-e4455b83b339 tempest-SnapshotMetadataTestJSON-1035999281 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-34674eea-c59f-4b1f-af59-fd99f066830e 1073741824 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:40:43 devstack sudo[96061]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-34674eea-c59f-4b1f-af59-fd99f066830e 1073741824 Jul 10 04:40:43 devstack sudo[96061]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:40:44 devstack sudo[96059]: pam_unix(sudo:session): session closed for user root Jul 10 04:40:44 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-d32c8aa0-10ea-4dec-b3c6-ef0d500996db tempest-VolumesActionsTest-249281332 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-505938b1-7c42-4d37-a4cd-c9a23268684c" returned: 0 in 1.461s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:40:44 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-d32c8aa0-10ea-4dec-b3c6-ef0d500996db tempest-VolumesActionsTest-249281332 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-505938b1-7c42-4d37-a4cd-c9a23268684c {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:40:44 devstack sudo[96071]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-505938b1-7c42-4d37-a4cd-c9a23268684c Jul 10 04:40:44 devstack sudo[96071]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:40:44 devstack sudo[96061]: pam_unix(sudo:session): session closed for user root Jul 10 04:40:44 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-0c101c04-3e11-4f10-9c85-e4455b83b339 tempest-SnapshotMetadataTestJSON-1035999281 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-34674eea-c59f-4b1f-af59-fd99f066830e 1073741824" returned: 0 in 1.411s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:40:44 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-0c101c04-3e11-4f10-9c85-e4455b83b339 tempest-SnapshotMetadataTestJSON-1035999281 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-34674eea-c59f-4b1f-af59-fd99f066830e {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:40:44 devstack sudo[96086]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-34674eea-c59f-4b1f-af59-fd99f066830e Jul 10 04:40:44 devstack sudo[96086]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:40:45 devstack sudo[96071]: pam_unix(sudo:session): session closed for user root Jul 10 04:40:45 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-d32c8aa0-10ea-4dec-b3c6-ef0d500996db tempest-VolumesActionsTest-249281332 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-505938b1-7c42-4d37-a4cd-c9a23268684c" returned: 0 in 1.073s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:40:45 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-d32c8aa0-10ea-4dec-b3c6-ef0d500996db tempest-VolumesActionsTest-249281332 None] Lock "cinder-quobyte-505938b1-7c42-4d37-a4cd-c9a23268684c" released by "delete_volume" :: held 2.612s {{(pid=87444) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 04:40:45 devstack cinder-volume[87444]: DEBUG cinder.quota [None req-d32c8aa0-10ea-4dec-b3c6-ef0d500996db tempest-VolumesActionsTest-249281332 None] Created reservations ['f069d671-cc4d-4df3-ab66-a89bab17daac', '7aa6cff7-7d0f-4e8a-848a-6198004d8efa', '346aff74-0710-4218-a07b-2c41cf7f442f', '227cbd7e-6375-431a-a283-a7389211343a'] {{(pid=87444) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 04:40:45 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-d32c8aa0-10ea-4dec-b3c6-ef0d500996db tempest-VolumesActionsTest-249281332 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 04:40:45 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-d32c8aa0-10ea-4dec-b3c6-ef0d500996db tempest-VolumesActionsTest-249281332 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 04:40:45 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-d32c8aa0-10ea-4dec-b3c6-ef0d500996db tempest-VolumesActionsTest-249281332 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922': None} {{(pid=87444) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 04:40:45 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-d32c8aa0-10ea-4dec-b3c6-ef0d500996db tempest-VolumesActionsTest-249281332 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922'] {{(pid=87444) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 04:40:45 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-d32c8aa0-10ea-4dec-b3c6-ef0d500996db tempest-VolumesActionsTest-249281332 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 04:40:45 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-d32c8aa0-10ea-4dec-b3c6-ef0d500996db tempest-VolumesActionsTest-249281332 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:40:45 devstack sudo[96086]: pam_unix(sudo:session): session closed for user root Jul 10 04:40:45 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-0c101c04-3e11-4f10-9c85-e4455b83b339 tempest-SnapshotMetadataTestJSON-1035999281 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-34674eea-c59f-4b1f-af59-fd99f066830e" returned: 0 in 1.046s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:40:45 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-0c101c04-3e11-4f10-9c85-e4455b83b339 tempest-SnapshotMetadataTestJSON-1035999281 None] <== create_volume: return (2524ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922'} {{(pid=87444) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 04:40:45 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-0c101c04-3e11-4f10-9c85-e4455b83b339 tempest-SnapshotMetadataTestJSON-1035999281 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.527s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 04:40:45 devstack sudo[96096]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097 Jul 10 04:40:45 devstack sudo[96096]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:40:45 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-0c101c04-3e11-4f10-9c85-e4455b83b339 tempest-SnapshotMetadataTestJSON-1035999281 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5798dc42-c2db-498f-aa94-2448808ec8be) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-34674eea-c59f-4b1f-af59-fd99f066830e', 'volume_size': 1}' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:40:45 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-0c101c04-3e11-4f10-9c85-e4455b83b339 tempest-SnapshotMetadataTestJSON-1035999281 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1fb6f1df-4c20-4c6b-8803-e1ebadbdd2d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:40:45 devstack cinder-volume[87444]: INFO cinder.volume.flows.manager.create_volume [None req-0c101c04-3e11-4f10-9c85-e4455b83b339 tempest-SnapshotMetadataTestJSON-1035999281 None] Volume volume-34674eea-c59f-4b1f-af59-fd99f066830e (34674eea-c59f-4b1f-af59-fd99f066830e): created successfully Jul 10 04:40:45 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-0c101c04-3e11-4f10-9c85-e4455b83b339 tempest-SnapshotMetadataTestJSON-1035999281 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1fb6f1df-4c20-4c6b-8803-e1ebadbdd2d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:40:45 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-0c101c04-3e11-4f10-9c85-e4455b83b339 tempest-SnapshotMetadataTestJSON-1035999281 None] Flow 'volume_create_manager' (1afa50fe-3092-4850-9d15-cbd2560fd49d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87444) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 04:40:45 devstack cinder-volume[87444]: INFO cinder.volume.manager [None req-0c101c04-3e11-4f10-9c85-e4455b83b339 tempest-SnapshotMetadataTestJSON-1035999281 None] Created volume successfully. Jul 10 04:40:46 devstack sudo[96096]: pam_unix(sudo:session): session closed for user root Jul 10 04:40:46 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-d32c8aa0-10ea-4dec-b3c6-ef0d500996db tempest-VolumesActionsTest-249281332 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097" returned: 0 in 0.764s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:40:46 devstack cinder-volume[87444]: DEBUG cinder.manager [None req-d32c8aa0-10ea-4dec-b3c6-ef0d500996db tempest-VolumesActionsTest-249281332 None] Notifying Schedulers of capabilities ... {{(pid=87444) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 04:40:46 devstack cinder-volume[87444]: INFO cinder.volume.manager [None req-d32c8aa0-10ea-4dec-b3c6-ef0d500996db tempest-VolumesActionsTest-249281332 None] Deleted volume successfully. Jul 10 04:40:46 devstack cinder-volume[87444]: DEBUG dbcounter [-] [87444] Writing DB stats cinder:UPDATE=134,cinder:SELECT=133,cinder:INSERT=43,cinder:DELETE=7 {{(pid=87444) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 10 04:40:46 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-d32c8aa0-10ea-4dec-b3c6-ef0d500996db tempest-VolumesActionsTest-249281332 None] Lock "cinder-505938b1-7c42-4d37-a4cd-c9a23268684c-delete_volume" released by "delete_volume" :: held 3.730s {{(pid=87444) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 04:40:46 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-ba0e01fd-d6c6-42ea-b258-d47b71a6ea6e tempest-SnapshotMetadataTestJSON-1035999281 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 04:40:46 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-ba0e01fd-d6c6-42ea-b258-d47b71a6ea6e tempest-SnapshotMetadataTestJSON-1035999281 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 04:40:46 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.remotefs [None req-ba0e01fd-d6c6-42ea-b258-d47b71a6ea6e tempest-SnapshotMetadataTestJSON-1035999281 None] Creating offline snapshot f0c94116-52b7-4d97-bb14-c2f30f7930ec of volume 34674eea-c59f-4b1f-af59-fd99f066830e {{(pid=87444) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 10 04:40:46 devstack cinder-volume[87444]: DEBUG oslo.privsep.daemon [-] privsep: reply[f49a48b7-d4e0-4fe0-89df-33ed21a0239c]: (4, 'qcow2') {{(pid=88499) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 04:40:46 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-ba0e01fd-d6c6-42ea-b258-d47b71a6ea6e tempest-SnapshotMetadataTestJSON-1035999281 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-34674eea-c59f-4b1f-af59-fd99f066830e {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:40:46 devstack sudo[96099]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-34674eea-c59f-4b1f-af59-fd99f066830e Jul 10 04:40:46 devstack sudo[96099]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:40:47 devstack sudo[96099]: pam_unix(sudo:session): session closed for user root Jul 10 04:40:47 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-ba0e01fd-d6c6-42ea-b258-d47b71a6ea6e tempest-SnapshotMetadataTestJSON-1035999281 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-34674eea-c59f-4b1f-af59-fd99f066830e" returned: 0 in 0.976s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:40:47 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-ba0e01fd-d6c6-42ea-b258-d47b71a6ea6e tempest-SnapshotMetadataTestJSON-1035999281 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-34674eea-c59f-4b1f-af59-fd99f066830e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-34674eea-c59f-4b1f-af59-fd99f066830e.f0c94116-52b7-4d97-bb14-c2f30f7930ec 1G {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:40:47 devstack sudo[96105]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-34674eea-c59f-4b1f-af59-fd99f066830e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-34674eea-c59f-4b1f-af59-fd99f066830e.f0c94116-52b7-4d97-bb14-c2f30f7930ec 1G Jul 10 04:40:47 devstack sudo[96105]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:40:48 devstack sudo[96105]: pam_unix(sudo:session): session closed for user root Jul 10 04:40:48 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-ba0e01fd-d6c6-42ea-b258-d47b71a6ea6e tempest-SnapshotMetadataTestJSON-1035999281 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-34674eea-c59f-4b1f-af59-fd99f066830e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-34674eea-c59f-4b1f-af59-fd99f066830e.f0c94116-52b7-4d97-bb14-c2f30f7930ec 1G" returned: 0 in 1.117s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:40:48 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-ba0e01fd-d6c6-42ea-b258-d47b71a6ea6e tempest-SnapshotMetadataTestJSON-1035999281 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-34674eea-c59f-4b1f-af59-fd99f066830e -F qcow2 /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-34674eea-c59f-4b1f-af59-fd99f066830e.f0c94116-52b7-4d97-bb14-c2f30f7930ec {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:40:48 devstack sudo[96129]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-34674eea-c59f-4b1f-af59-fd99f066830e -F qcow2 /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-34674eea-c59f-4b1f-af59-fd99f066830e.f0c94116-52b7-4d97-bb14-c2f30f7930ec Jul 10 04:40:48 devstack sudo[96129]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:40:49 devstack sudo[96129]: pam_unix(sudo:session): session closed for user root Jul 10 04:40:49 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-ba0e01fd-d6c6-42ea-b258-d47b71a6ea6e tempest-SnapshotMetadataTestJSON-1035999281 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-34674eea-c59f-4b1f-af59-fd99f066830e -F qcow2 /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-34674eea-c59f-4b1f-af59-fd99f066830e.f0c94116-52b7-4d97-bb14-c2f30f7930ec" returned: 0 in 0.792s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:40:49 devstack cinder-volume[87444]: WARNING cinder.volume.drivers.remotefs [None req-ba0e01fd-d6c6-42ea-b258-d47b71a6ea6e tempest-SnapshotMetadataTestJSON-1035999281 None] /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-34674eea-c59f-4b1f-af59-fd99f066830e.f0c94116-52b7-4d97-bb14-c2f30f7930ec is being set with open permissions: ugo+rw Jul 10 04:40:49 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-ba0e01fd-d6c6-42ea-b258-d47b71a6ea6e tempest-SnapshotMetadataTestJSON-1035999281 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-34674eea-c59f-4b1f-af59-fd99f066830e.f0c94116-52b7-4d97-bb14-c2f30f7930ec {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:40:49 devstack sudo[96137]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-34674eea-c59f-4b1f-af59-fd99f066830e.f0c94116-52b7-4d97-bb14-c2f30f7930ec Jul 10 04:40:49 devstack sudo[96137]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:40:50 devstack sudo[96137]: pam_unix(sudo:session): session closed for user root Jul 10 04:40:50 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-ba0e01fd-d6c6-42ea-b258-d47b71a6ea6e tempest-SnapshotMetadataTestJSON-1035999281 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-34674eea-c59f-4b1f-af59-fd99f066830e.f0c94116-52b7-4d97-bb14-c2f30f7930ec" returned: 0 in 0.813s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:40:50 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-ba0e01fd-d6c6-42ea-b258-d47b71a6ea6e tempest-SnapshotMetadataTestJSON-1035999281 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-34674eea-c59f-4b1f-af59-fd99f066830e.info {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:40:50 devstack sudo[96141]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-34674eea-c59f-4b1f-af59-fd99f066830e.info Jul 10 04:40:50 devstack sudo[96141]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:40:51 devstack sudo[96141]: pam_unix(sudo:session): session closed for user root Jul 10 04:40:51 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-ba0e01fd-d6c6-42ea-b258-d47b71a6ea6e tempest-SnapshotMetadataTestJSON-1035999281 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-34674eea-c59f-4b1f-af59-fd99f066830e.info" returned: 0 in 0.844s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:40:51 devstack cinder-volume[87444]: WARNING cinder.volume.drivers.remotefs [None req-ba0e01fd-d6c6-42ea-b258-d47b71a6ea6e tempest-SnapshotMetadataTestJSON-1035999281 None] /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-34674eea-c59f-4b1f-af59-fd99f066830e.info is being set with open permissions: ugo+rw Jul 10 04:40:51 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-ba0e01fd-d6c6-42ea-b258-d47b71a6ea6e tempest-SnapshotMetadataTestJSON-1035999281 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-34674eea-c59f-4b1f-af59-fd99f066830e.info {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:40:51 devstack sudo[96145]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-34674eea-c59f-4b1f-af59-fd99f066830e.info Jul 10 04:40:51 devstack sudo[96145]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:40:52 devstack sudo[96145]: pam_unix(sudo:session): session closed for user root Jul 10 04:40:52 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-ba0e01fd-d6c6-42ea-b258-d47b71a6ea6e tempest-SnapshotMetadataTestJSON-1035999281 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-34674eea-c59f-4b1f-af59-fd99f066830e.info" returned: 0 in 0.790s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:40:52 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-ba0e01fd-d6c6-42ea-b258-d47b71a6ea6e tempest-SnapshotMetadataTestJSON-1035999281 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.478s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 04:40:52 devstack cinder-volume[87444]: INFO cinder.volume.manager [None req-ba0e01fd-d6c6-42ea-b258-d47b71a6ea6e tempest-SnapshotMetadataTestJSON-1035999281 None] Create snapshot completed successfully Jul 10 04:40:53 devstack cinder-volume[87444]: INFO cinder.volume.manager [None req-4e9e45db-2968-4d17-9496-0feda83d61c1 tempest-GroupsTest-1660920858 None] Group tempest-Group1-1779190835: creating Jul 10 04:40:53 devstack cinder-volume[87444]: INFO cinder.volume.manager [None req-4e9e45db-2968-4d17-9496-0feda83d61c1 tempest-GroupsTest-1660920858 None] Group tempest-Group1-1779190835: created successfully Jul 10 04:40:53 devstack cinder-volume[87444]: INFO cinder.volume.manager [None req-4e9e45db-2968-4d17-9496-0feda83d61c1 tempest-GroupsTest-1660920858 None] Create group completed successfully. Jul 10 04:40:53 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-7d663131-c667-4f71-8159-fab15099121c tempest-SnapshotMetadataTestJSON-1035999281 None] Acquiring lock "cinder-f0c94116-52b7-4d97-bb14-c2f30f7930ec-delete_snapshot" by "delete_snapshot" {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 04:40:53 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-7d663131-c667-4f71-8159-fab15099121c tempest-SnapshotMetadataTestJSON-1035999281 None] Lock "cinder-f0c94116-52b7-4d97-bb14-c2f30f7930ec-delete_snapshot" acquired by "delete_snapshot" :: waited 0.019s {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 04:40:53 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-7d663131-c667-4f71-8159-fab15099121c tempest-SnapshotMetadataTestJSON-1035999281 None] Acquiring lock "cinder-quobyte-34674eea-c59f-4b1f-af59-fd99f066830e" by "delete_snapshot" {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 04:40:53 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-7d663131-c667-4f71-8159-fab15099121c tempest-SnapshotMetadataTestJSON-1035999281 None] Lock "cinder-quobyte-34674eea-c59f-4b1f-af59-fd99f066830e" acquired by "delete_snapshot" :: waited 0.023s {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 04:40:53 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-7d663131-c667-4f71-8159-fab15099121c tempest-SnapshotMetadataTestJSON-1035999281 None] Acquiring lock "cinder-quobyte-f0c94116-52b7-4d97-bb14-c2f30f7930ec" by "_delete_snapshot" {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 04:40:53 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-7d663131-c667-4f71-8159-fab15099121c tempest-SnapshotMetadataTestJSON-1035999281 None] Lock "cinder-quobyte-f0c94116-52b7-4d97-bb14-c2f30f7930ec" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 04:40:53 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.remotefs [None req-7d663131-c667-4f71-8159-fab15099121c tempest-SnapshotMetadataTestJSON-1035999281 None] Deleting offline snapshot f0c94116-52b7-4d97-bb14-c2f30f7930ec of volume 34674eea-c59f-4b1f-af59-fd99f066830e {{(pid=87444) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 10 04:40:53 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.remotefs [None req-7d663131-c667-4f71-8159-fab15099121c tempest-SnapshotMetadataTestJSON-1035999281 None] snapshot_file for this snap is: volume-34674eea-c59f-4b1f-af59-fd99f066830e.f0c94116-52b7-4d97-bb14-c2f30f7930ec {{(pid=87444) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 10 04:40:53 devstack cinder-volume[87444]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad0f29f3-b737-46dc-ad29-555d16002bbb]: (4, 'qcow2') {{(pid=88499) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 04:40:53 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-7d663131-c667-4f71-8159-fab15099121c tempest-SnapshotMetadataTestJSON-1035999281 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-34674eea-c59f-4b1f-af59-fd99f066830e.f0c94116-52b7-4d97-bb14-c2f30f7930ec {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:40:54 devstack sudo[96149]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-34674eea-c59f-4b1f-af59-fd99f066830e.f0c94116-52b7-4d97-bb14-c2f30f7930ec Jul 10 04:40:54 devstack sudo[96149]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:40:54 devstack sudo[96149]: pam_unix(sudo:session): session closed for user root Jul 10 04:40:54 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-7d663131-c667-4f71-8159-fab15099121c tempest-SnapshotMetadataTestJSON-1035999281 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-34674eea-c59f-4b1f-af59-fd99f066830e.f0c94116-52b7-4d97-bb14-c2f30f7930ec" returned: 0 in 0.841s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:40:54 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.remotefs [None req-7d663131-c667-4f71-8159-fab15099121c tempest-SnapshotMetadataTestJSON-1035999281 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-34674eea-c59f-4b1f-af59-fd99f066830e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87444) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 10 04:40:54 devstack cinder-volume[87444]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0ef44b8-66e1-4cdc-8d6d-33f5b6adb46d]: (4, 'qcow2') {{(pid=88499) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 04:40:54 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-7d663131-c667-4f71-8159-fab15099121c tempest-SnapshotMetadataTestJSON-1035999281 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-34674eea-c59f-4b1f-af59-fd99f066830e {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:40:54 devstack cinder-volume[87444]: DEBUG cinder.volume.flows.manager.create_volume [None req-b474f142-31b1-40f3-b185-8c2f26a80b84 tempest-VolumeQuotasNegativeTestJSON-1984637455 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87444) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 04:40:54 devstack sudo[96154]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-34674eea-c59f-4b1f-af59-fd99f066830e Jul 10 04:40:54 devstack sudo[96154]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:40:54 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-b474f142-31b1-40f3-b185-8c2f26a80b84 tempest-VolumeQuotasNegativeTestJSON-1984637455 None] Flow 'volume_create_manager' (273e5221-68ab-4ab0-b48f-70819b53a0bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 04:40:54 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-b474f142-31b1-40f3-b185-8c2f26a80b84 tempest-VolumeQuotasNegativeTestJSON-1984637455 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d731a06c-90a5-4256-bca1-b3b0313d9012) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:40:54 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-b474f142-31b1-40f3-b185-8c2f26a80b84 tempest-VolumeQuotasNegativeTestJSON-1984637455 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d731a06c-90a5-4256-bca1-b3b0313d9012) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T02:40:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-1304835779',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a16b8e12-a257-4f03-adb2-45810a23d081,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dd9495e54ca04976896b0e330f18ba17',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T02:40:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T02:40:55Z,use_quota=True,user_id='1fe7513bc2e44097bbe5de89186f6355',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(317e369e-1e06-434d-ae95-a335f0e6c903),volume_type_id=317e369e-1e06-434d-ae95-a335f0e6c903)' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:40:54 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-b474f142-31b1-40f3-b185-8c2f26a80b84 tempest-VolumeQuotasNegativeTestJSON-1984637455 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ca25ac66-5ee8-418b-b1d6-155f9ac026b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:40:54 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-b474f142-31b1-40f3-b185-8c2f26a80b84 tempest-VolumeQuotasNegativeTestJSON-1984637455 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ca25ac66-5ee8-418b-b1d6-155f9ac026b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:40:54 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-b474f142-31b1-40f3-b185-8c2f26a80b84 tempest-VolumeQuotasNegativeTestJSON-1984637455 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (968a65f1-9eeb-4b88-8af4-5f1f89eeb357) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:40:55 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-b474f142-31b1-40f3-b185-8c2f26a80b84 tempest-VolumeQuotasNegativeTestJSON-1984637455 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (968a65f1-9eeb-4b88-8af4-5f1f89eeb357) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a16b8e12-a257-4f03-adb2-45810a23d081', 'volume_name': 'volume-a16b8e12-a257-4f03-adb2-45810a23d081', 'volume_size': 1}' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:40:55 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-b474f142-31b1-40f3-b185-8c2f26a80b84 tempest-VolumeQuotasNegativeTestJSON-1984637455 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (55419c39-84b7-4dce-bdc0-31b418736b03) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:40:55 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-b474f142-31b1-40f3-b185-8c2f26a80b84 tempest-VolumeQuotasNegativeTestJSON-1984637455 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (55419c39-84b7-4dce-bdc0-31b418736b03) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:40:55 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-b474f142-31b1-40f3-b185-8c2f26a80b84 tempest-VolumeQuotasNegativeTestJSON-1984637455 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (288d407a-2dd7-49b9-b096-9c0e670ade30) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:40:55 devstack cinder-volume[87444]: INFO cinder.volume.flows.manager.create_volume [None req-b474f142-31b1-40f3-b185-8c2f26a80b84 tempest-VolumeQuotasNegativeTestJSON-1984637455 None] Volume a16b8e12-a257-4f03-adb2-45810a23d081: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a16b8e12-a257-4f03-adb2-45810a23d081', 'volume_size': 1} Jul 10 04:40:55 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-b474f142-31b1-40f3-b185-8c2f26a80b84 tempest-VolumeQuotasNegativeTestJSON-1984637455 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 04:40:55 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-b474f142-31b1-40f3-b185-8c2f26a80b84 tempest-VolumeQuotasNegativeTestJSON-1984637455 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 04:40:55 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-b474f142-31b1-40f3-b185-8c2f26a80b84 tempest-VolumeQuotasNegativeTestJSON-1984637455 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T02:40:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-1304835779',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a16b8e12-a257-4f03-adb2-45810a23d081,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dd9495e54ca04976896b0e330f18ba17',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T02:40:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T02:40:55Z,use_quota=True,user_id='1fe7513bc2e44097bbe5de89186f6355',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(317e369e-1e06-434d-ae95-a335f0e6c903),volume_type_id=317e369e-1e06-434d-ae95-a335f0e6c903)}" {{(pid=87444) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 04:40:55 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.remotefs [None req-b474f142-31b1-40f3-b185-8c2f26a80b84 tempest-VolumeQuotasNegativeTestJSON-1984637455 None] Creating volume a16b8e12-a257-4f03-adb2-45810a23d081 {{(pid=87444) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 04:40:55 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-b474f142-31b1-40f3-b185-8c2f26a80b84 tempest-VolumeQuotasNegativeTestJSON-1984637455 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 04:40:55 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-b474f142-31b1-40f3-b185-8c2f26a80b84 tempest-VolumeQuotasNegativeTestJSON-1984637455 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 04:40:55 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-b474f142-31b1-40f3-b185-8c2f26a80b84 tempest-VolumeQuotasNegativeTestJSON-1984637455 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922': None} {{(pid=87444) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 04:40:55 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-b474f142-31b1-40f3-b185-8c2f26a80b84 tempest-VolumeQuotasNegativeTestJSON-1984637455 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922'] {{(pid=87444) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 04:40:55 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-b474f142-31b1-40f3-b185-8c2f26a80b84 tempest-VolumeQuotasNegativeTestJSON-1984637455 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 04:40:55 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-b474f142-31b1-40f3-b185-8c2f26a80b84 tempest-VolumeQuotasNegativeTestJSON-1984637455 None] Selected osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922 as target Quobyte volume. {{(pid=87444) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 04:40:55 devstack cinder-volume[87444]: INFO cinder.volume.drivers.remotefs [None req-b474f142-31b1-40f3-b185-8c2f26a80b84 tempest-VolumeQuotasNegativeTestJSON-1984637455 None] casted to osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922 Jul 10 04:40:55 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-b474f142-31b1-40f3-b185-8c2f26a80b84 tempest-VolumeQuotasNegativeTestJSON-1984637455 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-a16b8e12-a257-4f03-adb2-45810a23d081 1073741824 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:40:55 devstack cinder-volume[87444]: INFO cinder.volume.manager [None req-a55aac43-1d52-4231-be12-83c48b7d1d96 tempest-GroupsTest-1660920858 None] Group tempest-Group2-896660086: creating Jul 10 04:40:55 devstack sudo[96156]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-a16b8e12-a257-4f03-adb2-45810a23d081 1073741824 Jul 10 04:40:55 devstack sudo[96156]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:40:55 devstack cinder-volume[87444]: INFO cinder.volume.manager [None req-a55aac43-1d52-4231-be12-83c48b7d1d96 tempest-GroupsTest-1660920858 None] Group tempest-Group2-896660086: created successfully Jul 10 04:40:55 devstack cinder-volume[87444]: INFO cinder.volume.manager [None req-a55aac43-1d52-4231-be12-83c48b7d1d96 tempest-GroupsTest-1660920858 None] Create group completed successfully. Jul 10 04:40:55 devstack cinder-volume[87444]: DEBUG cinder.volume.flows.manager.create_volume [None req-02f3d8e0-80e8-47d9-89ac-0aad9e44b907 tempest-VolumesActionsTest-249281332 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87444) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 04:40:55 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-02f3d8e0-80e8-47d9-89ac-0aad9e44b907 tempest-VolumesActionsTest-249281332 None] Flow 'volume_create_manager' (8da02a2b-bafa-46b7-b62a-39c7ff9a25dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 04:40:55 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-02f3d8e0-80e8-47d9-89ac-0aad9e44b907 tempest-VolumesActionsTest-249281332 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8def4e3c-e9eb-4f41-b076-13f769730382) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:40:55 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-02f3d8e0-80e8-47d9-89ac-0aad9e44b907 tempest-VolumesActionsTest-249281332 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8def4e3c-e9eb-4f41-b076-13f769730382) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T02:40:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1779075897',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=45da5fcd-38dd-4ecc-baa5-13e270690df8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8896182fdfb44908ba0a8d3405add17a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T02:40:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T02:40:55Z,use_quota=True,user_id='439be0ce5a464a3c827a628503ea0e00',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(317e369e-1e06-434d-ae95-a335f0e6c903),volume_type_id=317e369e-1e06-434d-ae95-a335f0e6c903)' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:40:55 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-02f3d8e0-80e8-47d9-89ac-0aad9e44b907 tempest-VolumesActionsTest-249281332 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (48c2cdd5-5761-4ae7-9a68-ade19649dd31) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:40:55 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-02f3d8e0-80e8-47d9-89ac-0aad9e44b907 tempest-VolumesActionsTest-249281332 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (48c2cdd5-5761-4ae7-9a68-ade19649dd31) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:40:55 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-02f3d8e0-80e8-47d9-89ac-0aad9e44b907 tempest-VolumesActionsTest-249281332 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5bbee158-48f1-4dcb-ac6d-ae45ee52a5c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:40:55 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-02f3d8e0-80e8-47d9-89ac-0aad9e44b907 tempest-VolumesActionsTest-249281332 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5bbee158-48f1-4dcb-ac6d-ae45ee52a5c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '45da5fcd-38dd-4ecc-baa5-13e270690df8', 'volume_name': 'volume-45da5fcd-38dd-4ecc-baa5-13e270690df8', 'volume_size': 1}' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:40:55 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-02f3d8e0-80e8-47d9-89ac-0aad9e44b907 tempest-VolumesActionsTest-249281332 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eca2c402-12df-4ff3-88a4-6087b74f2325) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:40:55 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-02f3d8e0-80e8-47d9-89ac-0aad9e44b907 tempest-VolumesActionsTest-249281332 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eca2c402-12df-4ff3-88a4-6087b74f2325) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:40:55 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-02f3d8e0-80e8-47d9-89ac-0aad9e44b907 tempest-VolumesActionsTest-249281332 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (58dc696f-9369-4f00-85e7-7b505b03c302) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:40:55 devstack cinder-volume[87444]: INFO cinder.volume.flows.manager.create_volume [None req-02f3d8e0-80e8-47d9-89ac-0aad9e44b907 tempest-VolumesActionsTest-249281332 None] Volume 45da5fcd-38dd-4ecc-baa5-13e270690df8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-45da5fcd-38dd-4ecc-baa5-13e270690df8', 'volume_size': 1} Jul 10 04:40:55 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-02f3d8e0-80e8-47d9-89ac-0aad9e44b907 tempest-VolumesActionsTest-249281332 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 04:40:55 devstack sudo[96154]: pam_unix(sudo:session): session closed for user root Jul 10 04:40:55 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-7d663131-c667-4f71-8159-fab15099121c tempest-SnapshotMetadataTestJSON-1035999281 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-34674eea-c59f-4b1f-af59-fd99f066830e" returned: 0 in 0.885s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:40:55 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-7d663131-c667-4f71-8159-fab15099121c tempest-SnapshotMetadataTestJSON-1035999281 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-34674eea-c59f-4b1f-af59-fd99f066830e.f0c94116-52b7-4d97-bb14-c2f30f7930ec {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:40:55 devstack sudo[96164]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-34674eea-c59f-4b1f-af59-fd99f066830e.f0c94116-52b7-4d97-bb14-c2f30f7930ec Jul 10 04:40:55 devstack sudo[96164]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:40:55 devstack sudo[96156]: pam_unix(sudo:session): session closed for user root Jul 10 04:40:55 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-b474f142-31b1-40f3-b185-8c2f26a80b84 tempest-VolumeQuotasNegativeTestJSON-1984637455 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-a16b8e12-a257-4f03-adb2-45810a23d081 1073741824" returned: 0 in 0.905s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:40:55 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-b474f142-31b1-40f3-b185-8c2f26a80b84 tempest-VolumeQuotasNegativeTestJSON-1984637455 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-a16b8e12-a257-4f03-adb2-45810a23d081 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:40:56 devstack sudo[96167]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-a16b8e12-a257-4f03-adb2-45810a23d081 Jul 10 04:40:56 devstack sudo[96167]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:40:56 devstack sudo[96164]: pam_unix(sudo:session): session closed for user root Jul 10 04:40:56 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-7d663131-c667-4f71-8159-fab15099121c tempest-SnapshotMetadataTestJSON-1035999281 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-34674eea-c59f-4b1f-af59-fd99f066830e.f0c94116-52b7-4d97-bb14-c2f30f7930ec" returned: 0 in 0.781s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:40:56 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-7d663131-c667-4f71-8159-fab15099121c tempest-SnapshotMetadataTestJSON-1035999281 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-34674eea-c59f-4b1f-af59-fd99f066830e.f0c94116-52b7-4d97-bb14-c2f30f7930ec {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:40:56 devstack sudo[96173]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-34674eea-c59f-4b1f-af59-fd99f066830e.f0c94116-52b7-4d97-bb14-c2f30f7930ec Jul 10 04:40:56 devstack sudo[96173]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:40:56 devstack sudo[96167]: pam_unix(sudo:session): session closed for user root Jul 10 04:40:56 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-b474f142-31b1-40f3-b185-8c2f26a80b84 tempest-VolumeQuotasNegativeTestJSON-1984637455 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-a16b8e12-a257-4f03-adb2-45810a23d081" returned: 0 in 0.707s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:40:56 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-b474f142-31b1-40f3-b185-8c2f26a80b84 tempest-VolumeQuotasNegativeTestJSON-1984637455 None] <== create_volume: return (1660ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922'} {{(pid=87444) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 04:40:56 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-b474f142-31b1-40f3-b185-8c2f26a80b84 tempest-VolumeQuotasNegativeTestJSON-1984637455 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.664s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 04:40:56 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-02f3d8e0-80e8-47d9-89ac-0aad9e44b907 tempest-VolumesActionsTest-249281332 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.108s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 04:40:56 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-02f3d8e0-80e8-47d9-89ac-0aad9e44b907 tempest-VolumesActionsTest-249281332 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T02:40:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1779075897',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=45da5fcd-38dd-4ecc-baa5-13e270690df8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8896182fdfb44908ba0a8d3405add17a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T02:40:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T02:40:55Z,use_quota=True,user_id='439be0ce5a464a3c827a628503ea0e00',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(317e369e-1e06-434d-ae95-a335f0e6c903),volume_type_id=317e369e-1e06-434d-ae95-a335f0e6c903)}" {{(pid=87444) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 04:40:56 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.remotefs [None req-02f3d8e0-80e8-47d9-89ac-0aad9e44b907 tempest-VolumesActionsTest-249281332 None] Creating volume 45da5fcd-38dd-4ecc-baa5-13e270690df8 {{(pid=87444) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 04:40:56 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-02f3d8e0-80e8-47d9-89ac-0aad9e44b907 tempest-VolumesActionsTest-249281332 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 04:40:56 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-02f3d8e0-80e8-47d9-89ac-0aad9e44b907 tempest-VolumesActionsTest-249281332 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 04:40:56 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-02f3d8e0-80e8-47d9-89ac-0aad9e44b907 tempest-VolumesActionsTest-249281332 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922': None} {{(pid=87444) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 04:40:56 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-02f3d8e0-80e8-47d9-89ac-0aad9e44b907 tempest-VolumesActionsTest-249281332 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922'] {{(pid=87444) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 04:40:56 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-02f3d8e0-80e8-47d9-89ac-0aad9e44b907 tempest-VolumesActionsTest-249281332 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 04:40:56 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-02f3d8e0-80e8-47d9-89ac-0aad9e44b907 tempest-VolumesActionsTest-249281332 None] Selected osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922 as target Quobyte volume. {{(pid=87444) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 04:40:56 devstack cinder-volume[87444]: INFO cinder.volume.drivers.remotefs [None req-02f3d8e0-80e8-47d9-89ac-0aad9e44b907 tempest-VolumesActionsTest-249281332 None] casted to osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922 Jul 10 04:40:56 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-02f3d8e0-80e8-47d9-89ac-0aad9e44b907 tempest-VolumesActionsTest-249281332 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-45da5fcd-38dd-4ecc-baa5-13e270690df8 1073741824 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:40:56 devstack cinder-volume[87444]: DEBUG cinder.volume.flows.manager.create_volume [None req-a4581d50-d14f-4160-aad7-71f65fb96be8 tempest-GroupsTest-1660920858 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87444) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 04:40:56 devstack sudo[96176]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-45da5fcd-38dd-4ecc-baa5-13e270690df8 1073741824 Jul 10 04:40:56 devstack sudo[96176]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:40:56 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-a4581d50-d14f-4160-aad7-71f65fb96be8 tempest-GroupsTest-1660920858 None] Flow 'volume_create_manager' (91cab8b7-d25e-431b-ac11-6bd37f9a7f01) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 04:40:56 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-a4581d50-d14f-4160-aad7-71f65fb96be8 tempest-GroupsTest-1660920858 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dd33b94e-4f5c-42b0-8502-069f71cd7950) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:40:56 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-a4581d50-d14f-4160-aad7-71f65fb96be8 tempest-GroupsTest-1660920858 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dd33b94e-4f5c-42b0-8502-069f71cd7950) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T02:40:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1976102573',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=3d9ff0d0-604a-4185-897f-169324428645,host='devstack@QuobyteHD#QuobyteHD',id=fef091fd-079d-4729-9ef8-0925ff68112a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5123392880514662ab5398a5aa74b6ab',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T02:40:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T02:40:57Z,use_quota=True,user_id='05df2bbe3479427caa427952a7ac24af',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(407b324c-5ee7-4954-bfdf-7767a2728285),volume_type_id=407b324c-5ee7-4954-bfdf-7767a2728285)' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:40:56 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-a4581d50-d14f-4160-aad7-71f65fb96be8 tempest-GroupsTest-1660920858 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4104a699-1917-47ea-8b9a-bd2acc93655a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:40:56 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-a4581d50-d14f-4160-aad7-71f65fb96be8 tempest-GroupsTest-1660920858 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4104a699-1917-47ea-8b9a-bd2acc93655a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:40:56 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-a4581d50-d14f-4160-aad7-71f65fb96be8 tempest-GroupsTest-1660920858 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d08e00a6-305f-457e-9260-cb3ba0afc160) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:40:56 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-a4581d50-d14f-4160-aad7-71f65fb96be8 tempest-GroupsTest-1660920858 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d08e00a6-305f-457e-9260-cb3ba0afc160) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fef091fd-079d-4729-9ef8-0925ff68112a', 'volume_name': 'volume-fef091fd-079d-4729-9ef8-0925ff68112a', 'volume_size': 1}' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:40:56 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-a4581d50-d14f-4160-aad7-71f65fb96be8 tempest-GroupsTest-1660920858 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5b5db290-8133-4078-9b47-ffac604ad4d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:40:56 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-a4581d50-d14f-4160-aad7-71f65fb96be8 tempest-GroupsTest-1660920858 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5b5db290-8133-4078-9b47-ffac604ad4d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:40:56 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-a4581d50-d14f-4160-aad7-71f65fb96be8 tempest-GroupsTest-1660920858 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e0ebb0ce-9acf-48f4-a244-c2a00fcf612e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:40:56 devstack cinder-volume[87444]: INFO cinder.volume.flows.manager.create_volume [None req-a4581d50-d14f-4160-aad7-71f65fb96be8 tempest-GroupsTest-1660920858 None] Volume fef091fd-079d-4729-9ef8-0925ff68112a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fef091fd-079d-4729-9ef8-0925ff68112a', 'volume_size': 1} Jul 10 04:40:56 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-a4581d50-d14f-4160-aad7-71f65fb96be8 tempest-GroupsTest-1660920858 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 04:40:56 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-b474f142-31b1-40f3-b185-8c2f26a80b84 tempest-VolumeQuotasNegativeTestJSON-1984637455 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (288d407a-2dd7-49b9-b096-9c0e670ade30) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a16b8e12-a257-4f03-adb2-45810a23d081', 'volume_size': 1}' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:40:56 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-b474f142-31b1-40f3-b185-8c2f26a80b84 tempest-VolumeQuotasNegativeTestJSON-1984637455 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (233dd90e-7764-433e-8f82-4edab1db5b24) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:40:56 devstack cinder-volume[87444]: INFO cinder.volume.flows.manager.create_volume [None req-b474f142-31b1-40f3-b185-8c2f26a80b84 tempest-VolumeQuotasNegativeTestJSON-1984637455 None] Volume volume-a16b8e12-a257-4f03-adb2-45810a23d081 (a16b8e12-a257-4f03-adb2-45810a23d081): created successfully Jul 10 04:40:56 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-b474f142-31b1-40f3-b185-8c2f26a80b84 tempest-VolumeQuotasNegativeTestJSON-1984637455 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (233dd90e-7764-433e-8f82-4edab1db5b24) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:40:56 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-b474f142-31b1-40f3-b185-8c2f26a80b84 tempest-VolumeQuotasNegativeTestJSON-1984637455 None] Flow 'volume_create_manager' (273e5221-68ab-4ab0-b48f-70819b53a0bc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87444) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 04:40:56 devstack cinder-volume[87444]: DEBUG dbcounter [-] [87444] Writing DB stats cinder:SELECT=107,cinder:UPDATE=119,cinder:INSERT=29,cinder:DELETE=4 {{(pid=87444) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 10 04:40:56 devstack cinder-volume[87444]: INFO cinder.volume.manager [None req-b474f142-31b1-40f3-b185-8c2f26a80b84 tempest-VolumeQuotasNegativeTestJSON-1984637455 None] Created volume successfully. Jul 10 04:40:57 devstack sudo[96173]: pam_unix(sudo:session): session closed for user root Jul 10 04:40:57 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-7d663131-c667-4f71-8159-fab15099121c tempest-SnapshotMetadataTestJSON-1035999281 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-34674eea-c59f-4b1f-af59-fd99f066830e.f0c94116-52b7-4d97-bb14-c2f30f7930ec" returned: 0 in 0.702s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:40:57 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-7d663131-c667-4f71-8159-fab15099121c tempest-SnapshotMetadataTestJSON-1035999281 None] Lock "cinder-quobyte-f0c94116-52b7-4d97-bb14-c2f30f7930ec" released by "_delete_snapshot" :: held 3.323s {{(pid=87444) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 04:40:57 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-7d663131-c667-4f71-8159-fab15099121c tempest-SnapshotMetadataTestJSON-1035999281 None] Lock "cinder-quobyte-34674eea-c59f-4b1f-af59-fd99f066830e" released by "delete_snapshot" :: held 3.350s {{(pid=87444) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 04:40:57 devstack cinder-volume[87444]: DEBUG cinder.quota [None req-7d663131-c667-4f71-8159-fab15099121c tempest-SnapshotMetadataTestJSON-1035999281 None] Created reservations ['952fba3d-efcc-46a5-8a97-03defd231625', 'be427498-4512-4bd6-b575-94cef604a178', '43bcddd0-1848-4d9c-b14d-54cbf7ebcd8a', '04934871-15ed-4c2d-a8e4-70b2adee1ff7'] {{(pid=87444) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 04:40:57 devstack cinder-volume[87444]: INFO cinder.volume.manager [None req-7d663131-c667-4f71-8159-fab15099121c tempest-SnapshotMetadataTestJSON-1035999281 None] Delete snapshot completed successfully. Jul 10 04:40:57 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-7d663131-c667-4f71-8159-fab15099121c tempest-SnapshotMetadataTestJSON-1035999281 None] Lock "cinder-f0c94116-52b7-4d97-bb14-c2f30f7930ec-delete_snapshot" released by "delete_snapshot" :: held 3.488s {{(pid=87444) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 04:40:57 devstack sudo[96176]: pam_unix(sudo:session): session closed for user root Jul 10 04:40:57 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-02f3d8e0-80e8-47d9-89ac-0aad9e44b907 tempest-VolumesActionsTest-249281332 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-45da5fcd-38dd-4ecc-baa5-13e270690df8 1073741824" returned: 0 in 0.869s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:40:57 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-02f3d8e0-80e8-47d9-89ac-0aad9e44b907 tempest-VolumesActionsTest-249281332 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-45da5fcd-38dd-4ecc-baa5-13e270690df8 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:40:57 devstack sudo[96182]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-45da5fcd-38dd-4ecc-baa5-13e270690df8 Jul 10 04:40:57 devstack sudo[96182]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:40:58 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-d32afd74-a208-416e-a01f-b7dcee6add81 tempest-SnapshotMetadataTestJSON-1035999281 None] Acquiring lock "cinder-34674eea-c59f-4b1f-af59-fd99f066830e-delete_volume" by "delete_volume" {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 04:40:58 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-d32afd74-a208-416e-a01f-b7dcee6add81 tempest-SnapshotMetadataTestJSON-1035999281 None] Lock "cinder-34674eea-c59f-4b1f-af59-fd99f066830e-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 04:40:58 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-d32afd74-a208-416e-a01f-b7dcee6add81 tempest-SnapshotMetadataTestJSON-1035999281 None] Acquiring lock "cinder-quobyte-34674eea-c59f-4b1f-af59-fd99f066830e" by "delete_volume" {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 04:40:58 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-d32afd74-a208-416e-a01f-b7dcee6add81 tempest-SnapshotMetadataTestJSON-1035999281 None] Lock "cinder-quobyte-34674eea-c59f-4b1f-af59-fd99f066830e" acquired by "delete_volume" :: waited 0.018s {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 04:40:58 devstack cinder-volume[87444]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9dbc565-12b0-4887-9fee-a35f880dddb7]: (4, 'qcow2') {{(pid=88499) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 04:40:58 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-d32afd74-a208-416e-a01f-b7dcee6add81 tempest-SnapshotMetadataTestJSON-1035999281 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-34674eea-c59f-4b1f-af59-fd99f066830e {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:40:58 devstack sudo[96182]: pam_unix(sudo:session): session closed for user root Jul 10 04:40:58 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-02f3d8e0-80e8-47d9-89ac-0aad9e44b907 tempest-VolumesActionsTest-249281332 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-45da5fcd-38dd-4ecc-baa5-13e270690df8" returned: 0 in 0.715s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:40:58 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-02f3d8e0-80e8-47d9-89ac-0aad9e44b907 tempest-VolumesActionsTest-249281332 None] <== create_volume: return (1622ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922'} {{(pid=87444) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 04:40:58 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-02f3d8e0-80e8-47d9-89ac-0aad9e44b907 tempest-VolumesActionsTest-249281332 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.627s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 04:40:58 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-a4581d50-d14f-4160-aad7-71f65fb96be8 tempest-GroupsTest-1660920858 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.491s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 04:40:58 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-a4581d50-d14f-4160-aad7-71f65fb96be8 tempest-GroupsTest-1660920858 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=3d9ff0d0-604a-4185-897f-169324428645,created_at=2026-07-10T02:40:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1976102573',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=3d9ff0d0-604a-4185-897f-169324428645,host='devstack@QuobyteHD#QuobyteHD',id=fef091fd-079d-4729-9ef8-0925ff68112a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5123392880514662ab5398a5aa74b6ab',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T02:40:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T02:40:57Z,use_quota=True,user_id='05df2bbe3479427caa427952a7ac24af',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(407b324c-5ee7-4954-bfdf-7767a2728285),volume_type_id=407b324c-5ee7-4954-bfdf-7767a2728285)}" {{(pid=87444) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 04:40:58 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.remotefs [None req-a4581d50-d14f-4160-aad7-71f65fb96be8 tempest-GroupsTest-1660920858 None] Creating volume fef091fd-079d-4729-9ef8-0925ff68112a {{(pid=87444) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 04:40:58 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-a4581d50-d14f-4160-aad7-71f65fb96be8 tempest-GroupsTest-1660920858 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 04:40:58 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-a4581d50-d14f-4160-aad7-71f65fb96be8 tempest-GroupsTest-1660920858 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 04:40:58 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-a4581d50-d14f-4160-aad7-71f65fb96be8 tempest-GroupsTest-1660920858 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922': None} {{(pid=87444) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 04:40:58 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-a4581d50-d14f-4160-aad7-71f65fb96be8 tempest-GroupsTest-1660920858 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922'] {{(pid=87444) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 04:40:58 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-a4581d50-d14f-4160-aad7-71f65fb96be8 tempest-GroupsTest-1660920858 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 04:40:58 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-a4581d50-d14f-4160-aad7-71f65fb96be8 tempest-GroupsTest-1660920858 None] Selected osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922 as target Quobyte volume. {{(pid=87444) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 04:40:58 devstack cinder-volume[87444]: INFO cinder.volume.drivers.remotefs [None req-a4581d50-d14f-4160-aad7-71f65fb96be8 tempest-GroupsTest-1660920858 None] casted to osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922 Jul 10 04:40:58 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-a4581d50-d14f-4160-aad7-71f65fb96be8 tempest-GroupsTest-1660920858 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-fef091fd-079d-4729-9ef8-0925ff68112a 1073741824 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:40:58 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-02f3d8e0-80e8-47d9-89ac-0aad9e44b907 tempest-VolumesActionsTest-249281332 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (58dc696f-9369-4f00-85e7-7b505b03c302) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-45da5fcd-38dd-4ecc-baa5-13e270690df8', 'volume_size': 1}' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:40:58 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-02f3d8e0-80e8-47d9-89ac-0aad9e44b907 tempest-VolumesActionsTest-249281332 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9c98db1b-01e9-4f72-b968-5709be96fafc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:40:58 devstack sudo[96186]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-fef091fd-079d-4729-9ef8-0925ff68112a 1073741824 Jul 10 04:40:58 devstack sudo[96186]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:40:58 devstack cinder-volume[87444]: INFO cinder.volume.flows.manager.create_volume [None req-02f3d8e0-80e8-47d9-89ac-0aad9e44b907 tempest-VolumesActionsTest-249281332 None] Volume volume-45da5fcd-38dd-4ecc-baa5-13e270690df8 (45da5fcd-38dd-4ecc-baa5-13e270690df8): created successfully Jul 10 04:40:58 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-02f3d8e0-80e8-47d9-89ac-0aad9e44b907 tempest-VolumesActionsTest-249281332 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9c98db1b-01e9-4f72-b968-5709be96fafc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:40:58 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-02f3d8e0-80e8-47d9-89ac-0aad9e44b907 tempest-VolumesActionsTest-249281332 None] Flow 'volume_create_manager' (8da02a2b-bafa-46b7-b62a-39c7ff9a25dd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87444) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 04:40:58 devstack cinder-volume[87444]: INFO cinder.volume.manager [None req-02f3d8e0-80e8-47d9-89ac-0aad9e44b907 tempest-VolumesActionsTest-249281332 None] Created volume successfully. Jul 10 04:40:58 devstack sudo[96185]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-34674eea-c59f-4b1f-af59-fd99f066830e Jul 10 04:40:58 devstack sudo[96185]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:40:58 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-a7be7960-710c-486f-8303-592373e29025 tempest-VolumesActionsTest-1960720823 None] Acquiring lock "cinder-45da5fcd-38dd-4ecc-baa5-13e270690df8-delete_volume" by "delete_volume" {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 04:40:58 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-a7be7960-710c-486f-8303-592373e29025 tempest-VolumesActionsTest-1960720823 None] Lock "cinder-45da5fcd-38dd-4ecc-baa5-13e270690df8-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 04:40:58 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-a7be7960-710c-486f-8303-592373e29025 tempest-VolumesActionsTest-1960720823 None] Acquiring lock "cinder-quobyte-45da5fcd-38dd-4ecc-baa5-13e270690df8" by "delete_volume" {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 04:40:58 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-a7be7960-710c-486f-8303-592373e29025 tempest-VolumesActionsTest-1960720823 None] Lock "cinder-quobyte-45da5fcd-38dd-4ecc-baa5-13e270690df8" acquired by "delete_volume" :: waited 0.025s {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 04:40:58 devstack cinder-volume[87444]: DEBUG oslo.privsep.daemon [-] privsep: reply[694bd001-966e-4fee-93c5-cecda6d05941]: (4, 'qcow2') {{(pid=88499) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 04:40:58 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-a7be7960-710c-486f-8303-592373e29025 tempest-VolumesActionsTest-1960720823 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-45da5fcd-38dd-4ecc-baa5-13e270690df8 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:40:59 devstack sudo[96190]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-45da5fcd-38dd-4ecc-baa5-13e270690df8 Jul 10 04:40:59 devstack sudo[96190]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:40:59 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-dd4c500a-b6b1-44cc-b2cb-1d284a62818e tempest-VolumeQuotasNegativeTestJSON-1984637455 None] Acquiring lock "cinder-a16b8e12-a257-4f03-adb2-45810a23d081-delete_volume" by "delete_volume" {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 04:40:59 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-dd4c500a-b6b1-44cc-b2cb-1d284a62818e tempest-VolumeQuotasNegativeTestJSON-1984637455 None] Lock "cinder-a16b8e12-a257-4f03-adb2-45810a23d081-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 04:40:59 devstack sudo[96185]: pam_unix(sudo:session): session closed for user root Jul 10 04:40:59 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-d32afd74-a208-416e-a01f-b7dcee6add81 tempest-SnapshotMetadataTestJSON-1035999281 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-34674eea-c59f-4b1f-af59-fd99f066830e" returned: 0 in 0.992s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:40:59 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-d32afd74-a208-416e-a01f-b7dcee6add81 tempest-SnapshotMetadataTestJSON-1035999281 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-34674eea-c59f-4b1f-af59-fd99f066830e {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:40:59 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-dd4c500a-b6b1-44cc-b2cb-1d284a62818e tempest-VolumeQuotasNegativeTestJSON-1984637455 None] Acquiring lock "cinder-quobyte-a16b8e12-a257-4f03-adb2-45810a23d081" by "delete_volume" {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 04:40:59 devstack sudo[96197]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-34674eea-c59f-4b1f-af59-fd99f066830e Jul 10 04:40:59 devstack sudo[96197]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:40:59 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-dd4c500a-b6b1-44cc-b2cb-1d284a62818e tempest-VolumeQuotasNegativeTestJSON-1984637455 None] Lock "cinder-quobyte-a16b8e12-a257-4f03-adb2-45810a23d081" acquired by "delete_volume" :: waited 0.025s {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 04:40:59 devstack cinder-volume[87444]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4ca28f3-48e9-49b2-a2f8-cb42c59abe53]: (4, 'qcow2') {{(pid=88499) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 04:40:59 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-dd4c500a-b6b1-44cc-b2cb-1d284a62818e tempest-VolumeQuotasNegativeTestJSON-1984637455 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-a16b8e12-a257-4f03-adb2-45810a23d081 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:40:59 devstack sudo[96186]: pam_unix(sudo:session): session closed for user root Jul 10 04:40:59 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-a4581d50-d14f-4160-aad7-71f65fb96be8 tempest-GroupsTest-1660920858 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-fef091fd-079d-4729-9ef8-0925ff68112a 1073741824" returned: 0 in 1.110s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:40:59 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-a4581d50-d14f-4160-aad7-71f65fb96be8 tempest-GroupsTest-1660920858 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-fef091fd-079d-4729-9ef8-0925ff68112a {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:40:59 devstack sudo[96199]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-a16b8e12-a257-4f03-adb2-45810a23d081 Jul 10 04:40:59 devstack sudo[96199]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:40:59 devstack sudo[96200]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-fef091fd-079d-4729-9ef8-0925ff68112a Jul 10 04:40:59 devstack sudo[96200]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:40:59 devstack sudo[96190]: pam_unix(sudo:session): session closed for user root Jul 10 04:40:59 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-a7be7960-710c-486f-8303-592373e29025 tempest-VolumesActionsTest-1960720823 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-45da5fcd-38dd-4ecc-baa5-13e270690df8" returned: 0 in 0.945s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:40:59 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-a7be7960-710c-486f-8303-592373e29025 tempest-VolumesActionsTest-1960720823 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-45da5fcd-38dd-4ecc-baa5-13e270690df8 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:40:59 devstack sudo[96209]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-45da5fcd-38dd-4ecc-baa5-13e270690df8 Jul 10 04:40:59 devstack sudo[96209]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:40:59 devstack sudo[96197]: pam_unix(sudo:session): session closed for user root Jul 10 04:40:59 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-d32afd74-a208-416e-a01f-b7dcee6add81 tempest-SnapshotMetadataTestJSON-1035999281 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-34674eea-c59f-4b1f-af59-fd99f066830e" returned: 0 in 0.694s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:41:00 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-d32afd74-a208-416e-a01f-b7dcee6add81 tempest-SnapshotMetadataTestJSON-1035999281 None] Lock "cinder-quobyte-34674eea-c59f-4b1f-af59-fd99f066830e" released by "delete_volume" :: held 1.768s {{(pid=87444) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 04:41:00 devstack cinder-volume[87444]: DEBUG cinder.quota [None req-d32afd74-a208-416e-a01f-b7dcee6add81 tempest-SnapshotMetadataTestJSON-1035999281 None] Created reservations ['430126ec-e954-4d82-aa9c-7c7cdc549957', '785103e1-db47-4177-a85b-613530cf45f4', '9a55e44a-2e47-4b6f-b862-3ca8b2543c94', '36014881-aa2a-44de-9fa9-f5fb19fc10a8'] {{(pid=87444) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 04:41:00 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-d32afd74-a208-416e-a01f-b7dcee6add81 tempest-SnapshotMetadataTestJSON-1035999281 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 04:41:00 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-d32afd74-a208-416e-a01f-b7dcee6add81 tempest-SnapshotMetadataTestJSON-1035999281 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 04:41:00 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-d32afd74-a208-416e-a01f-b7dcee6add81 tempest-SnapshotMetadataTestJSON-1035999281 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922': None} {{(pid=87444) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 04:41:00 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-d32afd74-a208-416e-a01f-b7dcee6add81 tempest-SnapshotMetadataTestJSON-1035999281 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922'] {{(pid=87444) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 04:41:00 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-d32afd74-a208-416e-a01f-b7dcee6add81 tempest-SnapshotMetadataTestJSON-1035999281 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 04:41:00 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-d32afd74-a208-416e-a01f-b7dcee6add81 tempest-SnapshotMetadataTestJSON-1035999281 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:41:00 devstack sudo[96216]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097 Jul 10 04:41:00 devstack sudo[96216]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:41:00 devstack sudo[96199]: pam_unix(sudo:session): session closed for user root Jul 10 04:41:00 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-dd4c500a-b6b1-44cc-b2cb-1d284a62818e tempest-VolumeQuotasNegativeTestJSON-1984637455 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-a16b8e12-a257-4f03-adb2-45810a23d081" returned: 0 in 0.932s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:41:00 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-dd4c500a-b6b1-44cc-b2cb-1d284a62818e tempest-VolumeQuotasNegativeTestJSON-1984637455 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-a16b8e12-a257-4f03-adb2-45810a23d081 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:41:00 devstack sudo[96200]: pam_unix(sudo:session): session closed for user root Jul 10 04:41:00 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-a4581d50-d14f-4160-aad7-71f65fb96be8 tempest-GroupsTest-1660920858 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-fef091fd-079d-4729-9ef8-0925ff68112a" returned: 0 in 0.833s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:41:00 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-a4581d50-d14f-4160-aad7-71f65fb96be8 tempest-GroupsTest-1660920858 None] <== create_volume: return (1990ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922'} {{(pid=87444) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 04:41:00 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-a4581d50-d14f-4160-aad7-71f65fb96be8 tempest-GroupsTest-1660920858 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.996s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 04:41:00 devstack sudo[96218]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-a16b8e12-a257-4f03-adb2-45810a23d081 Jul 10 04:41:00 devstack sudo[96218]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:41:00 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-a4581d50-d14f-4160-aad7-71f65fb96be8 tempest-GroupsTest-1660920858 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e0ebb0ce-9acf-48f4-a244-c2a00fcf612e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fef091fd-079d-4729-9ef8-0925ff68112a', 'volume_size': 1}' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:41:00 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-a4581d50-d14f-4160-aad7-71f65fb96be8 tempest-GroupsTest-1660920858 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (355f9522-10e7-4cac-b9be-20293227dd54) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:41:00 devstack cinder-volume[87444]: INFO cinder.volume.flows.manager.create_volume [None req-a4581d50-d14f-4160-aad7-71f65fb96be8 tempest-GroupsTest-1660920858 None] Volume volume-fef091fd-079d-4729-9ef8-0925ff68112a (fef091fd-079d-4729-9ef8-0925ff68112a): created successfully Jul 10 04:41:00 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-a4581d50-d14f-4160-aad7-71f65fb96be8 tempest-GroupsTest-1660920858 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (355f9522-10e7-4cac-b9be-20293227dd54) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:41:00 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-a4581d50-d14f-4160-aad7-71f65fb96be8 tempest-GroupsTest-1660920858 None] Flow 'volume_create_manager' (91cab8b7-d25e-431b-ac11-6bd37f9a7f01) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87444) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 04:41:00 devstack cinder-volume[87444]: INFO cinder.volume.manager [None req-a4581d50-d14f-4160-aad7-71f65fb96be8 tempest-GroupsTest-1660920858 None] Created volume successfully. Jul 10 04:41:00 devstack sudo[96209]: pam_unix(sudo:session): session closed for user root Jul 10 04:41:00 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-a7be7960-710c-486f-8303-592373e29025 tempest-VolumesActionsTest-1960720823 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-45da5fcd-38dd-4ecc-baa5-13e270690df8" returned: 0 in 0.805s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:41:00 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-a7be7960-710c-486f-8303-592373e29025 tempest-VolumesActionsTest-1960720823 None] Lock "cinder-quobyte-45da5fcd-38dd-4ecc-baa5-13e270690df8" released by "delete_volume" :: held 1.825s {{(pid=87444) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 04:41:00 devstack cinder-volume[87444]: DEBUG cinder.quota [None req-a7be7960-710c-486f-8303-592373e29025 tempest-VolumesActionsTest-1960720823 None] Created reservations ['c815a15b-9f04-4cfb-b1f5-0edbf10157eb', 'ca03f23a-8651-472c-a202-0b500624b444', '7f40f833-3edb-4922-b8f8-0464188a8b2a', '6d5d6bfb-7e30-4383-975d-ff1bf54ba36c'] {{(pid=87444) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 04:41:00 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-a7be7960-710c-486f-8303-592373e29025 tempest-VolumesActionsTest-1960720823 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 04:41:00 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-a7be7960-710c-486f-8303-592373e29025 tempest-VolumesActionsTest-1960720823 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 04:41:00 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-a7be7960-710c-486f-8303-592373e29025 tempest-VolumesActionsTest-1960720823 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922': None} {{(pid=87444) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 04:41:00 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-a7be7960-710c-486f-8303-592373e29025 tempest-VolumesActionsTest-1960720823 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922'] {{(pid=87444) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 04:41:00 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-a7be7960-710c-486f-8303-592373e29025 tempest-VolumesActionsTest-1960720823 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 04:41:00 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-a7be7960-710c-486f-8303-592373e29025 tempest-VolumesActionsTest-1960720823 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:41:00 devstack sudo[96222]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097 Jul 10 04:41:00 devstack sudo[96222]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:41:01 devstack sudo[96216]: pam_unix(sudo:session): session closed for user root Jul 10 04:41:01 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-d32afd74-a208-416e-a01f-b7dcee6add81 tempest-SnapshotMetadataTestJSON-1035999281 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097" returned: 0 in 0.880s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:41:01 devstack cinder-volume[87444]: DEBUG cinder.manager [None req-d32afd74-a208-416e-a01f-b7dcee6add81 tempest-SnapshotMetadataTestJSON-1035999281 None] Notifying Schedulers of capabilities ... {{(pid=87444) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 04:41:01 devstack cinder-volume[87444]: INFO cinder.volume.manager [None req-d32afd74-a208-416e-a01f-b7dcee6add81 tempest-SnapshotMetadataTestJSON-1035999281 None] Deleted volume successfully. Jul 10 04:41:01 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-d32afd74-a208-416e-a01f-b7dcee6add81 tempest-SnapshotMetadataTestJSON-1035999281 None] Lock "cinder-34674eea-c59f-4b1f-af59-fd99f066830e-delete_volume" released by "delete_volume" :: held 2.906s {{(pid=87444) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 04:41:01 devstack sudo[96218]: pam_unix(sudo:session): session closed for user root Jul 10 04:41:01 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-dd4c500a-b6b1-44cc-b2cb-1d284a62818e tempest-VolumeQuotasNegativeTestJSON-1984637455 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-a16b8e12-a257-4f03-adb2-45810a23d081" returned: 0 in 0.848s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:41:01 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-dd4c500a-b6b1-44cc-b2cb-1d284a62818e tempest-VolumeQuotasNegativeTestJSON-1984637455 None] Lock "cinder-quobyte-a16b8e12-a257-4f03-adb2-45810a23d081" released by "delete_volume" :: held 1.827s {{(pid=87444) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 04:41:01 devstack cinder-volume[87444]: DEBUG cinder.quota [None req-dd4c500a-b6b1-44cc-b2cb-1d284a62818e tempest-VolumeQuotasNegativeTestJSON-1984637455 None] Created reservations ['8855fac5-8328-49fd-a3ba-ecd97dc15118', '2f92885b-ba54-45c6-a817-f23adb05f643', '44f7fd86-7482-4b6e-b2a2-7016c1689656', 'b5f9c455-e00e-422a-80f6-883ba6574d43'] {{(pid=87444) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 04:41:01 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-dd4c500a-b6b1-44cc-b2cb-1d284a62818e tempest-VolumeQuotasNegativeTestJSON-1984637455 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 04:41:01 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-dd4c500a-b6b1-44cc-b2cb-1d284a62818e tempest-VolumeQuotasNegativeTestJSON-1984637455 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 04:41:01 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-dd4c500a-b6b1-44cc-b2cb-1d284a62818e tempest-VolumeQuotasNegativeTestJSON-1984637455 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922': None} {{(pid=87444) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 04:41:01 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-dd4c500a-b6b1-44cc-b2cb-1d284a62818e tempest-VolumeQuotasNegativeTestJSON-1984637455 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922'] {{(pid=87444) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 04:41:01 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-dd4c500a-b6b1-44cc-b2cb-1d284a62818e tempest-VolumeQuotasNegativeTestJSON-1984637455 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 04:41:01 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-dd4c500a-b6b1-44cc-b2cb-1d284a62818e tempest-VolumeQuotasNegativeTestJSON-1984637455 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:41:01 devstack sudo[96225]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097 Jul 10 04:41:01 devstack sudo[96225]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:41:01 devstack sudo[96222]: pam_unix(sudo:session): session closed for user root Jul 10 04:41:01 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-a7be7960-710c-486f-8303-592373e29025 tempest-VolumesActionsTest-1960720823 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097" returned: 0 in 0.843s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:41:01 devstack cinder-volume[87444]: DEBUG cinder.manager [None req-a7be7960-710c-486f-8303-592373e29025 tempest-VolumesActionsTest-1960720823 None] Notifying Schedulers of capabilities ... {{(pid=87444) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 04:41:01 devstack cinder-volume[87444]: INFO cinder.volume.manager [None req-a7be7960-710c-486f-8303-592373e29025 tempest-VolumesActionsTest-1960720823 None] Deleted volume successfully. Jul 10 04:41:01 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-a7be7960-710c-486f-8303-592373e29025 tempest-VolumesActionsTest-1960720823 None] Lock "cinder-45da5fcd-38dd-4ecc-baa5-13e270690df8-delete_volume" released by "delete_volume" :: held 2.968s {{(pid=87444) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 04:41:02 devstack cinder-volume[87444]: DEBUG cinder.volume.flows.manager.create_volume [None req-9507689e-3bb0-4140-94a1-bc43a5e1e0c9 tempest-VolumesActionsTest-249281332 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87444) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 04:41:02 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-9507689e-3bb0-4140-94a1-bc43a5e1e0c9 tempest-VolumesActionsTest-249281332 None] Flow 'volume_create_manager' (edacc179-efed-47dd-901f-50fa17c1cc76) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 04:41:02 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-9507689e-3bb0-4140-94a1-bc43a5e1e0c9 tempest-VolumesActionsTest-249281332 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fd323f98-b340-4851-9bda-57e96893162c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:41:02 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-9507689e-3bb0-4140-94a1-bc43a5e1e0c9 tempest-VolumesActionsTest-249281332 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fd323f98-b340-4851-9bda-57e96893162c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T02:41:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-303968494',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0a032e83-f98f-416f-9166-08527ae6bf30,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8896182fdfb44908ba0a8d3405add17a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T02:41:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T02:41:02Z,use_quota=True,user_id='439be0ce5a464a3c827a628503ea0e00',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(317e369e-1e06-434d-ae95-a335f0e6c903),volume_type_id=317e369e-1e06-434d-ae95-a335f0e6c903)' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:41:02 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-9507689e-3bb0-4140-94a1-bc43a5e1e0c9 tempest-VolumesActionsTest-249281332 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4c900086-742b-47ce-814e-1e286a3cffdd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:41:02 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-9507689e-3bb0-4140-94a1-bc43a5e1e0c9 tempest-VolumesActionsTest-249281332 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4c900086-742b-47ce-814e-1e286a3cffdd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:41:02 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-9507689e-3bb0-4140-94a1-bc43a5e1e0c9 tempest-VolumesActionsTest-249281332 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (146f740e-9685-4019-9b07-33a1e7e3c7a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:41:02 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-9507689e-3bb0-4140-94a1-bc43a5e1e0c9 tempest-VolumesActionsTest-249281332 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (146f740e-9685-4019-9b07-33a1e7e3c7a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0a032e83-f98f-416f-9166-08527ae6bf30', 'volume_name': 'volume-0a032e83-f98f-416f-9166-08527ae6bf30', 'volume_size': 1}' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:41:02 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-9507689e-3bb0-4140-94a1-bc43a5e1e0c9 tempest-VolumesActionsTest-249281332 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7009198f-bce6-4665-861f-c51d81bb81bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:41:02 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-9507689e-3bb0-4140-94a1-bc43a5e1e0c9 tempest-VolumesActionsTest-249281332 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7009198f-bce6-4665-861f-c51d81bb81bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:41:02 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-9507689e-3bb0-4140-94a1-bc43a5e1e0c9 tempest-VolumesActionsTest-249281332 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f33bae93-6ff4-49be-af2c-6d50294b747f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:41:02 devstack cinder-volume[87444]: INFO cinder.volume.flows.manager.create_volume [None req-9507689e-3bb0-4140-94a1-bc43a5e1e0c9 tempest-VolumesActionsTest-249281332 None] Volume 0a032e83-f98f-416f-9166-08527ae6bf30: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0a032e83-f98f-416f-9166-08527ae6bf30', 'volume_size': 1} Jul 10 04:41:02 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-9507689e-3bb0-4140-94a1-bc43a5e1e0c9 tempest-VolumesActionsTest-249281332 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 04:41:02 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-9507689e-3bb0-4140-94a1-bc43a5e1e0c9 tempest-VolumesActionsTest-249281332 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 04:41:02 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-9507689e-3bb0-4140-94a1-bc43a5e1e0c9 tempest-VolumesActionsTest-249281332 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T02:41:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-303968494',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0a032e83-f98f-416f-9166-08527ae6bf30,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8896182fdfb44908ba0a8d3405add17a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T02:41:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T02:41:02Z,use_quota=True,user_id='439be0ce5a464a3c827a628503ea0e00',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(317e369e-1e06-434d-ae95-a335f0e6c903),volume_type_id=317e369e-1e06-434d-ae95-a335f0e6c903)}" {{(pid=87444) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 04:41:02 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.remotefs [None req-9507689e-3bb0-4140-94a1-bc43a5e1e0c9 tempest-VolumesActionsTest-249281332 None] Creating volume 0a032e83-f98f-416f-9166-08527ae6bf30 {{(pid=87444) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 04:41:02 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-9507689e-3bb0-4140-94a1-bc43a5e1e0c9 tempest-VolumesActionsTest-249281332 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 04:41:02 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-9507689e-3bb0-4140-94a1-bc43a5e1e0c9 tempest-VolumesActionsTest-249281332 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 04:41:02 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-9507689e-3bb0-4140-94a1-bc43a5e1e0c9 tempest-VolumesActionsTest-249281332 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922': None} {{(pid=87444) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 04:41:02 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-9507689e-3bb0-4140-94a1-bc43a5e1e0c9 tempest-VolumesActionsTest-249281332 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922'] {{(pid=87444) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 04:41:02 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-9507689e-3bb0-4140-94a1-bc43a5e1e0c9 tempest-VolumesActionsTest-249281332 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 04:41:02 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-9507689e-3bb0-4140-94a1-bc43a5e1e0c9 tempest-VolumesActionsTest-249281332 None] Selected osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922 as target Quobyte volume. {{(pid=87444) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 04:41:02 devstack cinder-volume[87444]: INFO cinder.volume.drivers.remotefs [None req-9507689e-3bb0-4140-94a1-bc43a5e1e0c9 tempest-VolumesActionsTest-249281332 None] casted to osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922 Jul 10 04:41:02 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-9507689e-3bb0-4140-94a1-bc43a5e1e0c9 tempest-VolumesActionsTest-249281332 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-0a032e83-f98f-416f-9166-08527ae6bf30 1073741824 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:41:02 devstack sudo[96229]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-0a032e83-f98f-416f-9166-08527ae6bf30 1073741824 Jul 10 04:41:02 devstack sudo[96229]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:41:02 devstack sudo[96225]: pam_unix(sudo:session): session closed for user root Jul 10 04:41:02 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-dd4c500a-b6b1-44cc-b2cb-1d284a62818e tempest-VolumeQuotasNegativeTestJSON-1984637455 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097" returned: 0 in 1.061s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:41:02 devstack cinder-volume[87444]: DEBUG cinder.manager [None req-dd4c500a-b6b1-44cc-b2cb-1d284a62818e tempest-VolumeQuotasNegativeTestJSON-1984637455 None] Notifying Schedulers of capabilities ... {{(pid=87444) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 04:41:02 devstack cinder-volume[87444]: INFO cinder.volume.manager [None req-dd4c500a-b6b1-44cc-b2cb-1d284a62818e tempest-VolumeQuotasNegativeTestJSON-1984637455 None] Deleted volume successfully. Jul 10 04:41:02 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-dd4c500a-b6b1-44cc-b2cb-1d284a62818e tempest-VolumeQuotasNegativeTestJSON-1984637455 None] Lock "cinder-a16b8e12-a257-4f03-adb2-45810a23d081-delete_volume" released by "delete_volume" :: held 3.219s {{(pid=87444) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 04:41:02 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-0a46b409-d6bb-4f62-a7d3-6c59f026c242 tempest-GroupsTest-1660920858 None] Acquiring lock "cinder-quobyte-fef091fd-079d-4729-9ef8-0925ff68112a" by "delete_volume" {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 04:41:02 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-0a46b409-d6bb-4f62-a7d3-6c59f026c242 tempest-GroupsTest-1660920858 None] Lock "cinder-quobyte-fef091fd-079d-4729-9ef8-0925ff68112a" acquired by "delete_volume" :: waited 0.034s {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 04:41:02 devstack cinder-volume[87444]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f4db878-5dca-4412-afb5-d2ce71bf7c45]: (4, 'qcow2') {{(pid=88499) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 04:41:02 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-0a46b409-d6bb-4f62-a7d3-6c59f026c242 tempest-GroupsTest-1660920858 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-fef091fd-079d-4729-9ef8-0925ff68112a {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:41:02 devstack sudo[96234]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-fef091fd-079d-4729-9ef8-0925ff68112a Jul 10 04:41:02 devstack sudo[96234]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:41:03 devstack sudo[96229]: pam_unix(sudo:session): session closed for user root Jul 10 04:41:03 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-9507689e-3bb0-4140-94a1-bc43a5e1e0c9 tempest-VolumesActionsTest-249281332 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-0a032e83-f98f-416f-9166-08527ae6bf30 1073741824" returned: 0 in 1.106s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:41:03 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-9507689e-3bb0-4140-94a1-bc43a5e1e0c9 tempest-VolumesActionsTest-249281332 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-0a032e83-f98f-416f-9166-08527ae6bf30 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:41:03 devstack sudo[96241]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-0a032e83-f98f-416f-9166-08527ae6bf30 Jul 10 04:41:03 devstack sudo[96241]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:41:03 devstack sudo[96234]: pam_unix(sudo:session): session closed for user root Jul 10 04:41:03 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-0a46b409-d6bb-4f62-a7d3-6c59f026c242 tempest-GroupsTest-1660920858 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-fef091fd-079d-4729-9ef8-0925ff68112a" returned: 0 in 1.039s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:41:03 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-0a46b409-d6bb-4f62-a7d3-6c59f026c242 tempest-GroupsTest-1660920858 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-fef091fd-079d-4729-9ef8-0925ff68112a {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:41:03 devstack sudo[96246]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-fef091fd-079d-4729-9ef8-0925ff68112a Jul 10 04:41:03 devstack sudo[96246]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:41:04 devstack sudo[96241]: pam_unix(sudo:session): session closed for user root Jul 10 04:41:04 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-9507689e-3bb0-4140-94a1-bc43a5e1e0c9 tempest-VolumesActionsTest-249281332 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-0a032e83-f98f-416f-9166-08527ae6bf30" returned: 0 in 0.936s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:41:04 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-9507689e-3bb0-4140-94a1-bc43a5e1e0c9 tempest-VolumesActionsTest-249281332 None] <== create_volume: return (2097ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922'} {{(pid=87444) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 04:41:04 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-9507689e-3bb0-4140-94a1-bc43a5e1e0c9 tempest-VolumesActionsTest-249281332 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.099s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 04:41:04 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-9507689e-3bb0-4140-94a1-bc43a5e1e0c9 tempest-VolumesActionsTest-249281332 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f33bae93-6ff4-49be-af2c-6d50294b747f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0a032e83-f98f-416f-9166-08527ae6bf30', 'volume_size': 1}' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:41:04 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-9507689e-3bb0-4140-94a1-bc43a5e1e0c9 tempest-VolumesActionsTest-249281332 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ed633637-552f-4dca-8594-4569eb94bfa5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:41:04 devstack cinder-volume[87444]: INFO cinder.volume.flows.manager.create_volume [None req-9507689e-3bb0-4140-94a1-bc43a5e1e0c9 tempest-VolumesActionsTest-249281332 None] Volume volume-0a032e83-f98f-416f-9166-08527ae6bf30 (0a032e83-f98f-416f-9166-08527ae6bf30): created successfully Jul 10 04:41:04 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-9507689e-3bb0-4140-94a1-bc43a5e1e0c9 tempest-VolumesActionsTest-249281332 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ed633637-552f-4dca-8594-4569eb94bfa5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:41:04 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-9507689e-3bb0-4140-94a1-bc43a5e1e0c9 tempest-VolumesActionsTest-249281332 None] Flow 'volume_create_manager' (edacc179-efed-47dd-901f-50fa17c1cc76) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87444) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 04:41:04 devstack cinder-volume[87444]: INFO cinder.volume.manager [None req-9507689e-3bb0-4140-94a1-bc43a5e1e0c9 tempest-VolumesActionsTest-249281332 None] Created volume successfully. Jul 10 04:41:04 devstack sudo[96246]: pam_unix(sudo:session): session closed for user root Jul 10 04:41:04 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-0a46b409-d6bb-4f62-a7d3-6c59f026c242 tempest-GroupsTest-1660920858 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-fef091fd-079d-4729-9ef8-0925ff68112a" returned: 0 in 0.920s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:41:04 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-0a46b409-d6bb-4f62-a7d3-6c59f026c242 tempest-GroupsTest-1660920858 None] Lock "cinder-quobyte-fef091fd-079d-4729-9ef8-0925ff68112a" released by "delete_volume" :: held 2.023s {{(pid=87444) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 04:41:04 devstack cinder-volume[87444]: DEBUG cinder.quota [None req-0a46b409-d6bb-4f62-a7d3-6c59f026c242 tempest-GroupsTest-1660920858 None] Created reservations ['7865a629-76dc-4289-a88a-e770d6d7e066'] {{(pid=87444) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 04:41:04 devstack cinder-volume[87444]: WARNING cinder.quota [None req-0a46b409-d6bb-4f62-a7d3-6c59f026c242 tempest-GroupsTest-1660920858 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-1205838320 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-1205838320, it is now deprecated. Please use the default quota class for default quota. Jul 10 04:41:04 devstack cinder-volume[87444]: WARNING cinder.quota [None req-0a46b409-d6bb-4f62-a7d3-6c59f026c242 tempest-GroupsTest-1660920858 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-1205838320 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-1205838320, it is now deprecated. Please use the default quota class for default quota. Jul 10 04:41:04 devstack cinder-volume[87444]: DEBUG cinder.quota [None req-0a46b409-d6bb-4f62-a7d3-6c59f026c242 tempest-GroupsTest-1660920858 None] Created reservations ['239d94a4-e9d3-4fc5-9d98-eeb0f8c091fb', 'f7f04788-c49f-44ae-a0a2-bda428e83f40', '6ac17256-9074-4b73-8040-240c2e1d68c6', '9279bb14-a39f-4736-ae79-e7d75a6049e2'] {{(pid=87444) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 04:41:04 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-0a46b409-d6bb-4f62-a7d3-6c59f026c242 tempest-GroupsTest-1660920858 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 04:41:04 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-0a46b409-d6bb-4f62-a7d3-6c59f026c242 tempest-GroupsTest-1660920858 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 04:41:04 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-0a46b409-d6bb-4f62-a7d3-6c59f026c242 tempest-GroupsTest-1660920858 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922': None} {{(pid=87444) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 04:41:04 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-0a46b409-d6bb-4f62-a7d3-6c59f026c242 tempest-GroupsTest-1660920858 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922'] {{(pid=87444) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 04:41:04 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-0a46b409-d6bb-4f62-a7d3-6c59f026c242 tempest-GroupsTest-1660920858 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 04:41:04 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-0a46b409-d6bb-4f62-a7d3-6c59f026c242 tempest-GroupsTest-1660920858 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:41:04 devstack sudo[96250]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097 Jul 10 04:41:04 devstack sudo[96250]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:41:05 devstack cinder-volume[87444]: DEBUG cinder.quota [None req-ca634113-6b71-4c3b-b322-d6a96a34d938 tempest-GroupsTest-1660920858 None] Created reservations ['e778d339-594c-493f-90b2-e7ec82c618ca'] {{(pid=87444) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 04:41:05 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-ca634113-6b71-4c3b-b322-d6a96a34d938 tempest-GroupsTest-1660920858 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 04:41:05 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-ca634113-6b71-4c3b-b322-d6a96a34d938 tempest-GroupsTest-1660920858 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 04:41:05 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-ca634113-6b71-4c3b-b322-d6a96a34d938 tempest-GroupsTest-1660920858 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922': None} {{(pid=87444) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 04:41:05 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-ca634113-6b71-4c3b-b322-d6a96a34d938 tempest-GroupsTest-1660920858 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922'] {{(pid=87444) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 04:41:05 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-ca634113-6b71-4c3b-b322-d6a96a34d938 tempest-GroupsTest-1660920858 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.028s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 04:41:05 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-ca634113-6b71-4c3b-b322-d6a96a34d938 tempest-GroupsTest-1660920858 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:41:05 devstack sudo[96252]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097 Jul 10 04:41:05 devstack sudo[96252]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:41:05 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-8b3dc7c6-7e00-4911-a059-78f749e205be tempest-VolumesActionsTest-1960720823 None] Acquiring lock "cinder-0a032e83-f98f-416f-9166-08527ae6bf30-delete_volume" by "delete_volume" {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 04:41:05 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-8b3dc7c6-7e00-4911-a059-78f749e205be tempest-VolumesActionsTest-1960720823 None] Lock "cinder-0a032e83-f98f-416f-9166-08527ae6bf30-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 04:41:05 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-8b3dc7c6-7e00-4911-a059-78f749e205be tempest-VolumesActionsTest-1960720823 None] Acquiring lock "cinder-quobyte-0a032e83-f98f-416f-9166-08527ae6bf30" by "delete_volume" {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 04:41:05 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-8b3dc7c6-7e00-4911-a059-78f749e205be tempest-VolumesActionsTest-1960720823 None] Lock "cinder-quobyte-0a032e83-f98f-416f-9166-08527ae6bf30" acquired by "delete_volume" :: waited 0.048s {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 04:41:05 devstack cinder-volume[87444]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad80cbbc-243b-4f95-9e21-831d5bd37a84]: (4, 'qcow2') {{(pid=88499) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 04:41:05 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-8b3dc7c6-7e00-4911-a059-78f749e205be tempest-VolumesActionsTest-1960720823 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-0a032e83-f98f-416f-9166-08527ae6bf30 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:41:05 devstack sudo[96250]: pam_unix(sudo:session): session closed for user root Jul 10 04:41:05 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-0a46b409-d6bb-4f62-a7d3-6c59f026c242 tempest-GroupsTest-1660920858 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097" returned: 0 in 0.941s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:41:05 devstack cinder-volume[87444]: DEBUG cinder.manager [None req-0a46b409-d6bb-4f62-a7d3-6c59f026c242 tempest-GroupsTest-1660920858 None] Notifying Schedulers of capabilities ... {{(pid=87444) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 04:41:05 devstack cinder-volume[87444]: INFO cinder.volume.manager [None req-0a46b409-d6bb-4f62-a7d3-6c59f026c242 tempest-GroupsTest-1660920858 None] Delete group completed successfully. Jul 10 04:41:05 devstack sudo[96255]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-0a032e83-f98f-416f-9166-08527ae6bf30 Jul 10 04:41:05 devstack sudo[96255]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:41:06 devstack cinder-volume[87444]: DEBUG cinder.volume.flows.manager.create_volume [None req-6ebb212b-04c3-4293-b013-5fcd689d9de4 tempest-AbsoluteLimitsTests-1703484533 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87444) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 04:41:06 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-6ebb212b-04c3-4293-b013-5fcd689d9de4 tempest-AbsoluteLimitsTests-1703484533 None] Flow 'volume_create_manager' (f97ebe84-9323-4813-9648-267d02fe2909) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 04:41:06 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-6ebb212b-04c3-4293-b013-5fcd689d9de4 tempest-AbsoluteLimitsTests-1703484533 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (80253df8-b11c-4e9d-bca1-6296292f5324) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:41:06 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-6ebb212b-04c3-4293-b013-5fcd689d9de4 tempest-AbsoluteLimitsTests-1703484533 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (80253df8-b11c-4e9d-bca1-6296292f5324) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T02:41:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-2101813151',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=aee9521a-cba5-4dcf-8338-55a89c689f17,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='33cb444035a7497aaa11651d55f45c30',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T02:41:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T02:41:06Z,use_quota=True,user_id='3d022e7c858f40fc94e4cd6d3fd20888',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(317e369e-1e06-434d-ae95-a335f0e6c903),volume_type_id=317e369e-1e06-434d-ae95-a335f0e6c903)' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:41:06 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-6ebb212b-04c3-4293-b013-5fcd689d9de4 tempest-AbsoluteLimitsTests-1703484533 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a7850c70-0e72-47c6-b23c-089a49baeae2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:41:06 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-6ebb212b-04c3-4293-b013-5fcd689d9de4 tempest-AbsoluteLimitsTests-1703484533 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a7850c70-0e72-47c6-b23c-089a49baeae2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:41:06 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-6ebb212b-04c3-4293-b013-5fcd689d9de4 tempest-AbsoluteLimitsTests-1703484533 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9466da8a-f5b1-4315-8363-65d81a13e5c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:41:06 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-6ebb212b-04c3-4293-b013-5fcd689d9de4 tempest-AbsoluteLimitsTests-1703484533 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9466da8a-f5b1-4315-8363-65d81a13e5c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'aee9521a-cba5-4dcf-8338-55a89c689f17', 'volume_name': 'volume-aee9521a-cba5-4dcf-8338-55a89c689f17', 'volume_size': 1}' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:41:06 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-6ebb212b-04c3-4293-b013-5fcd689d9de4 tempest-AbsoluteLimitsTests-1703484533 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (39c0a384-d394-4a0c-8d06-e97dd0dcf529) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:41:06 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-6ebb212b-04c3-4293-b013-5fcd689d9de4 tempest-AbsoluteLimitsTests-1703484533 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (39c0a384-d394-4a0c-8d06-e97dd0dcf529) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:41:06 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-6ebb212b-04c3-4293-b013-5fcd689d9de4 tempest-AbsoluteLimitsTests-1703484533 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (191d255e-bb53-486c-810c-38758bc05d59) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:41:06 devstack cinder-volume[87444]: INFO cinder.volume.flows.manager.create_volume [None req-6ebb212b-04c3-4293-b013-5fcd689d9de4 tempest-AbsoluteLimitsTests-1703484533 None] Volume aee9521a-cba5-4dcf-8338-55a89c689f17: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-aee9521a-cba5-4dcf-8338-55a89c689f17', 'volume_size': 1} Jul 10 04:41:06 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-6ebb212b-04c3-4293-b013-5fcd689d9de4 tempest-AbsoluteLimitsTests-1703484533 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 04:41:06 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-6ebb212b-04c3-4293-b013-5fcd689d9de4 tempest-AbsoluteLimitsTests-1703484533 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 04:41:06 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-6ebb212b-04c3-4293-b013-5fcd689d9de4 tempest-AbsoluteLimitsTests-1703484533 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T02:41:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-2101813151',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=aee9521a-cba5-4dcf-8338-55a89c689f17,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='33cb444035a7497aaa11651d55f45c30',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T02:41:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T02:41:06Z,use_quota=True,user_id='3d022e7c858f40fc94e4cd6d3fd20888',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(317e369e-1e06-434d-ae95-a335f0e6c903),volume_type_id=317e369e-1e06-434d-ae95-a335f0e6c903)}" {{(pid=87444) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 04:41:06 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.remotefs [None req-6ebb212b-04c3-4293-b013-5fcd689d9de4 tempest-AbsoluteLimitsTests-1703484533 None] Creating volume aee9521a-cba5-4dcf-8338-55a89c689f17 {{(pid=87444) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 04:41:06 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-6ebb212b-04c3-4293-b013-5fcd689d9de4 tempest-AbsoluteLimitsTests-1703484533 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 04:41:06 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-6ebb212b-04c3-4293-b013-5fcd689d9de4 tempest-AbsoluteLimitsTests-1703484533 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 04:41:06 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-6ebb212b-04c3-4293-b013-5fcd689d9de4 tempest-AbsoluteLimitsTests-1703484533 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922': None} {{(pid=87444) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 04:41:06 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-6ebb212b-04c3-4293-b013-5fcd689d9de4 tempest-AbsoluteLimitsTests-1703484533 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922'] {{(pid=87444) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 04:41:06 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-6ebb212b-04c3-4293-b013-5fcd689d9de4 tempest-AbsoluteLimitsTests-1703484533 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 04:41:06 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-6ebb212b-04c3-4293-b013-5fcd689d9de4 tempest-AbsoluteLimitsTests-1703484533 None] Selected osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922 as target Quobyte volume. {{(pid=87444) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 04:41:06 devstack cinder-volume[87444]: INFO cinder.volume.drivers.remotefs [None req-6ebb212b-04c3-4293-b013-5fcd689d9de4 tempest-AbsoluteLimitsTests-1703484533 None] casted to osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922 Jul 10 04:41:06 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-6ebb212b-04c3-4293-b013-5fcd689d9de4 tempest-AbsoluteLimitsTests-1703484533 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-aee9521a-cba5-4dcf-8338-55a89c689f17 1073741824 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:41:06 devstack sudo[96257]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-aee9521a-cba5-4dcf-8338-55a89c689f17 1073741824 Jul 10 04:41:06 devstack sudo[96257]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:41:06 devstack sudo[96252]: pam_unix(sudo:session): session closed for user root Jul 10 04:41:06 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-ca634113-6b71-4c3b-b322-d6a96a34d938 tempest-GroupsTest-1660920858 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097" returned: 0 in 0.942s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:41:06 devstack cinder-volume[87444]: DEBUG cinder.manager [None req-ca634113-6b71-4c3b-b322-d6a96a34d938 tempest-GroupsTest-1660920858 None] Notifying Schedulers of capabilities ... {{(pid=87444) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 04:41:06 devstack cinder-volume[87444]: INFO cinder.volume.manager [None req-ca634113-6b71-4c3b-b322-d6a96a34d938 tempest-GroupsTest-1660920858 None] Delete group completed successfully. Jul 10 04:41:06 devstack sudo[96255]: pam_unix(sudo:session): session closed for user root Jul 10 04:41:06 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-8b3dc7c6-7e00-4911-a059-78f749e205be tempest-VolumesActionsTest-1960720823 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-0a032e83-f98f-416f-9166-08527ae6bf30" returned: 0 in 1.024s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:41:06 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-8b3dc7c6-7e00-4911-a059-78f749e205be tempest-VolumesActionsTest-1960720823 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-0a032e83-f98f-416f-9166-08527ae6bf30 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:41:06 devstack sudo[96263]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-0a032e83-f98f-416f-9166-08527ae6bf30 Jul 10 04:41:06 devstack sudo[96263]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:41:07 devstack cinder-volume[87444]: INFO cinder.volume.manager [None req-3910c838-a815-45a7-90a3-208a03b10dff tempest-GroupsTest-1660920858 None] Group tempest-GroupsTest-Group-683756657: creating Jul 10 04:41:07 devstack cinder-volume[87444]: INFO cinder.volume.manager [None req-3910c838-a815-45a7-90a3-208a03b10dff tempest-GroupsTest-1660920858 None] Group tempest-GroupsTest-Group-683756657: created successfully Jul 10 04:41:07 devstack cinder-volume[87444]: INFO cinder.volume.manager [None req-3910c838-a815-45a7-90a3-208a03b10dff tempest-GroupsTest-1660920858 None] Create group completed successfully. Jul 10 04:41:07 devstack sudo[96257]: pam_unix(sudo:session): session closed for user root Jul 10 04:41:07 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-6ebb212b-04c3-4293-b013-5fcd689d9de4 tempest-AbsoluteLimitsTests-1703484533 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-aee9521a-cba5-4dcf-8338-55a89c689f17 1073741824" returned: 0 in 1.089s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:41:07 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-6ebb212b-04c3-4293-b013-5fcd689d9de4 tempest-AbsoluteLimitsTests-1703484533 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-aee9521a-cba5-4dcf-8338-55a89c689f17 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:41:07 devstack sudo[96269]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-aee9521a-cba5-4dcf-8338-55a89c689f17 Jul 10 04:41:07 devstack sudo[96269]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:41:07 devstack sudo[96263]: pam_unix(sudo:session): session closed for user root Jul 10 04:41:07 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-8b3dc7c6-7e00-4911-a059-78f749e205be tempest-VolumesActionsTest-1960720823 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-0a032e83-f98f-416f-9166-08527ae6bf30" returned: 0 in 0.761s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:41:07 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-8b3dc7c6-7e00-4911-a059-78f749e205be tempest-VolumesActionsTest-1960720823 None] Lock "cinder-quobyte-0a032e83-f98f-416f-9166-08527ae6bf30" released by "delete_volume" :: held 1.893s {{(pid=87444) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 04:41:07 devstack cinder-volume[87444]: DEBUG cinder.quota [None req-8b3dc7c6-7e00-4911-a059-78f749e205be tempest-VolumesActionsTest-1960720823 None] Created reservations ['20dc3604-840e-47d9-be0a-ff99c28a2892', '264f82df-719e-45c8-b5c0-6b44987ade22', 'd4256812-304b-40c3-a88b-562bbf9149b7', '0c75d4b9-6e3d-4eb0-86ca-1f7d8f8ba79e'] {{(pid=87444) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 04:41:07 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-8b3dc7c6-7e00-4911-a059-78f749e205be tempest-VolumesActionsTest-1960720823 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 04:41:07 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-8b3dc7c6-7e00-4911-a059-78f749e205be tempest-VolumesActionsTest-1960720823 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 04:41:07 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-8b3dc7c6-7e00-4911-a059-78f749e205be tempest-VolumesActionsTest-1960720823 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922': None} {{(pid=87444) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 04:41:07 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-8b3dc7c6-7e00-4911-a059-78f749e205be tempest-VolumesActionsTest-1960720823 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922'] {{(pid=87444) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 04:41:07 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-8b3dc7c6-7e00-4911-a059-78f749e205be tempest-VolumesActionsTest-1960720823 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 04:41:07 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-8b3dc7c6-7e00-4911-a059-78f749e205be tempest-VolumesActionsTest-1960720823 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:41:07 devstack sudo[96272]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097 Jul 10 04:41:07 devstack sudo[96272]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:41:08 devstack sudo[96269]: pam_unix(sudo:session): session closed for user root Jul 10 04:41:08 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-6ebb212b-04c3-4293-b013-5fcd689d9de4 tempest-AbsoluteLimitsTests-1703484533 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-aee9521a-cba5-4dcf-8338-55a89c689f17" returned: 0 in 0.738s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:41:08 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-6ebb212b-04c3-4293-b013-5fcd689d9de4 tempest-AbsoluteLimitsTests-1703484533 None] <== create_volume: return (1880ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922'} {{(pid=87444) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 04:41:08 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-6ebb212b-04c3-4293-b013-5fcd689d9de4 tempest-AbsoluteLimitsTests-1703484533 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.884s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 04:41:08 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-6ebb212b-04c3-4293-b013-5fcd689d9de4 tempest-AbsoluteLimitsTests-1703484533 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (191d255e-bb53-486c-810c-38758bc05d59) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-aee9521a-cba5-4dcf-8338-55a89c689f17', 'volume_size': 1}' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:41:08 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-6ebb212b-04c3-4293-b013-5fcd689d9de4 tempest-AbsoluteLimitsTests-1703484533 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b369f31d-ffdc-4c44-bab4-bc3e12e6585e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:41:08 devstack cinder-volume[87444]: INFO cinder.volume.flows.manager.create_volume [None req-6ebb212b-04c3-4293-b013-5fcd689d9de4 tempest-AbsoluteLimitsTests-1703484533 None] Volume volume-aee9521a-cba5-4dcf-8338-55a89c689f17 (aee9521a-cba5-4dcf-8338-55a89c689f17): created successfully Jul 10 04:41:08 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-6ebb212b-04c3-4293-b013-5fcd689d9de4 tempest-AbsoluteLimitsTests-1703484533 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b369f31d-ffdc-4c44-bab4-bc3e12e6585e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:41:08 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-6ebb212b-04c3-4293-b013-5fcd689d9de4 tempest-AbsoluteLimitsTests-1703484533 None] Flow 'volume_create_manager' (f97ebe84-9323-4813-9648-267d02fe2909) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87444) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 04:41:08 devstack cinder-volume[87444]: INFO cinder.volume.manager [None req-6ebb212b-04c3-4293-b013-5fcd689d9de4 tempest-AbsoluteLimitsTests-1703484533 None] Created volume successfully. Jul 10 04:41:08 devstack cinder-volume[87444]: DEBUG cinder.volume.flows.manager.create_volume [None req-e28a03ba-c025-4d3b-b479-a70d11aa1f88 tempest-VolumesActionsTest-249281332 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87444) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 04:41:08 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-e28a03ba-c025-4d3b-b479-a70d11aa1f88 tempest-VolumesActionsTest-249281332 None] Flow 'volume_create_manager' (f8a78ad9-bda9-469b-ae8d-8d52ab23ac05) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 04:41:08 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-e28a03ba-c025-4d3b-b479-a70d11aa1f88 tempest-VolumesActionsTest-249281332 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (59761804-0539-44ca-bd33-953d015b6e52) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:41:08 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-e28a03ba-c025-4d3b-b479-a70d11aa1f88 tempest-VolumesActionsTest-249281332 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (59761804-0539-44ca-bd33-953d015b6e52) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T02:41:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-454985047',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f7d26561-6ac2-4135-aa7e-27a582385c8c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8896182fdfb44908ba0a8d3405add17a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T02:41:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T02:41:08Z,use_quota=True,user_id='439be0ce5a464a3c827a628503ea0e00',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(317e369e-1e06-434d-ae95-a335f0e6c903),volume_type_id=317e369e-1e06-434d-ae95-a335f0e6c903)' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:41:08 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-e28a03ba-c025-4d3b-b479-a70d11aa1f88 tempest-VolumesActionsTest-249281332 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (52a45f2e-f11b-4449-b89e-11403e1b0a7d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:41:08 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-e28a03ba-c025-4d3b-b479-a70d11aa1f88 tempest-VolumesActionsTest-249281332 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (52a45f2e-f11b-4449-b89e-11403e1b0a7d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:41:08 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-e28a03ba-c025-4d3b-b479-a70d11aa1f88 tempest-VolumesActionsTest-249281332 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5732417f-ed17-4aa7-966e-f61dd279b0bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:41:08 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-e28a03ba-c025-4d3b-b479-a70d11aa1f88 tempest-VolumesActionsTest-249281332 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5732417f-ed17-4aa7-966e-f61dd279b0bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f7d26561-6ac2-4135-aa7e-27a582385c8c', 'volume_name': 'volume-f7d26561-6ac2-4135-aa7e-27a582385c8c', 'volume_size': 1}' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:41:08 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-e28a03ba-c025-4d3b-b479-a70d11aa1f88 tempest-VolumesActionsTest-249281332 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b78d10d2-57e2-448f-b74e-1fc05c0159f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:41:08 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-e28a03ba-c025-4d3b-b479-a70d11aa1f88 tempest-VolumesActionsTest-249281332 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b78d10d2-57e2-448f-b74e-1fc05c0159f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:41:08 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-e28a03ba-c025-4d3b-b479-a70d11aa1f88 tempest-VolumesActionsTest-249281332 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f404388a-ffd8-4e6f-9738-32b6f4bbf75b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:41:08 devstack cinder-volume[87444]: INFO cinder.volume.flows.manager.create_volume [None req-e28a03ba-c025-4d3b-b479-a70d11aa1f88 tempest-VolumesActionsTest-249281332 None] Volume f7d26561-6ac2-4135-aa7e-27a582385c8c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f7d26561-6ac2-4135-aa7e-27a582385c8c', 'volume_size': 1} Jul 10 04:41:08 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-e28a03ba-c025-4d3b-b479-a70d11aa1f88 tempest-VolumesActionsTest-249281332 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 04:41:08 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-e28a03ba-c025-4d3b-b479-a70d11aa1f88 tempest-VolumesActionsTest-249281332 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 04:41:08 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-e28a03ba-c025-4d3b-b479-a70d11aa1f88 tempest-VolumesActionsTest-249281332 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T02:41:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-454985047',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f7d26561-6ac2-4135-aa7e-27a582385c8c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8896182fdfb44908ba0a8d3405add17a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T02:41:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T02:41:08Z,use_quota=True,user_id='439be0ce5a464a3c827a628503ea0e00',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(317e369e-1e06-434d-ae95-a335f0e6c903),volume_type_id=317e369e-1e06-434d-ae95-a335f0e6c903)}" {{(pid=87444) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 04:41:08 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.remotefs [None req-e28a03ba-c025-4d3b-b479-a70d11aa1f88 tempest-VolumesActionsTest-249281332 None] Creating volume f7d26561-6ac2-4135-aa7e-27a582385c8c {{(pid=87444) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 04:41:08 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-e28a03ba-c025-4d3b-b479-a70d11aa1f88 tempest-VolumesActionsTest-249281332 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 04:41:08 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-e28a03ba-c025-4d3b-b479-a70d11aa1f88 tempest-VolumesActionsTest-249281332 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 04:41:08 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-e28a03ba-c025-4d3b-b479-a70d11aa1f88 tempest-VolumesActionsTest-249281332 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922': None} {{(pid=87444) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 04:41:08 devstack sudo[96272]: pam_unix(sudo:session): session closed for user root Jul 10 04:41:08 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-e28a03ba-c025-4d3b-b479-a70d11aa1f88 tempest-VolumesActionsTest-249281332 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922'] {{(pid=87444) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 04:41:08 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-e28a03ba-c025-4d3b-b479-a70d11aa1f88 tempest-VolumesActionsTest-249281332 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 04:41:08 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-e28a03ba-c025-4d3b-b479-a70d11aa1f88 tempest-VolumesActionsTest-249281332 None] Selected osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922 as target Quobyte volume. {{(pid=87444) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 04:41:08 devstack cinder-volume[87444]: INFO cinder.volume.drivers.remotefs [None req-e28a03ba-c025-4d3b-b479-a70d11aa1f88 tempest-VolumesActionsTest-249281332 None] casted to osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922 Jul 10 04:41:08 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-e28a03ba-c025-4d3b-b479-a70d11aa1f88 tempest-VolumesActionsTest-249281332 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-f7d26561-6ac2-4135-aa7e-27a582385c8c 1073741824 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:41:08 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-8b3dc7c6-7e00-4911-a059-78f749e205be tempest-VolumesActionsTest-1960720823 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097" returned: 0 in 0.825s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:41:08 devstack cinder-volume[87444]: DEBUG cinder.manager [None req-8b3dc7c6-7e00-4911-a059-78f749e205be tempest-VolumesActionsTest-1960720823 None] Notifying Schedulers of capabilities ... {{(pid=87444) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 04:41:08 devstack cinder-volume[87444]: INFO cinder.volume.manager [None req-8b3dc7c6-7e00-4911-a059-78f749e205be tempest-VolumesActionsTest-1960720823 None] Deleted volume successfully. Jul 10 04:41:08 devstack sudo[96276]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-f7d26561-6ac2-4135-aa7e-27a582385c8c 1073741824 Jul 10 04:41:08 devstack sudo[96276]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:41:08 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-8b3dc7c6-7e00-4911-a059-78f749e205be tempest-VolumesActionsTest-1960720823 None] Lock "cinder-0a032e83-f98f-416f-9166-08527ae6bf30-delete_volume" released by "delete_volume" :: held 3.092s {{(pid=87444) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 04:41:09 devstack cinder-volume[87444]: DEBUG cinder.volume.flows.manager.create_volume [None req-9edd0cb5-dd9c-4aa2-985f-594bf0ce0369 tempest-GroupsTest-1660920858 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87444) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 04:41:09 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-9edd0cb5-dd9c-4aa2-985f-594bf0ce0369 tempest-GroupsTest-1660920858 None] Flow 'volume_create_manager' (79f17599-99ff-4c0a-8b07-eb9814101e0f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 04:41:09 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-9edd0cb5-dd9c-4aa2-985f-594bf0ce0369 tempest-GroupsTest-1660920858 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b30ace45-a84c-4579-be39-b44084919fc8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:41:09 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-9edd0cb5-dd9c-4aa2-985f-594bf0ce0369 tempest-GroupsTest-1660920858 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b30ace45-a84c-4579-be39-b44084919fc8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T02:41:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1678115515',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=c7acfe89-2867-4622-be95-9fb9d89fcac2,host='devstack@QuobyteHD#QuobyteHD',id=162d11ca-a7f5-4ea5-abdf-be4a517df1cb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5123392880514662ab5398a5aa74b6ab',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T02:41:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T02:41:09Z,use_quota=True,user_id='05df2bbe3479427caa427952a7ac24af',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9edd4922-390b-44ab-9873-a89248b4be71),volume_type_id=9edd4922-390b-44ab-9873-a89248b4be71)' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:41:09 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-9edd0cb5-dd9c-4aa2-985f-594bf0ce0369 tempest-GroupsTest-1660920858 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7c7fd51a-1dbd-408d-8178-31626ab750ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:41:09 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-9edd0cb5-dd9c-4aa2-985f-594bf0ce0369 tempest-GroupsTest-1660920858 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7c7fd51a-1dbd-408d-8178-31626ab750ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:41:09 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-9edd0cb5-dd9c-4aa2-985f-594bf0ce0369 tempest-GroupsTest-1660920858 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (341799d2-ddda-4842-85bb-46af897e0761) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:41:09 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-9edd0cb5-dd9c-4aa2-985f-594bf0ce0369 tempest-GroupsTest-1660920858 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (341799d2-ddda-4842-85bb-46af897e0761) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '162d11ca-a7f5-4ea5-abdf-be4a517df1cb', 'volume_name': 'volume-162d11ca-a7f5-4ea5-abdf-be4a517df1cb', 'volume_size': 1}' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:41:09 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-9edd0cb5-dd9c-4aa2-985f-594bf0ce0369 tempest-GroupsTest-1660920858 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0849793d-1eab-46c6-a201-d8b2e3f8590a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:41:09 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-9edd0cb5-dd9c-4aa2-985f-594bf0ce0369 tempest-GroupsTest-1660920858 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0849793d-1eab-46c6-a201-d8b2e3f8590a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:41:09 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-9edd0cb5-dd9c-4aa2-985f-594bf0ce0369 tempest-GroupsTest-1660920858 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2ad68264-74a3-4950-aed4-98e26eac632e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:41:09 devstack cinder-volume[87444]: INFO cinder.volume.flows.manager.create_volume [None req-9edd0cb5-dd9c-4aa2-985f-594bf0ce0369 tempest-GroupsTest-1660920858 None] Volume 162d11ca-a7f5-4ea5-abdf-be4a517df1cb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-162d11ca-a7f5-4ea5-abdf-be4a517df1cb', 'volume_size': 1} Jul 10 04:41:09 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-9edd0cb5-dd9c-4aa2-985f-594bf0ce0369 tempest-GroupsTest-1660920858 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 04:41:09 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-52d1ce43-bcea-45ad-8744-41f729bdeb40 tempest-AbsoluteLimitsTests-1703484533 None] Acquiring lock "cinder-aee9521a-cba5-4dcf-8338-55a89c689f17-delete_volume" by "delete_volume" {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 04:41:09 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-52d1ce43-bcea-45ad-8744-41f729bdeb40 tempest-AbsoluteLimitsTests-1703484533 None] Lock "cinder-aee9521a-cba5-4dcf-8338-55a89c689f17-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 04:41:09 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-52d1ce43-bcea-45ad-8744-41f729bdeb40 tempest-AbsoluteLimitsTests-1703484533 None] Acquiring lock "cinder-quobyte-aee9521a-cba5-4dcf-8338-55a89c689f17" by "delete_volume" {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 04:41:09 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-52d1ce43-bcea-45ad-8744-41f729bdeb40 tempest-AbsoluteLimitsTests-1703484533 None] Lock "cinder-quobyte-aee9521a-cba5-4dcf-8338-55a89c689f17" acquired by "delete_volume" :: waited 0.017s {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 04:41:09 devstack cinder-volume[87444]: DEBUG oslo.privsep.daemon [-] privsep: reply[78f559ed-b1f6-4766-8170-75bd666fd39a]: (4, 'qcow2') {{(pid=88499) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 04:41:09 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-52d1ce43-bcea-45ad-8744-41f729bdeb40 tempest-AbsoluteLimitsTests-1703484533 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-aee9521a-cba5-4dcf-8338-55a89c689f17 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:41:09 devstack cinder-volume[87444]: DEBUG cinder.volume.flows.manager.create_volume [None req-1169375f-2024-4c01-b8d2-31e327e2caa6 tempest-VolumeTypesAccessTest-1249180414 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87444) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 04:41:09 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-1169375f-2024-4c01-b8d2-31e327e2caa6 tempest-VolumeTypesAccessTest-1249180414 None] Flow 'volume_create_manager' (47d7603e-b62e-4f52-8fe9-e1f14991179d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 04:41:09 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-1169375f-2024-4c01-b8d2-31e327e2caa6 tempest-VolumeTypesAccessTest-1249180414 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2f91545e-890a-45de-9534-895cf29711f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:41:09 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-1169375f-2024-4c01-b8d2-31e327e2caa6 tempest-VolumeTypesAccessTest-1249180414 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2f91545e-890a-45de-9534-895cf29711f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T02:41:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-475636836',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5f1c2a0b-7ea0-4b18-8359-22128deb93a9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6db2774024164c389f9728365b077afb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T02:41:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T02:41:10Z,use_quota=True,user_id='dcf2e596e31d48b88b2b32bdc05a07d6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4323bd8b-2f15-4ef5-a8cb-afbd80f32c02),volume_type_id=4323bd8b-2f15-4ef5-a8cb-afbd80f32c02)' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:41:09 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-1169375f-2024-4c01-b8d2-31e327e2caa6 tempest-VolumeTypesAccessTest-1249180414 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (46e1bc6b-59d7-4969-a98e-1d86404d762b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:41:09 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-1169375f-2024-4c01-b8d2-31e327e2caa6 tempest-VolumeTypesAccessTest-1249180414 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (46e1bc6b-59d7-4969-a98e-1d86404d762b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:41:09 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-1169375f-2024-4c01-b8d2-31e327e2caa6 tempest-VolumeTypesAccessTest-1249180414 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d429c899-4efc-4784-9be8-d7b02ebad893) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:41:09 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-1169375f-2024-4c01-b8d2-31e327e2caa6 tempest-VolumeTypesAccessTest-1249180414 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d429c899-4efc-4784-9be8-d7b02ebad893) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5f1c2a0b-7ea0-4b18-8359-22128deb93a9', 'volume_name': 'volume-5f1c2a0b-7ea0-4b18-8359-22128deb93a9', 'volume_size': 1}' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:41:09 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-1169375f-2024-4c01-b8d2-31e327e2caa6 tempest-VolumeTypesAccessTest-1249180414 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8baf4eac-ed1b-4d94-a272-1f6c34165e02) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:41:09 devstack sudo[96281]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-aee9521a-cba5-4dcf-8338-55a89c689f17 Jul 10 04:41:09 devstack sudo[96281]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:41:09 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-1169375f-2024-4c01-b8d2-31e327e2caa6 tempest-VolumeTypesAccessTest-1249180414 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8baf4eac-ed1b-4d94-a272-1f6c34165e02) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:41:09 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-1169375f-2024-4c01-b8d2-31e327e2caa6 tempest-VolumeTypesAccessTest-1249180414 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ae0c3109-b1f8-4657-94a2-3a1ff1f9086e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:41:09 devstack cinder-volume[87444]: INFO cinder.volume.flows.manager.create_volume [None req-1169375f-2024-4c01-b8d2-31e327e2caa6 tempest-VolumeTypesAccessTest-1249180414 None] Volume 5f1c2a0b-7ea0-4b18-8359-22128deb93a9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5f1c2a0b-7ea0-4b18-8359-22128deb93a9', 'volume_size': 1} Jul 10 04:41:09 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-1169375f-2024-4c01-b8d2-31e327e2caa6 tempest-VolumeTypesAccessTest-1249180414 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 04:41:09 devstack sudo[96276]: pam_unix(sudo:session): session closed for user root Jul 10 04:41:09 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-e28a03ba-c025-4d3b-b479-a70d11aa1f88 tempest-VolumesActionsTest-249281332 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-f7d26561-6ac2-4135-aa7e-27a582385c8c 1073741824" returned: 0 in 1.025s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:41:09 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-e28a03ba-c025-4d3b-b479-a70d11aa1f88 tempest-VolumesActionsTest-249281332 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-f7d26561-6ac2-4135-aa7e-27a582385c8c {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:41:09 devstack sudo[96283]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-f7d26561-6ac2-4135-aa7e-27a582385c8c Jul 10 04:41:09 devstack sudo[96283]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:41:10 devstack sudo[96281]: pam_unix(sudo:session): session closed for user root Jul 10 04:41:10 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-52d1ce43-bcea-45ad-8744-41f729bdeb40 tempest-AbsoluteLimitsTests-1703484533 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-aee9521a-cba5-4dcf-8338-55a89c689f17" returned: 0 in 0.791s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:41:10 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-52d1ce43-bcea-45ad-8744-41f729bdeb40 tempest-AbsoluteLimitsTests-1703484533 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-aee9521a-cba5-4dcf-8338-55a89c689f17 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:41:10 devstack sudo[96283]: pam_unix(sudo:session): session closed for user root Jul 10 04:41:10 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-e28a03ba-c025-4d3b-b479-a70d11aa1f88 tempest-VolumesActionsTest-249281332 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-f7d26561-6ac2-4135-aa7e-27a582385c8c" returned: 0 in 0.633s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:41:10 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-e28a03ba-c025-4d3b-b479-a70d11aa1f88 tempest-VolumesActionsTest-249281332 None] <== create_volume: return (1709ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922'} {{(pid=87444) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 04:41:10 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-e28a03ba-c025-4d3b-b479-a70d11aa1f88 tempest-VolumesActionsTest-249281332 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.712s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 04:41:10 devstack sudo[96289]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-aee9521a-cba5-4dcf-8338-55a89c689f17 Jul 10 04:41:10 devstack sudo[96289]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:41:10 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-9edd0cb5-dd9c-4aa2-985f-594bf0ce0369 tempest-GroupsTest-1660920858 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.256s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 04:41:10 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-9edd0cb5-dd9c-4aa2-985f-594bf0ce0369 tempest-GroupsTest-1660920858 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=c7acfe89-2867-4622-be95-9fb9d89fcac2,created_at=2026-07-10T02:41:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1678115515',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=c7acfe89-2867-4622-be95-9fb9d89fcac2,host='devstack@QuobyteHD#QuobyteHD',id=162d11ca-a7f5-4ea5-abdf-be4a517df1cb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5123392880514662ab5398a5aa74b6ab',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T02:41:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T02:41:09Z,use_quota=True,user_id='05df2bbe3479427caa427952a7ac24af',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9edd4922-390b-44ab-9873-a89248b4be71),volume_type_id=9edd4922-390b-44ab-9873-a89248b4be71)}" {{(pid=87444) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 04:41:10 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.remotefs [None req-9edd0cb5-dd9c-4aa2-985f-594bf0ce0369 tempest-GroupsTest-1660920858 None] Creating volume 162d11ca-a7f5-4ea5-abdf-be4a517df1cb {{(pid=87444) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 04:41:10 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-9edd0cb5-dd9c-4aa2-985f-594bf0ce0369 tempest-GroupsTest-1660920858 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 04:41:10 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-9edd0cb5-dd9c-4aa2-985f-594bf0ce0369 tempest-GroupsTest-1660920858 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 04:41:10 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-9edd0cb5-dd9c-4aa2-985f-594bf0ce0369 tempest-GroupsTest-1660920858 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922': None} {{(pid=87444) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 04:41:10 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-9edd0cb5-dd9c-4aa2-985f-594bf0ce0369 tempest-GroupsTest-1660920858 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922'] {{(pid=87444) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 04:41:10 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-9edd0cb5-dd9c-4aa2-985f-594bf0ce0369 tempest-GroupsTest-1660920858 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 04:41:10 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-9edd0cb5-dd9c-4aa2-985f-594bf0ce0369 tempest-GroupsTest-1660920858 None] Selected osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922 as target Quobyte volume. {{(pid=87444) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 04:41:10 devstack cinder-volume[87444]: INFO cinder.volume.drivers.remotefs [None req-9edd0cb5-dd9c-4aa2-985f-594bf0ce0369 tempest-GroupsTest-1660920858 None] casted to osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922 Jul 10 04:41:10 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-9edd0cb5-dd9c-4aa2-985f-594bf0ce0369 tempest-GroupsTest-1660920858 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-162d11ca-a7f5-4ea5-abdf-be4a517df1cb 1073741824 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:41:10 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-e28a03ba-c025-4d3b-b479-a70d11aa1f88 tempest-VolumesActionsTest-249281332 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f404388a-ffd8-4e6f-9738-32b6f4bbf75b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f7d26561-6ac2-4135-aa7e-27a582385c8c', 'volume_size': 1}' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:41:10 devstack sudo[96291]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-162d11ca-a7f5-4ea5-abdf-be4a517df1cb 1073741824 Jul 10 04:41:10 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-e28a03ba-c025-4d3b-b479-a70d11aa1f88 tempest-VolumesActionsTest-249281332 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e2663930-7081-4840-8b16-3e8ec592c0bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:41:10 devstack sudo[96291]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:41:10 devstack cinder-volume[87444]: INFO cinder.volume.flows.manager.create_volume [None req-e28a03ba-c025-4d3b-b479-a70d11aa1f88 tempest-VolumesActionsTest-249281332 None] Volume volume-f7d26561-6ac2-4135-aa7e-27a582385c8c (f7d26561-6ac2-4135-aa7e-27a582385c8c): created successfully Jul 10 04:41:10 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-e28a03ba-c025-4d3b-b479-a70d11aa1f88 tempest-VolumesActionsTest-249281332 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e2663930-7081-4840-8b16-3e8ec592c0bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:41:10 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-e28a03ba-c025-4d3b-b479-a70d11aa1f88 tempest-VolumesActionsTest-249281332 None] Flow 'volume_create_manager' (f8a78ad9-bda9-469b-ae8d-8d52ab23ac05) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87444) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 04:41:10 devstack cinder-volume[87444]: INFO cinder.volume.manager [None req-e28a03ba-c025-4d3b-b479-a70d11aa1f88 tempest-VolumesActionsTest-249281332 None] Created volume successfully. Jul 10 04:41:10 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-9e35ef3d-9b0f-47ac-aad8-d69944eead85 tempest-VolumesActionsTest-1960720823 None] Acquiring lock "cinder-f7d26561-6ac2-4135-aa7e-27a582385c8c-delete_volume" by "delete_volume" {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 04:41:10 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-9e35ef3d-9b0f-47ac-aad8-d69944eead85 tempest-VolumesActionsTest-1960720823 None] Lock "cinder-f7d26561-6ac2-4135-aa7e-27a582385c8c-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 04:41:10 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-9e35ef3d-9b0f-47ac-aad8-d69944eead85 tempest-VolumesActionsTest-1960720823 None] Acquiring lock "cinder-quobyte-f7d26561-6ac2-4135-aa7e-27a582385c8c" by "delete_volume" {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 04:41:10 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-9e35ef3d-9b0f-47ac-aad8-d69944eead85 tempest-VolumesActionsTest-1960720823 None] Lock "cinder-quobyte-f7d26561-6ac2-4135-aa7e-27a582385c8c" acquired by "delete_volume" :: waited 0.033s {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 04:41:10 devstack cinder-volume[87444]: DEBUG oslo.privsep.daemon [-] privsep: reply[2804b9d3-8b23-4e06-bb9e-c9d3ce1757ec]: (4, 'qcow2') {{(pid=88499) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 04:41:10 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-9e35ef3d-9b0f-47ac-aad8-d69944eead85 tempest-VolumesActionsTest-1960720823 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-f7d26561-6ac2-4135-aa7e-27a582385c8c {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:41:11 devstack sudo[96289]: pam_unix(sudo:session): session closed for user root Jul 10 04:41:11 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-52d1ce43-bcea-45ad-8744-41f729bdeb40 tempest-AbsoluteLimitsTests-1703484533 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-aee9521a-cba5-4dcf-8338-55a89c689f17" returned: 0 in 0.720s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:41:11 devstack sudo[96293]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-f7d26561-6ac2-4135-aa7e-27a582385c8c Jul 10 04:41:11 devstack sudo[96293]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:41:11 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-52d1ce43-bcea-45ad-8744-41f729bdeb40 tempest-AbsoluteLimitsTests-1703484533 None] Lock "cinder-quobyte-aee9521a-cba5-4dcf-8338-55a89c689f17" released by "delete_volume" :: held 1.553s {{(pid=87444) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 04:41:11 devstack cinder-volume[87444]: DEBUG cinder.quota [None req-52d1ce43-bcea-45ad-8744-41f729bdeb40 tempest-AbsoluteLimitsTests-1703484533 None] Created reservations ['188b544b-d827-4279-9220-d7d6858db34c', '1958348e-7671-4879-a6d5-9e4c1b562f3a', '2a09beae-2b9d-4849-a361-f30a1c08fcac', '81054b3c-8315-4d1f-8efd-3c06c83d8606'] {{(pid=87444) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 04:41:11 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-52d1ce43-bcea-45ad-8744-41f729bdeb40 tempest-AbsoluteLimitsTests-1703484533 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 04:41:11 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-52d1ce43-bcea-45ad-8744-41f729bdeb40 tempest-AbsoluteLimitsTests-1703484533 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 04:41:11 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-52d1ce43-bcea-45ad-8744-41f729bdeb40 tempest-AbsoluteLimitsTests-1703484533 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922': None} {{(pid=87444) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 04:41:11 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-52d1ce43-bcea-45ad-8744-41f729bdeb40 tempest-AbsoluteLimitsTests-1703484533 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922'] {{(pid=87444) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 04:41:11 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-52d1ce43-bcea-45ad-8744-41f729bdeb40 tempest-AbsoluteLimitsTests-1703484533 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 04:41:11 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-52d1ce43-bcea-45ad-8744-41f729bdeb40 tempest-AbsoluteLimitsTests-1703484533 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:41:11 devstack sudo[96299]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097 Jul 10 04:41:11 devstack sudo[96299]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:41:11 devstack sudo[96291]: pam_unix(sudo:session): session closed for user root Jul 10 04:41:11 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-9edd0cb5-dd9c-4aa2-985f-594bf0ce0369 tempest-GroupsTest-1660920858 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-162d11ca-a7f5-4ea5-abdf-be4a517df1cb 1073741824" returned: 0 in 0.982s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:41:11 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-9edd0cb5-dd9c-4aa2-985f-594bf0ce0369 tempest-GroupsTest-1660920858 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-162d11ca-a7f5-4ea5-abdf-be4a517df1cb {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:41:11 devstack sudo[96301]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-162d11ca-a7f5-4ea5-abdf-be4a517df1cb Jul 10 04:41:11 devstack sudo[96301]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:41:11 devstack sudo[96293]: pam_unix(sudo:session): session closed for user root Jul 10 04:41:11 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-9e35ef3d-9b0f-47ac-aad8-d69944eead85 tempest-VolumesActionsTest-1960720823 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-f7d26561-6ac2-4135-aa7e-27a582385c8c" returned: 0 in 1.003s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:41:11 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-9e35ef3d-9b0f-47ac-aad8-d69944eead85 tempest-VolumesActionsTest-1960720823 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-f7d26561-6ac2-4135-aa7e-27a582385c8c {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:41:11 devstack sudo[96307]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-f7d26561-6ac2-4135-aa7e-27a582385c8c Jul 10 04:41:11 devstack sudo[96307]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:41:11 devstack sudo[96299]: pam_unix(sudo:session): session closed for user root Jul 10 04:41:11 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-52d1ce43-bcea-45ad-8744-41f729bdeb40 tempest-AbsoluteLimitsTests-1703484533 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097" returned: 0 in 0.744s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:41:11 devstack cinder-volume[87444]: DEBUG cinder.manager [None req-52d1ce43-bcea-45ad-8744-41f729bdeb40 tempest-AbsoluteLimitsTests-1703484533 None] Notifying Schedulers of capabilities ... {{(pid=87444) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 04:41:11 devstack cinder-volume[87444]: INFO cinder.volume.manager [None req-52d1ce43-bcea-45ad-8744-41f729bdeb40 tempest-AbsoluteLimitsTests-1703484533 None] Deleted volume successfully. Jul 10 04:41:12 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-52d1ce43-bcea-45ad-8744-41f729bdeb40 tempest-AbsoluteLimitsTests-1703484533 None] Lock "cinder-aee9521a-cba5-4dcf-8338-55a89c689f17-delete_volume" released by "delete_volume" :: held 2.576s {{(pid=87444) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 04:41:12 devstack sudo[96301]: pam_unix(sudo:session): session closed for user root Jul 10 04:41:12 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-9edd0cb5-dd9c-4aa2-985f-594bf0ce0369 tempest-GroupsTest-1660920858 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-162d11ca-a7f5-4ea5-abdf-be4a517df1cb" returned: 0 in 0.689s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:41:12 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-9edd0cb5-dd9c-4aa2-985f-594bf0ce0369 tempest-GroupsTest-1660920858 None] <== create_volume: return (1717ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922'} {{(pid=87444) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 04:41:12 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-9edd0cb5-dd9c-4aa2-985f-594bf0ce0369 tempest-GroupsTest-1660920858 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.720s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 04:41:12 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-1169375f-2024-4c01-b8d2-31e327e2caa6 tempest-VolumeTypesAccessTest-1249180414 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.414s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 04:41:12 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-1169375f-2024-4c01-b8d2-31e327e2caa6 tempest-VolumeTypesAccessTest-1249180414 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T02:41:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-475636836',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5f1c2a0b-7ea0-4b18-8359-22128deb93a9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6db2774024164c389f9728365b077afb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T02:41:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T02:41:10Z,use_quota=True,user_id='dcf2e596e31d48b88b2b32bdc05a07d6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4323bd8b-2f15-4ef5-a8cb-afbd80f32c02),volume_type_id=4323bd8b-2f15-4ef5-a8cb-afbd80f32c02)}" {{(pid=87444) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 04:41:12 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.remotefs [None req-1169375f-2024-4c01-b8d2-31e327e2caa6 tempest-VolumeTypesAccessTest-1249180414 None] Creating volume 5f1c2a0b-7ea0-4b18-8359-22128deb93a9 {{(pid=87444) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 04:41:12 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-1169375f-2024-4c01-b8d2-31e327e2caa6 tempest-VolumeTypesAccessTest-1249180414 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 04:41:12 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-1169375f-2024-4c01-b8d2-31e327e2caa6 tempest-VolumeTypesAccessTest-1249180414 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 04:41:12 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-1169375f-2024-4c01-b8d2-31e327e2caa6 tempest-VolumeTypesAccessTest-1249180414 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922': None} {{(pid=87444) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 04:41:12 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-1169375f-2024-4c01-b8d2-31e327e2caa6 tempest-VolumeTypesAccessTest-1249180414 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922'] {{(pid=87444) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 04:41:12 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-1169375f-2024-4c01-b8d2-31e327e2caa6 tempest-VolumeTypesAccessTest-1249180414 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 04:41:12 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-1169375f-2024-4c01-b8d2-31e327e2caa6 tempest-VolumeTypesAccessTest-1249180414 None] Selected osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922 as target Quobyte volume. {{(pid=87444) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 04:41:12 devstack cinder-volume[87444]: INFO cinder.volume.drivers.remotefs [None req-1169375f-2024-4c01-b8d2-31e327e2caa6 tempest-VolumeTypesAccessTest-1249180414 None] casted to osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922 Jul 10 04:41:12 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-1169375f-2024-4c01-b8d2-31e327e2caa6 tempest-VolumeTypesAccessTest-1249180414 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-5f1c2a0b-7ea0-4b18-8359-22128deb93a9 1073741824 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:41:12 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-9edd0cb5-dd9c-4aa2-985f-594bf0ce0369 tempest-GroupsTest-1660920858 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2ad68264-74a3-4950-aed4-98e26eac632e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-162d11ca-a7f5-4ea5-abdf-be4a517df1cb', 'volume_size': 1}' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:41:12 devstack sudo[96310]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-5f1c2a0b-7ea0-4b18-8359-22128deb93a9 1073741824 Jul 10 04:41:12 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-9edd0cb5-dd9c-4aa2-985f-594bf0ce0369 tempest-GroupsTest-1660920858 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (81dc2a06-5383-44cc-b1b5-80df81457788) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:41:12 devstack sudo[96310]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:41:12 devstack cinder-volume[87444]: INFO cinder.volume.flows.manager.create_volume [None req-9edd0cb5-dd9c-4aa2-985f-594bf0ce0369 tempest-GroupsTest-1660920858 None] Volume volume-162d11ca-a7f5-4ea5-abdf-be4a517df1cb (162d11ca-a7f5-4ea5-abdf-be4a517df1cb): created successfully Jul 10 04:41:12 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-9edd0cb5-dd9c-4aa2-985f-594bf0ce0369 tempest-GroupsTest-1660920858 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (81dc2a06-5383-44cc-b1b5-80df81457788) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:41:12 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-9edd0cb5-dd9c-4aa2-985f-594bf0ce0369 tempest-GroupsTest-1660920858 None] Flow 'volume_create_manager' (79f17599-99ff-4c0a-8b07-eb9814101e0f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87444) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 04:41:12 devstack cinder-volume[87444]: INFO cinder.volume.manager [None req-9edd0cb5-dd9c-4aa2-985f-594bf0ce0369 tempest-GroupsTest-1660920858 None] Created volume successfully. Jul 10 04:41:12 devstack sudo[96307]: pam_unix(sudo:session): session closed for user root Jul 10 04:41:12 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-9e35ef3d-9b0f-47ac-aad8-d69944eead85 tempest-VolumesActionsTest-1960720823 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-f7d26561-6ac2-4135-aa7e-27a582385c8c" returned: 0 in 0.738s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:41:12 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-9e35ef3d-9b0f-47ac-aad8-d69944eead85 tempest-VolumesActionsTest-1960720823 None] Lock "cinder-quobyte-f7d26561-6ac2-4135-aa7e-27a582385c8c" released by "delete_volume" :: held 1.806s {{(pid=87444) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 04:41:12 devstack cinder-volume[87444]: DEBUG cinder.quota [None req-9e35ef3d-9b0f-47ac-aad8-d69944eead85 tempest-VolumesActionsTest-1960720823 None] Created reservations ['536d92bb-f396-4dbf-a5e3-61d95d66387a', '2f803ac7-5de3-4db5-b88e-e0116eebc48d', 'fa1b86ae-eef3-4dfc-b02e-59feef437f5d', '8b005372-ea13-40e8-8b96-0f2c9ed1c972'] {{(pid=87444) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 04:41:12 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-9e35ef3d-9b0f-47ac-aad8-d69944eead85 tempest-VolumesActionsTest-1960720823 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 04:41:12 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-9e35ef3d-9b0f-47ac-aad8-d69944eead85 tempest-VolumesActionsTest-1960720823 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 04:41:12 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-9e35ef3d-9b0f-47ac-aad8-d69944eead85 tempest-VolumesActionsTest-1960720823 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922': None} {{(pid=87444) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 04:41:12 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-9e35ef3d-9b0f-47ac-aad8-d69944eead85 tempest-VolumesActionsTest-1960720823 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922'] {{(pid=87444) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 04:41:12 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-9e35ef3d-9b0f-47ac-aad8-d69944eead85 tempest-VolumesActionsTest-1960720823 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 04:41:12 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-9e35ef3d-9b0f-47ac-aad8-d69944eead85 tempest-VolumesActionsTest-1960720823 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:41:12 devstack sudo[96317]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097 Jul 10 04:41:12 devstack sudo[96317]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:41:13 devstack cinder-volume[87444]: DEBUG cinder.volume.flows.manager.create_volume [None req-ca18598c-a190-4cc9-9eac-a8eb6b45a508 tempest-GroupsTest-1660920858 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87444) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 04:41:13 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-ca18598c-a190-4cc9-9eac-a8eb6b45a508 tempest-GroupsTest-1660920858 None] Flow 'volume_create_manager' (37ee9300-6d3b-4734-bf2a-f12b2c10d070) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 04:41:13 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-ca18598c-a190-4cc9-9eac-a8eb6b45a508 tempest-GroupsTest-1660920858 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5b7f8d44-888f-4eab-9487-88b01e08fb3b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:41:13 devstack sudo[96310]: pam_unix(sudo:session): session closed for user root Jul 10 04:41:13 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-1169375f-2024-4c01-b8d2-31e327e2caa6 tempest-VolumeTypesAccessTest-1249180414 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-5f1c2a0b-7ea0-4b18-8359-22128deb93a9 1073741824" returned: 0 in 1.256s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:41:13 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-ca18598c-a190-4cc9-9eac-a8eb6b45a508 tempest-GroupsTest-1660920858 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5b7f8d44-888f-4eab-9487-88b01e08fb3b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T02:41:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1873268955',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=c7acfe89-2867-4622-be95-9fb9d89fcac2,host='devstack@QuobyteHD#QuobyteHD',id=64cd41e3-857f-492c-bd09-74b5487dfc73,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5123392880514662ab5398a5aa74b6ab',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T02:41:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T02:41:13Z,use_quota=True,user_id='05df2bbe3479427caa427952a7ac24af',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9edd4922-390b-44ab-9873-a89248b4be71),volume_type_id=9edd4922-390b-44ab-9873-a89248b4be71)' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:41:13 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-ca18598c-a190-4cc9-9eac-a8eb6b45a508 tempest-GroupsTest-1660920858 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4fb3ed1d-df90-4f7e-8938-c536a508bb45) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:41:13 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-ca18598c-a190-4cc9-9eac-a8eb6b45a508 tempest-GroupsTest-1660920858 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4fb3ed1d-df90-4f7e-8938-c536a508bb45) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:41:13 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-ca18598c-a190-4cc9-9eac-a8eb6b45a508 tempest-GroupsTest-1660920858 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (61855abe-bba4-4594-bc6f-204d0928d4f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:41:13 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-ca18598c-a190-4cc9-9eac-a8eb6b45a508 tempest-GroupsTest-1660920858 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (61855abe-bba4-4594-bc6f-204d0928d4f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '64cd41e3-857f-492c-bd09-74b5487dfc73', 'volume_name': 'volume-64cd41e3-857f-492c-bd09-74b5487dfc73', 'volume_size': 1}' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:41:13 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-ca18598c-a190-4cc9-9eac-a8eb6b45a508 tempest-GroupsTest-1660920858 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (15ad179b-bed2-4099-989a-9aaa183358b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:41:13 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-ca18598c-a190-4cc9-9eac-a8eb6b45a508 tempest-GroupsTest-1660920858 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (15ad179b-bed2-4099-989a-9aaa183358b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:41:13 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-ca18598c-a190-4cc9-9eac-a8eb6b45a508 tempest-GroupsTest-1660920858 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b21d13b6-e020-4819-9b36-9b0c189cba25) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:41:13 devstack cinder-volume[87444]: INFO cinder.volume.flows.manager.create_volume [None req-ca18598c-a190-4cc9-9eac-a8eb6b45a508 tempest-GroupsTest-1660920858 None] Volume 64cd41e3-857f-492c-bd09-74b5487dfc73: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-64cd41e3-857f-492c-bd09-74b5487dfc73', 'volume_size': 1} Jul 10 04:41:13 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-ca18598c-a190-4cc9-9eac-a8eb6b45a508 tempest-GroupsTest-1660920858 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 04:41:13 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-1169375f-2024-4c01-b8d2-31e327e2caa6 tempest-VolumeTypesAccessTest-1249180414 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-5f1c2a0b-7ea0-4b18-8359-22128deb93a9 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:41:13 devstack sudo[96320]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-5f1c2a0b-7ea0-4b18-8359-22128deb93a9 Jul 10 04:41:13 devstack sudo[96320]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:41:13 devstack cinder-volume[87444]: DEBUG cinder.volume.flows.manager.create_volume [None req-07f382c9-a430-4f42-82ec-c572bee92e99 tempest-VolumesActionsTest-249281332 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87444) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 04:41:13 devstack sudo[96317]: pam_unix(sudo:session): session closed for user root Jul 10 04:41:13 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-07f382c9-a430-4f42-82ec-c572bee92e99 tempest-VolumesActionsTest-249281332 None] Flow 'volume_create_manager' (ba3ce29a-1fd5-45ca-9baa-d40358a66aae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 04:41:13 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-07f382c9-a430-4f42-82ec-c572bee92e99 tempest-VolumesActionsTest-249281332 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7cf24807-6c44-4e8a-9ad6-fbdc4d740a42) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:41:13 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-9e35ef3d-9b0f-47ac-aad8-d69944eead85 tempest-VolumesActionsTest-1960720823 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097" returned: 0 in 1.158s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:41:13 devstack cinder-volume[87444]: DEBUG cinder.manager [None req-9e35ef3d-9b0f-47ac-aad8-d69944eead85 tempest-VolumesActionsTest-1960720823 None] Notifying Schedulers of capabilities ... {{(pid=87444) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 04:41:14 devstack cinder-volume[87444]: INFO cinder.volume.manager [None req-9e35ef3d-9b0f-47ac-aad8-d69944eead85 tempest-VolumesActionsTest-1960720823 None] Deleted volume successfully. Jul 10 04:41:14 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-07f382c9-a430-4f42-82ec-c572bee92e99 tempest-VolumesActionsTest-249281332 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7cf24807-6c44-4e8a-9ad6-fbdc4d740a42) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T02:41:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-393581782',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=600aaedd-99c5-4cfd-8568-413e8f979315,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8896182fdfb44908ba0a8d3405add17a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T02:41:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T02:41:14Z,use_quota=True,user_id='439be0ce5a464a3c827a628503ea0e00',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(317e369e-1e06-434d-ae95-a335f0e6c903),volume_type_id=317e369e-1e06-434d-ae95-a335f0e6c903)' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:41:14 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-07f382c9-a430-4f42-82ec-c572bee92e99 tempest-VolumesActionsTest-249281332 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (86bb5a8c-c253-49ed-98b5-0324889d3261) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:41:14 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-07f382c9-a430-4f42-82ec-c572bee92e99 tempest-VolumesActionsTest-249281332 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (86bb5a8c-c253-49ed-98b5-0324889d3261) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:41:14 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-07f382c9-a430-4f42-82ec-c572bee92e99 tempest-VolumesActionsTest-249281332 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b6717ebd-3dfa-47c8-a331-01b69980d2b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:41:14 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-07f382c9-a430-4f42-82ec-c572bee92e99 tempest-VolumesActionsTest-249281332 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b6717ebd-3dfa-47c8-a331-01b69980d2b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '600aaedd-99c5-4cfd-8568-413e8f979315', 'volume_name': 'volume-600aaedd-99c5-4cfd-8568-413e8f979315', 'volume_size': 1}' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:41:14 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-07f382c9-a430-4f42-82ec-c572bee92e99 tempest-VolumesActionsTest-249281332 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (18257ece-2bb1-46d6-8d82-5b3bebdf77a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:41:14 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-07f382c9-a430-4f42-82ec-c572bee92e99 tempest-VolumesActionsTest-249281332 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (18257ece-2bb1-46d6-8d82-5b3bebdf77a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:41:14 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-07f382c9-a430-4f42-82ec-c572bee92e99 tempest-VolumesActionsTest-249281332 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c5cc3c16-841d-43de-afd0-ce05c643e814) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:41:14 devstack cinder-volume[87444]: INFO cinder.volume.flows.manager.create_volume [None req-07f382c9-a430-4f42-82ec-c572bee92e99 tempest-VolumesActionsTest-249281332 None] Volume 600aaedd-99c5-4cfd-8568-413e8f979315: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-600aaedd-99c5-4cfd-8568-413e8f979315', 'volume_size': 1} Jul 10 04:41:14 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-07f382c9-a430-4f42-82ec-c572bee92e99 tempest-VolumesActionsTest-249281332 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 04:41:14 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-9e35ef3d-9b0f-47ac-aad8-d69944eead85 tempest-VolumesActionsTest-1960720823 None] Lock "cinder-f7d26561-6ac2-4135-aa7e-27a582385c8c-delete_volume" released by "delete_volume" :: held 3.289s {{(pid=87444) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 04:41:14 devstack sudo[96320]: pam_unix(sudo:session): session closed for user root Jul 10 04:41:14 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-1169375f-2024-4c01-b8d2-31e327e2caa6 tempest-VolumeTypesAccessTest-1249180414 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-5f1c2a0b-7ea0-4b18-8359-22128deb93a9" returned: 0 in 0.824s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:41:14 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-1169375f-2024-4c01-b8d2-31e327e2caa6 tempest-VolumeTypesAccessTest-1249180414 None] <== create_volume: return (2198ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922'} {{(pid=87444) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 04:41:14 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-1169375f-2024-4c01-b8d2-31e327e2caa6 tempest-VolumeTypesAccessTest-1249180414 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.206s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 04:41:14 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-ca18598c-a190-4cc9-9eac-a8eb6b45a508 tempest-GroupsTest-1660920858 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.858s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 04:41:14 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-ca18598c-a190-4cc9-9eac-a8eb6b45a508 tempest-GroupsTest-1660920858 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=c7acfe89-2867-4622-be95-9fb9d89fcac2,created_at=2026-07-10T02:41:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1873268955',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=c7acfe89-2867-4622-be95-9fb9d89fcac2,host='devstack@QuobyteHD#QuobyteHD',id=64cd41e3-857f-492c-bd09-74b5487dfc73,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5123392880514662ab5398a5aa74b6ab',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T02:41:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T02:41:13Z,use_quota=True,user_id='05df2bbe3479427caa427952a7ac24af',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9edd4922-390b-44ab-9873-a89248b4be71),volume_type_id=9edd4922-390b-44ab-9873-a89248b4be71)}" {{(pid=87444) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 04:41:14 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.remotefs [None req-ca18598c-a190-4cc9-9eac-a8eb6b45a508 tempest-GroupsTest-1660920858 None] Creating volume 64cd41e3-857f-492c-bd09-74b5487dfc73 {{(pid=87444) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 04:41:14 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-ca18598c-a190-4cc9-9eac-a8eb6b45a508 tempest-GroupsTest-1660920858 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 04:41:14 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-ca18598c-a190-4cc9-9eac-a8eb6b45a508 tempest-GroupsTest-1660920858 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 04:41:14 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-ca18598c-a190-4cc9-9eac-a8eb6b45a508 tempest-GroupsTest-1660920858 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922': None} {{(pid=87444) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 04:41:14 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-ca18598c-a190-4cc9-9eac-a8eb6b45a508 tempest-GroupsTest-1660920858 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922'] {{(pid=87444) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 04:41:14 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-ca18598c-a190-4cc9-9eac-a8eb6b45a508 tempest-GroupsTest-1660920858 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 04:41:14 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-ca18598c-a190-4cc9-9eac-a8eb6b45a508 tempest-GroupsTest-1660920858 None] Selected osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922 as target Quobyte volume. {{(pid=87444) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 04:41:14 devstack cinder-volume[87444]: INFO cinder.volume.drivers.remotefs [None req-ca18598c-a190-4cc9-9eac-a8eb6b45a508 tempest-GroupsTest-1660920858 None] casted to osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922 Jul 10 04:41:14 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-ca18598c-a190-4cc9-9eac-a8eb6b45a508 tempest-GroupsTest-1660920858 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-64cd41e3-857f-492c-bd09-74b5487dfc73 1073741824 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:41:14 devstack sudo[96324]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-64cd41e3-857f-492c-bd09-74b5487dfc73 1073741824 Jul 10 04:41:14 devstack sudo[96324]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:41:14 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-1169375f-2024-4c01-b8d2-31e327e2caa6 tempest-VolumeTypesAccessTest-1249180414 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ae0c3109-b1f8-4657-94a2-3a1ff1f9086e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5f1c2a0b-7ea0-4b18-8359-22128deb93a9', 'volume_size': 1}' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:41:14 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-1169375f-2024-4c01-b8d2-31e327e2caa6 tempest-VolumeTypesAccessTest-1249180414 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bb7adc69-905a-49d8-88eb-48ff63805011) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:41:14 devstack cinder-volume[87444]: INFO cinder.volume.flows.manager.create_volume [None req-1169375f-2024-4c01-b8d2-31e327e2caa6 tempest-VolumeTypesAccessTest-1249180414 None] Volume volume-5f1c2a0b-7ea0-4b18-8359-22128deb93a9 (5f1c2a0b-7ea0-4b18-8359-22128deb93a9): created successfully Jul 10 04:41:14 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-1169375f-2024-4c01-b8d2-31e327e2caa6 tempest-VolumeTypesAccessTest-1249180414 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bb7adc69-905a-49d8-88eb-48ff63805011) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:41:14 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-1169375f-2024-4c01-b8d2-31e327e2caa6 tempest-VolumeTypesAccessTest-1249180414 None] Flow 'volume_create_manager' (47d7603e-b62e-4f52-8fe9-e1f14991179d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87444) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 04:41:14 devstack cinder-volume[87444]: INFO cinder.volume.manager [None req-1169375f-2024-4c01-b8d2-31e327e2caa6 tempest-VolumeTypesAccessTest-1249180414 None] Created volume successfully. Jul 10 04:41:14 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-0de027c0-e6b5-4464-bf67-987887432f3c tempest-VolumeTypesAccessTest-1249180414 None] Acquiring lock "cinder-5f1c2a0b-7ea0-4b18-8359-22128deb93a9-delete_volume" by "delete_volume" {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 04:41:14 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-0de027c0-e6b5-4464-bf67-987887432f3c tempest-VolumeTypesAccessTest-1249180414 None] Lock "cinder-5f1c2a0b-7ea0-4b18-8359-22128deb93a9-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 04:41:14 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-0de027c0-e6b5-4464-bf67-987887432f3c tempest-VolumeTypesAccessTest-1249180414 None] Acquiring lock "cinder-quobyte-5f1c2a0b-7ea0-4b18-8359-22128deb93a9" by "delete_volume" {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 04:41:14 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-0de027c0-e6b5-4464-bf67-987887432f3c tempest-VolumeTypesAccessTest-1249180414 None] Lock "cinder-quobyte-5f1c2a0b-7ea0-4b18-8359-22128deb93a9" acquired by "delete_volume" :: waited 0.022s {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 04:41:15 devstack cinder-volume[87444]: DEBUG oslo.privsep.daemon [-] privsep: reply[385f9ce1-f22c-464f-90fb-7162ba3d83b1]: (4, 'qcow2') {{(pid=88499) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 04:41:15 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-0de027c0-e6b5-4464-bf67-987887432f3c tempest-VolumeTypesAccessTest-1249180414 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-5f1c2a0b-7ea0-4b18-8359-22128deb93a9 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:41:15 devstack sudo[96329]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-5f1c2a0b-7ea0-4b18-8359-22128deb93a9 Jul 10 04:41:15 devstack sudo[96329]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:41:15 devstack sudo[96324]: pam_unix(sudo:session): session closed for user root Jul 10 04:41:15 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-ca18598c-a190-4cc9-9eac-a8eb6b45a508 tempest-GroupsTest-1660920858 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-64cd41e3-857f-492c-bd09-74b5487dfc73 1073741824" returned: 0 in 0.995s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:41:15 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-ca18598c-a190-4cc9-9eac-a8eb6b45a508 tempest-GroupsTest-1660920858 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-64cd41e3-857f-492c-bd09-74b5487dfc73 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:41:15 devstack sudo[96332]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-64cd41e3-857f-492c-bd09-74b5487dfc73 Jul 10 04:41:15 devstack sudo[96332]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:41:15 devstack sudo[96329]: pam_unix(sudo:session): session closed for user root Jul 10 04:41:15 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-0de027c0-e6b5-4464-bf67-987887432f3c tempest-VolumeTypesAccessTest-1249180414 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-5f1c2a0b-7ea0-4b18-8359-22128deb93a9" returned: 0 in 0.845s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:41:15 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-0de027c0-e6b5-4464-bf67-987887432f3c tempest-VolumeTypesAccessTest-1249180414 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-5f1c2a0b-7ea0-4b18-8359-22128deb93a9 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:41:15 devstack sudo[96337]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-5f1c2a0b-7ea0-4b18-8359-22128deb93a9 Jul 10 04:41:15 devstack sudo[96337]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:41:16 devstack sudo[96332]: pam_unix(sudo:session): session closed for user root Jul 10 04:41:16 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-ca18598c-a190-4cc9-9eac-a8eb6b45a508 tempest-GroupsTest-1660920858 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-64cd41e3-857f-492c-bd09-74b5487dfc73" returned: 0 in 0.796s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:41:16 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-ca18598c-a190-4cc9-9eac-a8eb6b45a508 tempest-GroupsTest-1660920858 None] <== create_volume: return (1835ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922'} {{(pid=87444) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 04:41:16 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-ca18598c-a190-4cc9-9eac-a8eb6b45a508 tempest-GroupsTest-1660920858 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.838s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 04:41:16 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-07f382c9-a430-4f42-82ec-c572bee92e99 tempest-VolumesActionsTest-249281332 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.080s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 04:41:16 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-07f382c9-a430-4f42-82ec-c572bee92e99 tempest-VolumesActionsTest-249281332 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T02:41:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-393581782',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=600aaedd-99c5-4cfd-8568-413e8f979315,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8896182fdfb44908ba0a8d3405add17a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T02:41:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T02:41:14Z,use_quota=True,user_id='439be0ce5a464a3c827a628503ea0e00',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(317e369e-1e06-434d-ae95-a335f0e6c903),volume_type_id=317e369e-1e06-434d-ae95-a335f0e6c903)}" {{(pid=87444) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 04:41:16 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.remotefs [None req-07f382c9-a430-4f42-82ec-c572bee92e99 tempest-VolumesActionsTest-249281332 None] Creating volume 600aaedd-99c5-4cfd-8568-413e8f979315 {{(pid=87444) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 04:41:16 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-07f382c9-a430-4f42-82ec-c572bee92e99 tempest-VolumesActionsTest-249281332 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 04:41:16 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-07f382c9-a430-4f42-82ec-c572bee92e99 tempest-VolumesActionsTest-249281332 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 04:41:16 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-07f382c9-a430-4f42-82ec-c572bee92e99 tempest-VolumesActionsTest-249281332 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922': None} {{(pid=87444) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 04:41:16 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-07f382c9-a430-4f42-82ec-c572bee92e99 tempest-VolumesActionsTest-249281332 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922'] {{(pid=87444) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 04:41:16 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-07f382c9-a430-4f42-82ec-c572bee92e99 tempest-VolumesActionsTest-249281332 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 04:41:16 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-07f382c9-a430-4f42-82ec-c572bee92e99 tempest-VolumesActionsTest-249281332 None] Selected osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922 as target Quobyte volume. {{(pid=87444) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 04:41:16 devstack cinder-volume[87444]: INFO cinder.volume.drivers.remotefs [None req-07f382c9-a430-4f42-82ec-c572bee92e99 tempest-VolumesActionsTest-249281332 None] casted to osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922 Jul 10 04:41:16 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-07f382c9-a430-4f42-82ec-c572bee92e99 tempest-VolumesActionsTest-249281332 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-600aaedd-99c5-4cfd-8568-413e8f979315 1073741824 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:41:16 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-ca18598c-a190-4cc9-9eac-a8eb6b45a508 tempest-GroupsTest-1660920858 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b21d13b6-e020-4819-9b36-9b0c189cba25) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-64cd41e3-857f-492c-bd09-74b5487dfc73', 'volume_size': 1}' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:41:16 devstack sudo[96340]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-600aaedd-99c5-4cfd-8568-413e8f979315 1073741824 Jul 10 04:41:16 devstack sudo[96340]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:41:16 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-ca18598c-a190-4cc9-9eac-a8eb6b45a508 tempest-GroupsTest-1660920858 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3bab7aa0-a869-4128-b642-fb78e6dd1f7a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:41:16 devstack cinder-volume[87444]: INFO cinder.volume.flows.manager.create_volume [None req-ca18598c-a190-4cc9-9eac-a8eb6b45a508 tempest-GroupsTest-1660920858 None] Volume volume-64cd41e3-857f-492c-bd09-74b5487dfc73 (64cd41e3-857f-492c-bd09-74b5487dfc73): created successfully Jul 10 04:41:16 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-ca18598c-a190-4cc9-9eac-a8eb6b45a508 tempest-GroupsTest-1660920858 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3bab7aa0-a869-4128-b642-fb78e6dd1f7a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:41:16 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-ca18598c-a190-4cc9-9eac-a8eb6b45a508 tempest-GroupsTest-1660920858 None] Flow 'volume_create_manager' (37ee9300-6d3b-4734-bf2a-f12b2c10d070) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87444) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 04:41:16 devstack cinder-volume[87444]: INFO cinder.volume.manager [None req-ca18598c-a190-4cc9-9eac-a8eb6b45a508 tempest-GroupsTest-1660920858 None] Created volume successfully. Jul 10 04:41:16 devstack sudo[96337]: pam_unix(sudo:session): session closed for user root Jul 10 04:41:16 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-0de027c0-e6b5-4464-bf67-987887432f3c tempest-VolumeTypesAccessTest-1249180414 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-5f1c2a0b-7ea0-4b18-8359-22128deb93a9" returned: 0 in 0.718s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:41:16 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-0de027c0-e6b5-4464-bf67-987887432f3c tempest-VolumeTypesAccessTest-1249180414 None] Lock "cinder-quobyte-5f1c2a0b-7ea0-4b18-8359-22128deb93a9" released by "delete_volume" :: held 1.607s {{(pid=87444) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 04:41:16 devstack cinder-volume[87444]: WARNING cinder.quota [None req-0de027c0-e6b5-4464-bf67-987887432f3c tempest-VolumeTypesAccessTest-1249180414 None] Deprecated: Default quota for resource: volumes_tempest-VolumeTypesAccessTest-volume-type-790643981 is set by the default quota flag: quota_volumes_tempest-VolumeTypesAccessTest-volume-type-790643981, it is now deprecated. Please use the default quota class for default quota. Jul 10 04:41:16 devstack cinder-volume[87444]: WARNING cinder.quota [None req-0de027c0-e6b5-4464-bf67-987887432f3c tempest-VolumeTypesAccessTest-1249180414 None] Deprecated: Default quota for resource: gigabytes_tempest-VolumeTypesAccessTest-volume-type-790643981 is set by the default quota flag: quota_gigabytes_tempest-VolumeTypesAccessTest-volume-type-790643981, it is now deprecated. Please use the default quota class for default quota. Jul 10 04:41:16 devstack cinder-volume[87444]: DEBUG cinder.quota [None req-0de027c0-e6b5-4464-bf67-987887432f3c tempest-VolumeTypesAccessTest-1249180414 None] Created reservations ['9e161075-2e30-4078-94c1-b73c7fc411a8', 'd412e54a-ce48-467c-9220-b0f0e188ce43', '8b447ee6-81e5-482c-b6de-1f48a77d5e88', '5f835b53-3a2a-40b0-bcae-4125494eb03e'] {{(pid=87444) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 04:41:16 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-0de027c0-e6b5-4464-bf67-987887432f3c tempest-VolumeTypesAccessTest-1249180414 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 04:41:16 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-0de027c0-e6b5-4464-bf67-987887432f3c tempest-VolumeTypesAccessTest-1249180414 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 04:41:16 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-0de027c0-e6b5-4464-bf67-987887432f3c tempest-VolumeTypesAccessTest-1249180414 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922': None} {{(pid=87444) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 04:41:16 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-0de027c0-e6b5-4464-bf67-987887432f3c tempest-VolumeTypesAccessTest-1249180414 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922'] {{(pid=87444) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 04:41:16 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-0de027c0-e6b5-4464-bf67-987887432f3c tempest-VolumeTypesAccessTest-1249180414 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 04:41:16 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-0de027c0-e6b5-4464-bf67-987887432f3c tempest-VolumeTypesAccessTest-1249180414 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:41:16 devstack sudo[96345]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097 Jul 10 04:41:16 devstack sudo[96345]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:41:17 devstack cinder-volume[87444]: INFO cinder.volume.manager [None req-87941370-ea8a-4443-ac50-8d1c6803ad4b tempest-GroupsTest-1660920858 None] Update group completed successfully. Jul 10 04:41:17 devstack sudo[96340]: pam_unix(sudo:session): session closed for user root Jul 10 04:41:17 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-07f382c9-a430-4f42-82ec-c572bee92e99 tempest-VolumesActionsTest-249281332 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-600aaedd-99c5-4cfd-8568-413e8f979315 1073741824" returned: 0 in 1.124s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:41:17 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-07f382c9-a430-4f42-82ec-c572bee92e99 tempest-VolumesActionsTest-249281332 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-600aaedd-99c5-4cfd-8568-413e8f979315 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:41:17 devstack sudo[96348]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-600aaedd-99c5-4cfd-8568-413e8f979315 Jul 10 04:41:17 devstack sudo[96348]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:41:17 devstack sudo[96345]: pam_unix(sudo:session): session closed for user root Jul 10 04:41:17 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-0de027c0-e6b5-4464-bf67-987887432f3c tempest-VolumeTypesAccessTest-1249180414 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097" returned: 0 in 0.901s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:41:17 devstack cinder-volume[87444]: DEBUG cinder.manager [None req-0de027c0-e6b5-4464-bf67-987887432f3c tempest-VolumeTypesAccessTest-1249180414 None] Notifying Schedulers of capabilities ... {{(pid=87444) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 04:41:17 devstack cinder-volume[87444]: INFO cinder.volume.manager [None req-0de027c0-e6b5-4464-bf67-987887432f3c tempest-VolumeTypesAccessTest-1249180414 None] Deleted volume successfully. Jul 10 04:41:17 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-0de027c0-e6b5-4464-bf67-987887432f3c tempest-VolumeTypesAccessTest-1249180414 None] Lock "cinder-5f1c2a0b-7ea0-4b18-8359-22128deb93a9-delete_volume" released by "delete_volume" :: held 2.783s {{(pid=87444) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 04:41:18 devstack sudo[96348]: pam_unix(sudo:session): session closed for user root Jul 10 04:41:18 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-07f382c9-a430-4f42-82ec-c572bee92e99 tempest-VolumesActionsTest-249281332 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-600aaedd-99c5-4cfd-8568-413e8f979315" returned: 0 in 0.772s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:41:18 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-07f382c9-a430-4f42-82ec-c572bee92e99 tempest-VolumesActionsTest-249281332 None] <== create_volume: return (1951ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922'} {{(pid=87444) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 04:41:18 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-07f382c9-a430-4f42-82ec-c572bee92e99 tempest-VolumesActionsTest-249281332 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.953s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 04:41:18 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-07f382c9-a430-4f42-82ec-c572bee92e99 tempest-VolumesActionsTest-249281332 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c5cc3c16-841d-43de-afd0-ce05c643e814) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-600aaedd-99c5-4cfd-8568-413e8f979315', 'volume_size': 1}' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:41:18 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-07f382c9-a430-4f42-82ec-c572bee92e99 tempest-VolumesActionsTest-249281332 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bb584cf8-d11e-4930-9067-353a8b9df195) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:41:18 devstack cinder-volume[87444]: INFO cinder.volume.flows.manager.create_volume [None req-07f382c9-a430-4f42-82ec-c572bee92e99 tempest-VolumesActionsTest-249281332 None] Volume volume-600aaedd-99c5-4cfd-8568-413e8f979315 (600aaedd-99c5-4cfd-8568-413e8f979315): created successfully Jul 10 04:41:18 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-07f382c9-a430-4f42-82ec-c572bee92e99 tempest-VolumesActionsTest-249281332 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bb584cf8-d11e-4930-9067-353a8b9df195) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:41:18 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-07f382c9-a430-4f42-82ec-c572bee92e99 tempest-VolumesActionsTest-249281332 None] Flow 'volume_create_manager' (ba3ce29a-1fd5-45ca-9baa-d40358a66aae) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87444) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 04:41:18 devstack cinder-volume[87444]: INFO cinder.volume.manager [None req-07f382c9-a430-4f42-82ec-c572bee92e99 tempest-VolumesActionsTest-249281332 None] Created volume successfully. Jul 10 04:41:18 devstack cinder-volume[87444]: INFO cinder.volume.manager [None req-648ded3f-6c0f-4fd0-a60b-d4cb7bd04d0a tempest-GroupsTest-1660920858 None] Update group completed successfully. Jul 10 04:41:19 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-2bbde231-cb00-4c5e-a35e-4587ceee41f8 tempest-VolumesActionsTest-1960720823 None] Acquiring lock "cinder-600aaedd-99c5-4cfd-8568-413e8f979315-delete_volume" by "delete_volume" {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 04:41:19 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-2bbde231-cb00-4c5e-a35e-4587ceee41f8 tempest-VolumesActionsTest-1960720823 None] Lock "cinder-600aaedd-99c5-4cfd-8568-413e8f979315-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 04:41:19 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-2bbde231-cb00-4c5e-a35e-4587ceee41f8 tempest-VolumesActionsTest-1960720823 None] Acquiring lock "cinder-quobyte-600aaedd-99c5-4cfd-8568-413e8f979315" by "delete_volume" {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 04:41:19 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-2bbde231-cb00-4c5e-a35e-4587ceee41f8 tempest-VolumesActionsTest-1960720823 None] Lock "cinder-quobyte-600aaedd-99c5-4cfd-8568-413e8f979315" acquired by "delete_volume" :: waited 0.019s {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 04:41:19 devstack cinder-volume[87444]: DEBUG oslo.privsep.daemon [-] privsep: reply[e01a8276-b4a7-4bc3-bd9b-414a2a156578]: (4, 'qcow2') {{(pid=88499) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 04:41:19 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-2bbde231-cb00-4c5e-a35e-4587ceee41f8 tempest-VolumesActionsTest-1960720823 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-600aaedd-99c5-4cfd-8568-413e8f979315 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:41:19 devstack sudo[96352]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-600aaedd-99c5-4cfd-8568-413e8f979315 Jul 10 04:41:19 devstack sudo[96352]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:41:20 devstack sudo[96352]: pam_unix(sudo:session): session closed for user root Jul 10 04:41:20 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-2bbde231-cb00-4c5e-a35e-4587ceee41f8 tempest-VolumesActionsTest-1960720823 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-600aaedd-99c5-4cfd-8568-413e8f979315" returned: 0 in 0.943s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:41:20 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-2bbde231-cb00-4c5e-a35e-4587ceee41f8 tempest-VolumesActionsTest-1960720823 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-600aaedd-99c5-4cfd-8568-413e8f979315 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:41:20 devstack sudo[96357]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-600aaedd-99c5-4cfd-8568-413e8f979315 Jul 10 04:41:20 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-a3f122c8-9743-488c-9c90-b45137fd3000 tempest-GroupsTest-1660920858 None] Acquiring lock "cinder-quobyte-162d11ca-a7f5-4ea5-abdf-be4a517df1cb" by "delete_volume" {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 04:41:20 devstack sudo[96357]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:41:20 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-a3f122c8-9743-488c-9c90-b45137fd3000 tempest-GroupsTest-1660920858 None] Lock "cinder-quobyte-162d11ca-a7f5-4ea5-abdf-be4a517df1cb" acquired by "delete_volume" :: waited 0.051s {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 04:41:20 devstack cinder-volume[87444]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4bdd82f-e1e5-481a-8cbe-0efcb7ac8a5f]: (4, 'qcow2') {{(pid=88499) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 04:41:20 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-a3f122c8-9743-488c-9c90-b45137fd3000 tempest-GroupsTest-1660920858 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-162d11ca-a7f5-4ea5-abdf-be4a517df1cb {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:41:20 devstack sudo[96359]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-162d11ca-a7f5-4ea5-abdf-be4a517df1cb Jul 10 04:41:20 devstack sudo[96359]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:41:21 devstack sudo[96357]: pam_unix(sudo:session): session closed for user root Jul 10 04:41:21 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-2bbde231-cb00-4c5e-a35e-4587ceee41f8 tempest-VolumesActionsTest-1960720823 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-600aaedd-99c5-4cfd-8568-413e8f979315" returned: 0 in 0.838s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:41:21 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-2bbde231-cb00-4c5e-a35e-4587ceee41f8 tempest-VolumesActionsTest-1960720823 None] Lock "cinder-quobyte-600aaedd-99c5-4cfd-8568-413e8f979315" released by "delete_volume" :: held 1.837s {{(pid=87444) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 04:41:21 devstack cinder-volume[87444]: DEBUG cinder.quota [None req-2bbde231-cb00-4c5e-a35e-4587ceee41f8 tempest-VolumesActionsTest-1960720823 None] Created reservations ['3cd71fd4-ece7-4450-9ecd-c13d635019b9', 'dd08503a-8579-4032-9266-686e227fea53', '1bb2015f-674c-4d4d-a758-64aaa0d1d4ac', '3c351b77-a51d-4fce-926c-185573172ecd'] {{(pid=87444) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 04:41:21 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-2bbde231-cb00-4c5e-a35e-4587ceee41f8 tempest-VolumesActionsTest-1960720823 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 04:41:21 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-2bbde231-cb00-4c5e-a35e-4587ceee41f8 tempest-VolumesActionsTest-1960720823 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 04:41:21 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-2bbde231-cb00-4c5e-a35e-4587ceee41f8 tempest-VolumesActionsTest-1960720823 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922': None} {{(pid=87444) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 04:41:21 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-2bbde231-cb00-4c5e-a35e-4587ceee41f8 tempest-VolumesActionsTest-1960720823 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922'] {{(pid=87444) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 04:41:21 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-2bbde231-cb00-4c5e-a35e-4587ceee41f8 tempest-VolumesActionsTest-1960720823 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 04:41:21 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-2bbde231-cb00-4c5e-a35e-4587ceee41f8 tempest-VolumesActionsTest-1960720823 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:41:21 devstack sudo[96359]: pam_unix(sudo:session): session closed for user root Jul 10 04:41:21 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-a3f122c8-9743-488c-9c90-b45137fd3000 tempest-GroupsTest-1660920858 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-162d11ca-a7f5-4ea5-abdf-be4a517df1cb" returned: 0 in 0.986s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:41:21 devstack sudo[96365]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097 Jul 10 04:41:21 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-a3f122c8-9743-488c-9c90-b45137fd3000 tempest-GroupsTest-1660920858 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-162d11ca-a7f5-4ea5-abdf-be4a517df1cb {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:41:21 devstack sudo[96365]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:41:21 devstack sudo[96367]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-162d11ca-a7f5-4ea5-abdf-be4a517df1cb Jul 10 04:41:21 devstack sudo[96367]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:41:22 devstack sudo[96365]: pam_unix(sudo:session): session closed for user root Jul 10 04:41:22 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-2bbde231-cb00-4c5e-a35e-4587ceee41f8 tempest-VolumesActionsTest-1960720823 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097" returned: 0 in 1.221s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:41:22 devstack cinder-volume[87444]: DEBUG cinder.manager [None req-2bbde231-cb00-4c5e-a35e-4587ceee41f8 tempest-VolumesActionsTest-1960720823 None] Notifying Schedulers of capabilities ... {{(pid=87444) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 04:41:22 devstack cinder-volume[87444]: DEBUG cinder.volume.flows.manager.create_volume [None req-5b956339-e88c-40f3-bc3e-22fb94ad15c2 tempest-VolumesActionsTest-249281332 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87444) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 04:41:22 devstack sudo[96367]: pam_unix(sudo:session): session closed for user root Jul 10 04:41:22 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-5b956339-e88c-40f3-bc3e-22fb94ad15c2 tempest-VolumesActionsTest-249281332 None] Flow 'volume_create_manager' (f5256de0-7d55-45ed-98bd-08623267c726) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 04:41:22 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-5b956339-e88c-40f3-bc3e-22fb94ad15c2 tempest-VolumesActionsTest-249281332 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8af0a571-a77c-4213-8f78-1d8a54acfc69) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:41:22 devstack cinder-volume[87444]: INFO cinder.volume.manager [None req-2bbde231-cb00-4c5e-a35e-4587ceee41f8 tempest-VolumesActionsTest-1960720823 None] Deleted volume successfully. Jul 10 04:41:22 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-a3f122c8-9743-488c-9c90-b45137fd3000 tempest-GroupsTest-1660920858 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-162d11ca-a7f5-4ea5-abdf-be4a517df1cb" returned: 0 in 1.242s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:41:22 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-a3f122c8-9743-488c-9c90-b45137fd3000 tempest-GroupsTest-1660920858 None] Lock "cinder-quobyte-162d11ca-a7f5-4ea5-abdf-be4a517df1cb" released by "delete_volume" :: held 2.316s {{(pid=87444) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 04:41:22 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-a3f122c8-9743-488c-9c90-b45137fd3000 tempest-GroupsTest-1660920858 None] Acquiring lock "cinder-quobyte-64cd41e3-857f-492c-bd09-74b5487dfc73" by "delete_volume" {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 04:41:22 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-5b956339-e88c-40f3-bc3e-22fb94ad15c2 tempest-VolumesActionsTest-249281332 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8af0a571-a77c-4213-8f78-1d8a54acfc69) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T02:41:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-827593831',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0abec944-a675-4b40-b632-b6349d055b7f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8896182fdfb44908ba0a8d3405add17a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T02:41:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T02:41:23Z,use_quota=True,user_id='439be0ce5a464a3c827a628503ea0e00',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(317e369e-1e06-434d-ae95-a335f0e6c903),volume_type_id=317e369e-1e06-434d-ae95-a335f0e6c903)' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:41:22 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-5b956339-e88c-40f3-bc3e-22fb94ad15c2 tempest-VolumesActionsTest-249281332 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f5285884-6ebc-42d4-a83e-c819dbc679db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:41:22 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-5b956339-e88c-40f3-bc3e-22fb94ad15c2 tempest-VolumesActionsTest-249281332 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f5285884-6ebc-42d4-a83e-c819dbc679db) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:41:22 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-5b956339-e88c-40f3-bc3e-22fb94ad15c2 tempest-VolumesActionsTest-249281332 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e85f58ae-74a9-4515-91dd-c1f9d5afd044) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:41:22 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-5b956339-e88c-40f3-bc3e-22fb94ad15c2 tempest-VolumesActionsTest-249281332 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e85f58ae-74a9-4515-91dd-c1f9d5afd044) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0abec944-a675-4b40-b632-b6349d055b7f', 'volume_name': 'volume-0abec944-a675-4b40-b632-b6349d055b7f', 'volume_size': 1}' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:41:22 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-5b956339-e88c-40f3-bc3e-22fb94ad15c2 tempest-VolumesActionsTest-249281332 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (06a2b00a-8ed5-4b3d-a13b-82d01520f4c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:41:22 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-5b956339-e88c-40f3-bc3e-22fb94ad15c2 tempest-VolumesActionsTest-249281332 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (06a2b00a-8ed5-4b3d-a13b-82d01520f4c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:41:22 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-5b956339-e88c-40f3-bc3e-22fb94ad15c2 tempest-VolumesActionsTest-249281332 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0687b351-3cd8-4e50-af14-f8f91d30764b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:41:22 devstack cinder-volume[87444]: INFO cinder.volume.flows.manager.create_volume [None req-5b956339-e88c-40f3-bc3e-22fb94ad15c2 tempest-VolumesActionsTest-249281332 None] Volume 0abec944-a675-4b40-b632-b6349d055b7f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0abec944-a675-4b40-b632-b6349d055b7f', 'volume_size': 1} Jul 10 04:41:22 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-5b956339-e88c-40f3-bc3e-22fb94ad15c2 tempest-VolumesActionsTest-249281332 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 04:41:22 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-5b956339-e88c-40f3-bc3e-22fb94ad15c2 tempest-VolumesActionsTest-249281332 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 04:41:22 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-5b956339-e88c-40f3-bc3e-22fb94ad15c2 tempest-VolumesActionsTest-249281332 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T02:41:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-827593831',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0abec944-a675-4b40-b632-b6349d055b7f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8896182fdfb44908ba0a8d3405add17a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T02:41:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T02:41:23Z,use_quota=True,user_id='439be0ce5a464a3c827a628503ea0e00',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(317e369e-1e06-434d-ae95-a335f0e6c903),volume_type_id=317e369e-1e06-434d-ae95-a335f0e6c903)}" {{(pid=87444) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 04:41:22 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.remotefs [None req-5b956339-e88c-40f3-bc3e-22fb94ad15c2 tempest-VolumesActionsTest-249281332 None] Creating volume 0abec944-a675-4b40-b632-b6349d055b7f {{(pid=87444) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 04:41:22 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-5b956339-e88c-40f3-bc3e-22fb94ad15c2 tempest-VolumesActionsTest-249281332 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 04:41:22 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-5b956339-e88c-40f3-bc3e-22fb94ad15c2 tempest-VolumesActionsTest-249281332 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 04:41:22 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-5b956339-e88c-40f3-bc3e-22fb94ad15c2 tempest-VolumesActionsTest-249281332 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922': None} {{(pid=87444) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 04:41:22 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-5b956339-e88c-40f3-bc3e-22fb94ad15c2 tempest-VolumesActionsTest-249281332 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922'] {{(pid=87444) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 04:41:22 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-5b956339-e88c-40f3-bc3e-22fb94ad15c2 tempest-VolumesActionsTest-249281332 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 04:41:22 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-5b956339-e88c-40f3-bc3e-22fb94ad15c2 tempest-VolumesActionsTest-249281332 None] Selected osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922 as target Quobyte volume. {{(pid=87444) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 04:41:22 devstack cinder-volume[87444]: INFO cinder.volume.drivers.remotefs [None req-5b956339-e88c-40f3-bc3e-22fb94ad15c2 tempest-VolumesActionsTest-249281332 None] casted to osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922 Jul 10 04:41:22 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-5b956339-e88c-40f3-bc3e-22fb94ad15c2 tempest-VolumesActionsTest-249281332 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-0abec944-a675-4b40-b632-b6349d055b7f 1073741824 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:41:22 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-2bbde231-cb00-4c5e-a35e-4587ceee41f8 tempest-VolumesActionsTest-1960720823 None] Lock "cinder-600aaedd-99c5-4cfd-8568-413e8f979315-delete_volume" released by "delete_volume" :: held 3.522s {{(pid=87444) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 04:41:22 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-a3f122c8-9743-488c-9c90-b45137fd3000 tempest-GroupsTest-1660920858 None] Lock "cinder-quobyte-64cd41e3-857f-492c-bd09-74b5487dfc73" acquired by "delete_volume" :: waited 0.088s {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 04:41:22 devstack sudo[96372]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-0abec944-a675-4b40-b632-b6349d055b7f 1073741824 Jul 10 04:41:22 devstack sudo[96372]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:41:22 devstack cinder-volume[87444]: DEBUG oslo.privsep.daemon [-] privsep: reply[cfaff51c-919d-4a7b-9b97-d8f8143a505c]: (4, 'qcow2') {{(pid=88499) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 04:41:22 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-a3f122c8-9743-488c-9c90-b45137fd3000 tempest-GroupsTest-1660920858 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-64cd41e3-857f-492c-bd09-74b5487dfc73 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:41:23 devstack sudo[96374]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-64cd41e3-857f-492c-bd09-74b5487dfc73 Jul 10 04:41:23 devstack sudo[96374]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:41:23 devstack sudo[96372]: pam_unix(sudo:session): session closed for user root Jul 10 04:41:23 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-5b956339-e88c-40f3-bc3e-22fb94ad15c2 tempest-VolumesActionsTest-249281332 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-0abec944-a675-4b40-b632-b6349d055b7f 1073741824" returned: 0 in 1.115s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:41:23 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-5b956339-e88c-40f3-bc3e-22fb94ad15c2 tempest-VolumesActionsTest-249281332 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-0abec944-a675-4b40-b632-b6349d055b7f {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:41:24 devstack sudo[96374]: pam_unix(sudo:session): session closed for user root Jul 10 04:41:24 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-a3f122c8-9743-488c-9c90-b45137fd3000 tempest-GroupsTest-1660920858 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-64cd41e3-857f-492c-bd09-74b5487dfc73" returned: 0 in 1.128s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:41:24 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-a3f122c8-9743-488c-9c90-b45137fd3000 tempest-GroupsTest-1660920858 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-64cd41e3-857f-492c-bd09-74b5487dfc73 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:41:24 devstack sudo[96384]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-0abec944-a675-4b40-b632-b6349d055b7f Jul 10 04:41:24 devstack sudo[96384]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:41:24 devstack sudo[96386]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-64cd41e3-857f-492c-bd09-74b5487dfc73 Jul 10 04:41:24 devstack sudo[96386]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:41:24 devstack sudo[96384]: pam_unix(sudo:session): session closed for user root Jul 10 04:41:25 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-5b956339-e88c-40f3-bc3e-22fb94ad15c2 tempest-VolumesActionsTest-249281332 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-0abec944-a675-4b40-b632-b6349d055b7f" returned: 0 in 1.020s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:41:25 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-5b956339-e88c-40f3-bc3e-22fb94ad15c2 tempest-VolumesActionsTest-249281332 None] <== create_volume: return (2193ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922'} {{(pid=87444) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 04:41:25 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-5b956339-e88c-40f3-bc3e-22fb94ad15c2 tempest-VolumesActionsTest-249281332 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.197s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 04:41:25 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-5b956339-e88c-40f3-bc3e-22fb94ad15c2 tempest-VolumesActionsTest-249281332 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0687b351-3cd8-4e50-af14-f8f91d30764b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0abec944-a675-4b40-b632-b6349d055b7f', 'volume_size': 1}' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:41:25 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-5b956339-e88c-40f3-bc3e-22fb94ad15c2 tempest-VolumesActionsTest-249281332 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f458fa67-c069-4670-95b9-a0d149cee05f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:41:25 devstack cinder-volume[87444]: INFO cinder.volume.flows.manager.create_volume [None req-5b956339-e88c-40f3-bc3e-22fb94ad15c2 tempest-VolumesActionsTest-249281332 None] Volume volume-0abec944-a675-4b40-b632-b6349d055b7f (0abec944-a675-4b40-b632-b6349d055b7f): created successfully Jul 10 04:41:25 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-5b956339-e88c-40f3-bc3e-22fb94ad15c2 tempest-VolumesActionsTest-249281332 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f458fa67-c069-4670-95b9-a0d149cee05f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:41:25 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-5b956339-e88c-40f3-bc3e-22fb94ad15c2 tempest-VolumesActionsTest-249281332 None] Flow 'volume_create_manager' (f5256de0-7d55-45ed-98bd-08623267c726) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87444) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 04:41:25 devstack cinder-volume[87444]: INFO cinder.volume.manager [None req-5b956339-e88c-40f3-bc3e-22fb94ad15c2 tempest-VolumesActionsTest-249281332 None] Created volume successfully. Jul 10 04:41:25 devstack sudo[96386]: pam_unix(sudo:session): session closed for user root Jul 10 04:41:25 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-a3f122c8-9743-488c-9c90-b45137fd3000 tempest-GroupsTest-1660920858 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-64cd41e3-857f-492c-bd09-74b5487dfc73" returned: 0 in 1.154s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:41:25 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-a3f122c8-9743-488c-9c90-b45137fd3000 tempest-GroupsTest-1660920858 None] Lock "cinder-quobyte-64cd41e3-857f-492c-bd09-74b5487dfc73" released by "delete_volume" :: held 2.335s {{(pid=87444) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 04:41:25 devstack cinder-volume[87444]: DEBUG cinder.quota [None req-a3f122c8-9743-488c-9c90-b45137fd3000 tempest-GroupsTest-1660920858 None] Created reservations ['39993f9d-a380-484c-aabc-81fa53981481'] {{(pid=87444) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 04:41:25 devstack cinder-volume[87444]: WARNING cinder.quota [None req-a3f122c8-9743-488c-9c90-b45137fd3000 tempest-GroupsTest-1660920858 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-111085703 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-111085703, it is now deprecated. Please use the default quota class for default quota. Jul 10 04:41:25 devstack cinder-volume[87444]: WARNING cinder.quota [None req-a3f122c8-9743-488c-9c90-b45137fd3000 tempest-GroupsTest-1660920858 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-111085703 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-111085703, it is now deprecated. Please use the default quota class for default quota. Jul 10 04:41:25 devstack cinder-volume[87444]: DEBUG cinder.quota [None req-a3f122c8-9743-488c-9c90-b45137fd3000 tempest-GroupsTest-1660920858 None] Created reservations ['81a1b466-01bf-4f07-98d4-932548a92d0b', '4cb2a02b-dd19-4ba8-b7e6-ec525fa5eb41', '42487ecf-b5ef-479e-a9cf-d614c5b5c11d', '3baa0d09-b968-4294-8c49-3f53c5d6e678'] {{(pid=87444) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 04:41:25 devstack cinder-volume[87444]: DEBUG cinder.quota [None req-a3f122c8-9743-488c-9c90-b45137fd3000 tempest-GroupsTest-1660920858 None] Created reservations ['27eeda32-c51e-4067-bbe0-78c5369116ce', 'f5d522b3-129a-46c2-921f-e273b4a0d3d6', '1795f288-4bd7-44b4-a2a6-60922a339100', 'c8bc00c7-d942-4d47-9efd-db40a3af4983'] {{(pid=87444) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 04:41:25 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-a3f122c8-9743-488c-9c90-b45137fd3000 tempest-GroupsTest-1660920858 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 04:41:25 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-a3f122c8-9743-488c-9c90-b45137fd3000 tempest-GroupsTest-1660920858 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 04:41:25 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-a3f122c8-9743-488c-9c90-b45137fd3000 tempest-GroupsTest-1660920858 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922': None} {{(pid=87444) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 04:41:25 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-a3f122c8-9743-488c-9c90-b45137fd3000 tempest-GroupsTest-1660920858 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922'] {{(pid=87444) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 04:41:25 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-a3f122c8-9743-488c-9c90-b45137fd3000 tempest-GroupsTest-1660920858 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 04:41:25 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-a3f122c8-9743-488c-9c90-b45137fd3000 tempest-GroupsTest-1660920858 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:41:25 devstack sudo[96390]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097 Jul 10 04:41:25 devstack sudo[96390]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:41:26 devstack sudo[96390]: pam_unix(sudo:session): session closed for user root Jul 10 04:41:26 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-a3f122c8-9743-488c-9c90-b45137fd3000 tempest-GroupsTest-1660920858 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097" returned: 0 in 0.870s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:41:26 devstack cinder-volume[87444]: DEBUG cinder.manager [None req-a3f122c8-9743-488c-9c90-b45137fd3000 tempest-GroupsTest-1660920858 None] Notifying Schedulers of capabilities ... {{(pid=87444) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 04:41:26 devstack cinder-volume[87444]: INFO cinder.volume.manager [None req-a3f122c8-9743-488c-9c90-b45137fd3000 tempest-GroupsTest-1660920858 None] Delete group completed successfully. Jul 10 04:41:26 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-1997ee19-42ca-44c6-8e52-0aefe21732c5 tempest-VolumesActionsTest-249281332 None] Acquiring lock "cinder-0abec944-a675-4b40-b632-b6349d055b7f-delete_volume" by "delete_volume" {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 04:41:26 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-1997ee19-42ca-44c6-8e52-0aefe21732c5 tempest-VolumesActionsTest-249281332 None] Lock "cinder-0abec944-a675-4b40-b632-b6349d055b7f-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 04:41:26 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-1997ee19-42ca-44c6-8e52-0aefe21732c5 tempest-VolumesActionsTest-249281332 None] Acquiring lock "cinder-quobyte-0abec944-a675-4b40-b632-b6349d055b7f" by "delete_volume" {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 04:41:26 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-1997ee19-42ca-44c6-8e52-0aefe21732c5 tempest-VolumesActionsTest-249281332 None] Lock "cinder-quobyte-0abec944-a675-4b40-b632-b6349d055b7f" acquired by "delete_volume" :: waited 0.021s {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 04:41:27 devstack cinder-volume[87444]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f40fb32-e822-4d6f-b263-ac1f0c9a98a3]: (4, 'qcow2') {{(pid=88499) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 04:41:27 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-1997ee19-42ca-44c6-8e52-0aefe21732c5 tempest-VolumesActionsTest-249281332 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-0abec944-a675-4b40-b632-b6349d055b7f {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:41:27 devstack sudo[96393]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-0abec944-a675-4b40-b632-b6349d055b7f Jul 10 04:41:27 devstack sudo[96393]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:41:27 devstack sudo[96393]: pam_unix(sudo:session): session closed for user root Jul 10 04:41:27 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-1997ee19-42ca-44c6-8e52-0aefe21732c5 tempest-VolumesActionsTest-249281332 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-0abec944-a675-4b40-b632-b6349d055b7f" returned: 0 in 0.965s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:41:27 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-1997ee19-42ca-44c6-8e52-0aefe21732c5 tempest-VolumesActionsTest-249281332 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-0abec944-a675-4b40-b632-b6349d055b7f {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:41:28 devstack sudo[96398]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-0abec944-a675-4b40-b632-b6349d055b7f Jul 10 04:41:28 devstack sudo[96398]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:41:28 devstack cinder-volume[87444]: DEBUG cinder.volume.flows.manager.create_volume [None req-256288d5-bad9-403d-ab32-3696f8d82094 tempest-VolumesSnapshotTestJSON-1690897005 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87444) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 04:41:28 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-256288d5-bad9-403d-ab32-3696f8d82094 tempest-VolumesSnapshotTestJSON-1690897005 None] Flow 'volume_create_manager' (90ffa1f5-c257-4782-9996-4093a2e94d44) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 04:41:28 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-256288d5-bad9-403d-ab32-3696f8d82094 tempest-VolumesSnapshotTestJSON-1690897005 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bb0b110f-6345-45d9-baad-a16d915af98d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:41:28 devstack sudo[96398]: pam_unix(sudo:session): session closed for user root Jul 10 04:41:28 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-256288d5-bad9-403d-ab32-3696f8d82094 tempest-VolumesSnapshotTestJSON-1690897005 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bb0b110f-6345-45d9-baad-a16d915af98d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T02:41:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-172118156',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6a357083-ca5b-48c8-95e3-902e6d5d5cd4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='92c5956be8c447b9872943111e4168dc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T02:41:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T02:41:29Z,use_quota=True,user_id='16ea7041ff434f7890eca88a786ad0f0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(317e369e-1e06-434d-ae95-a335f0e6c903),volume_type_id=317e369e-1e06-434d-ae95-a335f0e6c903)' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:41:28 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-256288d5-bad9-403d-ab32-3696f8d82094 tempest-VolumesSnapshotTestJSON-1690897005 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (478dc96c-f912-48de-b1c7-a486806e3c3e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:41:28 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-256288d5-bad9-403d-ab32-3696f8d82094 tempest-VolumesSnapshotTestJSON-1690897005 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (478dc96c-f912-48de-b1c7-a486806e3c3e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:41:28 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-256288d5-bad9-403d-ab32-3696f8d82094 tempest-VolumesSnapshotTestJSON-1690897005 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7cf1a31c-e8eb-497e-b927-eda375c05e5c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:41:28 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-256288d5-bad9-403d-ab32-3696f8d82094 tempest-VolumesSnapshotTestJSON-1690897005 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7cf1a31c-e8eb-497e-b927-eda375c05e5c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6a357083-ca5b-48c8-95e3-902e6d5d5cd4', 'volume_name': 'volume-6a357083-ca5b-48c8-95e3-902e6d5d5cd4', 'volume_size': 1}' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:41:28 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-256288d5-bad9-403d-ab32-3696f8d82094 tempest-VolumesSnapshotTestJSON-1690897005 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (66c89a87-604b-45f1-85b3-6f5c04cdd533) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:41:28 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-256288d5-bad9-403d-ab32-3696f8d82094 tempest-VolumesSnapshotTestJSON-1690897005 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (66c89a87-604b-45f1-85b3-6f5c04cdd533) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:41:28 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-256288d5-bad9-403d-ab32-3696f8d82094 tempest-VolumesSnapshotTestJSON-1690897005 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (acebca33-0e3d-4b60-82db-6138a53bac3b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:41:28 devstack cinder-volume[87444]: INFO cinder.volume.flows.manager.create_volume [None req-256288d5-bad9-403d-ab32-3696f8d82094 tempest-VolumesSnapshotTestJSON-1690897005 None] Volume 6a357083-ca5b-48c8-95e3-902e6d5d5cd4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6a357083-ca5b-48c8-95e3-902e6d5d5cd4', 'volume_size': 1} Jul 10 04:41:28 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-256288d5-bad9-403d-ab32-3696f8d82094 tempest-VolumesSnapshotTestJSON-1690897005 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 04:41:28 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-256288d5-bad9-403d-ab32-3696f8d82094 tempest-VolumesSnapshotTestJSON-1690897005 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 04:41:28 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-256288d5-bad9-403d-ab32-3696f8d82094 tempest-VolumesSnapshotTestJSON-1690897005 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T02:41:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-172118156',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6a357083-ca5b-48c8-95e3-902e6d5d5cd4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='92c5956be8c447b9872943111e4168dc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T02:41:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T02:41:29Z,use_quota=True,user_id='16ea7041ff434f7890eca88a786ad0f0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(317e369e-1e06-434d-ae95-a335f0e6c903),volume_type_id=317e369e-1e06-434d-ae95-a335f0e6c903)}" {{(pid=87444) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 04:41:28 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.remotefs [None req-256288d5-bad9-403d-ab32-3696f8d82094 tempest-VolumesSnapshotTestJSON-1690897005 None] Creating volume 6a357083-ca5b-48c8-95e3-902e6d5d5cd4 {{(pid=87444) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 04:41:28 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-256288d5-bad9-403d-ab32-3696f8d82094 tempest-VolumesSnapshotTestJSON-1690897005 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 04:41:28 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-256288d5-bad9-403d-ab32-3696f8d82094 tempest-VolumesSnapshotTestJSON-1690897005 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 04:41:28 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-256288d5-bad9-403d-ab32-3696f8d82094 tempest-VolumesSnapshotTestJSON-1690897005 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922': None} {{(pid=87444) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 04:41:28 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-256288d5-bad9-403d-ab32-3696f8d82094 tempest-VolumesSnapshotTestJSON-1690897005 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922'] {{(pid=87444) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 04:41:28 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-256288d5-bad9-403d-ab32-3696f8d82094 tempest-VolumesSnapshotTestJSON-1690897005 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 04:41:28 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-256288d5-bad9-403d-ab32-3696f8d82094 tempest-VolumesSnapshotTestJSON-1690897005 None] Selected osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922 as target Quobyte volume. {{(pid=87444) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 04:41:28 devstack cinder-volume[87444]: INFO cinder.volume.drivers.remotefs [None req-256288d5-bad9-403d-ab32-3696f8d82094 tempest-VolumesSnapshotTestJSON-1690897005 None] casted to osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922 Jul 10 04:41:28 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-256288d5-bad9-403d-ab32-3696f8d82094 tempest-VolumesSnapshotTestJSON-1690897005 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-6a357083-ca5b-48c8-95e3-902e6d5d5cd4 1073741824 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:41:28 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-1997ee19-42ca-44c6-8e52-0aefe21732c5 tempest-VolumesActionsTest-249281332 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-0abec944-a675-4b40-b632-b6349d055b7f" returned: 0 in 0.951s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:41:28 devstack sudo[96401]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-6a357083-ca5b-48c8-95e3-902e6d5d5cd4 1073741824 Jul 10 04:41:28 devstack sudo[96401]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:41:28 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-1997ee19-42ca-44c6-8e52-0aefe21732c5 tempest-VolumesActionsTest-249281332 None] Lock "cinder-quobyte-0abec944-a675-4b40-b632-b6349d055b7f" released by "delete_volume" :: held 1.995s {{(pid=87444) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 04:41:29 devstack cinder-volume[87444]: DEBUG cinder.quota [None req-1997ee19-42ca-44c6-8e52-0aefe21732c5 tempest-VolumesActionsTest-249281332 None] Created reservations ['10fff338-ac15-44bb-b057-433f998c7199', '12b0b098-f6d5-4a0e-8fa8-0b1755d796bc', '796a9ae5-87f9-4d06-8fdc-c8ef72738d28', 'f0dc0b37-125f-4a8a-a113-688de052f440'] {{(pid=87444) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 04:41:29 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-1997ee19-42ca-44c6-8e52-0aefe21732c5 tempest-VolumesActionsTest-249281332 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 04:41:29 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-1997ee19-42ca-44c6-8e52-0aefe21732c5 tempest-VolumesActionsTest-249281332 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 04:41:29 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-1997ee19-42ca-44c6-8e52-0aefe21732c5 tempest-VolumesActionsTest-249281332 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922': None} {{(pid=87444) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 04:41:29 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-1997ee19-42ca-44c6-8e52-0aefe21732c5 tempest-VolumesActionsTest-249281332 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922'] {{(pid=87444) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 04:41:29 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-1997ee19-42ca-44c6-8e52-0aefe21732c5 tempest-VolumesActionsTest-249281332 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 04:41:29 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-1997ee19-42ca-44c6-8e52-0aefe21732c5 tempest-VolumesActionsTest-249281332 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:41:29 devstack sudo[96403]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097 Jul 10 04:41:29 devstack sudo[96403]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:41:30 devstack sudo[96401]: pam_unix(sudo:session): session closed for user root Jul 10 04:41:30 devstack sudo[96403]: pam_unix(sudo:session): session closed for user root Jul 10 04:41:30 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-256288d5-bad9-403d-ab32-3696f8d82094 tempest-VolumesSnapshotTestJSON-1690897005 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-6a357083-ca5b-48c8-95e3-902e6d5d5cd4 1073741824" returned: 0 in 1.154s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:41:30 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-1997ee19-42ca-44c6-8e52-0aefe21732c5 tempest-VolumesActionsTest-249281332 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097" returned: 0 in 0.945s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:41:30 devstack cinder-volume[87444]: DEBUG cinder.manager [None req-1997ee19-42ca-44c6-8e52-0aefe21732c5 tempest-VolumesActionsTest-249281332 None] Notifying Schedulers of capabilities ... {{(pid=87444) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 04:41:30 devstack cinder-volume[87444]: INFO cinder.volume.manager [None req-1997ee19-42ca-44c6-8e52-0aefe21732c5 tempest-VolumesActionsTest-249281332 None] Deleted volume successfully. Jul 10 04:41:30 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-1997ee19-42ca-44c6-8e52-0aefe21732c5 tempest-VolumesActionsTest-249281332 None] Lock "cinder-0abec944-a675-4b40-b632-b6349d055b7f-delete_volume" released by "delete_volume" :: held 3.293s {{(pid=87444) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 04:41:30 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-256288d5-bad9-403d-ab32-3696f8d82094 tempest-VolumesSnapshotTestJSON-1690897005 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-6a357083-ca5b-48c8-95e3-902e6d5d5cd4 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:41:30 devstack sudo[96410]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-6a357083-ca5b-48c8-95e3-902e6d5d5cd4 Jul 10 04:41:30 devstack sudo[96410]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:41:31 devstack sudo[96410]: pam_unix(sudo:session): session closed for user root Jul 10 04:41:31 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-256288d5-bad9-403d-ab32-3696f8d82094 tempest-VolumesSnapshotTestJSON-1690897005 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-6a357083-ca5b-48c8-95e3-902e6d5d5cd4" returned: 0 in 0.917s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:41:31 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-256288d5-bad9-403d-ab32-3696f8d82094 tempest-VolumesSnapshotTestJSON-1690897005 None] <== create_volume: return (2157ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922'} {{(pid=87444) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 04:41:31 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-256288d5-bad9-403d-ab32-3696f8d82094 tempest-VolumesSnapshotTestJSON-1690897005 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.161s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 04:41:31 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-256288d5-bad9-403d-ab32-3696f8d82094 tempest-VolumesSnapshotTestJSON-1690897005 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (acebca33-0e3d-4b60-82db-6138a53bac3b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6a357083-ca5b-48c8-95e3-902e6d5d5cd4', 'volume_size': 1}' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:41:31 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-256288d5-bad9-403d-ab32-3696f8d82094 tempest-VolumesSnapshotTestJSON-1690897005 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7078ebf3-d279-414c-9302-db9d35f17a6e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:41:31 devstack cinder-volume[87444]: INFO cinder.volume.flows.manager.create_volume [None req-256288d5-bad9-403d-ab32-3696f8d82094 tempest-VolumesSnapshotTestJSON-1690897005 None] Volume volume-6a357083-ca5b-48c8-95e3-902e6d5d5cd4 (6a357083-ca5b-48c8-95e3-902e6d5d5cd4): created successfully Jul 10 04:41:31 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-256288d5-bad9-403d-ab32-3696f8d82094 tempest-VolumesSnapshotTestJSON-1690897005 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7078ebf3-d279-414c-9302-db9d35f17a6e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:41:31 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-256288d5-bad9-403d-ab32-3696f8d82094 tempest-VolumesSnapshotTestJSON-1690897005 None] Flow 'volume_create_manager' (90ffa1f5-c257-4782-9996-4093a2e94d44) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87444) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 04:41:31 devstack cinder-volume[87444]: INFO cinder.volume.manager [None req-256288d5-bad9-403d-ab32-3696f8d82094 tempest-VolumesSnapshotTestJSON-1690897005 None] Created volume successfully. Jul 10 04:41:32 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-d7254374-1ea3-473f-9b55-9a4faa990458 tempest-VolumesSnapshotTestJSON-1690897005 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 04:41:32 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-d7254374-1ea3-473f-9b55-9a4faa990458 tempest-VolumesSnapshotTestJSON-1690897005 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 04:41:32 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.remotefs [None req-d7254374-1ea3-473f-9b55-9a4faa990458 tempest-VolumesSnapshotTestJSON-1690897005 None] Creating offline snapshot da49cce0-a77b-4e00-8b1f-c4bb024a5469 of volume 6a357083-ca5b-48c8-95e3-902e6d5d5cd4 {{(pid=87444) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 10 04:41:32 devstack cinder-volume[87444]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4cd2040-caff-43a8-b223-aa65b7bb788e]: (4, 'qcow2') {{(pid=88499) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 04:41:32 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-d7254374-1ea3-473f-9b55-9a4faa990458 tempest-VolumesSnapshotTestJSON-1690897005 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-6a357083-ca5b-48c8-95e3-902e6d5d5cd4 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:41:32 devstack sudo[96452]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-6a357083-ca5b-48c8-95e3-902e6d5d5cd4 Jul 10 04:41:32 devstack sudo[96452]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:41:32 devstack cinder-volume[87444]: DEBUG oslo_service.periodic_task [None req-01f0ce3e-6850-4e14-881d-e40d3c4ad6e5 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87444) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 10 04:41:32 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-01f0ce3e-6850-4e14-881d-e40d3c4ad6e5 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 04:41:32 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-01f0ce3e-6850-4e14-881d-e40d3c4ad6e5 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 04:41:32 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-01f0ce3e-6850-4e14-881d-e40d3c4ad6e5 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922': None} {{(pid=87444) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 04:41:33 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-01f0ce3e-6850-4e14-881d-e40d3c4ad6e5 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922'] {{(pid=87444) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 04:41:33 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-01f0ce3e-6850-4e14-881d-e40d3c4ad6e5 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 04:41:33 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-01f0ce3e-6850-4e14-881d-e40d3c4ad6e5 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:41:33 devstack sudo[96455]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097 Jul 10 04:41:33 devstack sudo[96455]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:41:33 devstack sudo[96452]: pam_unix(sudo:session): session closed for user root Jul 10 04:41:33 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-d7254374-1ea3-473f-9b55-9a4faa990458 tempest-VolumesSnapshotTestJSON-1690897005 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-6a357083-ca5b-48c8-95e3-902e6d5d5cd4" returned: 0 in 1.211s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:41:33 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-d7254374-1ea3-473f-9b55-9a4faa990458 tempest-VolumesSnapshotTestJSON-1690897005 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-6a357083-ca5b-48c8-95e3-902e6d5d5cd4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-6a357083-ca5b-48c8-95e3-902e6d5d5cd4.da49cce0-a77b-4e00-8b1f-c4bb024a5469 1G {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:41:33 devstack sudo[96460]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-6a357083-ca5b-48c8-95e3-902e6d5d5cd4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-6a357083-ca5b-48c8-95e3-902e6d5d5cd4.da49cce0-a77b-4e00-8b1f-c4bb024a5469 1G Jul 10 04:41:33 devstack sudo[96460]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:41:34 devstack sudo[96455]: pam_unix(sudo:session): session closed for user root Jul 10 04:41:34 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-01f0ce3e-6850-4e14-881d-e40d3c4ad6e5 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097" returned: 0 in 1.263s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:41:34 devstack cinder-volume[87444]: DEBUG cinder.manager [None req-01f0ce3e-6850-4e14-881d-e40d3c4ad6e5 None None] Notifying Schedulers of capabilities ... {{(pid=87444) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 04:41:34 devstack cinder-volume[87444]: DEBUG oslo_service.periodic_task [None req-01f0ce3e-6850-4e14-881d-e40d3c4ad6e5 None None] Running periodic task VolumeManager._thread_info {{(pid=87444) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 10 04:41:34 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-01f0ce3e-6850-4e14-881d-e40d3c4ad6e5 None None] thread count: 8 {{(pid=87444) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 10 04:41:34 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-01f0ce3e-6850-4e14-881d-e40d3c4ad6e5 None None] thread info: [<_MainThread(MainThread, started 126839257915520)>, , , , , , , ] {{(pid=87444) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 10 04:41:34 devstack sudo[96460]: pam_unix(sudo:session): session closed for user root Jul 10 04:41:34 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-d7254374-1ea3-473f-9b55-9a4faa990458 tempest-VolumesSnapshotTestJSON-1690897005 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-6a357083-ca5b-48c8-95e3-902e6d5d5cd4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-6a357083-ca5b-48c8-95e3-902e6d5d5cd4.da49cce0-a77b-4e00-8b1f-c4bb024a5469 1G" returned: 0 in 1.258s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:41:34 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-d7254374-1ea3-473f-9b55-9a4faa990458 tempest-VolumesSnapshotTestJSON-1690897005 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6a357083-ca5b-48c8-95e3-902e6d5d5cd4 -F qcow2 /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-6a357083-ca5b-48c8-95e3-902e6d5d5cd4.da49cce0-a77b-4e00-8b1f-c4bb024a5469 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:41:34 devstack sudo[96468]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6a357083-ca5b-48c8-95e3-902e6d5d5cd4 -F qcow2 /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-6a357083-ca5b-48c8-95e3-902e6d5d5cd4.da49cce0-a77b-4e00-8b1f-c4bb024a5469 Jul 10 04:41:34 devstack sudo[96468]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:41:35 devstack cinder-volume[87444]: DEBUG cinder.volume.flows.manager.create_volume [None req-14fee237-5de1-45e0-a741-7a6ccb1c916c tempest-VolumeRetypeWithoutMigrationTest-797371622 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87444) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 04:41:35 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-14fee237-5de1-45e0-a741-7a6ccb1c916c tempest-VolumeRetypeWithoutMigrationTest-797371622 None] Flow 'volume_create_manager' (244ec875-d582-4ce7-953c-0122dc07d4fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 04:41:35 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-14fee237-5de1-45e0-a741-7a6ccb1c916c tempest-VolumeRetypeWithoutMigrationTest-797371622 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2adca98d-92c0-44a2-955b-4403f6e9042a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:41:35 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-14fee237-5de1-45e0-a741-7a6ccb1c916c tempest-VolumeRetypeWithoutMigrationTest-797371622 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2adca98d-92c0-44a2-955b-4403f6e9042a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T02:41:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-930377948',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=04cae276-a1d3-4314-9fc0-a726d07ef497,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='12b692734ce34ab595d473b609102d52',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T02:41:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T02:41:35Z,use_quota=True,user_id='171e03d05fd447ddbe66913d0bf40a3b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6fe09a43-c592-4c46-8aea-1b9c5d41f424),volume_type_id=6fe09a43-c592-4c46-8aea-1b9c5d41f424)' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:41:35 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-14fee237-5de1-45e0-a741-7a6ccb1c916c tempest-VolumeRetypeWithoutMigrationTest-797371622 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (72a8d789-edd9-4fe3-8cd1-c37aa9120970) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:41:35 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-14fee237-5de1-45e0-a741-7a6ccb1c916c tempest-VolumeRetypeWithoutMigrationTest-797371622 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (72a8d789-edd9-4fe3-8cd1-c37aa9120970) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:41:35 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-14fee237-5de1-45e0-a741-7a6ccb1c916c tempest-VolumeRetypeWithoutMigrationTest-797371622 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ba4019a2-4c00-4b84-acd8-2cb5ce38d04f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:41:35 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-14fee237-5de1-45e0-a741-7a6ccb1c916c tempest-VolumeRetypeWithoutMigrationTest-797371622 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ba4019a2-4c00-4b84-acd8-2cb5ce38d04f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '04cae276-a1d3-4314-9fc0-a726d07ef497', 'volume_name': 'volume-04cae276-a1d3-4314-9fc0-a726d07ef497', 'volume_size': 1}' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:41:35 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-14fee237-5de1-45e0-a741-7a6ccb1c916c tempest-VolumeRetypeWithoutMigrationTest-797371622 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (97d2e811-867e-450c-a063-7ed08755b98b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:41:35 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-14fee237-5de1-45e0-a741-7a6ccb1c916c tempest-VolumeRetypeWithoutMigrationTest-797371622 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (97d2e811-867e-450c-a063-7ed08755b98b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:41:35 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-14fee237-5de1-45e0-a741-7a6ccb1c916c tempest-VolumeRetypeWithoutMigrationTest-797371622 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (657e14f5-6a3f-4303-8d65-fc850a3f9086) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:41:35 devstack cinder-volume[87444]: INFO cinder.volume.flows.manager.create_volume [None req-14fee237-5de1-45e0-a741-7a6ccb1c916c tempest-VolumeRetypeWithoutMigrationTest-797371622 None] Volume 04cae276-a1d3-4314-9fc0-a726d07ef497: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-04cae276-a1d3-4314-9fc0-a726d07ef497', 'volume_size': 1} Jul 10 04:41:35 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-14fee237-5de1-45e0-a741-7a6ccb1c916c tempest-VolumeRetypeWithoutMigrationTest-797371622 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 04:41:35 devstack sudo[96468]: pam_unix(sudo:session): session closed for user root Jul 10 04:41:35 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-d7254374-1ea3-473f-9b55-9a4faa990458 tempest-VolumesSnapshotTestJSON-1690897005 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6a357083-ca5b-48c8-95e3-902e6d5d5cd4 -F qcow2 /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-6a357083-ca5b-48c8-95e3-902e6d5d5cd4.da49cce0-a77b-4e00-8b1f-c4bb024a5469" returned: 0 in 0.934s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:41:35 devstack cinder-volume[87444]: WARNING cinder.volume.drivers.remotefs [None req-d7254374-1ea3-473f-9b55-9a4faa990458 tempest-VolumesSnapshotTestJSON-1690897005 None] /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-6a357083-ca5b-48c8-95e3-902e6d5d5cd4.da49cce0-a77b-4e00-8b1f-c4bb024a5469 is being set with open permissions: ugo+rw Jul 10 04:41:35 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-d7254374-1ea3-473f-9b55-9a4faa990458 tempest-VolumesSnapshotTestJSON-1690897005 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-6a357083-ca5b-48c8-95e3-902e6d5d5cd4.da49cce0-a77b-4e00-8b1f-c4bb024a5469 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:41:35 devstack sudo[96473]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-6a357083-ca5b-48c8-95e3-902e6d5d5cd4.da49cce0-a77b-4e00-8b1f-c4bb024a5469 Jul 10 04:41:35 devstack sudo[96473]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:41:36 devstack cinder-volume[87444]: DEBUG cinder.volume.flows.manager.create_volume [None req-acfc2dfa-c780-4c12-a0c6-ed2fa499ce54 tempest-VolumesListAdminTestJSON-1558846114 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87444) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 04:41:36 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-acfc2dfa-c780-4c12-a0c6-ed2fa499ce54 tempest-VolumesListAdminTestJSON-1558846114 None] Flow 'volume_create_manager' (83474f40-8c3a-4c7c-b81b-940a82d017fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 04:41:36 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-acfc2dfa-c780-4c12-a0c6-ed2fa499ce54 tempest-VolumesListAdminTestJSON-1558846114 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aa774277-3571-4093-af58-b275b70dcd6e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:41:36 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-acfc2dfa-c780-4c12-a0c6-ed2fa499ce54 tempest-VolumesListAdminTestJSON-1558846114 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aa774277-3571-4093-af58-b275b70dcd6e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T02:41:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-750407651',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=73477818-c1f6-4c83-9fcc-b44bc2510d0d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bb9d9c6a14dd42618fe962674acab751',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T02:41:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T02:41:36Z,use_quota=True,user_id='e83ca0de97814a1b8583b26a84ce04a9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(317e369e-1e06-434d-ae95-a335f0e6c903),volume_type_id=317e369e-1e06-434d-ae95-a335f0e6c903)' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:41:36 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-acfc2dfa-c780-4c12-a0c6-ed2fa499ce54 tempest-VolumesListAdminTestJSON-1558846114 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8fd3a408-37b9-40c2-853d-834808961c80) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:41:36 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-acfc2dfa-c780-4c12-a0c6-ed2fa499ce54 tempest-VolumesListAdminTestJSON-1558846114 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8fd3a408-37b9-40c2-853d-834808961c80) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:41:36 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-acfc2dfa-c780-4c12-a0c6-ed2fa499ce54 tempest-VolumesListAdminTestJSON-1558846114 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4dc53905-c24f-4143-b6d1-6f5e3a09c7fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:41:36 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-acfc2dfa-c780-4c12-a0c6-ed2fa499ce54 tempest-VolumesListAdminTestJSON-1558846114 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4dc53905-c24f-4143-b6d1-6f5e3a09c7fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '73477818-c1f6-4c83-9fcc-b44bc2510d0d', 'volume_name': 'volume-73477818-c1f6-4c83-9fcc-b44bc2510d0d', 'volume_size': 1}' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:41:36 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-acfc2dfa-c780-4c12-a0c6-ed2fa499ce54 tempest-VolumesListAdminTestJSON-1558846114 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (297e0406-c94a-4a8e-b69e-b4af6bd67dd6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:41:36 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-acfc2dfa-c780-4c12-a0c6-ed2fa499ce54 tempest-VolumesListAdminTestJSON-1558846114 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (297e0406-c94a-4a8e-b69e-b4af6bd67dd6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:41:36 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-acfc2dfa-c780-4c12-a0c6-ed2fa499ce54 tempest-VolumesListAdminTestJSON-1558846114 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (abe655a9-0d39-4a7a-be89-dac0754ccb05) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:41:36 devstack cinder-volume[87444]: INFO cinder.volume.flows.manager.create_volume [None req-acfc2dfa-c780-4c12-a0c6-ed2fa499ce54 tempest-VolumesListAdminTestJSON-1558846114 None] Volume 73477818-c1f6-4c83-9fcc-b44bc2510d0d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-73477818-c1f6-4c83-9fcc-b44bc2510d0d', 'volume_size': 1} Jul 10 04:41:36 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-acfc2dfa-c780-4c12-a0c6-ed2fa499ce54 tempest-VolumesListAdminTestJSON-1558846114 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 04:41:36 devstack sudo[96473]: pam_unix(sudo:session): session closed for user root Jul 10 04:41:36 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-d7254374-1ea3-473f-9b55-9a4faa990458 tempest-VolumesSnapshotTestJSON-1690897005 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-6a357083-ca5b-48c8-95e3-902e6d5d5cd4.da49cce0-a77b-4e00-8b1f-c4bb024a5469" returned: 0 in 0.751s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:41:36 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-d7254374-1ea3-473f-9b55-9a4faa990458 tempest-VolumesSnapshotTestJSON-1690897005 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-6a357083-ca5b-48c8-95e3-902e6d5d5cd4.info {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:41:36 devstack sudo[96477]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-6a357083-ca5b-48c8-95e3-902e6d5d5cd4.info Jul 10 04:41:36 devstack sudo[96477]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:41:37 devstack sudo[96477]: pam_unix(sudo:session): session closed for user root Jul 10 04:41:37 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-d7254374-1ea3-473f-9b55-9a4faa990458 tempest-VolumesSnapshotTestJSON-1690897005 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-6a357083-ca5b-48c8-95e3-902e6d5d5cd4.info" returned: 0 in 0.705s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:41:37 devstack cinder-volume[87444]: WARNING cinder.volume.drivers.remotefs [None req-d7254374-1ea3-473f-9b55-9a4faa990458 tempest-VolumesSnapshotTestJSON-1690897005 None] /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-6a357083-ca5b-48c8-95e3-902e6d5d5cd4.info is being set with open permissions: ugo+rw Jul 10 04:41:37 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-d7254374-1ea3-473f-9b55-9a4faa990458 tempest-VolumesSnapshotTestJSON-1690897005 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-6a357083-ca5b-48c8-95e3-902e6d5d5cd4.info {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:41:37 devstack sudo[96480]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-6a357083-ca5b-48c8-95e3-902e6d5d5cd4.info Jul 10 04:41:37 devstack sudo[96480]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:41:38 devstack sudo[96480]: pam_unix(sudo:session): session closed for user root Jul 10 04:41:38 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-d7254374-1ea3-473f-9b55-9a4faa990458 tempest-VolumesSnapshotTestJSON-1690897005 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-6a357083-ca5b-48c8-95e3-902e6d5d5cd4.info" returned: 0 in 0.704s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:41:38 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-d7254374-1ea3-473f-9b55-9a4faa990458 tempest-VolumesSnapshotTestJSON-1690897005 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.681s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 04:41:38 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-14fee237-5de1-45e0-a741-7a6ccb1c916c tempest-VolumeRetypeWithoutMigrationTest-797371622 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.548s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 04:41:38 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-14fee237-5de1-45e0-a741-7a6ccb1c916c tempest-VolumeRetypeWithoutMigrationTest-797371622 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T02:41:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-930377948',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=04cae276-a1d3-4314-9fc0-a726d07ef497,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='12b692734ce34ab595d473b609102d52',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T02:41:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T02:41:35Z,use_quota=True,user_id='171e03d05fd447ddbe66913d0bf40a3b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6fe09a43-c592-4c46-8aea-1b9c5d41f424),volume_type_id=6fe09a43-c592-4c46-8aea-1b9c5d41f424)}" {{(pid=87444) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 04:41:38 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.remotefs [None req-14fee237-5de1-45e0-a741-7a6ccb1c916c tempest-VolumeRetypeWithoutMigrationTest-797371622 None] Creating volume 04cae276-a1d3-4314-9fc0-a726d07ef497 {{(pid=87444) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 04:41:38 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-14fee237-5de1-45e0-a741-7a6ccb1c916c tempest-VolumeRetypeWithoutMigrationTest-797371622 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 04:41:38 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-14fee237-5de1-45e0-a741-7a6ccb1c916c tempest-VolumeRetypeWithoutMigrationTest-797371622 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 04:41:38 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-14fee237-5de1-45e0-a741-7a6ccb1c916c tempest-VolumeRetypeWithoutMigrationTest-797371622 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922': None} {{(pid=87444) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 04:41:38 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-14fee237-5de1-45e0-a741-7a6ccb1c916c tempest-VolumeRetypeWithoutMigrationTest-797371622 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922'] {{(pid=87444) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 04:41:38 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-14fee237-5de1-45e0-a741-7a6ccb1c916c tempest-VolumeRetypeWithoutMigrationTest-797371622 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 04:41:38 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-14fee237-5de1-45e0-a741-7a6ccb1c916c tempest-VolumeRetypeWithoutMigrationTest-797371622 None] Selected osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922 as target Quobyte volume. {{(pid=87444) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 04:41:38 devstack cinder-volume[87444]: INFO cinder.volume.drivers.remotefs [None req-14fee237-5de1-45e0-a741-7a6ccb1c916c tempest-VolumeRetypeWithoutMigrationTest-797371622 None] casted to osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922 Jul 10 04:41:38 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-14fee237-5de1-45e0-a741-7a6ccb1c916c tempest-VolumeRetypeWithoutMigrationTest-797371622 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-04cae276-a1d3-4314-9fc0-a726d07ef497 1073741824 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:41:38 devstack sudo[96483]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-04cae276-a1d3-4314-9fc0-a726d07ef497 1073741824 Jul 10 04:41:38 devstack sudo[96483]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:41:38 devstack cinder-volume[87444]: INFO cinder.volume.manager [None req-d7254374-1ea3-473f-9b55-9a4faa990458 tempest-VolumesSnapshotTestJSON-1690897005 None] Create snapshot completed successfully Jul 10 04:41:38 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-e4cce65d-3e95-4cdb-977e-86136bd01241 tempest-VolumesSnapshotTestJSON-1690897005 None] Acquiring lock "cinder-da49cce0-a77b-4e00-8b1f-c4bb024a5469-delete_snapshot" by "delete_snapshot" {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 04:41:38 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-e4cce65d-3e95-4cdb-977e-86136bd01241 tempest-VolumesSnapshotTestJSON-1690897005 None] Lock "cinder-da49cce0-a77b-4e00-8b1f-c4bb024a5469-delete_snapshot" acquired by "delete_snapshot" :: waited 0.025s {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 04:41:38 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-e4cce65d-3e95-4cdb-977e-86136bd01241 tempest-VolumesSnapshotTestJSON-1690897005 None] Acquiring lock "cinder-quobyte-6a357083-ca5b-48c8-95e3-902e6d5d5cd4" by "delete_snapshot" {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 04:41:38 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-e4cce65d-3e95-4cdb-977e-86136bd01241 tempest-VolumesSnapshotTestJSON-1690897005 None] Lock "cinder-quobyte-6a357083-ca5b-48c8-95e3-902e6d5d5cd4" acquired by "delete_snapshot" :: waited 0.016s {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 04:41:38 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-e4cce65d-3e95-4cdb-977e-86136bd01241 tempest-VolumesSnapshotTestJSON-1690897005 None] Acquiring lock "cinder-quobyte-da49cce0-a77b-4e00-8b1f-c4bb024a5469" by "_delete_snapshot" {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 04:41:38 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-e4cce65d-3e95-4cdb-977e-86136bd01241 tempest-VolumesSnapshotTestJSON-1690897005 None] Lock "cinder-quobyte-da49cce0-a77b-4e00-8b1f-c4bb024a5469" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 04:41:38 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.remotefs [None req-e4cce65d-3e95-4cdb-977e-86136bd01241 tempest-VolumesSnapshotTestJSON-1690897005 None] Deleting offline snapshot da49cce0-a77b-4e00-8b1f-c4bb024a5469 of volume 6a357083-ca5b-48c8-95e3-902e6d5d5cd4 {{(pid=87444) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 10 04:41:38 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.remotefs [None req-e4cce65d-3e95-4cdb-977e-86136bd01241 tempest-VolumesSnapshotTestJSON-1690897005 None] snapshot_file for this snap is: volume-6a357083-ca5b-48c8-95e3-902e6d5d5cd4.da49cce0-a77b-4e00-8b1f-c4bb024a5469 {{(pid=87444) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 10 04:41:39 devstack cinder-volume[87444]: DEBUG oslo.privsep.daemon [-] privsep: reply[87532b75-6c24-4b29-9a0f-12c3961f8dd1]: (4, 'qcow2') {{(pid=88499) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 04:41:39 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-e4cce65d-3e95-4cdb-977e-86136bd01241 tempest-VolumesSnapshotTestJSON-1690897005 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-6a357083-ca5b-48c8-95e3-902e6d5d5cd4.da49cce0-a77b-4e00-8b1f-c4bb024a5469 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:41:39 devstack sudo[96483]: pam_unix(sudo:session): session closed for user root Jul 10 04:41:39 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-14fee237-5de1-45e0-a741-7a6ccb1c916c tempest-VolumeRetypeWithoutMigrationTest-797371622 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-04cae276-a1d3-4314-9fc0-a726d07ef497 1073741824" returned: 0 in 0.956s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:41:39 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-14fee237-5de1-45e0-a741-7a6ccb1c916c tempest-VolumeRetypeWithoutMigrationTest-797371622 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-04cae276-a1d3-4314-9fc0-a726d07ef497 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:41:39 devstack sudo[96491]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-04cae276-a1d3-4314-9fc0-a726d07ef497 Jul 10 04:41:39 devstack sudo[96491]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:41:39 devstack sudo[96490]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-6a357083-ca5b-48c8-95e3-902e6d5d5cd4.da49cce0-a77b-4e00-8b1f-c4bb024a5469 Jul 10 04:41:39 devstack sudo[96490]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:41:39 devstack sudo[96491]: pam_unix(sudo:session): session closed for user root Jul 10 04:41:39 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-14fee237-5de1-45e0-a741-7a6ccb1c916c tempest-VolumeRetypeWithoutMigrationTest-797371622 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-04cae276-a1d3-4314-9fc0-a726d07ef497" returned: 0 in 0.729s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:41:39 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-14fee237-5de1-45e0-a741-7a6ccb1c916c tempest-VolumeRetypeWithoutMigrationTest-797371622 None] <== create_volume: return (1735ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922'} {{(pid=87444) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 04:41:39 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-14fee237-5de1-45e0-a741-7a6ccb1c916c tempest-VolumeRetypeWithoutMigrationTest-797371622 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.738s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 04:41:39 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-acfc2dfa-c780-4c12-a0c6-ed2fa499ce54 tempest-VolumesListAdminTestJSON-1558846114 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.400s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 04:41:39 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-acfc2dfa-c780-4c12-a0c6-ed2fa499ce54 tempest-VolumesListAdminTestJSON-1558846114 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T02:41:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-750407651',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=73477818-c1f6-4c83-9fcc-b44bc2510d0d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bb9d9c6a14dd42618fe962674acab751',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T02:41:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T02:41:36Z,use_quota=True,user_id='e83ca0de97814a1b8583b26a84ce04a9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(317e369e-1e06-434d-ae95-a335f0e6c903),volume_type_id=317e369e-1e06-434d-ae95-a335f0e6c903)}" {{(pid=87444) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 04:41:39 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.remotefs [None req-acfc2dfa-c780-4c12-a0c6-ed2fa499ce54 tempest-VolumesListAdminTestJSON-1558846114 None] Creating volume 73477818-c1f6-4c83-9fcc-b44bc2510d0d {{(pid=87444) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 04:41:39 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-acfc2dfa-c780-4c12-a0c6-ed2fa499ce54 tempest-VolumesListAdminTestJSON-1558846114 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 04:41:39 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-acfc2dfa-c780-4c12-a0c6-ed2fa499ce54 tempest-VolumesListAdminTestJSON-1558846114 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 04:41:39 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-acfc2dfa-c780-4c12-a0c6-ed2fa499ce54 tempest-VolumesListAdminTestJSON-1558846114 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922': None} {{(pid=87444) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 04:41:39 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-acfc2dfa-c780-4c12-a0c6-ed2fa499ce54 tempest-VolumesListAdminTestJSON-1558846114 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922'] {{(pid=87444) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 04:41:39 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-acfc2dfa-c780-4c12-a0c6-ed2fa499ce54 tempest-VolumesListAdminTestJSON-1558846114 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 04:41:39 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-acfc2dfa-c780-4c12-a0c6-ed2fa499ce54 tempest-VolumesListAdminTestJSON-1558846114 None] Selected osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922 as target Quobyte volume. {{(pid=87444) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 04:41:39 devstack cinder-volume[87444]: INFO cinder.volume.drivers.remotefs [None req-acfc2dfa-c780-4c12-a0c6-ed2fa499ce54 tempest-VolumesListAdminTestJSON-1558846114 None] casted to osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922 Jul 10 04:41:39 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-acfc2dfa-c780-4c12-a0c6-ed2fa499ce54 tempest-VolumesListAdminTestJSON-1558846114 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-73477818-c1f6-4c83-9fcc-b44bc2510d0d 1073741824 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:41:39 devstack sudo[96490]: pam_unix(sudo:session): session closed for user root Jul 10 04:41:39 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-e4cce65d-3e95-4cdb-977e-86136bd01241 tempest-VolumesSnapshotTestJSON-1690897005 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-6a357083-ca5b-48c8-95e3-902e6d5d5cd4.da49cce0-a77b-4e00-8b1f-c4bb024a5469" returned: 0 in 0.856s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:41:39 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.remotefs [None req-e4cce65d-3e95-4cdb-977e-86136bd01241 tempest-VolumesSnapshotTestJSON-1690897005 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6a357083-ca5b-48c8-95e3-902e6d5d5cd4(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87444) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 10 04:41:39 devstack sudo[96498]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-73477818-c1f6-4c83-9fcc-b44bc2510d0d 1073741824 Jul 10 04:41:39 devstack sudo[96498]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:41:39 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-14fee237-5de1-45e0-a741-7a6ccb1c916c tempest-VolumeRetypeWithoutMigrationTest-797371622 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (657e14f5-6a3f-4303-8d65-fc850a3f9086) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-04cae276-a1d3-4314-9fc0-a726d07ef497', 'volume_size': 1}' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:41:39 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-14fee237-5de1-45e0-a741-7a6ccb1c916c tempest-VolumeRetypeWithoutMigrationTest-797371622 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fcdf0f5c-16f6-4712-a897-686c9c4f018c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:41:39 devstack cinder-volume[87444]: DEBUG oslo.privsep.daemon [-] privsep: reply[6786b25b-d817-4b72-9bc3-4b4165722498]: (4, 'qcow2') {{(pid=88499) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 04:41:39 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-e4cce65d-3e95-4cdb-977e-86136bd01241 tempest-VolumesSnapshotTestJSON-1690897005 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-6a357083-ca5b-48c8-95e3-902e6d5d5cd4 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:41:39 devstack cinder-volume[87444]: INFO cinder.volume.flows.manager.create_volume [None req-14fee237-5de1-45e0-a741-7a6ccb1c916c tempest-VolumeRetypeWithoutMigrationTest-797371622 None] Volume volume-04cae276-a1d3-4314-9fc0-a726d07ef497 (04cae276-a1d3-4314-9fc0-a726d07ef497): created successfully Jul 10 04:41:39 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-14fee237-5de1-45e0-a741-7a6ccb1c916c tempest-VolumeRetypeWithoutMigrationTest-797371622 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fcdf0f5c-16f6-4712-a897-686c9c4f018c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:41:39 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-14fee237-5de1-45e0-a741-7a6ccb1c916c tempest-VolumeRetypeWithoutMigrationTest-797371622 None] Flow 'volume_create_manager' (244ec875-d582-4ce7-953c-0122dc07d4fa) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87444) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 04:41:39 devstack cinder-volume[87444]: INFO cinder.volume.manager [None req-14fee237-5de1-45e0-a741-7a6ccb1c916c tempest-VolumeRetypeWithoutMigrationTest-797371622 None] Created volume successfully. Jul 10 04:41:40 devstack sudo[96500]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-6a357083-ca5b-48c8-95e3-902e6d5d5cd4 Jul 10 04:41:40 devstack sudo[96500]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:41:40 devstack sudo[96500]: pam_unix(sudo:session): session closed for user root Jul 10 04:41:40 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-e4cce65d-3e95-4cdb-977e-86136bd01241 tempest-VolumesSnapshotTestJSON-1690897005 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-6a357083-ca5b-48c8-95e3-902e6d5d5cd4" returned: 0 in 0.813s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:41:40 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-e4cce65d-3e95-4cdb-977e-86136bd01241 tempest-VolumesSnapshotTestJSON-1690897005 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-6a357083-ca5b-48c8-95e3-902e6d5d5cd4.da49cce0-a77b-4e00-8b1f-c4bb024a5469 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:41:40 devstack sudo[96509]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-6a357083-ca5b-48c8-95e3-902e6d5d5cd4.da49cce0-a77b-4e00-8b1f-c4bb024a5469 Jul 10 04:41:40 devstack sudo[96509]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:41:40 devstack sudo[96498]: pam_unix(sudo:session): session closed for user root Jul 10 04:41:40 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-acfc2dfa-c780-4c12-a0c6-ed2fa499ce54 tempest-VolumesListAdminTestJSON-1558846114 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-73477818-c1f6-4c83-9fcc-b44bc2510d0d 1073741824" returned: 0 in 1.049s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:41:40 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-acfc2dfa-c780-4c12-a0c6-ed2fa499ce54 tempest-VolumesListAdminTestJSON-1558846114 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-73477818-c1f6-4c83-9fcc-b44bc2510d0d {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:41:40 devstack sudo[96511]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-73477818-c1f6-4c83-9fcc-b44bc2510d0d Jul 10 04:41:40 devstack sudo[96511]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:41:41 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-c097e84f-23b9-42fd-b406-f5583e97da0c tempest-VolumeRetypeWithoutMigrationTest-797371622 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 04:41:41 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-c097e84f-23b9-42fd-b406-f5583e97da0c tempest-VolumeRetypeWithoutMigrationTest-797371622 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 04:41:41 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-c097e84f-23b9-42fd-b406-f5583e97da0c tempest-VolumeRetypeWithoutMigrationTest-797371622 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922': None} {{(pid=87444) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 04:41:41 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-c097e84f-23b9-42fd-b406-f5583e97da0c tempest-VolumeRetypeWithoutMigrationTest-797371622 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922'] {{(pid=87444) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 04:41:41 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-c097e84f-23b9-42fd-b406-f5583e97da0c tempest-VolumeRetypeWithoutMigrationTest-797371622 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 04:41:41 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-c097e84f-23b9-42fd-b406-f5583e97da0c tempest-VolumeRetypeWithoutMigrationTest-797371622 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:41:41 devstack sudo[96515]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097 Jul 10 04:41:41 devstack sudo[96515]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:41:41 devstack sudo[96509]: pam_unix(sudo:session): session closed for user root Jul 10 04:41:41 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-e4cce65d-3e95-4cdb-977e-86136bd01241 tempest-VolumesSnapshotTestJSON-1690897005 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-6a357083-ca5b-48c8-95e3-902e6d5d5cd4.da49cce0-a77b-4e00-8b1f-c4bb024a5469" returned: 0 in 0.924s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:41:41 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-e4cce65d-3e95-4cdb-977e-86136bd01241 tempest-VolumesSnapshotTestJSON-1690897005 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-6a357083-ca5b-48c8-95e3-902e6d5d5cd4.da49cce0-a77b-4e00-8b1f-c4bb024a5469 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:41:41 devstack sudo[96518]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-6a357083-ca5b-48c8-95e3-902e6d5d5cd4.da49cce0-a77b-4e00-8b1f-c4bb024a5469 Jul 10 04:41:41 devstack sudo[96518]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:41:41 devstack sudo[96511]: pam_unix(sudo:session): session closed for user root Jul 10 04:41:41 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-acfc2dfa-c780-4c12-a0c6-ed2fa499ce54 tempest-VolumesListAdminTestJSON-1558846114 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-73477818-c1f6-4c83-9fcc-b44bc2510d0d" returned: 0 in 0.865s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:41:41 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-acfc2dfa-c780-4c12-a0c6-ed2fa499ce54 tempest-VolumesListAdminTestJSON-1558846114 None] <== create_volume: return (1984ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922'} {{(pid=87444) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 04:41:41 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-acfc2dfa-c780-4c12-a0c6-ed2fa499ce54 tempest-VolumesListAdminTestJSON-1558846114 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.987s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 04:41:41 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-acfc2dfa-c780-4c12-a0c6-ed2fa499ce54 tempest-VolumesListAdminTestJSON-1558846114 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (abe655a9-0d39-4a7a-be89-dac0754ccb05) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-73477818-c1f6-4c83-9fcc-b44bc2510d0d', 'volume_size': 1}' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:41:41 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-acfc2dfa-c780-4c12-a0c6-ed2fa499ce54 tempest-VolumesListAdminTestJSON-1558846114 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e57c3496-6e25-433a-8fbf-4a61063fbaf7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:41:41 devstack cinder-volume[87444]: INFO cinder.volume.flows.manager.create_volume [None req-acfc2dfa-c780-4c12-a0c6-ed2fa499ce54 tempest-VolumesListAdminTestJSON-1558846114 None] Volume volume-73477818-c1f6-4c83-9fcc-b44bc2510d0d (73477818-c1f6-4c83-9fcc-b44bc2510d0d): created successfully Jul 10 04:41:41 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-acfc2dfa-c780-4c12-a0c6-ed2fa499ce54 tempest-VolumesListAdminTestJSON-1558846114 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e57c3496-6e25-433a-8fbf-4a61063fbaf7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:41:41 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-acfc2dfa-c780-4c12-a0c6-ed2fa499ce54 tempest-VolumesListAdminTestJSON-1558846114 None] Flow 'volume_create_manager' (83474f40-8c3a-4c7c-b81b-940a82d017fb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87444) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 04:41:41 devstack cinder-volume[87444]: INFO cinder.volume.manager [None req-acfc2dfa-c780-4c12-a0c6-ed2fa499ce54 tempest-VolumesListAdminTestJSON-1558846114 None] Created volume successfully. Jul 10 04:41:42 devstack sudo[96515]: pam_unix(sudo:session): session closed for user root Jul 10 04:41:42 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-c097e84f-23b9-42fd-b406-f5583e97da0c tempest-VolumeRetypeWithoutMigrationTest-797371622 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097" returned: 0 in 0.713s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:41:42 devstack cinder-volume[87444]: DEBUG cinder.manager [None req-c097e84f-23b9-42fd-b406-f5583e97da0c tempest-VolumeRetypeWithoutMigrationTest-797371622 None] Notifying Schedulers of capabilities ... {{(pid=87444) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 04:41:42 devstack cinder-volume[87444]: INFO cinder.volume.manager [None req-c097e84f-23b9-42fd-b406-f5583e97da0c tempest-VolumeRetypeWithoutMigrationTest-797371622 None] Retype volume completed successfully. Jul 10 04:41:42 devstack sudo[96518]: pam_unix(sudo:session): session closed for user root Jul 10 04:41:42 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-e4cce65d-3e95-4cdb-977e-86136bd01241 tempest-VolumesSnapshotTestJSON-1690897005 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-6a357083-ca5b-48c8-95e3-902e6d5d5cd4.da49cce0-a77b-4e00-8b1f-c4bb024a5469" returned: 0 in 0.726s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:41:42 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-e4cce65d-3e95-4cdb-977e-86136bd01241 tempest-VolumesSnapshotTestJSON-1690897005 None] Lock "cinder-quobyte-da49cce0-a77b-4e00-8b1f-c4bb024a5469" released by "_delete_snapshot" :: held 3.457s {{(pid=87444) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 04:41:42 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-e4cce65d-3e95-4cdb-977e-86136bd01241 tempest-VolumesSnapshotTestJSON-1690897005 None] Lock "cinder-quobyte-6a357083-ca5b-48c8-95e3-902e6d5d5cd4" released by "delete_snapshot" :: held 3.489s {{(pid=87444) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 04:41:42 devstack cinder-volume[87444]: DEBUG cinder.quota [None req-e4cce65d-3e95-4cdb-977e-86136bd01241 tempest-VolumesSnapshotTestJSON-1690897005 None] Created reservations ['986abf3a-4e0a-431d-b13a-6f91b702ce78', '00df6cf1-ea03-47b1-9ab2-f0ad2431f69a', 'd523f910-b4e7-4dd9-bedf-57fc57ea8ce1', '0e8965c4-71ae-4244-951e-3c33b65ba209'] {{(pid=87444) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 04:41:42 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-cd9552f0-80a7-4549-8e60-f3303424db0e tempest-VolumeRetypeWithoutMigrationTest-797371622 None] Acquiring lock "cinder-04cae276-a1d3-4314-9fc0-a726d07ef497-delete_volume" by "delete_volume" {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 04:41:42 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-cd9552f0-80a7-4549-8e60-f3303424db0e tempest-VolumeRetypeWithoutMigrationTest-797371622 None] Lock "cinder-04cae276-a1d3-4314-9fc0-a726d07ef497-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 04:41:42 devstack cinder-volume[87444]: INFO cinder.volume.manager [None req-e4cce65d-3e95-4cdb-977e-86136bd01241 tempest-VolumesSnapshotTestJSON-1690897005 None] Delete snapshot completed successfully. Jul 10 04:41:42 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-cd9552f0-80a7-4549-8e60-f3303424db0e tempest-VolumeRetypeWithoutMigrationTest-797371622 None] Acquiring lock "cinder-quobyte-04cae276-a1d3-4314-9fc0-a726d07ef497" by "delete_volume" {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 04:41:42 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-e4cce65d-3e95-4cdb-977e-86136bd01241 tempest-VolumesSnapshotTestJSON-1690897005 None] Lock "cinder-da49cce0-a77b-4e00-8b1f-c4bb024a5469-delete_snapshot" released by "delete_snapshot" :: held 3.727s {{(pid=87444) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 04:41:42 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-cd9552f0-80a7-4549-8e60-f3303424db0e tempest-VolumeRetypeWithoutMigrationTest-797371622 None] Lock "cinder-quobyte-04cae276-a1d3-4314-9fc0-a726d07ef497" acquired by "delete_volume" :: waited 0.031s {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 04:41:42 devstack cinder-volume[87444]: DEBUG oslo.privsep.daemon [-] privsep: reply[d45b5c03-0e69-45a9-831f-3e2fcca2b6cc]: (4, 'qcow2') {{(pid=88499) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 04:41:42 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-cd9552f0-80a7-4549-8e60-f3303424db0e tempest-VolumeRetypeWithoutMigrationTest-797371622 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-04cae276-a1d3-4314-9fc0-a726d07ef497 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:41:42 devstack sudo[96523]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-04cae276-a1d3-4314-9fc0-a726d07ef497 Jul 10 04:41:42 devstack sudo[96523]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:41:43 devstack cinder-volume[87444]: DEBUG cinder.volume.flows.manager.create_volume [None req-8926cf21-50fd-47e5-9e94-b58aafdbc5fa tempest-VolumesListAdminTestJSON-1558846114 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87444) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 04:41:43 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-8926cf21-50fd-47e5-9e94-b58aafdbc5fa tempest-VolumesListAdminTestJSON-1558846114 None] Flow 'volume_create_manager' (87286361-b888-402b-a855-8d3fa905ba27) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 04:41:43 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-8926cf21-50fd-47e5-9e94-b58aafdbc5fa tempest-VolumesListAdminTestJSON-1558846114 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b556c483-27ad-4ad9-8073-3fe516e755c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:41:43 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-8926cf21-50fd-47e5-9e94-b58aafdbc5fa tempest-VolumesListAdminTestJSON-1558846114 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b556c483-27ad-4ad9-8073-3fe516e755c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T02:41:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-937507996',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3a1593fc-1974-4696-97cc-d97ea48c1e79,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bb9d9c6a14dd42618fe962674acab751',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T02:41:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T02:41:43Z,use_quota=True,user_id='e83ca0de97814a1b8583b26a84ce04a9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(317e369e-1e06-434d-ae95-a335f0e6c903),volume_type_id=317e369e-1e06-434d-ae95-a335f0e6c903)' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:41:43 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-8926cf21-50fd-47e5-9e94-b58aafdbc5fa tempest-VolumesListAdminTestJSON-1558846114 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7cc4dc09-7263-4af5-8feb-4b108912e29d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:41:43 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-8926cf21-50fd-47e5-9e94-b58aafdbc5fa tempest-VolumesListAdminTestJSON-1558846114 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7cc4dc09-7263-4af5-8feb-4b108912e29d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:41:43 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-8926cf21-50fd-47e5-9e94-b58aafdbc5fa tempest-VolumesListAdminTestJSON-1558846114 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (15112697-8585-4fda-966b-490b601ba712) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:41:43 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-8926cf21-50fd-47e5-9e94-b58aafdbc5fa tempest-VolumesListAdminTestJSON-1558846114 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (15112697-8585-4fda-966b-490b601ba712) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3a1593fc-1974-4696-97cc-d97ea48c1e79', 'volume_name': 'volume-3a1593fc-1974-4696-97cc-d97ea48c1e79', 'volume_size': 1}' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:41:43 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-8926cf21-50fd-47e5-9e94-b58aafdbc5fa tempest-VolumesListAdminTestJSON-1558846114 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cbc40547-e472-480d-93e2-5b7329ffb240) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:41:43 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-8926cf21-50fd-47e5-9e94-b58aafdbc5fa tempest-VolumesListAdminTestJSON-1558846114 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cbc40547-e472-480d-93e2-5b7329ffb240) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:41:43 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-8926cf21-50fd-47e5-9e94-b58aafdbc5fa tempest-VolumesListAdminTestJSON-1558846114 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b41c876f-9812-40a2-a9ae-0ede5fdfff82) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:41:43 devstack cinder-volume[87444]: INFO cinder.volume.flows.manager.create_volume [None req-8926cf21-50fd-47e5-9e94-b58aafdbc5fa tempest-VolumesListAdminTestJSON-1558846114 None] Volume 3a1593fc-1974-4696-97cc-d97ea48c1e79: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3a1593fc-1974-4696-97cc-d97ea48c1e79', 'volume_size': 1} Jul 10 04:41:43 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-8926cf21-50fd-47e5-9e94-b58aafdbc5fa tempest-VolumesListAdminTestJSON-1558846114 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 04:41:43 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-8926cf21-50fd-47e5-9e94-b58aafdbc5fa tempest-VolumesListAdminTestJSON-1558846114 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 04:41:43 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-8926cf21-50fd-47e5-9e94-b58aafdbc5fa tempest-VolumesListAdminTestJSON-1558846114 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T02:41:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-937507996',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3a1593fc-1974-4696-97cc-d97ea48c1e79,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bb9d9c6a14dd42618fe962674acab751',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T02:41:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T02:41:43Z,use_quota=True,user_id='e83ca0de97814a1b8583b26a84ce04a9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(317e369e-1e06-434d-ae95-a335f0e6c903),volume_type_id=317e369e-1e06-434d-ae95-a335f0e6c903)}" {{(pid=87444) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 04:41:43 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.remotefs [None req-8926cf21-50fd-47e5-9e94-b58aafdbc5fa tempest-VolumesListAdminTestJSON-1558846114 None] Creating volume 3a1593fc-1974-4696-97cc-d97ea48c1e79 {{(pid=87444) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 04:41:43 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-8926cf21-50fd-47e5-9e94-b58aafdbc5fa tempest-VolumesListAdminTestJSON-1558846114 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 04:41:43 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-8926cf21-50fd-47e5-9e94-b58aafdbc5fa tempest-VolumesListAdminTestJSON-1558846114 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 04:41:43 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-8926cf21-50fd-47e5-9e94-b58aafdbc5fa tempest-VolumesListAdminTestJSON-1558846114 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922': None} {{(pid=87444) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 04:41:43 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-8926cf21-50fd-47e5-9e94-b58aafdbc5fa tempest-VolumesListAdminTestJSON-1558846114 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922'] {{(pid=87444) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 04:41:43 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-8926cf21-50fd-47e5-9e94-b58aafdbc5fa tempest-VolumesListAdminTestJSON-1558846114 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 04:41:43 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-8926cf21-50fd-47e5-9e94-b58aafdbc5fa tempest-VolumesListAdminTestJSON-1558846114 None] Selected osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922 as target Quobyte volume. {{(pid=87444) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 04:41:43 devstack cinder-volume[87444]: INFO cinder.volume.drivers.remotefs [None req-8926cf21-50fd-47e5-9e94-b58aafdbc5fa tempest-VolumesListAdminTestJSON-1558846114 None] casted to osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922 Jul 10 04:41:43 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-8926cf21-50fd-47e5-9e94-b58aafdbc5fa tempest-VolumesListAdminTestJSON-1558846114 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-3a1593fc-1974-4696-97cc-d97ea48c1e79 1073741824 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:41:43 devstack sudo[96529]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-3a1593fc-1974-4696-97cc-d97ea48c1e79 1073741824 Jul 10 04:41:43 devstack sudo[96529]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:41:43 devstack sudo[96523]: pam_unix(sudo:session): session closed for user root Jul 10 04:41:43 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-cd9552f0-80a7-4549-8e60-f3303424db0e tempest-VolumeRetypeWithoutMigrationTest-797371622 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-04cae276-a1d3-4314-9fc0-a726d07ef497" returned: 0 in 0.874s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:41:43 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-cd9552f0-80a7-4549-8e60-f3303424db0e tempest-VolumeRetypeWithoutMigrationTest-797371622 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-04cae276-a1d3-4314-9fc0-a726d07ef497 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:41:43 devstack sudo[96531]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-04cae276-a1d3-4314-9fc0-a726d07ef497 Jul 10 04:41:43 devstack sudo[96531]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:41:43 devstack cinder-volume[87444]: DEBUG cinder.volume.flows.manager.create_volume [None req-7ade19db-0e11-4f6b-838b-453201722b28 tempest-VolumesSnapshotTestJSON-1690897005 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87444) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 04:41:43 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-7ade19db-0e11-4f6b-838b-453201722b28 tempest-VolumesSnapshotTestJSON-1690897005 None] Flow 'volume_create_manager' (7d57b0d4-b8ab-4583-ad94-fbadac5ae25e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 04:41:43 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-7ade19db-0e11-4f6b-838b-453201722b28 tempest-VolumesSnapshotTestJSON-1690897005 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9d0f764a-3c00-4f07-b20d-1c205f0e6ab9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:41:44 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-7ade19db-0e11-4f6b-838b-453201722b28 tempest-VolumesSnapshotTestJSON-1690897005 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9d0f764a-3c00-4f07-b20d-1c205f0e6ab9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T02:41:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-247127341',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=80504d94-f520-4b4a-bf04-620bfa5f2b42,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='92c5956be8c447b9872943111e4168dc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T02:41:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T02:41:44Z,use_quota=True,user_id='16ea7041ff434f7890eca88a786ad0f0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(317e369e-1e06-434d-ae95-a335f0e6c903),volume_type_id=317e369e-1e06-434d-ae95-a335f0e6c903)' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:41:44 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-7ade19db-0e11-4f6b-838b-453201722b28 tempest-VolumesSnapshotTestJSON-1690897005 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c9caf1cf-c768-49b9-b699-c21adacfc25c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:41:44 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-7ade19db-0e11-4f6b-838b-453201722b28 tempest-VolumesSnapshotTestJSON-1690897005 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c9caf1cf-c768-49b9-b699-c21adacfc25c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:41:44 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-7ade19db-0e11-4f6b-838b-453201722b28 tempest-VolumesSnapshotTestJSON-1690897005 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f49d7704-0673-44a5-b336-4f6fc541704c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:41:44 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-7ade19db-0e11-4f6b-838b-453201722b28 tempest-VolumesSnapshotTestJSON-1690897005 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f49d7704-0673-44a5-b336-4f6fc541704c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '80504d94-f520-4b4a-bf04-620bfa5f2b42', 'volume_name': 'volume-80504d94-f520-4b4a-bf04-620bfa5f2b42', 'volume_size': 1}' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:41:44 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-7ade19db-0e11-4f6b-838b-453201722b28 tempest-VolumesSnapshotTestJSON-1690897005 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bcc90977-cff4-478e-97b9-5325c8f46517) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:41:44 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-7ade19db-0e11-4f6b-838b-453201722b28 tempest-VolumesSnapshotTestJSON-1690897005 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bcc90977-cff4-478e-97b9-5325c8f46517) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:41:44 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-7ade19db-0e11-4f6b-838b-453201722b28 tempest-VolumesSnapshotTestJSON-1690897005 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8a6b527e-89ed-4aca-a0cd-6e2076829045) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:41:44 devstack cinder-volume[87444]: INFO cinder.volume.flows.manager.create_volume [None req-7ade19db-0e11-4f6b-838b-453201722b28 tempest-VolumesSnapshotTestJSON-1690897005 None] Volume 80504d94-f520-4b4a-bf04-620bfa5f2b42: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-80504d94-f520-4b4a-bf04-620bfa5f2b42', 'volume_size': 1} Jul 10 04:41:44 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-7ade19db-0e11-4f6b-838b-453201722b28 tempest-VolumesSnapshotTestJSON-1690897005 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 04:41:44 devstack sudo[96531]: pam_unix(sudo:session): session closed for user root Jul 10 04:41:44 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-cd9552f0-80a7-4549-8e60-f3303424db0e tempest-VolumeRetypeWithoutMigrationTest-797371622 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-04cae276-a1d3-4314-9fc0-a726d07ef497" returned: 0 in 0.822s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:41:44 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-cd9552f0-80a7-4549-8e60-f3303424db0e tempest-VolumeRetypeWithoutMigrationTest-797371622 None] Lock "cinder-quobyte-04cae276-a1d3-4314-9fc0-a726d07ef497" released by "delete_volume" :: held 1.756s {{(pid=87444) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 04:41:44 devstack cinder-volume[87444]: WARNING cinder.quota [None req-cd9552f0-80a7-4549-8e60-f3303424db0e tempest-VolumeRetypeWithoutMigrationTest-797371622 None] Deprecated: Default quota for resource: volumes_volume-type-2 is set by the default quota flag: quota_volumes_volume-type-2, it is now deprecated. Please use the default quota class for default quota. Jul 10 04:41:44 devstack cinder-volume[87444]: WARNING cinder.quota [None req-cd9552f0-80a7-4549-8e60-f3303424db0e tempest-VolumeRetypeWithoutMigrationTest-797371622 None] Deprecated: Default quota for resource: gigabytes_volume-type-2 is set by the default quota flag: quota_gigabytes_volume-type-2, it is now deprecated. Please use the default quota class for default quota. Jul 10 04:41:44 devstack cinder-volume[87444]: DEBUG cinder.quota [None req-cd9552f0-80a7-4549-8e60-f3303424db0e tempest-VolumeRetypeWithoutMigrationTest-797371622 None] Created reservations ['b1a6f976-f658-4d0c-9b7c-5196044ad1da', '944adebd-d7ae-4682-99e3-cc9401900ccb', 'cb2086d4-d55c-44b7-9122-2e8f70313558', '13db5a9f-8f60-4ebd-ba9c-2def027b51f2'] {{(pid=87444) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 04:41:44 devstack sudo[96529]: pam_unix(sudo:session): session closed for user root Jul 10 04:41:44 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-8926cf21-50fd-47e5-9e94-b58aafdbc5fa tempest-VolumesListAdminTestJSON-1558846114 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-3a1593fc-1974-4696-97cc-d97ea48c1e79 1073741824" returned: 0 in 1.021s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:41:44 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-cd9552f0-80a7-4549-8e60-f3303424db0e tempest-VolumeRetypeWithoutMigrationTest-797371622 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 04:41:44 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-cd9552f0-80a7-4549-8e60-f3303424db0e tempest-VolumeRetypeWithoutMigrationTest-797371622 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 04:41:44 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-cd9552f0-80a7-4549-8e60-f3303424db0e tempest-VolumeRetypeWithoutMigrationTest-797371622 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922': None} {{(pid=87444) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 04:41:44 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-cd9552f0-80a7-4549-8e60-f3303424db0e tempest-VolumeRetypeWithoutMigrationTest-797371622 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922'] {{(pid=87444) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 04:41:44 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-cd9552f0-80a7-4549-8e60-f3303424db0e tempest-VolumeRetypeWithoutMigrationTest-797371622 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 04:41:44 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-cd9552f0-80a7-4549-8e60-f3303424db0e tempest-VolumeRetypeWithoutMigrationTest-797371622 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:41:44 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-8926cf21-50fd-47e5-9e94-b58aafdbc5fa tempest-VolumesListAdminTestJSON-1558846114 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-3a1593fc-1974-4696-97cc-d97ea48c1e79 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:41:44 devstack sudo[96538]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097 Jul 10 04:41:44 devstack sudo[96538]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:41:44 devstack sudo[96539]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-3a1593fc-1974-4696-97cc-d97ea48c1e79 Jul 10 04:41:44 devstack sudo[96539]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:41:45 devstack sudo[96539]: pam_unix(sudo:session): session closed for user root Jul 10 04:41:45 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-8926cf21-50fd-47e5-9e94-b58aafdbc5fa tempest-VolumesListAdminTestJSON-1558846114 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-3a1593fc-1974-4696-97cc-d97ea48c1e79" returned: 0 in 0.764s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:41:45 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-8926cf21-50fd-47e5-9e94-b58aafdbc5fa tempest-VolumesListAdminTestJSON-1558846114 None] <== create_volume: return (1861ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922'} {{(pid=87444) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 04:41:45 devstack sudo[96538]: pam_unix(sudo:session): session closed for user root Jul 10 04:41:45 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-8926cf21-50fd-47e5-9e94-b58aafdbc5fa tempest-VolumesListAdminTestJSON-1558846114 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.865s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 04:41:45 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-7ade19db-0e11-4f6b-838b-453201722b28 tempest-VolumesSnapshotTestJSON-1690897005 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.271s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 04:41:45 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-7ade19db-0e11-4f6b-838b-453201722b28 tempest-VolumesSnapshotTestJSON-1690897005 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T02:41:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-247127341',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=80504d94-f520-4b4a-bf04-620bfa5f2b42,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='92c5956be8c447b9872943111e4168dc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T02:41:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T02:41:44Z,use_quota=True,user_id='16ea7041ff434f7890eca88a786ad0f0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(317e369e-1e06-434d-ae95-a335f0e6c903),volume_type_id=317e369e-1e06-434d-ae95-a335f0e6c903)}" {{(pid=87444) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 04:41:45 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.remotefs [None req-7ade19db-0e11-4f6b-838b-453201722b28 tempest-VolumesSnapshotTestJSON-1690897005 None] Creating volume 80504d94-f520-4b4a-bf04-620bfa5f2b42 {{(pid=87444) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 04:41:45 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-7ade19db-0e11-4f6b-838b-453201722b28 tempest-VolumesSnapshotTestJSON-1690897005 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 04:41:45 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-7ade19db-0e11-4f6b-838b-453201722b28 tempest-VolumesSnapshotTestJSON-1690897005 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 04:41:45 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-7ade19db-0e11-4f6b-838b-453201722b28 tempest-VolumesSnapshotTestJSON-1690897005 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922': None} {{(pid=87444) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 04:41:45 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-7ade19db-0e11-4f6b-838b-453201722b28 tempest-VolumesSnapshotTestJSON-1690897005 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922'] {{(pid=87444) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 04:41:45 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-7ade19db-0e11-4f6b-838b-453201722b28 tempest-VolumesSnapshotTestJSON-1690897005 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 04:41:45 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-7ade19db-0e11-4f6b-838b-453201722b28 tempest-VolumesSnapshotTestJSON-1690897005 None] Selected osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922 as target Quobyte volume. {{(pid=87444) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 04:41:45 devstack cinder-volume[87444]: INFO cinder.volume.drivers.remotefs [None req-7ade19db-0e11-4f6b-838b-453201722b28 tempest-VolumesSnapshotTestJSON-1690897005 None] casted to osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922 Jul 10 04:41:45 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-7ade19db-0e11-4f6b-838b-453201722b28 tempest-VolumesSnapshotTestJSON-1690897005 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-80504d94-f520-4b4a-bf04-620bfa5f2b42 1073741824 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:41:45 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-cd9552f0-80a7-4549-8e60-f3303424db0e tempest-VolumeRetypeWithoutMigrationTest-797371622 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097" returned: 0 in 0.820s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:41:45 devstack cinder-volume[87444]: DEBUG cinder.manager [None req-cd9552f0-80a7-4549-8e60-f3303424db0e tempest-VolumeRetypeWithoutMigrationTest-797371622 None] Notifying Schedulers of capabilities ... {{(pid=87444) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 04:41:45 devstack cinder-volume[87444]: INFO cinder.volume.manager [None req-cd9552f0-80a7-4549-8e60-f3303424db0e tempest-VolumeRetypeWithoutMigrationTest-797371622 None] Deleted volume successfully. Jul 10 04:41:45 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-8926cf21-50fd-47e5-9e94-b58aafdbc5fa tempest-VolumesListAdminTestJSON-1558846114 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b41c876f-9812-40a2-a9ae-0ede5fdfff82) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3a1593fc-1974-4696-97cc-d97ea48c1e79', 'volume_size': 1}' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:41:45 devstack sudo[96549]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-80504d94-f520-4b4a-bf04-620bfa5f2b42 1073741824 Jul 10 04:41:45 devstack sudo[96549]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:41:45 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-8926cf21-50fd-47e5-9e94-b58aafdbc5fa tempest-VolumesListAdminTestJSON-1558846114 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (698e07e5-11ae-4754-9f80-9506f1edb3f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:41:45 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-cd9552f0-80a7-4549-8e60-f3303424db0e tempest-VolumeRetypeWithoutMigrationTest-797371622 None] Lock "cinder-04cae276-a1d3-4314-9fc0-a726d07ef497-delete_volume" released by "delete_volume" :: held 2.839s {{(pid=87444) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 04:41:45 devstack cinder-volume[87444]: INFO cinder.volume.flows.manager.create_volume [None req-8926cf21-50fd-47e5-9e94-b58aafdbc5fa tempest-VolumesListAdminTestJSON-1558846114 None] Volume volume-3a1593fc-1974-4696-97cc-d97ea48c1e79 (3a1593fc-1974-4696-97cc-d97ea48c1e79): created successfully Jul 10 04:41:45 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-8926cf21-50fd-47e5-9e94-b58aafdbc5fa tempest-VolumesListAdminTestJSON-1558846114 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (698e07e5-11ae-4754-9f80-9506f1edb3f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:41:45 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-8926cf21-50fd-47e5-9e94-b58aafdbc5fa tempest-VolumesListAdminTestJSON-1558846114 None] Flow 'volume_create_manager' (87286361-b888-402b-a855-8d3fa905ba27) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87444) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 04:41:45 devstack cinder-volume[87444]: INFO cinder.volume.manager [None req-8926cf21-50fd-47e5-9e94-b58aafdbc5fa tempest-VolumesListAdminTestJSON-1558846114 None] Created volume successfully. Jul 10 04:41:45 devstack cinder-volume[87444]: DEBUG cinder.volume.flows.manager.create_volume [None req-4542d92b-2221-4f72-91d1-328df7105f08 tempest-VolumesImageMetadata-1791203028 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87444) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 04:41:45 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-4542d92b-2221-4f72-91d1-328df7105f08 tempest-VolumesImageMetadata-1791203028 None] Flow 'volume_create_manager' (0d51f58d-2f7c-4c53-be30-a398520c1b9d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 04:41:45 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-4542d92b-2221-4f72-91d1-328df7105f08 tempest-VolumesImageMetadata-1791203028 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eeb2cab0-e79e-4b46-bb73-d621deaecf52) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:41:45 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-4542d92b-2221-4f72-91d1-328df7105f08 tempest-VolumesImageMetadata-1791203028 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eeb2cab0-e79e-4b46-bb73-d621deaecf52) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T02:41:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-1741762140',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d17a35d7-0961-4ac4-9d8b-639864f18312,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='93df19f854d448cdb7b211159dccccc9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T02:41:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T02:41:46Z,use_quota=True,user_id='19dbf4519b42410da43dd6fdcd44b58e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(317e369e-1e06-434d-ae95-a335f0e6c903),volume_type_id=317e369e-1e06-434d-ae95-a335f0e6c903)' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:41:45 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-4542d92b-2221-4f72-91d1-328df7105f08 tempest-VolumesImageMetadata-1791203028 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aef3ddc2-2cee-4f47-a665-675adf1a17f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:41:45 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-4542d92b-2221-4f72-91d1-328df7105f08 tempest-VolumesImageMetadata-1791203028 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aef3ddc2-2cee-4f47-a665-675adf1a17f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:41:45 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-4542d92b-2221-4f72-91d1-328df7105f08 tempest-VolumesImageMetadata-1791203028 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c136fa1d-6f4c-4f64-aab1-41786206b306) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:41:45 devstack cinder-volume[87444]: DEBUG cinder.image.glance [None req-4542d92b-2221-4f72-91d1-328df7105f08 tempest-VolumesImageMetadata-1791203028 None] Creating Keystone auth plugin from conf {{(pid=87444) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jul 10 04:41:46 devstack sudo[96549]: pam_unix(sudo:session): session closed for user root Jul 10 04:41:46 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-7ade19db-0e11-4f6b-838b-453201722b28 tempest-VolumesSnapshotTestJSON-1690897005 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-80504d94-f520-4b4a-bf04-620bfa5f2b42 1073741824" returned: 0 in 1.049s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:41:46 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-7ade19db-0e11-4f6b-838b-453201722b28 tempest-VolumesSnapshotTestJSON-1690897005 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-80504d94-f520-4b4a-bf04-620bfa5f2b42 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:41:46 devstack sudo[96556]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-80504d94-f520-4b4a-bf04-620bfa5f2b42 Jul 10 04:41:46 devstack sudo[96556]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:41:46 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-4542d92b-2221-4f72-91d1-328df7105f08 tempest-VolumesImageMetadata-1791203028 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c136fa1d-6f4c-4f64-aab1-41786206b306) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'd17a35d7-0961-4ac4-9d8b-639864f18312', 'volume_name': 'volume-d17a35d7-0961-4ac4-9d8b-639864f18312', 'volume_size': 1, 'image_id': '5ac2ee4b-64bc-499a-b553-ae96ba343fc0', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/5ac2ee4b-64bc-499a-b553-ae96ba343fc0', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'ca4bb946b593473194351a84617cf92e', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '5ac2ee4b-64bc-499a-b553-ae96ba343fc0', 'created_at': datetime.datetime(2026, 7, 10, 2, 26, 36, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 10, 2, 26, 38, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/5ac2ee4b-64bc-499a-b553-ae96ba343fc0/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:41:46 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-4542d92b-2221-4f72-91d1-328df7105f08 tempest-VolumesImageMetadata-1791203028 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8dfe9e56-5bd2-4415-ad25-b0d53a684f77) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:41:46 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-4542d92b-2221-4f72-91d1-328df7105f08 tempest-VolumesImageMetadata-1791203028 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8dfe9e56-5bd2-4415-ad25-b0d53a684f77) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:41:46 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-4542d92b-2221-4f72-91d1-328df7105f08 tempest-VolumesImageMetadata-1791203028 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ba70f6e4-3cfd-420b-8865-34624acbe335) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:41:46 devstack cinder-volume[87444]: INFO cinder.volume.flows.manager.create_volume [None req-4542d92b-2221-4f72-91d1-328df7105f08 tempest-VolumesImageMetadata-1791203028 None] Volume d17a35d7-0961-4ac4-9d8b-639864f18312: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-d17a35d7-0961-4ac4-9d8b-639864f18312', 'volume_size': 1, 'image_id': '5ac2ee4b-64bc-499a-b553-ae96ba343fc0', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/5ac2ee4b-64bc-499a-b553-ae96ba343fc0', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'ca4bb946b593473194351a84617cf92e', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '5ac2ee4b-64bc-499a-b553-ae96ba343fc0', 'created_at': datetime.datetime(2026, 7, 10, 2, 26, 36, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 10, 2, 26, 38, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/5ac2ee4b-64bc-499a-b553-ae96ba343fc0/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Jul 10 04:41:46 devstack cinder-volume[87444]: DEBUG cinder.volume.flows.manager.create_volume [None req-4542d92b-2221-4f72-91d1-328df7105f08 tempest-VolumesImageMetadata-1791203028 None] Trying to clone d17a35d7-0961-4ac4-9d8b-639864f18312 from image 5ac2ee4b-64bc-499a-b553-ae96ba343fc0 at location (None, [{'url': 'file:///opt/stack/data/glance/images/5ac2ee4b-64bc-499a-b553-ae96ba343fc0', 'metadata': {}}]). {{(pid=87444) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jul 10 04:41:47 devstack cinder-volume[87444]: DEBUG dbcounter [-] [87444] Writing DB stats cinder:SELECT=146,cinder:UPDATE=187,cinder:DELETE=14,cinder:INSERT=40 {{(pid=87444) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 10 04:41:47 devstack cinder-volume[87444]: DEBUG cinder.volume.flows.manager.create_volume [None req-aebe9135-d362-4b53-a075-f4d7e96470ea tempest-VolumesListAdminTestJSON-1558846114 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87444) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 04:41:47 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-aebe9135-d362-4b53-a075-f4d7e96470ea tempest-VolumesListAdminTestJSON-1558846114 None] Flow 'volume_create_manager' (c13258cd-9b90-434d-963e-d5a801748331) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 04:41:47 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-aebe9135-d362-4b53-a075-f4d7e96470ea tempest-VolumesListAdminTestJSON-1558846114 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f5b72269-f2d4-461c-996e-a26785edaa64) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:41:47 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-aebe9135-d362-4b53-a075-f4d7e96470ea tempest-VolumesListAdminTestJSON-1558846114 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f5b72269-f2d4-461c-996e-a26785edaa64) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T02:41:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-2095359049',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ca67c661-fa73-4f3f-9618-d326aab3b21d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bb9d9c6a14dd42618fe962674acab751',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T02:41:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T02:41:47Z,use_quota=True,user_id='e83ca0de97814a1b8583b26a84ce04a9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(317e369e-1e06-434d-ae95-a335f0e6c903),volume_type_id=317e369e-1e06-434d-ae95-a335f0e6c903)' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:41:47 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-aebe9135-d362-4b53-a075-f4d7e96470ea tempest-VolumesListAdminTestJSON-1558846114 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1c0481c2-c836-43c3-9ec5-2f08a4d1108e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:41:47 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-aebe9135-d362-4b53-a075-f4d7e96470ea tempest-VolumesListAdminTestJSON-1558846114 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1c0481c2-c836-43c3-9ec5-2f08a4d1108e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:41:47 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-aebe9135-d362-4b53-a075-f4d7e96470ea tempest-VolumesListAdminTestJSON-1558846114 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (32f696b0-74a8-4a33-9e4f-5d99dc10853b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:41:47 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-aebe9135-d362-4b53-a075-f4d7e96470ea tempest-VolumesListAdminTestJSON-1558846114 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (32f696b0-74a8-4a33-9e4f-5d99dc10853b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ca67c661-fa73-4f3f-9618-d326aab3b21d', 'volume_name': 'volume-ca67c661-fa73-4f3f-9618-d326aab3b21d', 'volume_size': 1}' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:41:47 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-aebe9135-d362-4b53-a075-f4d7e96470ea tempest-VolumesListAdminTestJSON-1558846114 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3e0b021d-289f-4816-a862-c655734b60d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:41:47 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-aebe9135-d362-4b53-a075-f4d7e96470ea tempest-VolumesListAdminTestJSON-1558846114 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3e0b021d-289f-4816-a862-c655734b60d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:41:47 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-aebe9135-d362-4b53-a075-f4d7e96470ea tempest-VolumesListAdminTestJSON-1558846114 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2d5a477a-d0aa-42c9-8b1e-5df55192cb23) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:41:47 devstack cinder-volume[87444]: INFO cinder.volume.flows.manager.create_volume [None req-aebe9135-d362-4b53-a075-f4d7e96470ea tempest-VolumesListAdminTestJSON-1558846114 None] Volume ca67c661-fa73-4f3f-9618-d326aab3b21d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ca67c661-fa73-4f3f-9618-d326aab3b21d', 'volume_size': 1} Jul 10 04:41:47 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-aebe9135-d362-4b53-a075-f4d7e96470ea tempest-VolumesListAdminTestJSON-1558846114 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 04:41:47 devstack sudo[96556]: pam_unix(sudo:session): session closed for user root Jul 10 04:41:47 devstack cinder-volume[87444]: DEBUG cinder.image.image_utils [None req-4542d92b-2221-4f72-91d1-328df7105f08 tempest-VolumesImageMetadata-1791203028 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_5ac2ee4b-64bc-499a-b553-ae96ba343fc0_95xrxidzdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=87444) fetch /opt/stack/cinder/cinder/image/image_utils.py:765}} Jul 10 04:41:47 devstack cinder-volume[87444]: INFO cinder.image.image_utils [None req-4542d92b-2221-4f72-91d1-328df7105f08 tempest-VolumesImageMetadata-1791203028 None] Image download 20.69 MB at 20.69 MB/s Jul 10 04:41:47 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-7ade19db-0e11-4f6b-838b-453201722b28 tempest-VolumesSnapshotTestJSON-1690897005 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-80504d94-f520-4b4a-bf04-620bfa5f2b42" returned: 0 in 0.986s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:41:47 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-7ade19db-0e11-4f6b-838b-453201722b28 tempest-VolumesSnapshotTestJSON-1690897005 None] <== create_volume: return (2089ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922'} {{(pid=87444) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 04:41:47 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-7ade19db-0e11-4f6b-838b-453201722b28 tempest-VolumesSnapshotTestJSON-1690897005 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.094s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 04:41:47 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-aebe9135-d362-4b53-a075-f4d7e96470ea tempest-VolumesListAdminTestJSON-1558846114 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.087s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 04:41:47 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-aebe9135-d362-4b53-a075-f4d7e96470ea tempest-VolumesListAdminTestJSON-1558846114 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T02:41:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-2095359049',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ca67c661-fa73-4f3f-9618-d326aab3b21d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bb9d9c6a14dd42618fe962674acab751',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T02:41:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T02:41:47Z,use_quota=True,user_id='e83ca0de97814a1b8583b26a84ce04a9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(317e369e-1e06-434d-ae95-a335f0e6c903),volume_type_id=317e369e-1e06-434d-ae95-a335f0e6c903)}" {{(pid=87444) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 04:41:47 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.remotefs [None req-aebe9135-d362-4b53-a075-f4d7e96470ea tempest-VolumesListAdminTestJSON-1558846114 None] Creating volume ca67c661-fa73-4f3f-9618-d326aab3b21d {{(pid=87444) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 04:41:47 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-aebe9135-d362-4b53-a075-f4d7e96470ea tempest-VolumesListAdminTestJSON-1558846114 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 04:41:47 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-aebe9135-d362-4b53-a075-f4d7e96470ea tempest-VolumesListAdminTestJSON-1558846114 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 04:41:47 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-aebe9135-d362-4b53-a075-f4d7e96470ea tempest-VolumesListAdminTestJSON-1558846114 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922': None} {{(pid=87444) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 04:41:47 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-aebe9135-d362-4b53-a075-f4d7e96470ea tempest-VolumesListAdminTestJSON-1558846114 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922'] {{(pid=87444) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 04:41:47 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-aebe9135-d362-4b53-a075-f4d7e96470ea tempest-VolumesListAdminTestJSON-1558846114 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 04:41:47 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-aebe9135-d362-4b53-a075-f4d7e96470ea tempest-VolumesListAdminTestJSON-1558846114 None] Selected osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922 as target Quobyte volume. {{(pid=87444) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 04:41:47 devstack cinder-volume[87444]: INFO cinder.volume.drivers.remotefs [None req-aebe9135-d362-4b53-a075-f4d7e96470ea tempest-VolumesListAdminTestJSON-1558846114 None] casted to osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922 Jul 10 04:41:47 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-aebe9135-d362-4b53-a075-f4d7e96470ea tempest-VolumesListAdminTestJSON-1558846114 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-ca67c661-fa73-4f3f-9618-d326aab3b21d 1073741824 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:41:47 devstack sudo[96580]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-ca67c661-fa73-4f3f-9618-d326aab3b21d 1073741824 Jul 10 04:41:47 devstack sudo[96580]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:41:47 devstack cinder-volume[87444]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1fd1917-8163-42cb-ac35-30476f53f430]: (4, 'qcow2') {{(pid=88499) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 04:41:47 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-4542d92b-2221-4f72-91d1-328df7105f08 tempest-VolumesImageMetadata-1791203028 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_5ac2ee4b-64bc-499a-b553-ae96ba343fc0_95xrxidzdevstack@QuobyteHD {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:41:47 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-7ade19db-0e11-4f6b-838b-453201722b28 tempest-VolumesSnapshotTestJSON-1690897005 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8a6b527e-89ed-4aca-a0cd-6e2076829045) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-80504d94-f520-4b4a-bf04-620bfa5f2b42', 'volume_size': 1}' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:41:47 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-7ade19db-0e11-4f6b-838b-453201722b28 tempest-VolumesSnapshotTestJSON-1690897005 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fce90bb7-86af-4979-aabe-e33716111e36) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:41:47 devstack cinder-volume[87444]: INFO cinder.volume.flows.manager.create_volume [None req-7ade19db-0e11-4f6b-838b-453201722b28 tempest-VolumesSnapshotTestJSON-1690897005 None] Volume volume-80504d94-f520-4b4a-bf04-620bfa5f2b42 (80504d94-f520-4b4a-bf04-620bfa5f2b42): created successfully Jul 10 04:41:47 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-7ade19db-0e11-4f6b-838b-453201722b28 tempest-VolumesSnapshotTestJSON-1690897005 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fce90bb7-86af-4979-aabe-e33716111e36) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:41:47 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-7ade19db-0e11-4f6b-838b-453201722b28 tempest-VolumesSnapshotTestJSON-1690897005 None] Flow 'volume_create_manager' (7d57b0d4-b8ab-4583-ad94-fbadac5ae25e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87444) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 04:41:47 devstack cinder-volume[87444]: INFO cinder.volume.manager [None req-7ade19db-0e11-4f6b-838b-453201722b28 tempest-VolumesSnapshotTestJSON-1690897005 None] Created volume successfully. Jul 10 04:41:47 devstack sudo[96582]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_5ac2ee4b-64bc-499a-b553-ae96ba343fc0_95xrxidzdevstack@QuobyteHD Jul 10 04:41:47 devstack sudo[96582]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:41:48 devstack sudo[96582]: pam_unix(sudo:session): session closed for user root Jul 10 04:41:48 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-4542d92b-2221-4f72-91d1-328df7105f08 tempest-VolumesImageMetadata-1791203028 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_5ac2ee4b-64bc-499a-b553-ae96ba343fc0_95xrxidzdevstack@QuobyteHD" returned: 0 in 0.855s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:41:48 devstack cinder-volume[87444]: DEBUG cinder.image.image_utils [None req-4542d92b-2221-4f72-91d1-328df7105f08 tempest-VolumesImageMetadata-1791203028 None] Temporary image 5ac2ee4b-64bc-499a-b553-ae96ba343fc0 is fetched for user 19dbf4519b42410da43dd6fdcd44b58e. {{(pid=87444) fetch /opt/stack/cinder/cinder/image/image_utils.py:1464}} Jul 10 04:41:48 devstack cinder-volume[87444]: DEBUG oslo.privsep.daemon [-] privsep: reply[38476b94-24af-4cc2-b1fc-43fb2aa6b772]: (4, 'qcow2') {{(pid=88499) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 04:41:48 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-4542d92b-2221-4f72-91d1-328df7105f08 tempest-VolumesImageMetadata-1791203028 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_5ac2ee4b-64bc-499a-b553-ae96ba343fc0_95xrxidzdevstack@QuobyteHD {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:41:48 devstack sudo[96580]: pam_unix(sudo:session): session closed for user root Jul 10 04:41:48 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-aebe9135-d362-4b53-a075-f4d7e96470ea tempest-VolumesListAdminTestJSON-1558846114 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-ca67c661-fa73-4f3f-9618-d326aab3b21d 1073741824" returned: 0 in 1.054s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:41:48 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-7ae8a55c-bd89-47dc-b754-fd6f0111deb2 tempest-VolumesSnapshotTestJSON-1690897005 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 04:41:48 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-aebe9135-d362-4b53-a075-f4d7e96470ea tempest-VolumesListAdminTestJSON-1558846114 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-ca67c661-fa73-4f3f-9618-d326aab3b21d {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:41:48 devstack sudo[96592]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-ca67c661-fa73-4f3f-9618-d326aab3b21d Jul 10 04:41:48 devstack sudo[96592]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:41:48 devstack sudo[96591]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_5ac2ee4b-64bc-499a-b553-ae96ba343fc0_95xrxidzdevstack@QuobyteHD Jul 10 04:41:48 devstack sudo[96591]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:41:49 devstack sudo[96591]: pam_unix(sudo:session): session closed for user root Jul 10 04:41:49 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-4542d92b-2221-4f72-91d1-328df7105f08 tempest-VolumesImageMetadata-1791203028 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_5ac2ee4b-64bc-499a-b553-ae96ba343fc0_95xrxidzdevstack@QuobyteHD" returned: 0 in 0.753s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:41:49 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-4542d92b-2221-4f72-91d1-328df7105f08 tempest-VolumesImageMetadata-1791203028 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 04:41:49 devstack sudo[96592]: pam_unix(sudo:session): session closed for user root Jul 10 04:41:49 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-aebe9135-d362-4b53-a075-f4d7e96470ea tempest-VolumesListAdminTestJSON-1558846114 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-ca67c661-fa73-4f3f-9618-d326aab3b21d" returned: 0 in 0.707s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:41:49 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-aebe9135-d362-4b53-a075-f4d7e96470ea tempest-VolumesListAdminTestJSON-1558846114 None] <== create_volume: return (1809ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922'} {{(pid=87444) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 04:41:49 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-aebe9135-d362-4b53-a075-f4d7e96470ea tempest-VolumesListAdminTestJSON-1558846114 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.812s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 04:41:49 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-7ae8a55c-bd89-47dc-b754-fd6f0111deb2 tempest-VolumesSnapshotTestJSON-1690897005 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.722s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 04:41:49 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.remotefs [None req-7ae8a55c-bd89-47dc-b754-fd6f0111deb2 tempest-VolumesSnapshotTestJSON-1690897005 None] Creating offline snapshot 3862dff9-3f00-4305-a09e-50ab1b1f1122 of volume 80504d94-f520-4b4a-bf04-620bfa5f2b42 {{(pid=87444) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 10 04:41:49 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-aebe9135-d362-4b53-a075-f4d7e96470ea tempest-VolumesListAdminTestJSON-1558846114 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2d5a477a-d0aa-42c9-8b1e-5df55192cb23) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ca67c661-fa73-4f3f-9618-d326aab3b21d', 'volume_size': 1}' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:41:49 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-aebe9135-d362-4b53-a075-f4d7e96470ea tempest-VolumesListAdminTestJSON-1558846114 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0600abd0-b89e-44da-a9d5-8ddc52ef1465) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:41:49 devstack cinder-volume[87444]: DEBUG oslo.privsep.daemon [-] privsep: reply[4073f2bc-c8db-4860-8d59-5ce5878cb1f3]: (4, 'qcow2') {{(pid=88499) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 04:41:49 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-7ae8a55c-bd89-47dc-b754-fd6f0111deb2 tempest-VolumesSnapshotTestJSON-1690897005 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-80504d94-f520-4b4a-bf04-620bfa5f2b42 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:41:49 devstack cinder-volume[87444]: INFO cinder.volume.flows.manager.create_volume [None req-aebe9135-d362-4b53-a075-f4d7e96470ea tempest-VolumesListAdminTestJSON-1558846114 None] Volume volume-ca67c661-fa73-4f3f-9618-d326aab3b21d (ca67c661-fa73-4f3f-9618-d326aab3b21d): created successfully Jul 10 04:41:49 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-aebe9135-d362-4b53-a075-f4d7e96470ea tempest-VolumesListAdminTestJSON-1558846114 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0600abd0-b89e-44da-a9d5-8ddc52ef1465) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:41:49 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-aebe9135-d362-4b53-a075-f4d7e96470ea tempest-VolumesListAdminTestJSON-1558846114 None] Flow 'volume_create_manager' (c13258cd-9b90-434d-963e-d5a801748331) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87444) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 04:41:49 devstack cinder-volume[87444]: INFO cinder.volume.manager [None req-aebe9135-d362-4b53-a075-f4d7e96470ea tempest-VolumesListAdminTestJSON-1558846114 None] Created volume successfully. Jul 10 04:41:49 devstack sudo[96599]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-80504d94-f520-4b4a-bf04-620bfa5f2b42 Jul 10 04:41:49 devstack sudo[96599]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:41:50 devstack sudo[96599]: pam_unix(sudo:session): session closed for user root Jul 10 04:41:50 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-7ae8a55c-bd89-47dc-b754-fd6f0111deb2 tempest-VolumesSnapshotTestJSON-1690897005 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-80504d94-f520-4b4a-bf04-620bfa5f2b42" returned: 0 in 0.779s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:41:50 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-7ae8a55c-bd89-47dc-b754-fd6f0111deb2 tempest-VolumesSnapshotTestJSON-1690897005 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-80504d94-f520-4b4a-bf04-620bfa5f2b42,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-80504d94-f520-4b4a-bf04-620bfa5f2b42.3862dff9-3f00-4305-a09e-50ab1b1f1122 1G {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:41:50 devstack sudo[96604]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-80504d94-f520-4b4a-bf04-620bfa5f2b42,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-80504d94-f520-4b4a-bf04-620bfa5f2b42.3862dff9-3f00-4305-a09e-50ab1b1f1122 1G Jul 10 04:41:50 devstack sudo[96604]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:41:50 devstack sudo[96604]: pam_unix(sudo:session): session closed for user root Jul 10 04:41:50 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-7ae8a55c-bd89-47dc-b754-fd6f0111deb2 tempest-VolumesSnapshotTestJSON-1690897005 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-80504d94-f520-4b4a-bf04-620bfa5f2b42,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-80504d94-f520-4b4a-bf04-620bfa5f2b42.3862dff9-3f00-4305-a09e-50ab1b1f1122 1G" returned: 0 in 0.943s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:41:50 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-7ae8a55c-bd89-47dc-b754-fd6f0111deb2 tempest-VolumesSnapshotTestJSON-1690897005 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-80504d94-f520-4b4a-bf04-620bfa5f2b42 -F qcow2 /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-80504d94-f520-4b4a-bf04-620bfa5f2b42.3862dff9-3f00-4305-a09e-50ab1b1f1122 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:41:51 devstack sudo[96610]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-80504d94-f520-4b4a-bf04-620bfa5f2b42 -F qcow2 /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-80504d94-f520-4b4a-bf04-620bfa5f2b42.3862dff9-3f00-4305-a09e-50ab1b1f1122 Jul 10 04:41:51 devstack sudo[96610]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:41:51 devstack cinder-volume[87444]: DEBUG cinder.volume.flows.manager.create_volume [None req-1914e8e1-3818-4b89-abc2-2dd36e46389b tempest-VolumesListAdminTestJSON-529731424 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87444) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 04:41:51 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-1914e8e1-3818-4b89-abc2-2dd36e46389b tempest-VolumesListAdminTestJSON-529731424 None] Flow 'volume_create_manager' (9ea28004-f70f-4712-bc46-6efbb5bf496d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 04:41:51 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-1914e8e1-3818-4b89-abc2-2dd36e46389b tempest-VolumesListAdminTestJSON-529731424 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cbcf278f-ab49-4f41-8c55-7a7487ca5752) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:41:51 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-1914e8e1-3818-4b89-abc2-2dd36e46389b tempest-VolumesListAdminTestJSON-529731424 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cbcf278f-ab49-4f41-8c55-7a7487ca5752) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T02:41:51Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=46fdc644-bc3e-4969-8e1e-6f54bec4f9b9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5fcb333a08ef425c855d08253ff3aa97',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T02:41:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T02:41:51Z,use_quota=True,user_id='f57ba5bc0bf8481bbb07f40072b11027',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(317e369e-1e06-434d-ae95-a335f0e6c903),volume_type_id=317e369e-1e06-434d-ae95-a335f0e6c903)' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:41:51 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-1914e8e1-3818-4b89-abc2-2dd36e46389b tempest-VolumesListAdminTestJSON-529731424 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (65a1a764-57f4-45ef-91d6-fcabdd38052f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:41:51 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-1914e8e1-3818-4b89-abc2-2dd36e46389b tempest-VolumesListAdminTestJSON-529731424 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (65a1a764-57f4-45ef-91d6-fcabdd38052f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:41:51 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-1914e8e1-3818-4b89-abc2-2dd36e46389b tempest-VolumesListAdminTestJSON-529731424 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1d9eb066-61c4-434b-a94c-105f588d6947) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:41:51 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-1914e8e1-3818-4b89-abc2-2dd36e46389b tempest-VolumesListAdminTestJSON-529731424 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1d9eb066-61c4-434b-a94c-105f588d6947) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '46fdc644-bc3e-4969-8e1e-6f54bec4f9b9', 'volume_name': 'volume-46fdc644-bc3e-4969-8e1e-6f54bec4f9b9', 'volume_size': 1}' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:41:51 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-1914e8e1-3818-4b89-abc2-2dd36e46389b tempest-VolumesListAdminTestJSON-529731424 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ebe31d92-392f-437d-a68d-dffd9906a287) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:41:51 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-1914e8e1-3818-4b89-abc2-2dd36e46389b tempest-VolumesListAdminTestJSON-529731424 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ebe31d92-392f-437d-a68d-dffd9906a287) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:41:51 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-1914e8e1-3818-4b89-abc2-2dd36e46389b tempest-VolumesListAdminTestJSON-529731424 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3a760253-c649-48ab-bdcf-26f8e2e8e580) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:41:51 devstack cinder-volume[87444]: INFO cinder.volume.flows.manager.create_volume [None req-1914e8e1-3818-4b89-abc2-2dd36e46389b tempest-VolumesListAdminTestJSON-529731424 None] Volume 46fdc644-bc3e-4969-8e1e-6f54bec4f9b9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-46fdc644-bc3e-4969-8e1e-6f54bec4f9b9', 'volume_size': 1} Jul 10 04:41:51 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-1914e8e1-3818-4b89-abc2-2dd36e46389b tempest-VolumesListAdminTestJSON-529731424 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 04:41:51 devstack sudo[96610]: pam_unix(sudo:session): session closed for user root Jul 10 04:41:51 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-7ae8a55c-bd89-47dc-b754-fd6f0111deb2 tempest-VolumesSnapshotTestJSON-1690897005 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-80504d94-f520-4b4a-bf04-620bfa5f2b42 -F qcow2 /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-80504d94-f520-4b4a-bf04-620bfa5f2b42.3862dff9-3f00-4305-a09e-50ab1b1f1122" returned: 0 in 0.755s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:41:51 devstack cinder-volume[87444]: WARNING cinder.volume.drivers.remotefs [None req-7ae8a55c-bd89-47dc-b754-fd6f0111deb2 tempest-VolumesSnapshotTestJSON-1690897005 None] /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-80504d94-f520-4b4a-bf04-620bfa5f2b42.3862dff9-3f00-4305-a09e-50ab1b1f1122 is being set with open permissions: ugo+rw Jul 10 04:41:51 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-7ae8a55c-bd89-47dc-b754-fd6f0111deb2 tempest-VolumesSnapshotTestJSON-1690897005 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-80504d94-f520-4b4a-bf04-620bfa5f2b42.3862dff9-3f00-4305-a09e-50ab1b1f1122 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:41:51 devstack sudo[96615]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-80504d94-f520-4b4a-bf04-620bfa5f2b42.3862dff9-3f00-4305-a09e-50ab1b1f1122 Jul 10 04:41:51 devstack sudo[96615]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:41:52 devstack sudo[96615]: pam_unix(sudo:session): session closed for user root Jul 10 04:41:52 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-7ae8a55c-bd89-47dc-b754-fd6f0111deb2 tempest-VolumesSnapshotTestJSON-1690897005 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-80504d94-f520-4b4a-bf04-620bfa5f2b42.3862dff9-3f00-4305-a09e-50ab1b1f1122" returned: 0 in 0.711s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:41:52 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-7ae8a55c-bd89-47dc-b754-fd6f0111deb2 tempest-VolumesSnapshotTestJSON-1690897005 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-80504d94-f520-4b4a-bf04-620bfa5f2b42.info {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:41:52 devstack sudo[96618]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-80504d94-f520-4b4a-bf04-620bfa5f2b42.info Jul 10 04:41:52 devstack sudo[96618]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:41:53 devstack sudo[96618]: pam_unix(sudo:session): session closed for user root Jul 10 04:41:53 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-7ae8a55c-bd89-47dc-b754-fd6f0111deb2 tempest-VolumesSnapshotTestJSON-1690897005 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-80504d94-f520-4b4a-bf04-620bfa5f2b42.info" returned: 0 in 0.712s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:41:53 devstack cinder-volume[87444]: WARNING cinder.volume.drivers.remotefs [None req-7ae8a55c-bd89-47dc-b754-fd6f0111deb2 tempest-VolumesSnapshotTestJSON-1690897005 None] /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-80504d94-f520-4b4a-bf04-620bfa5f2b42.info is being set with open permissions: ugo+rw Jul 10 04:41:53 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-7ae8a55c-bd89-47dc-b754-fd6f0111deb2 tempest-VolumesSnapshotTestJSON-1690897005 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-80504d94-f520-4b4a-bf04-620bfa5f2b42.info {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:41:53 devstack sudo[96622]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-80504d94-f520-4b4a-bf04-620bfa5f2b42.info Jul 10 04:41:53 devstack sudo[96622]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:41:53 devstack sudo[96622]: pam_unix(sudo:session): session closed for user root Jul 10 04:41:53 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-7ae8a55c-bd89-47dc-b754-fd6f0111deb2 tempest-VolumesSnapshotTestJSON-1690897005 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-80504d94-f520-4b4a-bf04-620bfa5f2b42.info" returned: 0 in 0.657s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:41:53 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-7ae8a55c-bd89-47dc-b754-fd6f0111deb2 tempest-VolumesSnapshotTestJSON-1690897005 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.655s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 04:41:53 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-4542d92b-2221-4f72-91d1-328df7105f08 tempest-VolumesImageMetadata-1791203028 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.683s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 04:41:53 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-4542d92b-2221-4f72-91d1-328df7105f08 tempest-VolumesImageMetadata-1791203028 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T02:41:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-1741762140',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d17a35d7-0961-4ac4-9d8b-639864f18312,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='93df19f854d448cdb7b211159dccccc9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T02:41:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T02:41:46Z,use_quota=True,user_id='19dbf4519b42410da43dd6fdcd44b58e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(317e369e-1e06-434d-ae95-a335f0e6c903),volume_type_id=317e369e-1e06-434d-ae95-a335f0e6c903)}" {{(pid=87444) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 04:41:53 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.remotefs [None req-4542d92b-2221-4f72-91d1-328df7105f08 tempest-VolumesImageMetadata-1791203028 None] Creating volume d17a35d7-0961-4ac4-9d8b-639864f18312 {{(pid=87444) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 04:41:53 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-4542d92b-2221-4f72-91d1-328df7105f08 tempest-VolumesImageMetadata-1791203028 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 04:41:53 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-4542d92b-2221-4f72-91d1-328df7105f08 tempest-VolumesImageMetadata-1791203028 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 04:41:53 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-4542d92b-2221-4f72-91d1-328df7105f08 tempest-VolumesImageMetadata-1791203028 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922': None} {{(pid=87444) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 04:41:53 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-4542d92b-2221-4f72-91d1-328df7105f08 tempest-VolumesImageMetadata-1791203028 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922'] {{(pid=87444) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 04:41:53 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-4542d92b-2221-4f72-91d1-328df7105f08 tempest-VolumesImageMetadata-1791203028 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 04:41:53 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-4542d92b-2221-4f72-91d1-328df7105f08 tempest-VolumesImageMetadata-1791203028 None] Selected osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922 as target Quobyte volume. {{(pid=87444) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 04:41:53 devstack cinder-volume[87444]: INFO cinder.volume.drivers.remotefs [None req-4542d92b-2221-4f72-91d1-328df7105f08 tempest-VolumesImageMetadata-1791203028 None] casted to osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922 Jul 10 04:41:53 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-4542d92b-2221-4f72-91d1-328df7105f08 tempest-VolumesImageMetadata-1791203028 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-d17a35d7-0961-4ac4-9d8b-639864f18312 1073741824 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:41:53 devstack sudo[96625]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-d17a35d7-0961-4ac4-9d8b-639864f18312 1073741824 Jul 10 04:41:53 devstack sudo[96625]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:41:53 devstack cinder-volume[87444]: INFO cinder.volume.manager [None req-7ae8a55c-bd89-47dc-b754-fd6f0111deb2 tempest-VolumesSnapshotTestJSON-1690897005 None] Create snapshot completed successfully Jul 10 04:41:54 devstack sudo[96625]: pam_unix(sudo:session): session closed for user root Jul 10 04:41:54 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-4542d92b-2221-4f72-91d1-328df7105f08 tempest-VolumesImageMetadata-1791203028 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-d17a35d7-0961-4ac4-9d8b-639864f18312 1073741824" returned: 0 in 0.838s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:41:54 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-4542d92b-2221-4f72-91d1-328df7105f08 tempest-VolumesImageMetadata-1791203028 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-d17a35d7-0961-4ac4-9d8b-639864f18312 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:41:54 devstack sudo[96630]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-d17a35d7-0961-4ac4-9d8b-639864f18312 Jul 10 04:41:54 devstack sudo[96630]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:41:55 devstack cinder-volume[87444]: DEBUG cinder.volume.flows.manager.create_volume [None req-3bbfff03-018a-4293-8a75-ed7b8ab23e23 tempest-VolumesSnapshotTestJSON-1690897005 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87444) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 04:41:55 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-3bbfff03-018a-4293-8a75-ed7b8ab23e23 tempest-VolumesSnapshotTestJSON-1690897005 None] Flow 'volume_create_manager' (06dbcddf-e1a5-44b9-b02a-7a4f3840508a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 04:41:55 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-3bbfff03-018a-4293-8a75-ed7b8ab23e23 tempest-VolumesSnapshotTestJSON-1690897005 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a89c840c-1a4a-4c32-b65d-6867d85df0d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:41:55 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-3bbfff03-018a-4293-8a75-ed7b8ab23e23 tempest-VolumesSnapshotTestJSON-1690897005 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a89c840c-1a4a-4c32-b65d-6867d85df0d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T02:41:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-2047389285',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=faf4712f-a297-40ad-a21a-3936e635088a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='92c5956be8c447b9872943111e4168dc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T02:41:55Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=3862dff9-3f00-4305-a09e-50ab1b1f1122,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T02:41:55Z,use_quota=True,user_id='16ea7041ff434f7890eca88a786ad0f0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(317e369e-1e06-434d-ae95-a335f0e6c903),volume_type_id=317e369e-1e06-434d-ae95-a335f0e6c903)' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:41:55 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-3bbfff03-018a-4293-8a75-ed7b8ab23e23 tempest-VolumesSnapshotTestJSON-1690897005 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (29218f5c-2592-4ea7-be46-c34d0c2454d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:41:55 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-3bbfff03-018a-4293-8a75-ed7b8ab23e23 tempest-VolumesSnapshotTestJSON-1690897005 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (29218f5c-2592-4ea7-be46-c34d0c2454d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:41:55 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-3bbfff03-018a-4293-8a75-ed7b8ab23e23 tempest-VolumesSnapshotTestJSON-1690897005 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (660272c7-7047-44bb-a598-17be9e66b00c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:41:55 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-3bbfff03-018a-4293-8a75-ed7b8ab23e23 tempest-VolumesSnapshotTestJSON-1690897005 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (660272c7-7047-44bb-a598-17be9e66b00c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'faf4712f-a297-40ad-a21a-3936e635088a', 'volume_name': 'volume-faf4712f-a297-40ad-a21a-3936e635088a', 'volume_size': 2, 'snapshot_id': '3862dff9-3f00-4305-a09e-50ab1b1f1122'}' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:41:55 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-3bbfff03-018a-4293-8a75-ed7b8ab23e23 tempest-VolumesSnapshotTestJSON-1690897005 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (773b5990-0685-47b9-9dda-7c60ee5ac099) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:41:55 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-3bbfff03-018a-4293-8a75-ed7b8ab23e23 tempest-VolumesSnapshotTestJSON-1690897005 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (773b5990-0685-47b9-9dda-7c60ee5ac099) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:41:55 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-3bbfff03-018a-4293-8a75-ed7b8ab23e23 tempest-VolumesSnapshotTestJSON-1690897005 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (304bf768-67d0-466d-9974-3dbdb04fcaae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:41:55 devstack cinder-volume[87444]: INFO cinder.volume.flows.manager.create_volume [None req-3bbfff03-018a-4293-8a75-ed7b8ab23e23 tempest-VolumesSnapshotTestJSON-1690897005 None] Volume faf4712f-a297-40ad-a21a-3936e635088a: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-faf4712f-a297-40ad-a21a-3936e635088a', 'volume_size': 2, 'snapshot_id': '3862dff9-3f00-4305-a09e-50ab1b1f1122'} Jul 10 04:41:55 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-3bbfff03-018a-4293-8a75-ed7b8ab23e23 tempest-VolumesSnapshotTestJSON-1690897005 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 04:41:55 devstack sudo[96630]: pam_unix(sudo:session): session closed for user root Jul 10 04:41:55 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-4542d92b-2221-4f72-91d1-328df7105f08 tempest-VolumesImageMetadata-1791203028 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-d17a35d7-0961-4ac4-9d8b-639864f18312" returned: 0 in 0.721s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:41:55 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-4542d92b-2221-4f72-91d1-328df7105f08 tempest-VolumesImageMetadata-1791203028 None] <== create_volume: return (1608ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922'} {{(pid=87444) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 04:41:55 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-4542d92b-2221-4f72-91d1-328df7105f08 tempest-VolumesImageMetadata-1791203028 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.611s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 04:41:55 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-1914e8e1-3818-4b89-abc2-2dd36e46389b tempest-VolumesListAdminTestJSON-529731424 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.383s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 04:41:55 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-1914e8e1-3818-4b89-abc2-2dd36e46389b tempest-VolumesListAdminTestJSON-529731424 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T02:41:51Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=46fdc644-bc3e-4969-8e1e-6f54bec4f9b9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5fcb333a08ef425c855d08253ff3aa97',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T02:41:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T02:41:51Z,use_quota=True,user_id='f57ba5bc0bf8481bbb07f40072b11027',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(317e369e-1e06-434d-ae95-a335f0e6c903),volume_type_id=317e369e-1e06-434d-ae95-a335f0e6c903)}" {{(pid=87444) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 04:41:55 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.remotefs [None req-1914e8e1-3818-4b89-abc2-2dd36e46389b tempest-VolumesListAdminTestJSON-529731424 None] Creating volume 46fdc644-bc3e-4969-8e1e-6f54bec4f9b9 {{(pid=87444) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 04:41:55 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-1914e8e1-3818-4b89-abc2-2dd36e46389b tempest-VolumesListAdminTestJSON-529731424 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 04:41:55 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-1914e8e1-3818-4b89-abc2-2dd36e46389b tempest-VolumesListAdminTestJSON-529731424 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 04:41:55 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-1914e8e1-3818-4b89-abc2-2dd36e46389b tempest-VolumesListAdminTestJSON-529731424 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922': None} {{(pid=87444) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 04:41:55 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-1914e8e1-3818-4b89-abc2-2dd36e46389b tempest-VolumesListAdminTestJSON-529731424 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922'] {{(pid=87444) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 04:41:55 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-1914e8e1-3818-4b89-abc2-2dd36e46389b tempest-VolumesListAdminTestJSON-529731424 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 04:41:55 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-1914e8e1-3818-4b89-abc2-2dd36e46389b tempest-VolumesListAdminTestJSON-529731424 None] Selected osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922 as target Quobyte volume. {{(pid=87444) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 04:41:55 devstack cinder-volume[87444]: INFO cinder.volume.drivers.remotefs [None req-1914e8e1-3818-4b89-abc2-2dd36e46389b tempest-VolumesListAdminTestJSON-529731424 None] casted to osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922 Jul 10 04:41:55 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-1914e8e1-3818-4b89-abc2-2dd36e46389b tempest-VolumesListAdminTestJSON-529731424 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-46fdc644-bc3e-4969-8e1e-6f54bec4f9b9 1073741824 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:41:55 devstack sudo[96633]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-46fdc644-bc3e-4969-8e1e-6f54bec4f9b9 1073741824 Jul 10 04:41:55 devstack sudo[96633]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:41:55 devstack cinder-volume[87444]: DEBUG cinder.volume.volume_utils [None req-4542d92b-2221-4f72-91d1-328df7105f08 tempest-VolumesImageMetadata-1791203028 None] Attempting download of 5ac2ee4b-64bc-499a-b553-ae96ba343fc0 ((None, [{'url': 'file:///opt/stack/data/glance/images/5ac2ee4b-64bc-499a-b553-ae96ba343fc0', 'metadata': {}}])) to volume d17a35d7-0961-4ac4-9d8b-639864f18312. {{(pid=87444) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jul 10 04:41:55 devstack cinder-volume[87444]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c476e61-12e1-4004-8cad-fccd82c39153]: (4, 'raw') {{(pid=88499) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 04:41:55 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-4542d92b-2221-4f72-91d1-328df7105f08 tempest-VolumesImageMetadata-1791203028 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_5ac2ee4b-64bc-499a-b553-ae96ba343fc0_nb6t8669 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:41:55 devstack sudo[96635]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_5ac2ee4b-64bc-499a-b553-ae96ba343fc0_nb6t8669 Jul 10 04:41:55 devstack sudo[96635]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:41:56 devstack sudo[96635]: pam_unix(sudo:session): session closed for user root Jul 10 04:41:56 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-4542d92b-2221-4f72-91d1-328df7105f08 tempest-VolumesImageMetadata-1791203028 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_5ac2ee4b-64bc-499a-b553-ae96ba343fc0_nb6t8669" returned: 0 in 0.813s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:41:56 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-4542d92b-2221-4f72-91d1-328df7105f08 tempest-VolumesImageMetadata-1791203028 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_5ac2ee4b-64bc-499a-b553-ae96ba343fc0_nb6t8669 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:41:56 devstack sudo[96633]: pam_unix(sudo:session): session closed for user root Jul 10 04:41:56 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-1914e8e1-3818-4b89-abc2-2dd36e46389b tempest-VolumesListAdminTestJSON-529731424 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-46fdc644-bc3e-4969-8e1e-6f54bec4f9b9 1073741824" returned: 0 in 0.975s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:41:56 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-1914e8e1-3818-4b89-abc2-2dd36e46389b tempest-VolumesListAdminTestJSON-529731424 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-46fdc644-bc3e-4969-8e1e-6f54bec4f9b9 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:41:56 devstack sudo[96643]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_5ac2ee4b-64bc-499a-b553-ae96ba343fc0_nb6t8669 Jul 10 04:41:56 devstack sudo[96643]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:41:56 devstack sudo[96644]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-46fdc644-bc3e-4969-8e1e-6f54bec4f9b9 Jul 10 04:41:56 devstack sudo[96644]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:41:57 devstack sudo[96643]: pam_unix(sudo:session): session closed for user root Jul 10 04:41:57 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-4542d92b-2221-4f72-91d1-328df7105f08 tempest-VolumesImageMetadata-1791203028 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_5ac2ee4b-64bc-499a-b553-ae96ba343fc0_nb6t8669" returned: 1 in 0.781s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:41:57 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-4542d92b-2221-4f72-91d1-328df7105f08 tempest-VolumesImageMetadata-1791203028 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_5ac2ee4b-64bc-499a-b553-ae96ba343fc0_nb6t8669' failed. Not Retrying. {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 10 04:41:57 devstack sudo[96644]: pam_unix(sudo:session): session closed for user root Jul 10 04:41:57 devstack cinder-volume[87444]: DEBUG oslo.privsep.daemon [-] privsep: reply[acb90937-c004-49d0-8d59-4250185231c3]: (4, 'qcow2') {{(pid=88499) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 04:41:57 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-4542d92b-2221-4f72-91d1-328df7105f08 tempest-VolumesImageMetadata-1791203028 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_5ac2ee4b-64bc-499a-b553-ae96ba343fc0_95xrxidzdevstack@QuobyteHD {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:41:57 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-1914e8e1-3818-4b89-abc2-2dd36e46389b tempest-VolumesListAdminTestJSON-529731424 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-46fdc644-bc3e-4969-8e1e-6f54bec4f9b9" returned: 0 in 0.695s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:41:57 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-1914e8e1-3818-4b89-abc2-2dd36e46389b tempest-VolumesListAdminTestJSON-529731424 None] <== create_volume: return (1729ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922'} {{(pid=87444) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 04:41:57 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-1914e8e1-3818-4b89-abc2-2dd36e46389b tempest-VolumesListAdminTestJSON-529731424 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.731s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 04:41:57 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-3bbfff03-018a-4293-8a75-ed7b8ab23e23 tempest-VolumesSnapshotTestJSON-1690897005 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 1.763s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 04:41:57 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-3bbfff03-018a-4293-8a75-ed7b8ab23e23 tempest-VolumesSnapshotTestJSON-1690897005 None] Acquiring lock "cinder-quobyte-3862dff9-3f00-4305-a09e-50ab1b1f1122-faf4712f-a297-40ad-a21a-3936e635088a" by "_create_volume_from_snapshot" {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 04:41:57 devstack cinder-volume[87444]: DEBUG dbcounter [-] [87444] Writing DB stats cinder:SELECT=156,cinder:INSERT=41,cinder:UPDATE=182,cinder:DELETE=14 {{(pid=87444) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 10 04:41:57 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-1914e8e1-3818-4b89-abc2-2dd36e46389b tempest-VolumesListAdminTestJSON-529731424 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3a760253-c649-48ab-bdcf-26f8e2e8e580) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-46fdc644-bc3e-4969-8e1e-6f54bec4f9b9', 'volume_size': 1}' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:41:57 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-1914e8e1-3818-4b89-abc2-2dd36e46389b tempest-VolumesListAdminTestJSON-529731424 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (795c6c9c-0a94-42e5-944a-a6d0d874112e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:41:57 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-3bbfff03-018a-4293-8a75-ed7b8ab23e23 tempest-VolumesSnapshotTestJSON-1690897005 None] Lock "cinder-quobyte-3862dff9-3f00-4305-a09e-50ab1b1f1122-faf4712f-a297-40ad-a21a-3936e635088a" acquired by "_create_volume_from_snapshot" :: waited 0.048s {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 04:41:57 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-3bbfff03-018a-4293-8a75-ed7b8ab23e23 tempest-VolumesSnapshotTestJSON-1690897005 None] Creating volume faf4712f-a297-40ad-a21a-3936e635088a from snapshot 3862dff9-3f00-4305-a09e-50ab1b1f1122 {{(pid=87444) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Jul 10 04:41:57 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-3bbfff03-018a-4293-8a75-ed7b8ab23e23 tempest-VolumesSnapshotTestJSON-1690897005 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 04:41:57 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-3bbfff03-018a-4293-8a75-ed7b8ab23e23 tempest-VolumesSnapshotTestJSON-1690897005 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 04:41:57 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-3bbfff03-018a-4293-8a75-ed7b8ab23e23 tempest-VolumesSnapshotTestJSON-1690897005 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922': None} {{(pid=87444) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 04:41:57 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-3bbfff03-018a-4293-8a75-ed7b8ab23e23 tempest-VolumesSnapshotTestJSON-1690897005 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922'] {{(pid=87444) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 04:41:57 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-3bbfff03-018a-4293-8a75-ed7b8ab23e23 tempest-VolumesSnapshotTestJSON-1690897005 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 04:41:57 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-3bbfff03-018a-4293-8a75-ed7b8ab23e23 tempest-VolumesSnapshotTestJSON-1690897005 None] Selected osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922 as target Quobyte volume. {{(pid=87444) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 04:41:57 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-3bbfff03-018a-4293-8a75-ed7b8ab23e23 tempest-VolumesSnapshotTestJSON-1690897005 None] Acquiring lock "cinder-quobyte-faf4712f-a297-40ad-a21a-3936e635088a" by "_copy_volume_from_snapshot" {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 04:41:57 devstack cinder-volume[87444]: INFO cinder.volume.flows.manager.create_volume [None req-1914e8e1-3818-4b89-abc2-2dd36e46389b tempest-VolumesListAdminTestJSON-529731424 None] Volume volume-46fdc644-bc3e-4969-8e1e-6f54bec4f9b9 (46fdc644-bc3e-4969-8e1e-6f54bec4f9b9): created successfully Jul 10 04:41:57 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-1914e8e1-3818-4b89-abc2-2dd36e46389b tempest-VolumesListAdminTestJSON-529731424 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (795c6c9c-0a94-42e5-944a-a6d0d874112e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:41:57 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-1914e8e1-3818-4b89-abc2-2dd36e46389b tempest-VolumesListAdminTestJSON-529731424 None] Flow 'volume_create_manager' (9ea28004-f70f-4712-bc46-6efbb5bf496d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87444) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 04:41:57 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-3bbfff03-018a-4293-8a75-ed7b8ab23e23 tempest-VolumesSnapshotTestJSON-1690897005 None] Lock "cinder-quobyte-faf4712f-a297-40ad-a21a-3936e635088a" acquired by "_copy_volume_from_snapshot" :: waited 0.041s {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 04:41:57 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-3bbfff03-018a-4293-8a75-ed7b8ab23e23 tempest-VolumesSnapshotTestJSON-1690897005 None] snapshot: 3862dff9-3f00-4305-a09e-50ab1b1f1122, volume: faf4712f-a297-40ad-a21a-3936e635088a, {{(pid=87444) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jul 10 04:41:57 devstack sudo[96650]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_5ac2ee4b-64bc-499a-b553-ae96ba343fc0_95xrxidzdevstack@QuobyteHD Jul 10 04:41:57 devstack sudo[96650]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:41:57 devstack cinder-volume[87444]: INFO cinder.volume.manager [None req-1914e8e1-3818-4b89-abc2-2dd36e46389b tempest-VolumesListAdminTestJSON-529731424 None] Created volume successfully. Jul 10 04:41:57 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-3bbfff03-018a-4293-8a75-ed7b8ab23e23 tempest-VolumesSnapshotTestJSON-1690897005 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 04:41:57 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-3bbfff03-018a-4293-8a75-ed7b8ab23e23 tempest-VolumesSnapshotTestJSON-1690897005 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 04:41:57 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-3bbfff03-018a-4293-8a75-ed7b8ab23e23 tempest-VolumesSnapshotTestJSON-1690897005 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922': None} {{(pid=87444) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 04:41:57 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-3bbfff03-018a-4293-8a75-ed7b8ab23e23 tempest-VolumesSnapshotTestJSON-1690897005 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922'] {{(pid=87444) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 04:41:57 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-3bbfff03-018a-4293-8a75-ed7b8ab23e23 tempest-VolumesSnapshotTestJSON-1690897005 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 04:41:57 devstack cinder-volume[87444]: DEBUG oslo.privsep.daemon [-] privsep: reply[96d6a3c1-748f-4cd4-92d6-6be0f3632096]: (4, 'qcow2') {{(pid=88499) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 04:41:57 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-3bbfff03-018a-4293-8a75-ed7b8ab23e23 tempest-VolumesSnapshotTestJSON-1690897005 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-80504d94-f520-4b4a-bf04-620bfa5f2b42.3862dff9-3f00-4305-a09e-50ab1b1f1122 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:41:57 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-f446a326-8316-41d1-bd3a-21f44da92b54 tempest-VolumesListAdminTestJSON-529731424 None] Acquiring lock "cinder-46fdc644-bc3e-4969-8e1e-6f54bec4f9b9-delete_volume" by "delete_volume" {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 04:41:57 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-f446a326-8316-41d1-bd3a-21f44da92b54 tempest-VolumesListAdminTestJSON-529731424 None] Lock "cinder-46fdc644-bc3e-4969-8e1e-6f54bec4f9b9-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 04:41:57 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-f446a326-8316-41d1-bd3a-21f44da92b54 tempest-VolumesListAdminTestJSON-529731424 None] Acquiring lock "cinder-quobyte-46fdc644-bc3e-4969-8e1e-6f54bec4f9b9" by "delete_volume" {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 04:41:57 devstack sudo[96652]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-80504d94-f520-4b4a-bf04-620bfa5f2b42.3862dff9-3f00-4305-a09e-50ab1b1f1122 Jul 10 04:41:57 devstack sudo[96652]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:41:57 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-f446a326-8316-41d1-bd3a-21f44da92b54 tempest-VolumesListAdminTestJSON-529731424 None] Lock "cinder-quobyte-46fdc644-bc3e-4969-8e1e-6f54bec4f9b9" acquired by "delete_volume" :: waited 0.027s {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 04:41:57 devstack cinder-volume[87444]: DEBUG oslo.privsep.daemon [-] privsep: reply[281c145f-c666-48f8-bbed-e4338f388cc7]: (4, 'qcow2') {{(pid=88499) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 04:41:57 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-f446a326-8316-41d1-bd3a-21f44da92b54 tempest-VolumesListAdminTestJSON-529731424 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-46fdc644-bc3e-4969-8e1e-6f54bec4f9b9 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:41:57 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-d479b390-4671-43a9-99cd-32e8124da1f2 tempest-VolumesListAdminTestJSON-1558846114 None] Acquiring lock "cinder-ca67c661-fa73-4f3f-9618-d326aab3b21d-delete_volume" by "delete_volume" {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 04:41:57 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-d479b390-4671-43a9-99cd-32e8124da1f2 tempest-VolumesListAdminTestJSON-1558846114 None] Lock "cinder-ca67c661-fa73-4f3f-9618-d326aab3b21d-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 04:41:57 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-d479b390-4671-43a9-99cd-32e8124da1f2 tempest-VolumesListAdminTestJSON-1558846114 None] Acquiring lock "cinder-quobyte-ca67c661-fa73-4f3f-9618-d326aab3b21d" by "delete_volume" {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 04:41:57 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-d479b390-4671-43a9-99cd-32e8124da1f2 tempest-VolumesListAdminTestJSON-1558846114 None] Lock "cinder-quobyte-ca67c661-fa73-4f3f-9618-d326aab3b21d" acquired by "delete_volume" :: waited 0.033s {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 04:41:57 devstack sudo[96654]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-46fdc644-bc3e-4969-8e1e-6f54bec4f9b9 Jul 10 04:41:57 devstack sudo[96654]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:41:57 devstack cinder-volume[87444]: DEBUG oslo.privsep.daemon [-] privsep: reply[44a4ed4c-aa80-4053-8646-d699c7344a41]: (4, 'qcow2') {{(pid=88499) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 04:41:57 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-d479b390-4671-43a9-99cd-32e8124da1f2 tempest-VolumesListAdminTestJSON-1558846114 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-ca67c661-fa73-4f3f-9618-d326aab3b21d {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:41:58 devstack sudo[96656]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-ca67c661-fa73-4f3f-9618-d326aab3b21d Jul 10 04:41:58 devstack sudo[96656]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:41:58 devstack sudo[96650]: pam_unix(sudo:session): session closed for user root Jul 10 04:41:58 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-4542d92b-2221-4f72-91d1-328df7105f08 tempest-VolumesImageMetadata-1791203028 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_5ac2ee4b-64bc-499a-b553-ae96ba343fc0_95xrxidzdevstack@QuobyteHD" returned: 0 in 1.090s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:41:58 devstack cinder-volume[87444]: DEBUG cinder.image.image_utils [None req-4542d92b-2221-4f72-91d1-328df7105f08 tempest-VolumesImageMetadata-1791203028 None] 5ac2ee4b-64bc-499a-b553-ae96ba343fc0 was qcow2, converting to raw {{(pid=87444) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1153}} Jul 10 04:41:58 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-4542d92b-2221-4f72-91d1-328df7105f08 tempest-VolumesImageMetadata-1791203028 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_5ac2ee4b-64bc-499a-b553-ae96ba343fc0_95xrxidzdevstack@QuobyteHD /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-d17a35d7-0961-4ac4-9d8b-639864f18312 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:41:58 devstack sudo[96662]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_5ac2ee4b-64bc-499a-b553-ae96ba343fc0_95xrxidzdevstack@QuobyteHD /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-d17a35d7-0961-4ac4-9d8b-639864f18312 Jul 10 04:41:58 devstack sudo[96662]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:41:58 devstack sudo[96652]: pam_unix(sudo:session): session closed for user root Jul 10 04:41:58 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-3bbfff03-018a-4293-8a75-ed7b8ab23e23 tempest-VolumesSnapshotTestJSON-1690897005 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-80504d94-f520-4b4a-bf04-620bfa5f2b42.3862dff9-3f00-4305-a09e-50ab1b1f1122" returned: 0 in 1.246s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:41:58 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.remotefs [None req-3bbfff03-018a-4293-8a75-ed7b8ab23e23 tempest-VolumesSnapshotTestJSON-1690897005 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-80504d94-f520-4b4a-bf04-620bfa5f2b42(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87444) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 10 04:41:58 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-3bbfff03-018a-4293-8a75-ed7b8ab23e23 tempest-VolumesSnapshotTestJSON-1690897005 None] will copy from snapshot at /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-80504d94-f520-4b4a-bf04-620bfa5f2b42 {{(pid=87444) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jul 10 04:41:58 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-3bbfff03-018a-4293-8a75-ed7b8ab23e23 tempest-VolumesSnapshotTestJSON-1690897005 None] Creating direct copy from snapshot {{(pid=87444) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jul 10 04:41:58 devstack cinder-volume[87444]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec528ed9-196c-45aa-ad53-210a8549b186]: (4, 'qcow2') {{(pid=88499) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 04:41:58 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-3bbfff03-018a-4293-8a75-ed7b8ab23e23 tempest-VolumesSnapshotTestJSON-1690897005 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-80504d94-f520-4b4a-bf04-620bfa5f2b42 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:41:58 devstack sudo[96654]: pam_unix(sudo:session): session closed for user root Jul 10 04:41:58 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-f446a326-8316-41d1-bd3a-21f44da92b54 tempest-VolumesListAdminTestJSON-529731424 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-46fdc644-bc3e-4969-8e1e-6f54bec4f9b9" returned: 0 in 1.041s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:41:58 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-f446a326-8316-41d1-bd3a-21f44da92b54 tempest-VolumesListAdminTestJSON-529731424 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-46fdc644-bc3e-4969-8e1e-6f54bec4f9b9 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:41:58 devstack sudo[96671]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-46fdc644-bc3e-4969-8e1e-6f54bec4f9b9 Jul 10 04:41:58 devstack sudo[96671]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:41:58 devstack sudo[96670]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-80504d94-f520-4b4a-bf04-620bfa5f2b42 Jul 10 04:41:58 devstack sudo[96670]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:41:59 devstack sudo[96656]: pam_unix(sudo:session): session closed for user root Jul 10 04:41:59 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-d479b390-4671-43a9-99cd-32e8124da1f2 tempest-VolumesListAdminTestJSON-1558846114 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-ca67c661-fa73-4f3f-9618-d326aab3b21d" returned: 0 in 1.161s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:41:59 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-d479b390-4671-43a9-99cd-32e8124da1f2 tempest-VolumesListAdminTestJSON-1558846114 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-ca67c661-fa73-4f3f-9618-d326aab3b21d {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:41:59 devstack sudo[96677]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-ca67c661-fa73-4f3f-9618-d326aab3b21d Jul 10 04:41:59 devstack sudo[96677]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:41:59 devstack sudo[96671]: pam_unix(sudo:session): session closed for user root Jul 10 04:41:59 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-f446a326-8316-41d1-bd3a-21f44da92b54 tempest-VolumesListAdminTestJSON-529731424 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-46fdc644-bc3e-4969-8e1e-6f54bec4f9b9" returned: 0 in 1.091s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:41:59 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-f446a326-8316-41d1-bd3a-21f44da92b54 tempest-VolumesListAdminTestJSON-529731424 None] Lock "cinder-quobyte-46fdc644-bc3e-4969-8e1e-6f54bec4f9b9" released by "delete_volume" :: held 2.217s {{(pid=87444) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 04:41:59 devstack sudo[96677]: pam_unix(sudo:session): session closed for user root Jul 10 04:41:59 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-d479b390-4671-43a9-99cd-32e8124da1f2 tempest-VolumesListAdminTestJSON-1558846114 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-ca67c661-fa73-4f3f-9618-d326aab3b21d" returned: 0 in 0.840s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:41:59 devstack sudo[96670]: pam_unix(sudo:session): session closed for user root Jul 10 04:41:59 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-3bbfff03-018a-4293-8a75-ed7b8ab23e23 tempest-VolumesSnapshotTestJSON-1690897005 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-80504d94-f520-4b4a-bf04-620bfa5f2b42" returned: 0 in 1.195s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:41:59 devstack cinder-volume[87444]: DEBUG cinder.utils [None req-3bbfff03-018a-4293-8a75-ed7b8ab23e23 tempest-VolumesSnapshotTestJSON-1690897005 None] Path /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-faf4712f-a297-40ad-a21a-3936e635088a not found in is_blk_device check {{(pid=87444) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 10 04:41:59 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-3bbfff03-018a-4293-8a75-ed7b8ab23e23 tempest-VolumesSnapshotTestJSON-1690897005 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-80504d94-f520-4b4a-bf04-620bfa5f2b42 /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-faf4712f-a297-40ad-a21a-3936e635088a {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:41:59 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-d479b390-4671-43a9-99cd-32e8124da1f2 tempest-VolumesListAdminTestJSON-1558846114 None] Lock "cinder-quobyte-ca67c661-fa73-4f3f-9618-d326aab3b21d" released by "delete_volume" :: held 2.078s {{(pid=87444) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 04:42:00 devstack sudo[96691]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-80504d94-f520-4b4a-bf04-620bfa5f2b42 /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-faf4712f-a297-40ad-a21a-3936e635088a Jul 10 04:42:00 devstack sudo[96691]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:42:00 devstack cinder-volume[87444]: DEBUG cinder.quota [None req-f446a326-8316-41d1-bd3a-21f44da92b54 tempest-VolumesListAdminTestJSON-529731424 None] Created reservations ['56227896-f1a8-47b7-b8d7-e32d96481b89', '5889dce0-d357-49f1-9267-5829a27c4b74', '17b6ce78-7896-406f-b872-1ec6099161b7', 'af56f9dd-78fc-45ea-911a-ad7f69050637'] {{(pid=87444) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 04:42:00 devstack cinder-volume[87444]: DEBUG cinder.quota [None req-d479b390-4671-43a9-99cd-32e8124da1f2 tempest-VolumesListAdminTestJSON-1558846114 None] Created reservations ['cda2bf67-f74f-4ac2-acd3-40283e0308e7', 'e754c2e1-b508-4ae5-bf71-bd8af236d998', 'fda684af-a26c-4367-a61a-d8d8b842ae1b', '8571cbd1-ef45-4b04-aaa0-6bfe93e2f02d'] {{(pid=87444) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 04:42:00 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-f446a326-8316-41d1-bd3a-21f44da92b54 tempest-VolumesListAdminTestJSON-529731424 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 04:42:00 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-f446a326-8316-41d1-bd3a-21f44da92b54 tempest-VolumesListAdminTestJSON-529731424 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 04:42:00 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-f446a326-8316-41d1-bd3a-21f44da92b54 tempest-VolumesListAdminTestJSON-529731424 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922': None} {{(pid=87444) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 04:42:00 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-f446a326-8316-41d1-bd3a-21f44da92b54 tempest-VolumesListAdminTestJSON-529731424 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922'] {{(pid=87444) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 04:42:00 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-f446a326-8316-41d1-bd3a-21f44da92b54 tempest-VolumesListAdminTestJSON-529731424 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 04:42:00 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-f446a326-8316-41d1-bd3a-21f44da92b54 tempest-VolumesListAdminTestJSON-529731424 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:42:00 devstack sudo[96693]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097 Jul 10 04:42:00 devstack sudo[96693]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:42:00 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-d479b390-4671-43a9-99cd-32e8124da1f2 tempest-VolumesListAdminTestJSON-1558846114 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 04:42:00 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-d479b390-4671-43a9-99cd-32e8124da1f2 tempest-VolumesListAdminTestJSON-1558846114 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 04:42:00 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-d479b390-4671-43a9-99cd-32e8124da1f2 tempest-VolumesListAdminTestJSON-1558846114 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922': None} {{(pid=87444) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 04:42:00 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-d479b390-4671-43a9-99cd-32e8124da1f2 tempest-VolumesListAdminTestJSON-1558846114 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922'] {{(pid=87444) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 04:42:00 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-d479b390-4671-43a9-99cd-32e8124da1f2 tempest-VolumesListAdminTestJSON-1558846114 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 04:42:00 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-d479b390-4671-43a9-99cd-32e8124da1f2 tempest-VolumesListAdminTestJSON-1558846114 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:42:00 devstack sudo[96695]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097 Jul 10 04:42:00 devstack sudo[96695]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:42:00 devstack sudo[96693]: pam_unix(sudo:session): session closed for user root Jul 10 04:42:00 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-f446a326-8316-41d1-bd3a-21f44da92b54 tempest-VolumesListAdminTestJSON-529731424 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097" returned: 0 in 0.826s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:42:00 devstack cinder-volume[87444]: DEBUG cinder.manager [None req-f446a326-8316-41d1-bd3a-21f44da92b54 tempest-VolumesListAdminTestJSON-529731424 None] Notifying Schedulers of capabilities ... {{(pid=87444) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 04:42:01 devstack cinder-volume[87444]: INFO cinder.volume.manager [None req-f446a326-8316-41d1-bd3a-21f44da92b54 tempest-VolumesListAdminTestJSON-529731424 None] Deleted volume successfully. Jul 10 04:42:01 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-f446a326-8316-41d1-bd3a-21f44da92b54 tempest-VolumesListAdminTestJSON-529731424 None] Lock "cinder-46fdc644-bc3e-4969-8e1e-6f54bec4f9b9-delete_volume" released by "delete_volume" :: held 3.427s {{(pid=87444) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 04:42:01 devstack sudo[96662]: pam_unix(sudo:session): session closed for user root Jul 10 04:42:01 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-4542d92b-2221-4f72-91d1-328df7105f08 tempest-VolumesImageMetadata-1791203028 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_5ac2ee4b-64bc-499a-b553-ae96ba343fc0_95xrxidzdevstack@QuobyteHD /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-d17a35d7-0961-4ac4-9d8b-639864f18312" returned: 0 in 2.812s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:42:01 devstack cinder-volume[87444]: DEBUG cinder.image.image_utils [None req-4542d92b-2221-4f72-91d1-328df7105f08 tempest-VolumesImageMetadata-1791203028 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_5ac2ee4b-64bc-499a-b553-ae96ba343fc0_95xrxidzdevstack@QuobyteHD, size 112.00 MB, duration 2.81 sec, destination /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-d17a35d7-0961-4ac4-9d8b-639864f18312 {{(pid=87444) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:561}} Jul 10 04:42:01 devstack cinder-volume[87444]: INFO cinder.image.image_utils [None req-4542d92b-2221-4f72-91d1-328df7105f08 tempest-VolumesImageMetadata-1791203028 None] Converted 112.00 MB image at 39.81 MB/s Jul 10 04:42:01 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-4542d92b-2221-4f72-91d1-328df7105f08 tempest-VolumesImageMetadata-1791203028 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-d17a35d7-0961-4ac4-9d8b-639864f18312 1G {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:42:01 devstack sudo[96708]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-d17a35d7-0961-4ac4-9d8b-639864f18312 1G Jul 10 04:42:01 devstack sudo[96708]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:42:01 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-b9adb83a-1540-4309-9614-adf74694d8cf tempest-VolumesListAdminTestJSON-1558846114 None] Acquiring lock "cinder-3a1593fc-1974-4696-97cc-d97ea48c1e79-delete_volume" by "delete_volume" {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 04:42:01 devstack sudo[96695]: pam_unix(sudo:session): session closed for user root Jul 10 04:42:01 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-d479b390-4671-43a9-99cd-32e8124da1f2 tempest-VolumesListAdminTestJSON-1558846114 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097" returned: 0 in 1.337s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:42:01 devstack cinder-volume[87444]: DEBUG cinder.manager [None req-d479b390-4671-43a9-99cd-32e8124da1f2 tempest-VolumesListAdminTestJSON-1558846114 None] Notifying Schedulers of capabilities ... {{(pid=87444) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 04:42:01 devstack cinder-volume[87444]: INFO cinder.volume.manager [None req-d479b390-4671-43a9-99cd-32e8124da1f2 tempest-VolumesListAdminTestJSON-1558846114 None] Deleted volume successfully. Jul 10 04:42:01 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-b9adb83a-1540-4309-9614-adf74694d8cf tempest-VolumesListAdminTestJSON-1558846114 None] Lock "cinder-3a1593fc-1974-4696-97cc-d97ea48c1e79-delete_volume" acquired by "delete_volume" :: waited 0.102s {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 04:42:01 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-d479b390-4671-43a9-99cd-32e8124da1f2 tempest-VolumesListAdminTestJSON-1558846114 None] Lock "cinder-ca67c661-fa73-4f3f-9618-d326aab3b21d-delete_volume" released by "delete_volume" :: held 3.883s {{(pid=87444) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 04:42:01 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-b9adb83a-1540-4309-9614-adf74694d8cf tempest-VolumesListAdminTestJSON-1558846114 None] Acquiring lock "cinder-quobyte-3a1593fc-1974-4696-97cc-d97ea48c1e79" by "delete_volume" {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 04:42:01 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-b9adb83a-1540-4309-9614-adf74694d8cf tempest-VolumesListAdminTestJSON-1558846114 None] Lock "cinder-quobyte-3a1593fc-1974-4696-97cc-d97ea48c1e79" acquired by "delete_volume" :: waited 0.041s {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 04:42:01 devstack cinder-volume[87444]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a7d5a25-abe9-4ba1-bf2c-694c057b85f5]: (4, 'qcow2') {{(pid=88499) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 04:42:01 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-b9adb83a-1540-4309-9614-adf74694d8cf tempest-VolumesListAdminTestJSON-1558846114 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-3a1593fc-1974-4696-97cc-d97ea48c1e79 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:42:02 devstack sudo[96711]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-3a1593fc-1974-4696-97cc-d97ea48c1e79 Jul 10 04:42:02 devstack sudo[96711]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:42:03 devstack cinder-volume[87444]: DEBUG cinder.volume.flows.manager.create_volume [None req-8b7fe78d-a910-47b0-83fb-837da9f6f525 tempest-VolumesDeleteCascade-473852886 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87444) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 04:42:03 devstack sudo[96708]: pam_unix(sudo:session): session closed for user root Jul 10 04:42:03 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-8b7fe78d-a910-47b0-83fb-837da9f6f525 tempest-VolumesDeleteCascade-473852886 None] Flow 'volume_create_manager' (e379087a-ca55-464a-bb50-d5d7264dd77d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 04:42:03 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-8b7fe78d-a910-47b0-83fb-837da9f6f525 tempest-VolumesDeleteCascade-473852886 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (831ef1ae-05b4-4426-bda1-d846e2909ccb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:42:03 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-4542d92b-2221-4f72-91d1-328df7105f08 tempest-VolumesImageMetadata-1791203028 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-d17a35d7-0961-4ac4-9d8b-639864f18312 1G" returned: 0 in 2.179s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:42:03 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-8b7fe78d-a910-47b0-83fb-837da9f6f525 tempest-VolumesDeleteCascade-473852886 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (831ef1ae-05b4-4426-bda1-d846e2909ccb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T02:42:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1381977828',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d9b19f8d-96d4-4eda-8c15-b3f878386b7b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1d1db54813084886981e0b7d83441a9a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T02:42:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T02:42:03Z,use_quota=True,user_id='5631bee5216c42c2b47ceda43dfb6a55',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(317e369e-1e06-434d-ae95-a335f0e6c903),volume_type_id=317e369e-1e06-434d-ae95-a335f0e6c903)' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:42:03 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-8b7fe78d-a910-47b0-83fb-837da9f6f525 tempest-VolumesDeleteCascade-473852886 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8d738865-c436-49f5-b646-96d44a84ccbc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:42:03 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-8b7fe78d-a910-47b0-83fb-837da9f6f525 tempest-VolumesDeleteCascade-473852886 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8d738865-c436-49f5-b646-96d44a84ccbc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:42:03 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-8b7fe78d-a910-47b0-83fb-837da9f6f525 tempest-VolumesDeleteCascade-473852886 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5c1f479e-5f91-4d2e-b8cf-89128313aafc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:42:03 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-8b7fe78d-a910-47b0-83fb-837da9f6f525 tempest-VolumesDeleteCascade-473852886 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5c1f479e-5f91-4d2e-b8cf-89128313aafc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd9b19f8d-96d4-4eda-8c15-b3f878386b7b', 'volume_name': 'volume-d9b19f8d-96d4-4eda-8c15-b3f878386b7b', 'volume_size': 1}' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:42:03 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-8b7fe78d-a910-47b0-83fb-837da9f6f525 tempest-VolumesDeleteCascade-473852886 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (351690de-549a-4060-9a99-bda18129014b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:42:03 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-8b7fe78d-a910-47b0-83fb-837da9f6f525 tempest-VolumesDeleteCascade-473852886 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (351690de-549a-4060-9a99-bda18129014b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:42:03 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-8b7fe78d-a910-47b0-83fb-837da9f6f525 tempest-VolumesDeleteCascade-473852886 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (83e18fc2-51c7-4f9d-967d-a884daa59e98) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:42:03 devstack cinder-volume[87444]: INFO cinder.volume.flows.manager.create_volume [None req-8b7fe78d-a910-47b0-83fb-837da9f6f525 tempest-VolumesDeleteCascade-473852886 None] Volume d9b19f8d-96d4-4eda-8c15-b3f878386b7b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d9b19f8d-96d4-4eda-8c15-b3f878386b7b', 'volume_size': 1} Jul 10 04:42:03 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-8b7fe78d-a910-47b0-83fb-837da9f6f525 tempest-VolumesDeleteCascade-473852886 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 04:42:03 devstack cinder-volume[87444]: DEBUG oslo.privsep.daemon [-] privsep: reply[96c921f5-d00f-4e98-abc7-703978a395e6]: (4, 'raw') {{(pid=88499) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 04:42:03 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-4542d92b-2221-4f72-91d1-328df7105f08 tempest-VolumesImageMetadata-1791203028 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-d17a35d7-0961-4ac4-9d8b-639864f18312 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:42:03 devstack sudo[96720]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-d17a35d7-0961-4ac4-9d8b-639864f18312 Jul 10 04:42:03 devstack sudo[96720]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:42:04 devstack sudo[96711]: pam_unix(sudo:session): session closed for user root Jul 10 04:42:04 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-b9adb83a-1540-4309-9614-adf74694d8cf tempest-VolumesListAdminTestJSON-1558846114 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-3a1593fc-1974-4696-97cc-d97ea48c1e79" returned: 0 in 2.383s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:42:04 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-b9adb83a-1540-4309-9614-adf74694d8cf tempest-VolumesListAdminTestJSON-1558846114 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-3a1593fc-1974-4696-97cc-d97ea48c1e79 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:42:04 devstack sudo[96725]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-3a1593fc-1974-4696-97cc-d97ea48c1e79 Jul 10 04:42:04 devstack sudo[96725]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:42:05 devstack sudo[96720]: pam_unix(sudo:session): session closed for user root Jul 10 04:42:05 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-4542d92b-2221-4f72-91d1-328df7105f08 tempest-VolumesImageMetadata-1791203028 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-d17a35d7-0961-4ac4-9d8b-639864f18312" returned: 0 in 1.666s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:42:05 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-4542d92b-2221-4f72-91d1-328df7105f08 tempest-VolumesImageMetadata-1791203028 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-d17a35d7-0961-4ac4-9d8b-639864f18312 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:42:05 devstack sudo[96729]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-d17a35d7-0961-4ac4-9d8b-639864f18312 Jul 10 04:42:05 devstack sudo[96729]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:42:05 devstack sudo[96725]: pam_unix(sudo:session): session closed for user root Jul 10 04:42:05 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-b9adb83a-1540-4309-9614-adf74694d8cf tempest-VolumesListAdminTestJSON-1558846114 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-3a1593fc-1974-4696-97cc-d97ea48c1e79" returned: 0 in 1.533s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:42:05 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-b9adb83a-1540-4309-9614-adf74694d8cf tempest-VolumesListAdminTestJSON-1558846114 None] Lock "cinder-quobyte-3a1593fc-1974-4696-97cc-d97ea48c1e79" released by "delete_volume" :: held 4.036s {{(pid=87444) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 04:42:05 devstack cinder-volume[87444]: DEBUG cinder.quota [None req-b9adb83a-1540-4309-9614-adf74694d8cf tempest-VolumesListAdminTestJSON-1558846114 None] Created reservations ['eaa19193-deab-4875-ad5a-65653c4ca1bf', '85815911-b346-4711-ae3f-49d0de180112', '5a488fe9-30ca-4256-9af4-61ad2a975771', '4ed71aa3-f79d-4224-bd0f-3a6fa15ab06f'] {{(pid=87444) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 04:42:06 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-b9adb83a-1540-4309-9614-adf74694d8cf tempest-VolumesListAdminTestJSON-1558846114 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 04:42:06 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-b9adb83a-1540-4309-9614-adf74694d8cf tempest-VolumesListAdminTestJSON-1558846114 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 04:42:06 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-b9adb83a-1540-4309-9614-adf74694d8cf tempest-VolumesListAdminTestJSON-1558846114 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922': None} {{(pid=87444) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 04:42:06 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-b9adb83a-1540-4309-9614-adf74694d8cf tempest-VolumesListAdminTestJSON-1558846114 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922'] {{(pid=87444) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 04:42:06 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-b9adb83a-1540-4309-9614-adf74694d8cf tempest-VolumesListAdminTestJSON-1558846114 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 04:42:06 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-b9adb83a-1540-4309-9614-adf74694d8cf tempest-VolumesListAdminTestJSON-1558846114 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:42:06 devstack sudo[96732]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097 Jul 10 04:42:06 devstack sudo[96732]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:42:06 devstack sudo[96691]: pam_unix(sudo:session): session closed for user root Jul 10 04:42:06 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-3bbfff03-018a-4293-8a75-ed7b8ab23e23 tempest-VolumesSnapshotTestJSON-1690897005 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-80504d94-f520-4b4a-bf04-620bfa5f2b42 /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-faf4712f-a297-40ad-a21a-3936e635088a" returned: 0 in 6.131s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:42:06 devstack cinder-volume[87444]: DEBUG oslo.privsep.daemon [-] privsep: reply[39133330-a4c2-455c-8cd3-9448b7a91e69]: (4, 'qcow2') {{(pid=88499) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 04:42:06 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-3bbfff03-018a-4293-8a75-ed7b8ab23e23 tempest-VolumesSnapshotTestJSON-1690897005 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-80504d94-f520-4b4a-bf04-620bfa5f2b42 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:42:06 devstack sudo[96734]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-80504d94-f520-4b4a-bf04-620bfa5f2b42 Jul 10 04:42:06 devstack sudo[96734]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:42:06 devstack sudo[96729]: pam_unix(sudo:session): session closed for user root Jul 10 04:42:06 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-b733c329-cf71-42fa-8fc4-a0f8d73cf784 tempest-VolumesListAdminTestJSON-1558846114 None] Acquiring lock "cinder-73477818-c1f6-4c83-9fcc-b44bc2510d0d-delete_volume" by "delete_volume" {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 04:42:06 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-4542d92b-2221-4f72-91d1-328df7105f08 tempest-VolumesImageMetadata-1791203028 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-d17a35d7-0961-4ac4-9d8b-639864f18312" returned: 1 in 1.255s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:42:06 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-4542d92b-2221-4f72-91d1-328df7105f08 tempest-VolumesImageMetadata-1791203028 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-d17a35d7-0961-4ac4-9d8b-639864f18312' failed. Not Retrying. {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 10 04:42:06 devstack cinder-volume[87444]: DEBUG cinder.volume.volume_utils [None req-4542d92b-2221-4f72-91d1-328df7105f08 tempest-VolumesImageMetadata-1791203028 None] Downloaded image 5ac2ee4b-64bc-499a-b553-ae96ba343fc0 ((None, [{'url': 'file:///opt/stack/data/glance/images/5ac2ee4b-64bc-499a-b553-ae96ba343fc0', 'metadata': {}}])) to volume d17a35d7-0961-4ac4-9d8b-639864f18312 successfully. {{(pid=87444) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jul 10 04:42:06 devstack cinder-volume[87444]: DEBUG cinder.image.image_utils [None req-4542d92b-2221-4f72-91d1-328df7105f08 tempest-VolumesImageMetadata-1791203028 None] Temporary image 5ac2ee4b-64bc-499a-b553-ae96ba343fc0 for user 19dbf4519b42410da43dd6fdcd44b58e is deleted. {{(pid=87444) fetch /opt/stack/cinder/cinder/image/image_utils.py:1468}} Jul 10 04:42:06 devstack cinder-volume[87444]: DEBUG cinder.volume.volume_utils [None req-4542d92b-2221-4f72-91d1-328df7105f08 tempest-VolumesImageMetadata-1791203028 None] Marking volume d17a35d7-0961-4ac4-9d8b-639864f18312 as bootable. {{(pid=87444) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jul 10 04:42:06 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-b733c329-cf71-42fa-8fc4-a0f8d73cf784 tempest-VolumesListAdminTestJSON-1558846114 None] Lock "cinder-73477818-c1f6-4c83-9fcc-b44bc2510d0d-delete_volume" acquired by "delete_volume" :: waited 0.043s {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 04:42:06 devstack cinder-volume[87444]: DEBUG cinder.volume.flows.manager.create_volume [None req-4542d92b-2221-4f72-91d1-328df7105f08 tempest-VolumesImageMetadata-1791203028 None] Copying metadata from image 5ac2ee4b-64bc-499a-b553-ae96ba343fc0 to d17a35d7-0961-4ac4-9d8b-639864f18312. {{(pid=87444) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jul 10 04:42:06 devstack cinder-volume[87444]: DEBUG cinder.volume.flows.manager.create_volume [None req-4542d92b-2221-4f72-91d1-328df7105f08 tempest-VolumesImageMetadata-1791203028 None] Creating volume glance metadata for volume d17a35d7-0961-4ac4-9d8b-639864f18312 backed by image 5ac2ee4b-64bc-499a-b553-ae96ba343fc0 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '5ac2ee4b-64bc-499a-b553-ae96ba343fc0', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=87444) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jul 10 04:42:06 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-b733c329-cf71-42fa-8fc4-a0f8d73cf784 tempest-VolumesListAdminTestJSON-1558846114 None] Acquiring lock "cinder-quobyte-73477818-c1f6-4c83-9fcc-b44bc2510d0d" by "delete_volume" {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 04:42:06 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-b733c329-cf71-42fa-8fc4-a0f8d73cf784 tempest-VolumesListAdminTestJSON-1558846114 None] Lock "cinder-quobyte-73477818-c1f6-4c83-9fcc-b44bc2510d0d" acquired by "delete_volume" :: waited 0.029s {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 04:42:06 devstack cinder-volume[87444]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec880ac0-e486-4be4-a3b6-91ea5692d034]: (4, 'qcow2') {{(pid=88499) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 04:42:06 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-b733c329-cf71-42fa-8fc4-a0f8d73cf784 tempest-VolumesListAdminTestJSON-1558846114 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-73477818-c1f6-4c83-9fcc-b44bc2510d0d {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:42:06 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-4542d92b-2221-4f72-91d1-328df7105f08 tempest-VolumesImageMetadata-1791203028 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ba70f6e4-3cfd-420b-8865-34624acbe335) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d17a35d7-0961-4ac4-9d8b-639864f18312', 'volume_size': 1, 'image_id': '5ac2ee4b-64bc-499a-b553-ae96ba343fc0', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/5ac2ee4b-64bc-499a-b553-ae96ba343fc0', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'ca4bb946b593473194351a84617cf92e', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '5ac2ee4b-64bc-499a-b553-ae96ba343fc0', 'created_at': datetime.datetime(2026, 7, 10, 2, 26, 36, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 10, 2, 26, 38, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/5ac2ee4b-64bc-499a-b553-ae96ba343fc0/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:42:06 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-4542d92b-2221-4f72-91d1-328df7105f08 tempest-VolumesImageMetadata-1791203028 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e94d2718-86ce-4592-bb4a-26ae7ab590f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:42:06 devstack cinder-volume[87444]: INFO cinder.volume.flows.manager.create_volume [None req-4542d92b-2221-4f72-91d1-328df7105f08 tempest-VolumesImageMetadata-1791203028 None] Volume volume-d17a35d7-0961-4ac4-9d8b-639864f18312 (d17a35d7-0961-4ac4-9d8b-639864f18312): created successfully Jul 10 04:42:06 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-4542d92b-2221-4f72-91d1-328df7105f08 tempest-VolumesImageMetadata-1791203028 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e94d2718-86ce-4592-bb4a-26ae7ab590f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:42:06 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-4542d92b-2221-4f72-91d1-328df7105f08 tempest-VolumesImageMetadata-1791203028 None] Flow 'volume_create_manager' (0d51f58d-2f7c-4c53-be30-a398520c1b9d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87444) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 04:42:06 devstack cinder-volume[87444]: INFO cinder.volume.manager [None req-4542d92b-2221-4f72-91d1-328df7105f08 tempest-VolumesImageMetadata-1791203028 None] Created volume successfully. Jul 10 04:42:06 devstack sudo[96739]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-73477818-c1f6-4c83-9fcc-b44bc2510d0d Jul 10 04:42:06 devstack sudo[96739]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:42:06 devstack sudo[96732]: pam_unix(sudo:session): session closed for user root Jul 10 04:42:06 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-b9adb83a-1540-4309-9614-adf74694d8cf tempest-VolumesListAdminTestJSON-1558846114 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097" returned: 0 in 0.820s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:42:06 devstack cinder-volume[87444]: DEBUG cinder.manager [None req-b9adb83a-1540-4309-9614-adf74694d8cf tempest-VolumesListAdminTestJSON-1558846114 None] Notifying Schedulers of capabilities ... {{(pid=87444) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 04:42:06 devstack cinder-volume[87444]: INFO cinder.volume.manager [None req-b9adb83a-1540-4309-9614-adf74694d8cf tempest-VolumesListAdminTestJSON-1558846114 None] Deleted volume successfully. Jul 10 04:42:06 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-b9adb83a-1540-4309-9614-adf74694d8cf tempest-VolumesListAdminTestJSON-1558846114 None] Lock "cinder-3a1593fc-1974-4696-97cc-d97ea48c1e79-delete_volume" released by "delete_volume" :: held 5.278s {{(pid=87444) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 04:42:07 devstack sudo[96734]: pam_unix(sudo:session): session closed for user root Jul 10 04:42:07 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-1d3e71ed-5266-487a-aee6-b1731e56f8d3 tempest-VolumesImageMetadata-1791203028 None] Acquiring lock "cinder-d17a35d7-0961-4ac4-9d8b-639864f18312-delete_volume" by "delete_volume" {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 04:42:07 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-3bbfff03-018a-4293-8a75-ed7b8ab23e23 tempest-VolumesSnapshotTestJSON-1690897005 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-80504d94-f520-4b4a-bf04-620bfa5f2b42" returned: 0 in 1.075s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:42:07 devstack cinder-volume[87444]: DEBUG cinder.image.image_utils [None req-3bbfff03-018a-4293-8a75-ed7b8ab23e23 tempest-VolumesSnapshotTestJSON-1690897005 None] Image conversion details: src /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-80504d94-f520-4b4a-bf04-620bfa5f2b42, size 1024.00 MB, duration 6.13 sec, destination /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-faf4712f-a297-40ad-a21a-3936e635088a {{(pid=87444) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:561}} Jul 10 04:42:07 devstack cinder-volume[87444]: INFO cinder.image.image_utils [None req-3bbfff03-018a-4293-8a75-ed7b8ab23e23 tempest-VolumesSnapshotTestJSON-1690897005 None] Converted 1024.00 MB image at 166.97 MB/s Jul 10 04:42:07 devstack cinder-volume[87444]: WARNING cinder.volume.drivers.remotefs [None req-3bbfff03-018a-4293-8a75-ed7b8ab23e23 tempest-VolumesSnapshotTestJSON-1690897005 None] /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-faf4712f-a297-40ad-a21a-3936e635088a is being set with open permissions: ugo+rw Jul 10 04:42:07 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-3bbfff03-018a-4293-8a75-ed7b8ab23e23 tempest-VolumesSnapshotTestJSON-1690897005 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-faf4712f-a297-40ad-a21a-3936e635088a {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:42:07 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-1d3e71ed-5266-487a-aee6-b1731e56f8d3 tempest-VolumesImageMetadata-1791203028 None] Lock "cinder-d17a35d7-0961-4ac4-9d8b-639864f18312-delete_volume" acquired by "delete_volume" :: waited 0.053s {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 04:42:07 devstack sudo[96746]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-faf4712f-a297-40ad-a21a-3936e635088a Jul 10 04:42:07 devstack sudo[96746]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:42:07 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-1d3e71ed-5266-487a-aee6-b1731e56f8d3 tempest-VolumesImageMetadata-1791203028 None] Acquiring lock "cinder-quobyte-d17a35d7-0961-4ac4-9d8b-639864f18312" by "delete_volume" {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 04:42:07 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-1d3e71ed-5266-487a-aee6-b1731e56f8d3 tempest-VolumesImageMetadata-1791203028 None] Lock "cinder-quobyte-d17a35d7-0961-4ac4-9d8b-639864f18312" acquired by "delete_volume" :: waited 0.024s {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 04:42:07 devstack cinder-volume[87444]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9891c51-ba69-4fe3-8546-b298fd41ec2c]: (4, 'raw') {{(pid=88499) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 04:42:07 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-1d3e71ed-5266-487a-aee6-b1731e56f8d3 tempest-VolumesImageMetadata-1791203028 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-d17a35d7-0961-4ac4-9d8b-639864f18312 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:42:07 devstack sudo[96739]: pam_unix(sudo:session): session closed for user root Jul 10 04:42:07 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-b733c329-cf71-42fa-8fc4-a0f8d73cf784 tempest-VolumesListAdminTestJSON-1558846114 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-73477818-c1f6-4c83-9fcc-b44bc2510d0d" returned: 0 in 0.869s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:42:07 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-b733c329-cf71-42fa-8fc4-a0f8d73cf784 tempest-VolumesListAdminTestJSON-1558846114 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-73477818-c1f6-4c83-9fcc-b44bc2510d0d {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:42:07 devstack sudo[96751]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-d17a35d7-0961-4ac4-9d8b-639864f18312 Jul 10 04:42:07 devstack sudo[96751]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:42:07 devstack sudo[96753]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-73477818-c1f6-4c83-9fcc-b44bc2510d0d Jul 10 04:42:07 devstack sudo[96753]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:42:07 devstack sudo[96746]: pam_unix(sudo:session): session closed for user root Jul 10 04:42:07 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-3bbfff03-018a-4293-8a75-ed7b8ab23e23 tempest-VolumesSnapshotTestJSON-1690897005 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-faf4712f-a297-40ad-a21a-3936e635088a" returned: 0 in 0.711s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:42:07 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-3bbfff03-018a-4293-8a75-ed7b8ab23e23 tempest-VolumesSnapshotTestJSON-1690897005 None] Lock "cinder-quobyte-faf4712f-a297-40ad-a21a-3936e635088a" released by "_copy_volume_from_snapshot" :: held 10.582s {{(pid=87444) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 04:42:07 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-3bbfff03-018a-4293-8a75-ed7b8ab23e23 tempest-VolumesSnapshotTestJSON-1690897005 None] Lock "cinder-quobyte-3862dff9-3f00-4305-a09e-50ab1b1f1122-faf4712f-a297-40ad-a21a-3936e635088a" released by "_create_volume_from_snapshot" :: held 10.646s {{(pid=87444) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 04:42:07 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-3bbfff03-018a-4293-8a75-ed7b8ab23e23 tempest-VolumesSnapshotTestJSON-1690897005 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 10.696s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 04:42:07 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-8b7fe78d-a910-47b0-83fb-837da9f6f525 tempest-VolumesDeleteCascade-473852886 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.456s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 04:42:07 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-8b7fe78d-a910-47b0-83fb-837da9f6f525 tempest-VolumesDeleteCascade-473852886 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T02:42:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1381977828',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d9b19f8d-96d4-4eda-8c15-b3f878386b7b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1d1db54813084886981e0b7d83441a9a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T02:42:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T02:42:03Z,use_quota=True,user_id='5631bee5216c42c2b47ceda43dfb6a55',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(317e369e-1e06-434d-ae95-a335f0e6c903),volume_type_id=317e369e-1e06-434d-ae95-a335f0e6c903)}" {{(pid=87444) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 04:42:07 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.remotefs [None req-8b7fe78d-a910-47b0-83fb-837da9f6f525 tempest-VolumesDeleteCascade-473852886 None] Creating volume d9b19f8d-96d4-4eda-8c15-b3f878386b7b {{(pid=87444) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 04:42:07 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-8b7fe78d-a910-47b0-83fb-837da9f6f525 tempest-VolumesDeleteCascade-473852886 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 04:42:07 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-8b7fe78d-a910-47b0-83fb-837da9f6f525 tempest-VolumesDeleteCascade-473852886 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 04:42:07 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-8b7fe78d-a910-47b0-83fb-837da9f6f525 tempest-VolumesDeleteCascade-473852886 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922': None} {{(pid=87444) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 04:42:07 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-8b7fe78d-a910-47b0-83fb-837da9f6f525 tempest-VolumesDeleteCascade-473852886 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922'] {{(pid=87444) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 04:42:07 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-8b7fe78d-a910-47b0-83fb-837da9f6f525 tempest-VolumesDeleteCascade-473852886 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 04:42:07 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-8b7fe78d-a910-47b0-83fb-837da9f6f525 tempest-VolumesDeleteCascade-473852886 None] Selected osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922 as target Quobyte volume. {{(pid=87444) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 04:42:07 devstack cinder-volume[87444]: INFO cinder.volume.drivers.remotefs [None req-8b7fe78d-a910-47b0-83fb-837da9f6f525 tempest-VolumesDeleteCascade-473852886 None] casted to osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922 Jul 10 04:42:07 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-8b7fe78d-a910-47b0-83fb-837da9f6f525 tempest-VolumesDeleteCascade-473852886 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-d9b19f8d-96d4-4eda-8c15-b3f878386b7b 1073741824 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:42:07 devstack sudo[96756]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-d9b19f8d-96d4-4eda-8c15-b3f878386b7b 1073741824 Jul 10 04:42:07 devstack sudo[96756]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:42:08 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-3bbfff03-018a-4293-8a75-ed7b8ab23e23 tempest-VolumesSnapshotTestJSON-1690897005 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (304bf768-67d0-466d-9974-3dbdb04fcaae) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-faf4712f-a297-40ad-a21a-3936e635088a', 'volume_size': 2, 'snapshot_id': '3862dff9-3f00-4305-a09e-50ab1b1f1122'}' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:42:08 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-3bbfff03-018a-4293-8a75-ed7b8ab23e23 tempest-VolumesSnapshotTestJSON-1690897005 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fb7e6f44-add6-4c4a-aa94-37ac58e5fa14) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:42:08 devstack cinder-volume[87444]: INFO cinder.volume.flows.manager.create_volume [None req-3bbfff03-018a-4293-8a75-ed7b8ab23e23 tempest-VolumesSnapshotTestJSON-1690897005 None] Volume volume-faf4712f-a297-40ad-a21a-3936e635088a (faf4712f-a297-40ad-a21a-3936e635088a): created successfully Jul 10 04:42:08 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-3bbfff03-018a-4293-8a75-ed7b8ab23e23 tempest-VolumesSnapshotTestJSON-1690897005 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fb7e6f44-add6-4c4a-aa94-37ac58e5fa14) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:42:08 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-3bbfff03-018a-4293-8a75-ed7b8ab23e23 tempest-VolumesSnapshotTestJSON-1690897005 None] Flow 'volume_create_manager' (06dbcddf-e1a5-44b9-b02a-7a4f3840508a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87444) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 04:42:08 devstack cinder-volume[87444]: INFO cinder.volume.manager [None req-3bbfff03-018a-4293-8a75-ed7b8ab23e23 tempest-VolumesSnapshotTestJSON-1690897005 None] Created volume successfully. Jul 10 04:42:08 devstack sudo[96753]: pam_unix(sudo:session): session closed for user root Jul 10 04:42:08 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-b733c329-cf71-42fa-8fc4-a0f8d73cf784 tempest-VolumesListAdminTestJSON-1558846114 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-73477818-c1f6-4c83-9fcc-b44bc2510d0d" returned: 0 in 0.714s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:42:08 devstack sudo[96751]: pam_unix(sudo:session): session closed for user root Jul 10 04:42:08 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-1d3e71ed-5266-487a-aee6-b1731e56f8d3 tempest-VolumesImageMetadata-1791203028 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-d17a35d7-0961-4ac4-9d8b-639864f18312" returned: 0 in 0.834s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:42:08 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-1d3e71ed-5266-487a-aee6-b1731e56f8d3 tempest-VolumesImageMetadata-1791203028 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-d17a35d7-0961-4ac4-9d8b-639864f18312 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:42:08 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-b733c329-cf71-42fa-8fc4-a0f8d73cf784 tempest-VolumesListAdminTestJSON-1558846114 None] Lock "cinder-quobyte-73477818-c1f6-4c83-9fcc-b44bc2510d0d" released by "delete_volume" :: held 1.652s {{(pid=87444) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 04:42:08 devstack cinder-volume[87444]: DEBUG cinder.quota [None req-b733c329-cf71-42fa-8fc4-a0f8d73cf784 tempest-VolumesListAdminTestJSON-1558846114 None] Created reservations ['a8c7c1ef-15c9-4a93-830b-b831a0cdaba7', '1eb359cc-854a-41fc-94ca-d43e4a6c8b52', '5db9922b-efe4-4d4d-b5cd-28eddcb09127', '2c8b6005-9d0c-40c3-b91d-878908ed7fa1'] {{(pid=87444) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 04:42:08 devstack sudo[96761]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-d17a35d7-0961-4ac4-9d8b-639864f18312 Jul 10 04:42:08 devstack sudo[96761]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:42:08 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-b733c329-cf71-42fa-8fc4-a0f8d73cf784 tempest-VolumesListAdminTestJSON-1558846114 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 04:42:08 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-b733c329-cf71-42fa-8fc4-a0f8d73cf784 tempest-VolumesListAdminTestJSON-1558846114 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 04:42:08 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-b733c329-cf71-42fa-8fc4-a0f8d73cf784 tempest-VolumesListAdminTestJSON-1558846114 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922': None} {{(pid=87444) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 04:42:08 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-b733c329-cf71-42fa-8fc4-a0f8d73cf784 tempest-VolumesListAdminTestJSON-1558846114 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922'] {{(pid=87444) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 04:42:08 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-b733c329-cf71-42fa-8fc4-a0f8d73cf784 tempest-VolumesListAdminTestJSON-1558846114 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 04:42:08 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-b733c329-cf71-42fa-8fc4-a0f8d73cf784 tempest-VolumesListAdminTestJSON-1558846114 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:42:08 devstack sudo[96763]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097 Jul 10 04:42:08 devstack sudo[96763]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:42:09 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-f6321e01-e021-40eb-a376-cab933ef9333 tempest-VolumesSnapshotTestJSON-1690897005 None] Acquiring lock "cinder-faf4712f-a297-40ad-a21a-3936e635088a-delete_volume" by "delete_volume" {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 04:42:09 devstack sudo[96756]: pam_unix(sudo:session): session closed for user root Jul 10 04:42:09 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-8b7fe78d-a910-47b0-83fb-837da9f6f525 tempest-VolumesDeleteCascade-473852886 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-d9b19f8d-96d4-4eda-8c15-b3f878386b7b 1073741824" returned: 0 in 1.073s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:42:09 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-f6321e01-e021-40eb-a376-cab933ef9333 tempest-VolumesSnapshotTestJSON-1690897005 None] Lock "cinder-faf4712f-a297-40ad-a21a-3936e635088a-delete_volume" acquired by "delete_volume" :: waited 0.055s {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 04:42:09 devstack sudo[96761]: pam_unix(sudo:session): session closed for user root Jul 10 04:42:09 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-1d3e71ed-5266-487a-aee6-b1731e56f8d3 tempest-VolumesImageMetadata-1791203028 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-d17a35d7-0961-4ac4-9d8b-639864f18312" returned: 1 in 0.895s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:42:09 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-1d3e71ed-5266-487a-aee6-b1731e56f8d3 tempest-VolumesImageMetadata-1791203028 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-d17a35d7-0961-4ac4-9d8b-639864f18312' failed. Not Retrying. {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 10 04:42:09 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-1d3e71ed-5266-487a-aee6-b1731e56f8d3 tempest-VolumesImageMetadata-1791203028 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-d17a35d7-0961-4ac4-9d8b-639864f18312 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:42:09 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-8b7fe78d-a910-47b0-83fb-837da9f6f525 tempest-VolumesDeleteCascade-473852886 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-d9b19f8d-96d4-4eda-8c15-b3f878386b7b {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:42:09 devstack sudo[96772]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-d17a35d7-0961-4ac4-9d8b-639864f18312 Jul 10 04:42:09 devstack sudo[96772]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:42:09 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-f6321e01-e021-40eb-a376-cab933ef9333 tempest-VolumesSnapshotTestJSON-1690897005 None] Acquiring lock "cinder-quobyte-faf4712f-a297-40ad-a21a-3936e635088a" by "delete_volume" {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 04:42:09 devstack sudo[96773]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-d9b19f8d-96d4-4eda-8c15-b3f878386b7b Jul 10 04:42:09 devstack sudo[96773]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:42:09 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-f6321e01-e021-40eb-a376-cab933ef9333 tempest-VolumesSnapshotTestJSON-1690897005 None] Lock "cinder-quobyte-faf4712f-a297-40ad-a21a-3936e635088a" acquired by "delete_volume" :: waited 0.025s {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 04:42:09 devstack cinder-volume[87444]: DEBUG oslo.privsep.daemon [-] privsep: reply[88fa40ad-5dae-4986-8f62-d6cdf7e58c7b]: (4, 'qcow2') {{(pid=88499) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 04:42:09 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-f6321e01-e021-40eb-a376-cab933ef9333 tempest-VolumesSnapshotTestJSON-1690897005 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-faf4712f-a297-40ad-a21a-3936e635088a {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:42:09 devstack sudo[96763]: pam_unix(sudo:session): session closed for user root Jul 10 04:42:09 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-b733c329-cf71-42fa-8fc4-a0f8d73cf784 tempest-VolumesListAdminTestJSON-1558846114 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097" returned: 0 in 0.852s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:42:09 devstack cinder-volume[87444]: DEBUG cinder.manager [None req-b733c329-cf71-42fa-8fc4-a0f8d73cf784 tempest-VolumesListAdminTestJSON-1558846114 None] Notifying Schedulers of capabilities ... {{(pid=87444) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 04:42:09 devstack cinder-volume[87444]: INFO cinder.volume.manager [None req-b733c329-cf71-42fa-8fc4-a0f8d73cf784 tempest-VolumesListAdminTestJSON-1558846114 None] Deleted volume successfully. Jul 10 04:42:09 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-b733c329-cf71-42fa-8fc4-a0f8d73cf784 tempest-VolumesListAdminTestJSON-1558846114 None] Lock "cinder-73477818-c1f6-4c83-9fcc-b44bc2510d0d-delete_volume" released by "delete_volume" :: held 2.827s {{(pid=87444) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 04:42:09 devstack sudo[96776]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-faf4712f-a297-40ad-a21a-3936e635088a Jul 10 04:42:09 devstack sudo[96776]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:42:09 devstack sudo[96772]: pam_unix(sudo:session): session closed for user root Jul 10 04:42:09 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-1d3e71ed-5266-487a-aee6-b1731e56f8d3 tempest-VolumesImageMetadata-1791203028 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-d17a35d7-0961-4ac4-9d8b-639864f18312" returned: 0 in 0.786s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:42:09 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-1d3e71ed-5266-487a-aee6-b1731e56f8d3 tempest-VolumesImageMetadata-1791203028 None] Lock "cinder-quobyte-d17a35d7-0961-4ac4-9d8b-639864f18312" released by "delete_volume" :: held 2.604s {{(pid=87444) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 04:42:09 devstack cinder-volume[87444]: DEBUG cinder.quota [None req-1d3e71ed-5266-487a-aee6-b1731e56f8d3 tempest-VolumesImageMetadata-1791203028 None] Created reservations ['25cf7354-1fb2-4854-bb30-645b1da116c6', 'c1f16889-1ca8-4033-8c77-ee11fd8a3be2', 'f6bfded4-afbb-4028-9cb2-677773452f54', 'f70b4269-0404-42a8-a640-34cbd413e911'] {{(pid=87444) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 04:42:09 devstack sudo[96773]: pam_unix(sudo:session): session closed for user root Jul 10 04:42:10 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-8b7fe78d-a910-47b0-83fb-837da9f6f525 tempest-VolumesDeleteCascade-473852886 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-d9b19f8d-96d4-4eda-8c15-b3f878386b7b" returned: 0 in 0.876s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:42:10 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-8b7fe78d-a910-47b0-83fb-837da9f6f525 tempest-VolumesDeleteCascade-473852886 None] <== create_volume: return (2058ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922'} {{(pid=87444) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 04:42:10 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-8b7fe78d-a910-47b0-83fb-837da9f6f525 tempest-VolumesDeleteCascade-473852886 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.061s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 04:42:10 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-8b7fe78d-a910-47b0-83fb-837da9f6f525 tempest-VolumesDeleteCascade-473852886 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (83e18fc2-51c7-4f9d-967d-a884daa59e98) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d9b19f8d-96d4-4eda-8c15-b3f878386b7b', 'volume_size': 1}' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:42:10 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-8b7fe78d-a910-47b0-83fb-837da9f6f525 tempest-VolumesDeleteCascade-473852886 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0a6f0ddb-6ab1-47c0-a31b-bf3541d13e87) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:42:10 devstack cinder-volume[87444]: INFO cinder.volume.flows.manager.create_volume [None req-8b7fe78d-a910-47b0-83fb-837da9f6f525 tempest-VolumesDeleteCascade-473852886 None] Volume volume-d9b19f8d-96d4-4eda-8c15-b3f878386b7b (d9b19f8d-96d4-4eda-8c15-b3f878386b7b): created successfully Jul 10 04:42:10 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-8b7fe78d-a910-47b0-83fb-837da9f6f525 tempest-VolumesDeleteCascade-473852886 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0a6f0ddb-6ab1-47c0-a31b-bf3541d13e87) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:42:10 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-8b7fe78d-a910-47b0-83fb-837da9f6f525 tempest-VolumesDeleteCascade-473852886 None] Flow 'volume_create_manager' (e379087a-ca55-464a-bb50-d5d7264dd77d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87444) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 04:42:10 devstack cinder-volume[87444]: INFO cinder.volume.manager [None req-8b7fe78d-a910-47b0-83fb-837da9f6f525 tempest-VolumesDeleteCascade-473852886 None] Created volume successfully. Jul 10 04:42:10 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-1d3e71ed-5266-487a-aee6-b1731e56f8d3 tempest-VolumesImageMetadata-1791203028 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 04:42:10 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-1d3e71ed-5266-487a-aee6-b1731e56f8d3 tempest-VolumesImageMetadata-1791203028 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 04:42:10 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-1d3e71ed-5266-487a-aee6-b1731e56f8d3 tempest-VolumesImageMetadata-1791203028 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922': None} {{(pid=87444) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 04:42:10 devstack sudo[96776]: pam_unix(sudo:session): session closed for user root Jul 10 04:42:10 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-1d3e71ed-5266-487a-aee6-b1731e56f8d3 tempest-VolumesImageMetadata-1791203028 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922'] {{(pid=87444) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 04:42:10 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-1d3e71ed-5266-487a-aee6-b1731e56f8d3 tempest-VolumesImageMetadata-1791203028 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 04:42:10 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-1d3e71ed-5266-487a-aee6-b1731e56f8d3 tempest-VolumesImageMetadata-1791203028 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:42:10 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-f6321e01-e021-40eb-a376-cab933ef9333 tempest-VolumesSnapshotTestJSON-1690897005 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-faf4712f-a297-40ad-a21a-3936e635088a" returned: 0 in 0.915s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:42:10 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-f6321e01-e021-40eb-a376-cab933ef9333 tempest-VolumesSnapshotTestJSON-1690897005 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-faf4712f-a297-40ad-a21a-3936e635088a {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:42:10 devstack sudo[96784]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097 Jul 10 04:42:10 devstack sudo[96784]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:42:10 devstack sudo[96785]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-faf4712f-a297-40ad-a21a-3936e635088a Jul 10 04:42:10 devstack sudo[96785]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:42:10 devstack sudo[96785]: pam_unix(sudo:session): session closed for user root Jul 10 04:42:10 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-f6321e01-e021-40eb-a376-cab933ef9333 tempest-VolumesSnapshotTestJSON-1690897005 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-faf4712f-a297-40ad-a21a-3936e635088a" returned: 0 in 0.847s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:42:11 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-f6321e01-e021-40eb-a376-cab933ef9333 tempest-VolumesSnapshotTestJSON-1690897005 None] Lock "cinder-quobyte-faf4712f-a297-40ad-a21a-3936e635088a" released by "delete_volume" :: held 1.837s {{(pid=87444) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 04:42:11 devstack sudo[96784]: pam_unix(sudo:session): session closed for user root Jul 10 04:42:11 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-1d3e71ed-5266-487a-aee6-b1731e56f8d3 tempest-VolumesImageMetadata-1791203028 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097" returned: 0 in 0.925s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:42:11 devstack cinder-volume[87444]: DEBUG cinder.manager [None req-1d3e71ed-5266-487a-aee6-b1731e56f8d3 tempest-VolumesImageMetadata-1791203028 None] Notifying Schedulers of capabilities ... {{(pid=87444) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 04:42:11 devstack cinder-volume[87444]: INFO cinder.volume.manager [None req-1d3e71ed-5266-487a-aee6-b1731e56f8d3 tempest-VolumesImageMetadata-1791203028 None] Deleted volume successfully. Jul 10 04:42:11 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-e52bd27a-5093-4c74-a98d-4fdf05fdc018 tempest-VolumesDeleteCascade-473852886 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 04:42:11 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-e52bd27a-5093-4c74-a98d-4fdf05fdc018 tempest-VolumesDeleteCascade-473852886 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 04:42:11 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.remotefs [None req-e52bd27a-5093-4c74-a98d-4fdf05fdc018 tempest-VolumesDeleteCascade-473852886 None] Creating offline snapshot 195e91a4-9ba0-44f1-bf44-0ac5e15971a6 of volume d9b19f8d-96d4-4eda-8c15-b3f878386b7b {{(pid=87444) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 10 04:42:11 devstack cinder-volume[87444]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec978ab7-7568-4281-8b0c-5fe3cf74036e]: (4, 'qcow2') {{(pid=88499) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 04:42:11 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-e52bd27a-5093-4c74-a98d-4fdf05fdc018 tempest-VolumesDeleteCascade-473852886 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-d9b19f8d-96d4-4eda-8c15-b3f878386b7b {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:42:11 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-1d3e71ed-5266-487a-aee6-b1731e56f8d3 tempest-VolumesImageMetadata-1791203028 None] Lock "cinder-d17a35d7-0961-4ac4-9d8b-639864f18312-delete_volume" released by "delete_volume" :: held 3.947s {{(pid=87444) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 04:42:11 devstack cinder-volume[87444]: DEBUG cinder.quota [None req-f6321e01-e021-40eb-a376-cab933ef9333 tempest-VolumesSnapshotTestJSON-1690897005 None] Created reservations ['ada5af20-5c51-4dec-882c-5d0fa45bbd7c', 'b99db942-1796-4984-ab78-39808df9920d', '7b966710-0a4c-4f58-96e4-194c5b29ba7d', 'cb2aeb68-19cd-4d88-afdd-6c71f001cf52'] {{(pid=87444) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 04:42:11 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-f6321e01-e021-40eb-a376-cab933ef9333 tempest-VolumesSnapshotTestJSON-1690897005 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 04:42:11 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-f6321e01-e021-40eb-a376-cab933ef9333 tempest-VolumesSnapshotTestJSON-1690897005 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 04:42:11 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-f6321e01-e021-40eb-a376-cab933ef9333 tempest-VolumesSnapshotTestJSON-1690897005 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922': None} {{(pid=87444) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 04:42:11 devstack sudo[96791]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-d9b19f8d-96d4-4eda-8c15-b3f878386b7b Jul 10 04:42:11 devstack sudo[96791]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:42:11 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-f6321e01-e021-40eb-a376-cab933ef9333 tempest-VolumesSnapshotTestJSON-1690897005 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922'] {{(pid=87444) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 04:42:11 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-f6321e01-e021-40eb-a376-cab933ef9333 tempest-VolumesSnapshotTestJSON-1690897005 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 04:42:11 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-f6321e01-e021-40eb-a376-cab933ef9333 tempest-VolumesSnapshotTestJSON-1690897005 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:42:11 devstack sudo[96793]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097 Jul 10 04:42:11 devstack sudo[96793]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:42:12 devstack sudo[96791]: pam_unix(sudo:session): session closed for user root Jul 10 04:42:12 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-e52bd27a-5093-4c74-a98d-4fdf05fdc018 tempest-VolumesDeleteCascade-473852886 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-d9b19f8d-96d4-4eda-8c15-b3f878386b7b" returned: 0 in 0.995s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:42:12 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-e52bd27a-5093-4c74-a98d-4fdf05fdc018 tempest-VolumesDeleteCascade-473852886 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-d9b19f8d-96d4-4eda-8c15-b3f878386b7b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-d9b19f8d-96d4-4eda-8c15-b3f878386b7b.195e91a4-9ba0-44f1-bf44-0ac5e15971a6 1G {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:42:12 devstack sudo[96793]: pam_unix(sudo:session): session closed for user root Jul 10 04:42:12 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-f6321e01-e021-40eb-a376-cab933ef9333 tempest-VolumesSnapshotTestJSON-1690897005 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097" returned: 0 in 0.864s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:42:12 devstack cinder-volume[87444]: DEBUG cinder.manager [None req-f6321e01-e021-40eb-a376-cab933ef9333 tempest-VolumesSnapshotTestJSON-1690897005 None] Notifying Schedulers of capabilities ... {{(pid=87444) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 04:42:12 devstack cinder-volume[87444]: INFO cinder.volume.manager [None req-f6321e01-e021-40eb-a376-cab933ef9333 tempest-VolumesSnapshotTestJSON-1690897005 None] Deleted volume successfully. Jul 10 04:42:12 devstack sudo[96799]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-d9b19f8d-96d4-4eda-8c15-b3f878386b7b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-d9b19f8d-96d4-4eda-8c15-b3f878386b7b.195e91a4-9ba0-44f1-bf44-0ac5e15971a6 1G Jul 10 04:42:12 devstack sudo[96799]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:42:12 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-f6321e01-e021-40eb-a376-cab933ef9333 tempest-VolumesSnapshotTestJSON-1690897005 None] Lock "cinder-faf4712f-a297-40ad-a21a-3936e635088a-delete_volume" released by "delete_volume" :: held 3.178s {{(pid=87444) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 04:42:12 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-104c056c-0964-4eae-b23a-721d21e89931 tempest-VolumesSnapshotTestJSON-1690897005 None] Acquiring lock "cinder-3862dff9-3f00-4305-a09e-50ab1b1f1122-delete_snapshot" by "delete_snapshot" {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 04:42:12 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-104c056c-0964-4eae-b23a-721d21e89931 tempest-VolumesSnapshotTestJSON-1690897005 None] Lock "cinder-3862dff9-3f00-4305-a09e-50ab1b1f1122-delete_snapshot" acquired by "delete_snapshot" :: waited 0.025s {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 04:42:12 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-104c056c-0964-4eae-b23a-721d21e89931 tempest-VolumesSnapshotTestJSON-1690897005 None] Acquiring lock "cinder-quobyte-80504d94-f520-4b4a-bf04-620bfa5f2b42" by "delete_snapshot" {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 04:42:12 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-104c056c-0964-4eae-b23a-721d21e89931 tempest-VolumesSnapshotTestJSON-1690897005 None] Lock "cinder-quobyte-80504d94-f520-4b4a-bf04-620bfa5f2b42" acquired by "delete_snapshot" :: waited 0.034s {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 04:42:12 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-104c056c-0964-4eae-b23a-721d21e89931 tempest-VolumesSnapshotTestJSON-1690897005 None] Acquiring lock "cinder-quobyte-3862dff9-3f00-4305-a09e-50ab1b1f1122" by "_delete_snapshot" {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 04:42:12 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-104c056c-0964-4eae-b23a-721d21e89931 tempest-VolumesSnapshotTestJSON-1690897005 None] Lock "cinder-quobyte-3862dff9-3f00-4305-a09e-50ab1b1f1122" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 04:42:12 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.remotefs [None req-104c056c-0964-4eae-b23a-721d21e89931 tempest-VolumesSnapshotTestJSON-1690897005 None] Deleting offline snapshot 3862dff9-3f00-4305-a09e-50ab1b1f1122 of volume 80504d94-f520-4b4a-bf04-620bfa5f2b42 {{(pid=87444) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 10 04:42:12 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.remotefs [None req-104c056c-0964-4eae-b23a-721d21e89931 tempest-VolumesSnapshotTestJSON-1690897005 None] snapshot_file for this snap is: volume-80504d94-f520-4b4a-bf04-620bfa5f2b42.3862dff9-3f00-4305-a09e-50ab1b1f1122 {{(pid=87444) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 10 04:42:12 devstack cinder-volume[87444]: DEBUG oslo.privsep.daemon [-] privsep: reply[649427e9-c1c6-47fd-af89-cb1fbd7cc145]: (4, 'qcow2') {{(pid=88499) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 04:42:12 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-104c056c-0964-4eae-b23a-721d21e89931 tempest-VolumesSnapshotTestJSON-1690897005 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-80504d94-f520-4b4a-bf04-620bfa5f2b42.3862dff9-3f00-4305-a09e-50ab1b1f1122 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:42:12 devstack sudo[96801]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-80504d94-f520-4b4a-bf04-620bfa5f2b42.3862dff9-3f00-4305-a09e-50ab1b1f1122 Jul 10 04:42:12 devstack sudo[96801]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:42:13 devstack sudo[96799]: pam_unix(sudo:session): session closed for user root Jul 10 04:42:13 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-e52bd27a-5093-4c74-a98d-4fdf05fdc018 tempest-VolumesDeleteCascade-473852886 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-d9b19f8d-96d4-4eda-8c15-b3f878386b7b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-d9b19f8d-96d4-4eda-8c15-b3f878386b7b.195e91a4-9ba0-44f1-bf44-0ac5e15971a6 1G" returned: 0 in 1.084s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:42:13 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-e52bd27a-5093-4c74-a98d-4fdf05fdc018 tempest-VolumesDeleteCascade-473852886 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d9b19f8d-96d4-4eda-8c15-b3f878386b7b -F qcow2 /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-d9b19f8d-96d4-4eda-8c15-b3f878386b7b.195e91a4-9ba0-44f1-bf44-0ac5e15971a6 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:42:13 devstack sudo[96809]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d9b19f8d-96d4-4eda-8c15-b3f878386b7b -F qcow2 /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-d9b19f8d-96d4-4eda-8c15-b3f878386b7b.195e91a4-9ba0-44f1-bf44-0ac5e15971a6 Jul 10 04:42:13 devstack sudo[96809]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:42:13 devstack sudo[96801]: pam_unix(sudo:session): session closed for user root Jul 10 04:42:13 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-104c056c-0964-4eae-b23a-721d21e89931 tempest-VolumesSnapshotTestJSON-1690897005 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-80504d94-f520-4b4a-bf04-620bfa5f2b42.3862dff9-3f00-4305-a09e-50ab1b1f1122" returned: 0 in 0.877s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:42:13 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.remotefs [None req-104c056c-0964-4eae-b23a-721d21e89931 tempest-VolumesSnapshotTestJSON-1690897005 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-80504d94-f520-4b4a-bf04-620bfa5f2b42(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87444) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 10 04:42:13 devstack cinder-volume[87444]: DEBUG oslo.privsep.daemon [-] privsep: reply[75114aa6-16e2-4ad0-b87a-f29b3f66c39c]: (4, 'qcow2') {{(pid=88499) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 04:42:13 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-104c056c-0964-4eae-b23a-721d21e89931 tempest-VolumesSnapshotTestJSON-1690897005 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-80504d94-f520-4b4a-bf04-620bfa5f2b42 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:42:13 devstack sudo[96812]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-80504d94-f520-4b4a-bf04-620bfa5f2b42 Jul 10 04:42:13 devstack sudo[96812]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:42:14 devstack sudo[96809]: pam_unix(sudo:session): session closed for user root Jul 10 04:42:14 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-e52bd27a-5093-4c74-a98d-4fdf05fdc018 tempest-VolumesDeleteCascade-473852886 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d9b19f8d-96d4-4eda-8c15-b3f878386b7b -F qcow2 /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-d9b19f8d-96d4-4eda-8c15-b3f878386b7b.195e91a4-9ba0-44f1-bf44-0ac5e15971a6" returned: 0 in 0.884s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:42:14 devstack cinder-volume[87444]: WARNING cinder.volume.drivers.remotefs [None req-e52bd27a-5093-4c74-a98d-4fdf05fdc018 tempest-VolumesDeleteCascade-473852886 None] /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-d9b19f8d-96d4-4eda-8c15-b3f878386b7b.195e91a4-9ba0-44f1-bf44-0ac5e15971a6 is being set with open permissions: ugo+rw Jul 10 04:42:14 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-e52bd27a-5093-4c74-a98d-4fdf05fdc018 tempest-VolumesDeleteCascade-473852886 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-d9b19f8d-96d4-4eda-8c15-b3f878386b7b.195e91a4-9ba0-44f1-bf44-0ac5e15971a6 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:42:14 devstack sudo[96818]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-d9b19f8d-96d4-4eda-8c15-b3f878386b7b.195e91a4-9ba0-44f1-bf44-0ac5e15971a6 Jul 10 04:42:14 devstack sudo[96818]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:42:14 devstack sudo[96812]: pam_unix(sudo:session): session closed for user root Jul 10 04:42:14 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-104c056c-0964-4eae-b23a-721d21e89931 tempest-VolumesSnapshotTestJSON-1690897005 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-80504d94-f520-4b4a-bf04-620bfa5f2b42" returned: 0 in 0.972s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:42:14 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-104c056c-0964-4eae-b23a-721d21e89931 tempest-VolumesSnapshotTestJSON-1690897005 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-80504d94-f520-4b4a-bf04-620bfa5f2b42.3862dff9-3f00-4305-a09e-50ab1b1f1122 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:42:14 devstack sudo[96823]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-80504d94-f520-4b4a-bf04-620bfa5f2b42.3862dff9-3f00-4305-a09e-50ab1b1f1122 Jul 10 04:42:14 devstack sudo[96823]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:42:15 devstack sudo[96818]: pam_unix(sudo:session): session closed for user root Jul 10 04:42:15 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-e52bd27a-5093-4c74-a98d-4fdf05fdc018 tempest-VolumesDeleteCascade-473852886 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-d9b19f8d-96d4-4eda-8c15-b3f878386b7b.195e91a4-9ba0-44f1-bf44-0ac5e15971a6" returned: 0 in 0.879s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:42:15 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-e52bd27a-5093-4c74-a98d-4fdf05fdc018 tempest-VolumesDeleteCascade-473852886 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-d9b19f8d-96d4-4eda-8c15-b3f878386b7b.info {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:42:15 devstack sudo[96826]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-d9b19f8d-96d4-4eda-8c15-b3f878386b7b.info Jul 10 04:42:15 devstack sudo[96826]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:42:15 devstack sudo[96823]: pam_unix(sudo:session): session closed for user root Jul 10 04:42:15 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-104c056c-0964-4eae-b23a-721d21e89931 tempest-VolumesSnapshotTestJSON-1690897005 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-80504d94-f520-4b4a-bf04-620bfa5f2b42.3862dff9-3f00-4305-a09e-50ab1b1f1122" returned: 0 in 1.002s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:42:15 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-104c056c-0964-4eae-b23a-721d21e89931 tempest-VolumesSnapshotTestJSON-1690897005 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-80504d94-f520-4b4a-bf04-620bfa5f2b42.3862dff9-3f00-4305-a09e-50ab1b1f1122 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:42:15 devstack sudo[96831]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-80504d94-f520-4b4a-bf04-620bfa5f2b42.3862dff9-3f00-4305-a09e-50ab1b1f1122 Jul 10 04:42:15 devstack sudo[96831]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:42:15 devstack sudo[96826]: pam_unix(sudo:session): session closed for user root Jul 10 04:42:15 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-e52bd27a-5093-4c74-a98d-4fdf05fdc018 tempest-VolumesDeleteCascade-473852886 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-d9b19f8d-96d4-4eda-8c15-b3f878386b7b.info" returned: 0 in 0.818s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:42:15 devstack cinder-volume[87444]: WARNING cinder.volume.drivers.remotefs [None req-e52bd27a-5093-4c74-a98d-4fdf05fdc018 tempest-VolumesDeleteCascade-473852886 None] /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-d9b19f8d-96d4-4eda-8c15-b3f878386b7b.info is being set with open permissions: ugo+rw Jul 10 04:42:15 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-e52bd27a-5093-4c74-a98d-4fdf05fdc018 tempest-VolumesDeleteCascade-473852886 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-d9b19f8d-96d4-4eda-8c15-b3f878386b7b.info {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:42:15 devstack sudo[96834]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-d9b19f8d-96d4-4eda-8c15-b3f878386b7b.info Jul 10 04:42:15 devstack sudo[96834]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:42:16 devstack sudo[96831]: pam_unix(sudo:session): session closed for user root Jul 10 04:42:16 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-104c056c-0964-4eae-b23a-721d21e89931 tempest-VolumesSnapshotTestJSON-1690897005 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-80504d94-f520-4b4a-bf04-620bfa5f2b42.3862dff9-3f00-4305-a09e-50ab1b1f1122" returned: 0 in 0.884s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:42:16 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-104c056c-0964-4eae-b23a-721d21e89931 tempest-VolumesSnapshotTestJSON-1690897005 None] Lock "cinder-quobyte-3862dff9-3f00-4305-a09e-50ab1b1f1122" released by "_delete_snapshot" :: held 3.884s {{(pid=87444) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 04:42:16 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-104c056c-0964-4eae-b23a-721d21e89931 tempest-VolumesSnapshotTestJSON-1690897005 None] Lock "cinder-quobyte-80504d94-f520-4b4a-bf04-620bfa5f2b42" released by "delete_snapshot" :: held 3.914s {{(pid=87444) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 04:42:16 devstack cinder-volume[87444]: DEBUG cinder.quota [None req-104c056c-0964-4eae-b23a-721d21e89931 tempest-VolumesSnapshotTestJSON-1690897005 None] Created reservations ['3e88ec8b-b208-4691-a8a0-b7d099a4ac77', '9e6810db-eae7-471e-82de-7b88acd37603', '3d7e1597-ee38-49e2-96a4-77a55b3ecbce', 'c8504b9d-3ab6-4556-9bd0-4e3be102f5ca'] {{(pid=87444) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 04:42:16 devstack cinder-volume[87444]: INFO cinder.volume.manager [None req-104c056c-0964-4eae-b23a-721d21e89931 tempest-VolumesSnapshotTestJSON-1690897005 None] Delete snapshot completed successfully. Jul 10 04:42:16 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-104c056c-0964-4eae-b23a-721d21e89931 tempest-VolumesSnapshotTestJSON-1690897005 None] Lock "cinder-3862dff9-3f00-4305-a09e-50ab1b1f1122-delete_snapshot" released by "delete_snapshot" :: held 4.164s {{(pid=87444) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 04:42:16 devstack sudo[96834]: pam_unix(sudo:session): session closed for user root Jul 10 04:42:16 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-e52bd27a-5093-4c74-a98d-4fdf05fdc018 tempest-VolumesDeleteCascade-473852886 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-d9b19f8d-96d4-4eda-8c15-b3f878386b7b.info" returned: 0 in 0.789s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:42:16 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-e52bd27a-5093-4c74-a98d-4fdf05fdc018 tempest-VolumesDeleteCascade-473852886 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.588s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 04:42:16 devstack cinder-volume[87444]: INFO cinder.volume.manager [None req-e52bd27a-5093-4c74-a98d-4fdf05fdc018 tempest-VolumesDeleteCascade-473852886 None] Create snapshot completed successfully Jul 10 04:42:16 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-04b09a0f-1072-4501-bc5f-80bacb0193f0 tempest-VolumesSnapshotTestJSON-1690897005 None] Acquiring lock "cinder-80504d94-f520-4b4a-bf04-620bfa5f2b42-delete_volume" by "delete_volume" {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 04:42:16 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-04b09a0f-1072-4501-bc5f-80bacb0193f0 tempest-VolumesSnapshotTestJSON-1690897005 None] Lock "cinder-80504d94-f520-4b4a-bf04-620bfa5f2b42-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 04:42:16 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-04b09a0f-1072-4501-bc5f-80bacb0193f0 tempest-VolumesSnapshotTestJSON-1690897005 None] Acquiring lock "cinder-quobyte-80504d94-f520-4b4a-bf04-620bfa5f2b42" by "delete_volume" {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 04:42:16 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-04b09a0f-1072-4501-bc5f-80bacb0193f0 tempest-VolumesSnapshotTestJSON-1690897005 None] Lock "cinder-quobyte-80504d94-f520-4b4a-bf04-620bfa5f2b42" acquired by "delete_volume" :: waited 0.019s {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 04:42:16 devstack cinder-volume[87444]: DEBUG oslo.privsep.daemon [-] privsep: reply[daf1e366-cdba-47d8-a820-6ef8a6ea1e70]: (4, 'qcow2') {{(pid=88499) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 04:42:16 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-04b09a0f-1072-4501-bc5f-80bacb0193f0 tempest-VolumesSnapshotTestJSON-1690897005 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-80504d94-f520-4b4a-bf04-620bfa5f2b42 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:42:17 devstack sudo[96838]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-80504d94-f520-4b4a-bf04-620bfa5f2b42 Jul 10 04:42:17 devstack sudo[96838]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:42:17 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-7711f573-404c-4da9-9da1-fbb5bb987b68 tempest-VolumesDeleteCascade-473852886 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 04:42:17 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-7711f573-404c-4da9-9da1-fbb5bb987b68 tempest-VolumesDeleteCascade-473852886 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 04:42:17 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.remotefs [None req-7711f573-404c-4da9-9da1-fbb5bb987b68 tempest-VolumesDeleteCascade-473852886 None] Creating offline snapshot f48b7140-9e7b-4aed-997a-56065ab747a7 of volume d9b19f8d-96d4-4eda-8c15-b3f878386b7b {{(pid=87444) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 10 04:42:17 devstack cinder-volume[87444]: DEBUG oslo.privsep.daemon [-] privsep: reply[7949fb56-1e02-40fa-b9e2-c1b85067dc9c]: (4, 'qcow2') {{(pid=88499) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 04:42:17 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-7711f573-404c-4da9-9da1-fbb5bb987b68 tempest-VolumesDeleteCascade-473852886 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-d9b19f8d-96d4-4eda-8c15-b3f878386b7b.195e91a4-9ba0-44f1-bf44-0ac5e15971a6 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:42:17 devstack sudo[96842]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-d9b19f8d-96d4-4eda-8c15-b3f878386b7b.195e91a4-9ba0-44f1-bf44-0ac5e15971a6 Jul 10 04:42:17 devstack sudo[96842]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:42:18 devstack sudo[96838]: pam_unix(sudo:session): session closed for user root Jul 10 04:42:18 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-04b09a0f-1072-4501-bc5f-80bacb0193f0 tempest-VolumesSnapshotTestJSON-1690897005 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-80504d94-f520-4b4a-bf04-620bfa5f2b42" returned: 0 in 1.055s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:42:18 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-04b09a0f-1072-4501-bc5f-80bacb0193f0 tempest-VolumesSnapshotTestJSON-1690897005 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-80504d94-f520-4b4a-bf04-620bfa5f2b42 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:42:18 devstack sudo[96845]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-80504d94-f520-4b4a-bf04-620bfa5f2b42 Jul 10 04:42:18 devstack sudo[96845]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:42:18 devstack sudo[96842]: pam_unix(sudo:session): session closed for user root Jul 10 04:42:18 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-7711f573-404c-4da9-9da1-fbb5bb987b68 tempest-VolumesDeleteCascade-473852886 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-d9b19f8d-96d4-4eda-8c15-b3f878386b7b.195e91a4-9ba0-44f1-bf44-0ac5e15971a6" returned: 0 in 1.008s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:42:18 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.remotefs [None req-7711f573-404c-4da9-9da1-fbb5bb987b68 tempest-VolumesDeleteCascade-473852886 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d9b19f8d-96d4-4eda-8c15-b3f878386b7b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87444) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 10 04:42:18 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-7711f573-404c-4da9-9da1-fbb5bb987b68 tempest-VolumesDeleteCascade-473852886 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-d9b19f8d-96d4-4eda-8c15-b3f878386b7b.195e91a4-9ba0-44f1-bf44-0ac5e15971a6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-d9b19f8d-96d4-4eda-8c15-b3f878386b7b.f48b7140-9e7b-4aed-997a-56065ab747a7 1G {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:42:18 devstack sudo[96851]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-d9b19f8d-96d4-4eda-8c15-b3f878386b7b.195e91a4-9ba0-44f1-bf44-0ac5e15971a6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-d9b19f8d-96d4-4eda-8c15-b3f878386b7b.f48b7140-9e7b-4aed-997a-56065ab747a7 1G Jul 10 04:42:18 devstack sudo[96851]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:42:18 devstack sudo[96845]: pam_unix(sudo:session): session closed for user root Jul 10 04:42:18 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-04b09a0f-1072-4501-bc5f-80bacb0193f0 tempest-VolumesSnapshotTestJSON-1690897005 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-80504d94-f520-4b4a-bf04-620bfa5f2b42" returned: 0 in 0.773s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:42:18 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-04b09a0f-1072-4501-bc5f-80bacb0193f0 tempest-VolumesSnapshotTestJSON-1690897005 None] Lock "cinder-quobyte-80504d94-f520-4b4a-bf04-620bfa5f2b42" released by "delete_volume" :: held 1.897s {{(pid=87444) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 04:42:18 devstack cinder-volume[87444]: DEBUG cinder.quota [None req-04b09a0f-1072-4501-bc5f-80bacb0193f0 tempest-VolumesSnapshotTestJSON-1690897005 None] Created reservations ['e3a5be41-7866-4a03-b923-adbd92a2aae9', '62349940-48d1-4087-aa07-45aca0b0ed79', '0427b6a4-01e6-4a75-8118-acc081051df9', '5923a536-adfc-444f-88b8-77ddb75b78b2'] {{(pid=87444) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 04:42:18 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-04b09a0f-1072-4501-bc5f-80bacb0193f0 tempest-VolumesSnapshotTestJSON-1690897005 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 04:42:18 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-04b09a0f-1072-4501-bc5f-80bacb0193f0 tempest-VolumesSnapshotTestJSON-1690897005 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 04:42:18 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-04b09a0f-1072-4501-bc5f-80bacb0193f0 tempest-VolumesSnapshotTestJSON-1690897005 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922': None} {{(pid=87444) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 04:42:18 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-04b09a0f-1072-4501-bc5f-80bacb0193f0 tempest-VolumesSnapshotTestJSON-1690897005 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922'] {{(pid=87444) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 04:42:18 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-04b09a0f-1072-4501-bc5f-80bacb0193f0 tempest-VolumesSnapshotTestJSON-1690897005 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 04:42:18 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-04b09a0f-1072-4501-bc5f-80bacb0193f0 tempest-VolumesSnapshotTestJSON-1690897005 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:42:19 devstack sudo[96853]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097 Jul 10 04:42:19 devstack sudo[96853]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:42:19 devstack cinder-volume[87444]: DEBUG cinder.volume.flows.manager.create_volume [None req-3dcca5b9-8d8f-4a48-95e5-09a0ccb8c00c tempest-VolumesTransfersV355Test-1331173015 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87444) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 04:42:19 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-3dcca5b9-8d8f-4a48-95e5-09a0ccb8c00c tempest-VolumesTransfersV355Test-1331173015 None] Flow 'volume_create_manager' (c49becde-ee93-4742-af2f-95ba00e02e52) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 04:42:19 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-3dcca5b9-8d8f-4a48-95e5-09a0ccb8c00c tempest-VolumesTransfersV355Test-1331173015 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f552565e-0215-442e-814c-bce4a37c6f23) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:42:19 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-3dcca5b9-8d8f-4a48-95e5-09a0ccb8c00c tempest-VolumesTransfersV355Test-1331173015 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f552565e-0215-442e-814c-bce4a37c6f23) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T02:42:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-384691766',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3dca2b75-4530-46ce-bab4-83c878db26e8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='55005e2e59f841d3979d0c53b9033ab2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T02:42:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T02:42:20Z,use_quota=True,user_id='aeea6b10dac04cada334ae2e381a4101',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(317e369e-1e06-434d-ae95-a335f0e6c903),volume_type_id=317e369e-1e06-434d-ae95-a335f0e6c903)' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:42:20 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-3dcca5b9-8d8f-4a48-95e5-09a0ccb8c00c tempest-VolumesTransfersV355Test-1331173015 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0ce7774d-75c1-4a90-88b4-0646af85a2f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:42:20 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-3dcca5b9-8d8f-4a48-95e5-09a0ccb8c00c tempest-VolumesTransfersV355Test-1331173015 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0ce7774d-75c1-4a90-88b4-0646af85a2f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:42:20 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-3dcca5b9-8d8f-4a48-95e5-09a0ccb8c00c tempest-VolumesTransfersV355Test-1331173015 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b0283a2c-96f8-4d8d-aabb-5b96f5e72dcc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:42:20 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-3dcca5b9-8d8f-4a48-95e5-09a0ccb8c00c tempest-VolumesTransfersV355Test-1331173015 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b0283a2c-96f8-4d8d-aabb-5b96f5e72dcc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3dca2b75-4530-46ce-bab4-83c878db26e8', 'volume_name': 'volume-3dca2b75-4530-46ce-bab4-83c878db26e8', 'volume_size': 1}' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:42:20 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-3dcca5b9-8d8f-4a48-95e5-09a0ccb8c00c tempest-VolumesTransfersV355Test-1331173015 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a10300c8-689a-4aa9-bd7f-ac418d12a226) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:42:20 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-3dcca5b9-8d8f-4a48-95e5-09a0ccb8c00c tempest-VolumesTransfersV355Test-1331173015 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a10300c8-689a-4aa9-bd7f-ac418d12a226) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:42:20 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-3dcca5b9-8d8f-4a48-95e5-09a0ccb8c00c tempest-VolumesTransfersV355Test-1331173015 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (67a6304e-78a1-407f-87ea-a269ec1aec9c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:42:20 devstack cinder-volume[87444]: INFO cinder.volume.flows.manager.create_volume [None req-3dcca5b9-8d8f-4a48-95e5-09a0ccb8c00c tempest-VolumesTransfersV355Test-1331173015 None] Volume 3dca2b75-4530-46ce-bab4-83c878db26e8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3dca2b75-4530-46ce-bab4-83c878db26e8', 'volume_size': 1} Jul 10 04:42:20 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-3dcca5b9-8d8f-4a48-95e5-09a0ccb8c00c tempest-VolumesTransfersV355Test-1331173015 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 04:42:20 devstack cinder-volume[87444]: DEBUG cinder.volume.flows.manager.create_volume [None req-94cd7690-27bb-4894-8322-fc9e96a6e0e1 tempest-VolumesSnapshotTestJSON-1690897005 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87444) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 04:42:20 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-94cd7690-27bb-4894-8322-fc9e96a6e0e1 tempest-VolumesSnapshotTestJSON-1690897005 None] Flow 'volume_create_manager' (1416a1de-7c5a-496a-a0a4-0a817643d9fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 04:42:20 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-94cd7690-27bb-4894-8322-fc9e96a6e0e1 tempest-VolumesSnapshotTestJSON-1690897005 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cb794d37-15f8-408e-9ccc-60b7fc088a43) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:42:20 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-94cd7690-27bb-4894-8322-fc9e96a6e0e1 tempest-VolumesSnapshotTestJSON-1690897005 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cb794d37-15f8-408e-9ccc-60b7fc088a43) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T02:42:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-707626368',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=809f59aa-2cd0-4e34-b823-ff4f97fc2ff3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='92c5956be8c447b9872943111e4168dc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T02:42:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T02:42:20Z,use_quota=True,user_id='16ea7041ff434f7890eca88a786ad0f0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(317e369e-1e06-434d-ae95-a335f0e6c903),volume_type_id=317e369e-1e06-434d-ae95-a335f0e6c903)' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:42:20 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-94cd7690-27bb-4894-8322-fc9e96a6e0e1 tempest-VolumesSnapshotTestJSON-1690897005 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5f55eb62-0fad-4bea-80ef-928bf4d00c8a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:42:20 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-94cd7690-27bb-4894-8322-fc9e96a6e0e1 tempest-VolumesSnapshotTestJSON-1690897005 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5f55eb62-0fad-4bea-80ef-928bf4d00c8a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:42:20 devstack sudo[96851]: pam_unix(sudo:session): session closed for user root Jul 10 04:42:20 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-94cd7690-27bb-4894-8322-fc9e96a6e0e1 tempest-VolumesSnapshotTestJSON-1690897005 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (52564bc9-808a-4371-a714-b229a9d7ee34) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:42:20 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-94cd7690-27bb-4894-8322-fc9e96a6e0e1 tempest-VolumesSnapshotTestJSON-1690897005 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (52564bc9-808a-4371-a714-b229a9d7ee34) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '809f59aa-2cd0-4e34-b823-ff4f97fc2ff3', 'volume_name': 'volume-809f59aa-2cd0-4e34-b823-ff4f97fc2ff3', 'volume_size': 1}' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:42:20 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-94cd7690-27bb-4894-8322-fc9e96a6e0e1 tempest-VolumesSnapshotTestJSON-1690897005 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cd11bcca-82b7-4d21-8456-6af616f567d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:42:20 devstack sudo[96853]: pam_unix(sudo:session): session closed for user root Jul 10 04:42:20 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-94cd7690-27bb-4894-8322-fc9e96a6e0e1 tempest-VolumesSnapshotTestJSON-1690897005 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cd11bcca-82b7-4d21-8456-6af616f567d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:42:20 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-94cd7690-27bb-4894-8322-fc9e96a6e0e1 tempest-VolumesSnapshotTestJSON-1690897005 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dfed53d3-7b51-4110-b199-8ff9f287515f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:42:20 devstack cinder-volume[87444]: INFO cinder.volume.flows.manager.create_volume [None req-94cd7690-27bb-4894-8322-fc9e96a6e0e1 tempest-VolumesSnapshotTestJSON-1690897005 None] Volume 809f59aa-2cd0-4e34-b823-ff4f97fc2ff3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-809f59aa-2cd0-4e34-b823-ff4f97fc2ff3', 'volume_size': 1} Jul 10 04:42:20 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-94cd7690-27bb-4894-8322-fc9e96a6e0e1 tempest-VolumesSnapshotTestJSON-1690897005 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 04:42:20 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-7711f573-404c-4da9-9da1-fbb5bb987b68 tempest-VolumesDeleteCascade-473852886 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-d9b19f8d-96d4-4eda-8c15-b3f878386b7b.195e91a4-9ba0-44f1-bf44-0ac5e15971a6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-d9b19f8d-96d4-4eda-8c15-b3f878386b7b.f48b7140-9e7b-4aed-997a-56065ab747a7 1G" returned: 0 in 1.497s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:42:20 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-04b09a0f-1072-4501-bc5f-80bacb0193f0 tempest-VolumesSnapshotTestJSON-1690897005 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097" returned: 0 in 1.244s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:42:20 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-7711f573-404c-4da9-9da1-fbb5bb987b68 tempest-VolumesDeleteCascade-473852886 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d9b19f8d-96d4-4eda-8c15-b3f878386b7b.195e91a4-9ba0-44f1-bf44-0ac5e15971a6 -F qcow2 /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-d9b19f8d-96d4-4eda-8c15-b3f878386b7b.f48b7140-9e7b-4aed-997a-56065ab747a7 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:42:20 devstack cinder-volume[87444]: DEBUG cinder.manager [None req-04b09a0f-1072-4501-bc5f-80bacb0193f0 tempest-VolumesSnapshotTestJSON-1690897005 None] Notifying Schedulers of capabilities ... {{(pid=87444) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 04:42:20 devstack cinder-volume[87444]: INFO cinder.volume.manager [None req-04b09a0f-1072-4501-bc5f-80bacb0193f0 tempest-VolumesSnapshotTestJSON-1690897005 None] Deleted volume successfully. Jul 10 04:42:20 devstack sudo[96861]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d9b19f8d-96d4-4eda-8c15-b3f878386b7b.195e91a4-9ba0-44f1-bf44-0ac5e15971a6 -F qcow2 /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-d9b19f8d-96d4-4eda-8c15-b3f878386b7b.f48b7140-9e7b-4aed-997a-56065ab747a7 Jul 10 04:42:20 devstack sudo[96861]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:42:20 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-04b09a0f-1072-4501-bc5f-80bacb0193f0 tempest-VolumesSnapshotTestJSON-1690897005 None] Lock "cinder-80504d94-f520-4b4a-bf04-620bfa5f2b42-delete_volume" released by "delete_volume" :: held 3.414s {{(pid=87444) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 04:42:20 devstack sudo[96861]: pam_unix(sudo:session): session closed for user root Jul 10 04:42:20 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-7711f573-404c-4da9-9da1-fbb5bb987b68 tempest-VolumesDeleteCascade-473852886 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d9b19f8d-96d4-4eda-8c15-b3f878386b7b.195e91a4-9ba0-44f1-bf44-0ac5e15971a6 -F qcow2 /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-d9b19f8d-96d4-4eda-8c15-b3f878386b7b.f48b7140-9e7b-4aed-997a-56065ab747a7" returned: 0 in 0.756s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:42:20 devstack cinder-volume[87444]: WARNING cinder.volume.drivers.remotefs [None req-7711f573-404c-4da9-9da1-fbb5bb987b68 tempest-VolumesDeleteCascade-473852886 None] /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-d9b19f8d-96d4-4eda-8c15-b3f878386b7b.f48b7140-9e7b-4aed-997a-56065ab747a7 is being set with open permissions: ugo+rw Jul 10 04:42:20 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-7711f573-404c-4da9-9da1-fbb5bb987b68 tempest-VolumesDeleteCascade-473852886 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-d9b19f8d-96d4-4eda-8c15-b3f878386b7b.f48b7140-9e7b-4aed-997a-56065ab747a7 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:42:21 devstack sudo[96866]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-d9b19f8d-96d4-4eda-8c15-b3f878386b7b.f48b7140-9e7b-4aed-997a-56065ab747a7 Jul 10 04:42:21 devstack sudo[96866]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:42:21 devstack sudo[96866]: pam_unix(sudo:session): session closed for user root Jul 10 04:42:21 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-7711f573-404c-4da9-9da1-fbb5bb987b68 tempest-VolumesDeleteCascade-473852886 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-d9b19f8d-96d4-4eda-8c15-b3f878386b7b.f48b7140-9e7b-4aed-997a-56065ab747a7" returned: 0 in 0.658s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:42:21 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-7711f573-404c-4da9-9da1-fbb5bb987b68 tempest-VolumesDeleteCascade-473852886 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.074s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 04:42:21 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-3dcca5b9-8d8f-4a48-95e5-09a0ccb8c00c tempest-VolumesTransfersV355Test-1331173015 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.654s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 04:42:21 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-3dcca5b9-8d8f-4a48-95e5-09a0ccb8c00c tempest-VolumesTransfersV355Test-1331173015 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T02:42:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-384691766',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3dca2b75-4530-46ce-bab4-83c878db26e8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='55005e2e59f841d3979d0c53b9033ab2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T02:42:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T02:42:20Z,use_quota=True,user_id='aeea6b10dac04cada334ae2e381a4101',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(317e369e-1e06-434d-ae95-a335f0e6c903),volume_type_id=317e369e-1e06-434d-ae95-a335f0e6c903)}" {{(pid=87444) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 04:42:21 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.remotefs [None req-3dcca5b9-8d8f-4a48-95e5-09a0ccb8c00c tempest-VolumesTransfersV355Test-1331173015 None] Creating volume 3dca2b75-4530-46ce-bab4-83c878db26e8 {{(pid=87444) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 04:42:21 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-3dcca5b9-8d8f-4a48-95e5-09a0ccb8c00c tempest-VolumesTransfersV355Test-1331173015 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 04:42:21 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-3dcca5b9-8d8f-4a48-95e5-09a0ccb8c00c tempest-VolumesTransfersV355Test-1331173015 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 04:42:21 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-3dcca5b9-8d8f-4a48-95e5-09a0ccb8c00c tempest-VolumesTransfersV355Test-1331173015 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922': None} {{(pid=87444) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 04:42:21 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-3dcca5b9-8d8f-4a48-95e5-09a0ccb8c00c tempest-VolumesTransfersV355Test-1331173015 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922'] {{(pid=87444) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 04:42:21 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-3dcca5b9-8d8f-4a48-95e5-09a0ccb8c00c tempest-VolumesTransfersV355Test-1331173015 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 04:42:21 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-3dcca5b9-8d8f-4a48-95e5-09a0ccb8c00c tempest-VolumesTransfersV355Test-1331173015 None] Selected osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922 as target Quobyte volume. {{(pid=87444) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 04:42:21 devstack cinder-volume[87444]: INFO cinder.volume.drivers.remotefs [None req-3dcca5b9-8d8f-4a48-95e5-09a0ccb8c00c tempest-VolumesTransfersV355Test-1331173015 None] casted to osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922 Jul 10 04:42:21 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-3dcca5b9-8d8f-4a48-95e5-09a0ccb8c00c tempest-VolumesTransfersV355Test-1331173015 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-3dca2b75-4530-46ce-bab4-83c878db26e8 1073741824 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:42:21 devstack cinder-volume[87444]: INFO cinder.volume.manager [None req-7711f573-404c-4da9-9da1-fbb5bb987b68 tempest-VolumesDeleteCascade-473852886 None] Create snapshot completed successfully Jul 10 04:42:21 devstack sudo[96869]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-3dca2b75-4530-46ce-bab4-83c878db26e8 1073741824 Jul 10 04:42:21 devstack sudo[96869]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:42:21 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-a692e740-592d-4ea2-8fb2-a071a2d82523 tempest-VolumesDeleteCascade-473852886 None] Acquiring lock "cinder-d9b19f8d-96d4-4eda-8c15-b3f878386b7b-delete_volume" by "delete_volume" {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 04:42:22 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-a692e740-592d-4ea2-8fb2-a071a2d82523 tempest-VolumesDeleteCascade-473852886 None] Lock "cinder-d9b19f8d-96d4-4eda-8c15-b3f878386b7b-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 04:42:22 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-a692e740-592d-4ea2-8fb2-a071a2d82523 tempest-VolumesDeleteCascade-473852886 None] Performing cascade delete. {{(pid=87444) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}} Jul 10 04:42:22 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-a692e740-592d-4ea2-8fb2-a071a2d82523 tempest-VolumesDeleteCascade-473852886 None] Acquiring lock "cinder-195e91a4-9ba0-44f1-bf44-0ac5e15971a6-delete_snapshot" by "delete_snapshot" {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 04:42:22 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-a692e740-592d-4ea2-8fb2-a071a2d82523 tempest-VolumesDeleteCascade-473852886 None] Lock "cinder-195e91a4-9ba0-44f1-bf44-0ac5e15971a6-delete_snapshot" acquired by "delete_snapshot" :: waited 0.022s {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 04:42:22 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-a692e740-592d-4ea2-8fb2-a071a2d82523 tempest-VolumesDeleteCascade-473852886 None] Acquiring lock "cinder-quobyte-d9b19f8d-96d4-4eda-8c15-b3f878386b7b" by "delete_snapshot" {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 04:42:22 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-a692e740-592d-4ea2-8fb2-a071a2d82523 tempest-VolumesDeleteCascade-473852886 None] Lock "cinder-quobyte-d9b19f8d-96d4-4eda-8c15-b3f878386b7b" acquired by "delete_snapshot" :: waited 0.018s {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 04:42:22 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-a692e740-592d-4ea2-8fb2-a071a2d82523 tempest-VolumesDeleteCascade-473852886 None] Acquiring lock "cinder-quobyte-195e91a4-9ba0-44f1-bf44-0ac5e15971a6" by "_delete_snapshot" {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 04:42:22 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-a692e740-592d-4ea2-8fb2-a071a2d82523 tempest-VolumesDeleteCascade-473852886 None] Lock "cinder-quobyte-195e91a4-9ba0-44f1-bf44-0ac5e15971a6" acquired by "_delete_snapshot" :: waited 0.022s {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 04:42:22 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.remotefs [None req-a692e740-592d-4ea2-8fb2-a071a2d82523 tempest-VolumesDeleteCascade-473852886 None] Deleting offline snapshot 195e91a4-9ba0-44f1-bf44-0ac5e15971a6 of volume d9b19f8d-96d4-4eda-8c15-b3f878386b7b {{(pid=87444) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 10 04:42:22 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.remotefs [None req-a692e740-592d-4ea2-8fb2-a071a2d82523 tempest-VolumesDeleteCascade-473852886 None] snapshot_file for this snap is: volume-d9b19f8d-96d4-4eda-8c15-b3f878386b7b.195e91a4-9ba0-44f1-bf44-0ac5e15971a6 {{(pid=87444) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 10 04:42:22 devstack cinder-volume[87444]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5677173-2e25-4df2-90ed-4e884feb155e]: (4, 'qcow2') {{(pid=88499) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 04:42:22 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-a692e740-592d-4ea2-8fb2-a071a2d82523 tempest-VolumesDeleteCascade-473852886 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-d9b19f8d-96d4-4eda-8c15-b3f878386b7b.195e91a4-9ba0-44f1-bf44-0ac5e15971a6 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:42:22 devstack sudo[96871]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-d9b19f8d-96d4-4eda-8c15-b3f878386b7b.195e91a4-9ba0-44f1-bf44-0ac5e15971a6 Jul 10 04:42:22 devstack sudo[96871]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:42:22 devstack sudo[96869]: pam_unix(sudo:session): session closed for user root Jul 10 04:42:22 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-3dcca5b9-8d8f-4a48-95e5-09a0ccb8c00c tempest-VolumesTransfersV355Test-1331173015 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-3dca2b75-4530-46ce-bab4-83c878db26e8 1073741824" returned: 0 in 1.020s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:42:22 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-3dcca5b9-8d8f-4a48-95e5-09a0ccb8c00c tempest-VolumesTransfersV355Test-1331173015 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-3dca2b75-4530-46ce-bab4-83c878db26e8 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:42:22 devstack sudo[96877]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-3dca2b75-4530-46ce-bab4-83c878db26e8 Jul 10 04:42:22 devstack sudo[96877]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:42:23 devstack sudo[96871]: pam_unix(sudo:session): session closed for user root Jul 10 04:42:23 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-a692e740-592d-4ea2-8fb2-a071a2d82523 tempest-VolumesDeleteCascade-473852886 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-d9b19f8d-96d4-4eda-8c15-b3f878386b7b.195e91a4-9ba0-44f1-bf44-0ac5e15971a6" returned: 0 in 0.952s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:42:23 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.remotefs [None req-a692e740-592d-4ea2-8fb2-a071a2d82523 tempest-VolumesDeleteCascade-473852886 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d9b19f8d-96d4-4eda-8c15-b3f878386b7b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87444) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 10 04:42:23 devstack cinder-volume[87444]: DEBUG oslo.privsep.daemon [-] privsep: reply[3fb1c105-ed1e-4c59-92d1-2a3af4e6975f]: (4, 'qcow2') {{(pid=88499) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 04:42:23 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-a692e740-592d-4ea2-8fb2-a071a2d82523 tempest-VolumesDeleteCascade-473852886 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-d9b19f8d-96d4-4eda-8c15-b3f878386b7b {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:42:23 devstack sudo[96884]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-d9b19f8d-96d4-4eda-8c15-b3f878386b7b Jul 10 04:42:23 devstack sudo[96884]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:42:23 devstack sudo[96877]: pam_unix(sudo:session): session closed for user root Jul 10 04:42:23 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-3dcca5b9-8d8f-4a48-95e5-09a0ccb8c00c tempest-VolumesTransfersV355Test-1331173015 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-3dca2b75-4530-46ce-bab4-83c878db26e8" returned: 0 in 0.704s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:42:23 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-3dcca5b9-8d8f-4a48-95e5-09a0ccb8c00c tempest-VolumesTransfersV355Test-1331173015 None] <== create_volume: return (1800ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922'} {{(pid=87444) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 04:42:23 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-3dcca5b9-8d8f-4a48-95e5-09a0ccb8c00c tempest-VolumesTransfersV355Test-1331173015 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.803s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 04:42:23 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-94cd7690-27bb-4894-8322-fc9e96a6e0e1 tempest-VolumesSnapshotTestJSON-1690897005 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.276s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 04:42:23 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-94cd7690-27bb-4894-8322-fc9e96a6e0e1 tempest-VolumesSnapshotTestJSON-1690897005 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T02:42:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-707626368',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=809f59aa-2cd0-4e34-b823-ff4f97fc2ff3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='92c5956be8c447b9872943111e4168dc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T02:42:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T02:42:20Z,use_quota=True,user_id='16ea7041ff434f7890eca88a786ad0f0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(317e369e-1e06-434d-ae95-a335f0e6c903),volume_type_id=317e369e-1e06-434d-ae95-a335f0e6c903)}" {{(pid=87444) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 04:42:23 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.remotefs [None req-94cd7690-27bb-4894-8322-fc9e96a6e0e1 tempest-VolumesSnapshotTestJSON-1690897005 None] Creating volume 809f59aa-2cd0-4e34-b823-ff4f97fc2ff3 {{(pid=87444) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 04:42:23 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-94cd7690-27bb-4894-8322-fc9e96a6e0e1 tempest-VolumesSnapshotTestJSON-1690897005 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 04:42:23 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-94cd7690-27bb-4894-8322-fc9e96a6e0e1 tempest-VolumesSnapshotTestJSON-1690897005 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 04:42:23 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-94cd7690-27bb-4894-8322-fc9e96a6e0e1 tempest-VolumesSnapshotTestJSON-1690897005 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922': None} {{(pid=87444) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 04:42:23 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-94cd7690-27bb-4894-8322-fc9e96a6e0e1 tempest-VolumesSnapshotTestJSON-1690897005 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922'] {{(pid=87444) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 04:42:23 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-94cd7690-27bb-4894-8322-fc9e96a6e0e1 tempest-VolumesSnapshotTestJSON-1690897005 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 04:42:23 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-94cd7690-27bb-4894-8322-fc9e96a6e0e1 tempest-VolumesSnapshotTestJSON-1690897005 None] Selected osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922 as target Quobyte volume. {{(pid=87444) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 04:42:23 devstack cinder-volume[87444]: INFO cinder.volume.drivers.remotefs [None req-94cd7690-27bb-4894-8322-fc9e96a6e0e1 tempest-VolumesSnapshotTestJSON-1690897005 None] casted to osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922 Jul 10 04:42:23 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-94cd7690-27bb-4894-8322-fc9e96a6e0e1 tempest-VolumesSnapshotTestJSON-1690897005 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-809f59aa-2cd0-4e34-b823-ff4f97fc2ff3 1073741824 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:42:23 devstack sudo[96887]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-809f59aa-2cd0-4e34-b823-ff4f97fc2ff3 1073741824 Jul 10 04:42:23 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-3dcca5b9-8d8f-4a48-95e5-09a0ccb8c00c tempest-VolumesTransfersV355Test-1331173015 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (67a6304e-78a1-407f-87ea-a269ec1aec9c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3dca2b75-4530-46ce-bab4-83c878db26e8', 'volume_size': 1}' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:42:23 devstack sudo[96887]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:42:23 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-3dcca5b9-8d8f-4a48-95e5-09a0ccb8c00c tempest-VolumesTransfersV355Test-1331173015 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (37d5035e-59c2-4a14-b346-299385f7062e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:42:23 devstack cinder-volume[87444]: INFO cinder.volume.flows.manager.create_volume [None req-3dcca5b9-8d8f-4a48-95e5-09a0ccb8c00c tempest-VolumesTransfersV355Test-1331173015 None] Volume volume-3dca2b75-4530-46ce-bab4-83c878db26e8 (3dca2b75-4530-46ce-bab4-83c878db26e8): created successfully Jul 10 04:42:23 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-3dcca5b9-8d8f-4a48-95e5-09a0ccb8c00c tempest-VolumesTransfersV355Test-1331173015 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (37d5035e-59c2-4a14-b346-299385f7062e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:42:23 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-3dcca5b9-8d8f-4a48-95e5-09a0ccb8c00c tempest-VolumesTransfersV355Test-1331173015 None] Flow 'volume_create_manager' (c49becde-ee93-4742-af2f-95ba00e02e52) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87444) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 04:42:23 devstack cinder-volume[87444]: INFO cinder.volume.manager [None req-3dcca5b9-8d8f-4a48-95e5-09a0ccb8c00c tempest-VolumesTransfersV355Test-1331173015 None] Created volume successfully. Jul 10 04:42:24 devstack sudo[96884]: pam_unix(sudo:session): session closed for user root Jul 10 04:42:24 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-a692e740-592d-4ea2-8fb2-a071a2d82523 tempest-VolumesDeleteCascade-473852886 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-d9b19f8d-96d4-4eda-8c15-b3f878386b7b" returned: 0 in 1.018s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:42:24 devstack cinder-volume[87444]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e061f64-acb5-44a8-aefa-57383b215e05]: (4, 'qcow2') {{(pid=88499) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 04:42:24 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-a692e740-592d-4ea2-8fb2-a071a2d82523 tempest-VolumesDeleteCascade-473852886 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-d9b19f8d-96d4-4eda-8c15-b3f878386b7b.f48b7140-9e7b-4aed-997a-56065ab747a7 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:42:24 devstack sudo[96897]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-d9b19f8d-96d4-4eda-8c15-b3f878386b7b.f48b7140-9e7b-4aed-997a-56065ab747a7 Jul 10 04:42:24 devstack sudo[96897]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:42:24 devstack sudo[96887]: pam_unix(sudo:session): session closed for user root Jul 10 04:42:24 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-94cd7690-27bb-4894-8322-fc9e96a6e0e1 tempest-VolumesSnapshotTestJSON-1690897005 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-809f59aa-2cd0-4e34-b823-ff4f97fc2ff3 1073741824" returned: 0 in 1.163s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:42:24 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-94cd7690-27bb-4894-8322-fc9e96a6e0e1 tempest-VolumesSnapshotTestJSON-1690897005 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-809f59aa-2cd0-4e34-b823-ff4f97fc2ff3 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:42:24 devstack sudo[96900]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-809f59aa-2cd0-4e34-b823-ff4f97fc2ff3 Jul 10 04:42:24 devstack sudo[96900]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:42:24 devstack cinder-volume[87444]: INFO cinder.volume.manager [None req-80067804-692b-4aa1-b3b3-abdce01f4a1a tempest-VolumesTransfersV355Test-259292868 None] Transfer volume completed successfully. Jul 10 04:42:25 devstack sudo[96897]: pam_unix(sudo:session): session closed for user root Jul 10 04:42:25 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-a692e740-592d-4ea2-8fb2-a071a2d82523 tempest-VolumesDeleteCascade-473852886 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-d9b19f8d-96d4-4eda-8c15-b3f878386b7b.f48b7140-9e7b-4aed-997a-56065ab747a7" returned: 0 in 0.909s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:42:25 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.remotefs [None req-a692e740-592d-4ea2-8fb2-a071a2d82523 tempest-VolumesDeleteCascade-473852886 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d9b19f8d-96d4-4eda-8c15-b3f878386b7b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87444) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 10 04:42:25 devstack cinder-volume[87444]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b3652db-bb40-48bc-addf-200e26ca3993]: (4, 'qcow2') {{(pid=88499) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 04:42:25 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-a692e740-592d-4ea2-8fb2-a071a2d82523 tempest-VolumesDeleteCascade-473852886 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-d9b19f8d-96d4-4eda-8c15-b3f878386b7b.195e91a4-9ba0-44f1-bf44-0ac5e15971a6 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:42:25 devstack sudo[96910]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-d9b19f8d-96d4-4eda-8c15-b3f878386b7b.195e91a4-9ba0-44f1-bf44-0ac5e15971a6 Jul 10 04:42:25 devstack sudo[96910]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:42:25 devstack sudo[96900]: pam_unix(sudo:session): session closed for user root Jul 10 04:42:25 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-94cd7690-27bb-4894-8322-fc9e96a6e0e1 tempest-VolumesSnapshotTestJSON-1690897005 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-809f59aa-2cd0-4e34-b823-ff4f97fc2ff3" returned: 0 in 0.785s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:42:25 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-94cd7690-27bb-4894-8322-fc9e96a6e0e1 tempest-VolumesSnapshotTestJSON-1690897005 None] <== create_volume: return (2012ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922'} {{(pid=87444) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 04:42:25 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-94cd7690-27bb-4894-8322-fc9e96a6e0e1 tempest-VolumesSnapshotTestJSON-1690897005 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.016s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 04:42:25 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-94cd7690-27bb-4894-8322-fc9e96a6e0e1 tempest-VolumesSnapshotTestJSON-1690897005 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dfed53d3-7b51-4110-b199-8ff9f287515f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-809f59aa-2cd0-4e34-b823-ff4f97fc2ff3', 'volume_size': 1}' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:42:25 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-94cd7690-27bb-4894-8322-fc9e96a6e0e1 tempest-VolumesSnapshotTestJSON-1690897005 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4156ae01-f389-4df1-9949-7bda0c28842d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:42:25 devstack cinder-volume[87444]: INFO cinder.volume.flows.manager.create_volume [None req-94cd7690-27bb-4894-8322-fc9e96a6e0e1 tempest-VolumesSnapshotTestJSON-1690897005 None] Volume volume-809f59aa-2cd0-4e34-b823-ff4f97fc2ff3 (809f59aa-2cd0-4e34-b823-ff4f97fc2ff3): created successfully Jul 10 04:42:25 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-94cd7690-27bb-4894-8322-fc9e96a6e0e1 tempest-VolumesSnapshotTestJSON-1690897005 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4156ae01-f389-4df1-9949-7bda0c28842d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:42:25 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-94cd7690-27bb-4894-8322-fc9e96a6e0e1 tempest-VolumesSnapshotTestJSON-1690897005 None] Flow 'volume_create_manager' (1416a1de-7c5a-496a-a0a4-0a817643d9fa) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87444) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 04:42:25 devstack cinder-volume[87444]: INFO cinder.volume.manager [None req-94cd7690-27bb-4894-8322-fc9e96a6e0e1 tempest-VolumesSnapshotTestJSON-1690897005 None] Created volume successfully. Jul 10 04:42:25 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-ccf0f5e7-2162-4ae1-b95d-d55a78318ee0 tempest-VolumesTransfersV355Test-878210328 None] Acquiring lock "cinder-3dca2b75-4530-46ce-bab4-83c878db26e8-delete_volume" by "delete_volume" {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 04:42:25 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-ccf0f5e7-2162-4ae1-b95d-d55a78318ee0 tempest-VolumesTransfersV355Test-878210328 None] Lock "cinder-3dca2b75-4530-46ce-bab4-83c878db26e8-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 04:42:26 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-ccf0f5e7-2162-4ae1-b95d-d55a78318ee0 tempest-VolumesTransfersV355Test-878210328 None] Acquiring lock "cinder-quobyte-3dca2b75-4530-46ce-bab4-83c878db26e8" by "delete_volume" {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 04:42:26 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-ccf0f5e7-2162-4ae1-b95d-d55a78318ee0 tempest-VolumesTransfersV355Test-878210328 None] Lock "cinder-quobyte-3dca2b75-4530-46ce-bab4-83c878db26e8" acquired by "delete_volume" :: waited 0.018s {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 04:42:26 devstack cinder-volume[87444]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a85c22b-1e77-47db-9a04-13d737360e0b]: (4, 'qcow2') {{(pid=88499) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 04:42:26 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-ccf0f5e7-2162-4ae1-b95d-d55a78318ee0 tempest-VolumesTransfersV355Test-878210328 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-3dca2b75-4530-46ce-bab4-83c878db26e8 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:42:26 devstack sudo[96916]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-3dca2b75-4530-46ce-bab4-83c878db26e8 Jul 10 04:42:26 devstack sudo[96916]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:42:26 devstack sudo[96910]: pam_unix(sudo:session): session closed for user root Jul 10 04:42:26 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-a692e740-592d-4ea2-8fb2-a071a2d82523 tempest-VolumesDeleteCascade-473852886 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-d9b19f8d-96d4-4eda-8c15-b3f878386b7b.195e91a4-9ba0-44f1-bf44-0ac5e15971a6" returned: 0 in 1.001s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:42:26 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.remotefs [None req-a692e740-592d-4ea2-8fb2-a071a2d82523 tempest-VolumesDeleteCascade-473852886 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d9b19f8d-96d4-4eda-8c15-b3f878386b7b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87444) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 10 04:42:26 devstack cinder-volume[87444]: DEBUG oslo.privsep.daemon [-] privsep: reply[61bce671-6238-4264-af24-2fc903ad23b9]: (4, 'qcow2') {{(pid=88499) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 04:42:26 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-a692e740-592d-4ea2-8fb2-a071a2d82523 tempest-VolumesDeleteCascade-473852886 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-d9b19f8d-96d4-4eda-8c15-b3f878386b7b {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:42:26 devstack sudo[96920]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-d9b19f8d-96d4-4eda-8c15-b3f878386b7b Jul 10 04:42:26 devstack sudo[96920]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:42:26 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-e9c8e63e-a24b-4a9d-a7a1-009ad21d48f7 tempest-VolumesSnapshotTestJSON-1690897005 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 04:42:26 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-e9c8e63e-a24b-4a9d-a7a1-009ad21d48f7 tempest-VolumesSnapshotTestJSON-1690897005 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 04:42:26 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.remotefs [None req-e9c8e63e-a24b-4a9d-a7a1-009ad21d48f7 tempest-VolumesSnapshotTestJSON-1690897005 None] Creating offline snapshot 13eca88b-eab0-4ab3-a9a0-dc0c6df2c2ff of volume 809f59aa-2cd0-4e34-b823-ff4f97fc2ff3 {{(pid=87444) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 10 04:42:26 devstack cinder-volume[87444]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f81af4b-7d47-4d3c-bb17-bd04a3f9d656]: (4, 'qcow2') {{(pid=88499) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 04:42:26 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-e9c8e63e-a24b-4a9d-a7a1-009ad21d48f7 tempest-VolumesSnapshotTestJSON-1690897005 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-809f59aa-2cd0-4e34-b823-ff4f97fc2ff3 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:42:26 devstack sudo[96922]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-809f59aa-2cd0-4e34-b823-ff4f97fc2ff3 Jul 10 04:42:26 devstack sudo[96922]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:42:27 devstack sudo[96916]: pam_unix(sudo:session): session closed for user root Jul 10 04:42:27 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-ccf0f5e7-2162-4ae1-b95d-d55a78318ee0 tempest-VolumesTransfersV355Test-878210328 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-3dca2b75-4530-46ce-bab4-83c878db26e8" returned: 0 in 1.126s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:42:27 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-ccf0f5e7-2162-4ae1-b95d-d55a78318ee0 tempest-VolumesTransfersV355Test-878210328 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-3dca2b75-4530-46ce-bab4-83c878db26e8 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:42:27 devstack sudo[96930]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-3dca2b75-4530-46ce-bab4-83c878db26e8 Jul 10 04:42:27 devstack sudo[96930]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:42:27 devstack sudo[96920]: pam_unix(sudo:session): session closed for user root Jul 10 04:42:27 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-a692e740-592d-4ea2-8fb2-a071a2d82523 tempest-VolumesDeleteCascade-473852886 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-d9b19f8d-96d4-4eda-8c15-b3f878386b7b" returned: 0 in 1.010s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:42:27 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-a692e740-592d-4ea2-8fb2-a071a2d82523 tempest-VolumesDeleteCascade-473852886 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-d9b19f8d-96d4-4eda-8c15-b3f878386b7b.195e91a4-9ba0-44f1-bf44-0ac5e15971a6 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:42:27 devstack sudo[96932]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-d9b19f8d-96d4-4eda-8c15-b3f878386b7b.195e91a4-9ba0-44f1-bf44-0ac5e15971a6 Jul 10 04:42:27 devstack sudo[96932]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:42:27 devstack cinder-volume[87444]: DEBUG cinder.volume.flows.manager.create_volume [None req-e4de4127-1003-4115-9891-bf31838a2f31 tempest-VolumesActionsTest-532776818 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87444) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 04:42:27 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-e4de4127-1003-4115-9891-bf31838a2f31 tempest-VolumesActionsTest-532776818 None] Flow 'volume_create_manager' (f2b26453-b18d-4c4f-b7c7-522a96d25e7b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 04:42:27 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-e4de4127-1003-4115-9891-bf31838a2f31 tempest-VolumesActionsTest-532776818 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (76e3399a-1528-484b-9a5b-ddf2c0c7b5d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:42:27 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-e4de4127-1003-4115-9891-bf31838a2f31 tempest-VolumesActionsTest-532776818 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (76e3399a-1528-484b-9a5b-ddf2c0c7b5d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T02:42:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1866653520',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=14eaa034-13c6-4839-956c-d2befd0d4d8d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b7f7c43e073b49e0a1374b22d129ca4d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T02:42:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T02:42:27Z,use_quota=True,user_id='874e82d532e748208db6ac2df2ee0324',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(317e369e-1e06-434d-ae95-a335f0e6c903),volume_type_id=317e369e-1e06-434d-ae95-a335f0e6c903)' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:42:27 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-e4de4127-1003-4115-9891-bf31838a2f31 tempest-VolumesActionsTest-532776818 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8cced6a7-d47f-4b8f-a14c-f65511dc3b40) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:42:27 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-e4de4127-1003-4115-9891-bf31838a2f31 tempest-VolumesActionsTest-532776818 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8cced6a7-d47f-4b8f-a14c-f65511dc3b40) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:42:27 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-e4de4127-1003-4115-9891-bf31838a2f31 tempest-VolumesActionsTest-532776818 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (92f85336-6f27-4208-9a93-dc15736f1878) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:42:27 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-e4de4127-1003-4115-9891-bf31838a2f31 tempest-VolumesActionsTest-532776818 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (92f85336-6f27-4208-9a93-dc15736f1878) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '14eaa034-13c6-4839-956c-d2befd0d4d8d', 'volume_name': 'volume-14eaa034-13c6-4839-956c-d2befd0d4d8d', 'volume_size': 1}' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:42:27 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-e4de4127-1003-4115-9891-bf31838a2f31 tempest-VolumesActionsTest-532776818 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ff8f9879-bf44-4c63-af71-b6d1e0032b5e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:42:27 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-e4de4127-1003-4115-9891-bf31838a2f31 tempest-VolumesActionsTest-532776818 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ff8f9879-bf44-4c63-af71-b6d1e0032b5e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:42:27 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-e4de4127-1003-4115-9891-bf31838a2f31 tempest-VolumesActionsTest-532776818 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3ee12599-b49b-4fe7-837d-405ef5913f73) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:42:27 devstack cinder-volume[87444]: INFO cinder.volume.flows.manager.create_volume [None req-e4de4127-1003-4115-9891-bf31838a2f31 tempest-VolumesActionsTest-532776818 None] Volume 14eaa034-13c6-4839-956c-d2befd0d4d8d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-14eaa034-13c6-4839-956c-d2befd0d4d8d', 'volume_size': 1} Jul 10 04:42:27 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-e4de4127-1003-4115-9891-bf31838a2f31 tempest-VolumesActionsTest-532776818 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 04:42:27 devstack sudo[96922]: pam_unix(sudo:session): session closed for user root Jul 10 04:42:27 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-e9c8e63e-a24b-4a9d-a7a1-009ad21d48f7 tempest-VolumesSnapshotTestJSON-1690897005 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-809f59aa-2cd0-4e34-b823-ff4f97fc2ff3" returned: 0 in 0.944s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:42:27 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-e9c8e63e-a24b-4a9d-a7a1-009ad21d48f7 tempest-VolumesSnapshotTestJSON-1690897005 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-809f59aa-2cd0-4e34-b823-ff4f97fc2ff3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-809f59aa-2cd0-4e34-b823-ff4f97fc2ff3.13eca88b-eab0-4ab3-a9a0-dc0c6df2c2ff 1G {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:42:27 devstack sudo[96937]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-809f59aa-2cd0-4e34-b823-ff4f97fc2ff3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-809f59aa-2cd0-4e34-b823-ff4f97fc2ff3.13eca88b-eab0-4ab3-a9a0-dc0c6df2c2ff 1G Jul 10 04:42:27 devstack sudo[96937]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:42:27 devstack sudo[96930]: pam_unix(sudo:session): session closed for user root Jul 10 04:42:27 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-ccf0f5e7-2162-4ae1-b95d-d55a78318ee0 tempest-VolumesTransfersV355Test-878210328 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-3dca2b75-4530-46ce-bab4-83c878db26e8" returned: 0 in 0.738s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:42:27 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-ccf0f5e7-2162-4ae1-b95d-d55a78318ee0 tempest-VolumesTransfersV355Test-878210328 None] Lock "cinder-quobyte-3dca2b75-4530-46ce-bab4-83c878db26e8" released by "delete_volume" :: held 1.910s {{(pid=87444) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 04:42:28 devstack cinder-volume[87444]: DEBUG cinder.quota [None req-ccf0f5e7-2162-4ae1-b95d-d55a78318ee0 tempest-VolumesTransfersV355Test-878210328 None] Created reservations ['6e997f69-b645-4b59-bdb7-8f9d36931f92', '7a8abef7-2259-4594-829f-bb56c9d4b5a8', '68af9072-7476-4183-bf40-01028eff5af8', 'f888d0f4-35e6-4d70-a6fc-74f6e801ab0b'] {{(pid=87444) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 04:42:28 devstack sudo[96932]: pam_unix(sudo:session): session closed for user root Jul 10 04:42:28 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-a692e740-592d-4ea2-8fb2-a071a2d82523 tempest-VolumesDeleteCascade-473852886 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-d9b19f8d-96d4-4eda-8c15-b3f878386b7b.195e91a4-9ba0-44f1-bf44-0ac5e15971a6" returned: 0 in 0.797s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:42:28 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-a692e740-592d-4ea2-8fb2-a071a2d82523 tempest-VolumesDeleteCascade-473852886 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-d9b19f8d-96d4-4eda-8c15-b3f878386b7b.195e91a4-9ba0-44f1-bf44-0ac5e15971a6 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:42:28 devstack sudo[96943]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-d9b19f8d-96d4-4eda-8c15-b3f878386b7b.195e91a4-9ba0-44f1-bf44-0ac5e15971a6 Jul 10 04:42:28 devstack sudo[96943]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:42:28 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-ccf0f5e7-2162-4ae1-b95d-d55a78318ee0 tempest-VolumesTransfersV355Test-878210328 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 04:42:28 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-ccf0f5e7-2162-4ae1-b95d-d55a78318ee0 tempest-VolumesTransfersV355Test-878210328 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 04:42:28 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-ccf0f5e7-2162-4ae1-b95d-d55a78318ee0 tempest-VolumesTransfersV355Test-878210328 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922': None} {{(pid=87444) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 04:42:28 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-ccf0f5e7-2162-4ae1-b95d-d55a78318ee0 tempest-VolumesTransfersV355Test-878210328 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922'] {{(pid=87444) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 04:42:28 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-ccf0f5e7-2162-4ae1-b95d-d55a78318ee0 tempest-VolumesTransfersV355Test-878210328 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 04:42:28 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-ccf0f5e7-2162-4ae1-b95d-d55a78318ee0 tempest-VolumesTransfersV355Test-878210328 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:42:28 devstack sudo[96945]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097 Jul 10 04:42:28 devstack sudo[96945]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:42:28 devstack sudo[96937]: pam_unix(sudo:session): session closed for user root Jul 10 04:42:28 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-e9c8e63e-a24b-4a9d-a7a1-009ad21d48f7 tempest-VolumesSnapshotTestJSON-1690897005 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-809f59aa-2cd0-4e34-b823-ff4f97fc2ff3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-809f59aa-2cd0-4e34-b823-ff4f97fc2ff3.13eca88b-eab0-4ab3-a9a0-dc0c6df2c2ff 1G" returned: 0 in 0.934s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:42:28 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-e9c8e63e-a24b-4a9d-a7a1-009ad21d48f7 tempest-VolumesSnapshotTestJSON-1690897005 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-809f59aa-2cd0-4e34-b823-ff4f97fc2ff3 -F qcow2 /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-809f59aa-2cd0-4e34-b823-ff4f97fc2ff3.13eca88b-eab0-4ab3-a9a0-dc0c6df2c2ff {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:42:28 devstack sudo[96951]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-809f59aa-2cd0-4e34-b823-ff4f97fc2ff3 -F qcow2 /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-809f59aa-2cd0-4e34-b823-ff4f97fc2ff3.13eca88b-eab0-4ab3-a9a0-dc0c6df2c2ff Jul 10 04:42:28 devstack sudo[96951]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:42:28 devstack sudo[96945]: pam_unix(sudo:session): session closed for user root Jul 10 04:42:28 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-ccf0f5e7-2162-4ae1-b95d-d55a78318ee0 tempest-VolumesTransfersV355Test-878210328 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097" returned: 0 in 0.752s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:42:28 devstack cinder-volume[87444]: DEBUG cinder.manager [None req-ccf0f5e7-2162-4ae1-b95d-d55a78318ee0 tempest-VolumesTransfersV355Test-878210328 None] Notifying Schedulers of capabilities ... {{(pid=87444) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 04:42:28 devstack cinder-volume[87444]: INFO cinder.volume.manager [None req-ccf0f5e7-2162-4ae1-b95d-d55a78318ee0 tempest-VolumesTransfersV355Test-878210328 None] Deleted volume successfully. Jul 10 04:42:28 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-ccf0f5e7-2162-4ae1-b95d-d55a78318ee0 tempest-VolumesTransfersV355Test-878210328 None] Lock "cinder-3dca2b75-4530-46ce-bab4-83c878db26e8-delete_volume" released by "delete_volume" :: held 2.898s {{(pid=87444) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 04:42:28 devstack sudo[96943]: pam_unix(sudo:session): session closed for user root Jul 10 04:42:28 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-a692e740-592d-4ea2-8fb2-a071a2d82523 tempest-VolumesDeleteCascade-473852886 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-d9b19f8d-96d4-4eda-8c15-b3f878386b7b.195e91a4-9ba0-44f1-bf44-0ac5e15971a6" returned: 0 in 0.857s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:42:28 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-a692e740-592d-4ea2-8fb2-a071a2d82523 tempest-VolumesDeleteCascade-473852886 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d9b19f8d-96d4-4eda-8c15-b3f878386b7b /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-d9b19f8d-96d4-4eda-8c15-b3f878386b7b.f48b7140-9e7b-4aed-997a-56065ab747a7 -F qcow2 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:42:28 devstack sudo[96955]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d9b19f8d-96d4-4eda-8c15-b3f878386b7b /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-d9b19f8d-96d4-4eda-8c15-b3f878386b7b.f48b7140-9e7b-4aed-997a-56065ab747a7 -F qcow2 Jul 10 04:42:28 devstack sudo[96955]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:42:28 devstack cinder-volume[87444]: DEBUG cinder.volume.flows.manager.create_volume [None req-0d55f6b7-6e6b-4d26-9712-bb2f9ae27f2a tempest-VolumesTransfersV355Test-1331173015 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87444) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 04:42:29 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-0d55f6b7-6e6b-4d26-9712-bb2f9ae27f2a tempest-VolumesTransfersV355Test-1331173015 None] Flow 'volume_create_manager' (c641a892-0839-4c71-8b2d-c105d71a25de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 04:42:29 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-0d55f6b7-6e6b-4d26-9712-bb2f9ae27f2a tempest-VolumesTransfersV355Test-1331173015 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (71391cd7-8ea6-4a0b-b6f9-fab63eaabccb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:42:29 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-0d55f6b7-6e6b-4d26-9712-bb2f9ae27f2a tempest-VolumesTransfersV355Test-1331173015 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (71391cd7-8ea6-4a0b-b6f9-fab63eaabccb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T02:42:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1998774568',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=929136fd-c05b-4954-a10f-27eccf702240,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='55005e2e59f841d3979d0c53b9033ab2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T02:42:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T02:42:29Z,use_quota=True,user_id='aeea6b10dac04cada334ae2e381a4101',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(317e369e-1e06-434d-ae95-a335f0e6c903),volume_type_id=317e369e-1e06-434d-ae95-a335f0e6c903)' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:42:29 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-0d55f6b7-6e6b-4d26-9712-bb2f9ae27f2a tempest-VolumesTransfersV355Test-1331173015 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b70edb86-6a6a-42a8-ab7e-197a0e152e02) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:42:29 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-0d55f6b7-6e6b-4d26-9712-bb2f9ae27f2a tempest-VolumesTransfersV355Test-1331173015 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b70edb86-6a6a-42a8-ab7e-197a0e152e02) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:42:29 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-0d55f6b7-6e6b-4d26-9712-bb2f9ae27f2a tempest-VolumesTransfersV355Test-1331173015 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d95e57e4-9468-4451-8506-0abeeda1e945) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:42:29 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-0d55f6b7-6e6b-4d26-9712-bb2f9ae27f2a tempest-VolumesTransfersV355Test-1331173015 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d95e57e4-9468-4451-8506-0abeeda1e945) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '929136fd-c05b-4954-a10f-27eccf702240', 'volume_name': 'volume-929136fd-c05b-4954-a10f-27eccf702240', 'volume_size': 1}' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:42:29 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-0d55f6b7-6e6b-4d26-9712-bb2f9ae27f2a tempest-VolumesTransfersV355Test-1331173015 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6d81bc04-122d-488d-b932-abd3f17fd6bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:42:29 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-0d55f6b7-6e6b-4d26-9712-bb2f9ae27f2a tempest-VolumesTransfersV355Test-1331173015 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6d81bc04-122d-488d-b932-abd3f17fd6bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:42:29 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-0d55f6b7-6e6b-4d26-9712-bb2f9ae27f2a tempest-VolumesTransfersV355Test-1331173015 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (55699fe7-c522-4ac2-8e71-2696e6555368) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:42:29 devstack cinder-volume[87444]: INFO cinder.volume.flows.manager.create_volume [None req-0d55f6b7-6e6b-4d26-9712-bb2f9ae27f2a tempest-VolumesTransfersV355Test-1331173015 None] Volume 929136fd-c05b-4954-a10f-27eccf702240: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-929136fd-c05b-4954-a10f-27eccf702240', 'volume_size': 1} Jul 10 04:42:29 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-0d55f6b7-6e6b-4d26-9712-bb2f9ae27f2a tempest-VolumesTransfersV355Test-1331173015 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 04:42:29 devstack sudo[96951]: pam_unix(sudo:session): session closed for user root Jul 10 04:42:29 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-e9c8e63e-a24b-4a9d-a7a1-009ad21d48f7 tempest-VolumesSnapshotTestJSON-1690897005 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-809f59aa-2cd0-4e34-b823-ff4f97fc2ff3 -F qcow2 /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-809f59aa-2cd0-4e34-b823-ff4f97fc2ff3.13eca88b-eab0-4ab3-a9a0-dc0c6df2c2ff" returned: 0 in 0.737s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:42:29 devstack cinder-volume[87444]: WARNING cinder.volume.drivers.remotefs [None req-e9c8e63e-a24b-4a9d-a7a1-009ad21d48f7 tempest-VolumesSnapshotTestJSON-1690897005 None] /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-809f59aa-2cd0-4e34-b823-ff4f97fc2ff3.13eca88b-eab0-4ab3-a9a0-dc0c6df2c2ff is being set with open permissions: ugo+rw Jul 10 04:42:29 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-e9c8e63e-a24b-4a9d-a7a1-009ad21d48f7 tempest-VolumesSnapshotTestJSON-1690897005 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-809f59aa-2cd0-4e34-b823-ff4f97fc2ff3.13eca88b-eab0-4ab3-a9a0-dc0c6df2c2ff {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:42:29 devstack sudo[96960]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-809f59aa-2cd0-4e34-b823-ff4f97fc2ff3.13eca88b-eab0-4ab3-a9a0-dc0c6df2c2ff Jul 10 04:42:29 devstack sudo[96960]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:42:29 devstack sudo[96955]: pam_unix(sudo:session): session closed for user root Jul 10 04:42:29 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-a692e740-592d-4ea2-8fb2-a071a2d82523 tempest-VolumesDeleteCascade-473852886 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d9b19f8d-96d4-4eda-8c15-b3f878386b7b /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-d9b19f8d-96d4-4eda-8c15-b3f878386b7b.f48b7140-9e7b-4aed-997a-56065ab747a7 -F qcow2" returned: 0 in 0.709s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:42:29 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-a692e740-592d-4ea2-8fb2-a071a2d82523 tempest-VolumesDeleteCascade-473852886 None] Lock "cinder-quobyte-195e91a4-9ba0-44f1-bf44-0ac5e15971a6" released by "_delete_snapshot" :: held 7.486s {{(pid=87444) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 04:42:29 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-a692e740-592d-4ea2-8fb2-a071a2d82523 tempest-VolumesDeleteCascade-473852886 None] Lock "cinder-quobyte-d9b19f8d-96d4-4eda-8c15-b3f878386b7b" released by "delete_snapshot" :: held 7.523s {{(pid=87444) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 04:42:29 devstack cinder-volume[87444]: DEBUG cinder.quota [None req-a692e740-592d-4ea2-8fb2-a071a2d82523 tempest-VolumesDeleteCascade-473852886 None] Created reservations ['538d6b2e-2e38-45c9-b728-7e2fbe4f18c3', '889efe4d-92f3-42ce-bc94-83cd027efefc', '886a4314-1703-482a-ac2a-039b1dc16575', '307048da-83a6-42b5-9fc2-72326e3cf0b1'] {{(pid=87444) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 04:42:29 devstack cinder-volume[87444]: INFO cinder.volume.manager [None req-a692e740-592d-4ea2-8fb2-a071a2d82523 tempest-VolumesDeleteCascade-473852886 None] Delete snapshot completed successfully. Jul 10 04:42:29 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-a692e740-592d-4ea2-8fb2-a071a2d82523 tempest-VolumesDeleteCascade-473852886 None] Lock "cinder-195e91a4-9ba0-44f1-bf44-0ac5e15971a6-delete_snapshot" released by "delete_snapshot" :: held 7.746s {{(pid=87444) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 04:42:29 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-a692e740-592d-4ea2-8fb2-a071a2d82523 tempest-VolumesDeleteCascade-473852886 None] Acquiring lock "cinder-f48b7140-9e7b-4aed-997a-56065ab747a7-delete_snapshot" by "delete_snapshot" {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 04:42:29 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-a692e740-592d-4ea2-8fb2-a071a2d82523 tempest-VolumesDeleteCascade-473852886 None] Lock "cinder-f48b7140-9e7b-4aed-997a-56065ab747a7-delete_snapshot" acquired by "delete_snapshot" :: waited 0.024s {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 04:42:29 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-a692e740-592d-4ea2-8fb2-a071a2d82523 tempest-VolumesDeleteCascade-473852886 None] Acquiring lock "cinder-quobyte-d9b19f8d-96d4-4eda-8c15-b3f878386b7b" by "delete_snapshot" {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 04:42:29 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-a692e740-592d-4ea2-8fb2-a071a2d82523 tempest-VolumesDeleteCascade-473852886 None] Lock "cinder-quobyte-d9b19f8d-96d4-4eda-8c15-b3f878386b7b" acquired by "delete_snapshot" :: waited 0.018s {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 04:42:29 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-a692e740-592d-4ea2-8fb2-a071a2d82523 tempest-VolumesDeleteCascade-473852886 None] Acquiring lock "cinder-quobyte-f48b7140-9e7b-4aed-997a-56065ab747a7" by "_delete_snapshot" {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 04:42:29 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-a692e740-592d-4ea2-8fb2-a071a2d82523 tempest-VolumesDeleteCascade-473852886 None] Lock "cinder-quobyte-f48b7140-9e7b-4aed-997a-56065ab747a7" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 04:42:29 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.remotefs [None req-a692e740-592d-4ea2-8fb2-a071a2d82523 tempest-VolumesDeleteCascade-473852886 None] Deleting offline snapshot f48b7140-9e7b-4aed-997a-56065ab747a7 of volume d9b19f8d-96d4-4eda-8c15-b3f878386b7b {{(pid=87444) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 10 04:42:29 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.remotefs [None req-a692e740-592d-4ea2-8fb2-a071a2d82523 tempest-VolumesDeleteCascade-473852886 None] snapshot_file for this snap is: volume-d9b19f8d-96d4-4eda-8c15-b3f878386b7b.f48b7140-9e7b-4aed-997a-56065ab747a7 {{(pid=87444) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 10 04:42:29 devstack cinder-volume[87444]: DEBUG oslo.privsep.daemon [-] privsep: reply[8bc481d1-9c77-4778-a2ef-90746e011781]: (4, 'qcow2') {{(pid=88499) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 04:42:29 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-a692e740-592d-4ea2-8fb2-a071a2d82523 tempest-VolumesDeleteCascade-473852886 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-d9b19f8d-96d4-4eda-8c15-b3f878386b7b.f48b7140-9e7b-4aed-997a-56065ab747a7 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:42:30 devstack sudo[96960]: pam_unix(sudo:session): session closed for user root Jul 10 04:42:30 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-e9c8e63e-a24b-4a9d-a7a1-009ad21d48f7 tempest-VolumesSnapshotTestJSON-1690897005 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-809f59aa-2cd0-4e34-b823-ff4f97fc2ff3.13eca88b-eab0-4ab3-a9a0-dc0c6df2c2ff" returned: 0 in 0.667s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:42:30 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-e9c8e63e-a24b-4a9d-a7a1-009ad21d48f7 tempest-VolumesSnapshotTestJSON-1690897005 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-809f59aa-2cd0-4e34-b823-ff4f97fc2ff3.info {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:42:30 devstack sudo[96967]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-809f59aa-2cd0-4e34-b823-ff4f97fc2ff3.info Jul 10 04:42:30 devstack sudo[96967]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:42:30 devstack sudo[96966]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-d9b19f8d-96d4-4eda-8c15-b3f878386b7b.f48b7140-9e7b-4aed-997a-56065ab747a7 Jul 10 04:42:30 devstack sudo[96966]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:42:30 devstack sudo[96967]: pam_unix(sudo:session): session closed for user root Jul 10 04:42:30 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-e9c8e63e-a24b-4a9d-a7a1-009ad21d48f7 tempest-VolumesSnapshotTestJSON-1690897005 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-809f59aa-2cd0-4e34-b823-ff4f97fc2ff3.info" returned: 0 in 0.650s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:42:30 devstack cinder-volume[87444]: WARNING cinder.volume.drivers.remotefs [None req-e9c8e63e-a24b-4a9d-a7a1-009ad21d48f7 tempest-VolumesSnapshotTestJSON-1690897005 None] /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-809f59aa-2cd0-4e34-b823-ff4f97fc2ff3.info is being set with open permissions: ugo+rw Jul 10 04:42:30 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-e9c8e63e-a24b-4a9d-a7a1-009ad21d48f7 tempest-VolumesSnapshotTestJSON-1690897005 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-809f59aa-2cd0-4e34-b823-ff4f97fc2ff3.info {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:42:30 devstack sudo[96974]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-809f59aa-2cd0-4e34-b823-ff4f97fc2ff3.info Jul 10 04:42:30 devstack sudo[96974]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:42:30 devstack sudo[96966]: pam_unix(sudo:session): session closed for user root Jul 10 04:42:30 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-a692e740-592d-4ea2-8fb2-a071a2d82523 tempest-VolumesDeleteCascade-473852886 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-d9b19f8d-96d4-4eda-8c15-b3f878386b7b.f48b7140-9e7b-4aed-997a-56065ab747a7" returned: 0 in 0.797s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:42:30 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.remotefs [None req-a692e740-592d-4ea2-8fb2-a071a2d82523 tempest-VolumesDeleteCascade-473852886 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d9b19f8d-96d4-4eda-8c15-b3f878386b7b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87444) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 10 04:42:30 devstack cinder-volume[87444]: DEBUG oslo.privsep.daemon [-] privsep: reply[439b577e-7624-4c37-a7b6-b7385176516a]: (4, 'qcow2') {{(pid=88499) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 04:42:30 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-a692e740-592d-4ea2-8fb2-a071a2d82523 tempest-VolumesDeleteCascade-473852886 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-d9b19f8d-96d4-4eda-8c15-b3f878386b7b {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:42:30 devstack sudo[96976]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-d9b19f8d-96d4-4eda-8c15-b3f878386b7b Jul 10 04:42:30 devstack sudo[96976]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:42:31 devstack sudo[96974]: pam_unix(sudo:session): session closed for user root Jul 10 04:42:31 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-e9c8e63e-a24b-4a9d-a7a1-009ad21d48f7 tempest-VolumesSnapshotTestJSON-1690897005 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-809f59aa-2cd0-4e34-b823-ff4f97fc2ff3.info" returned: 0 in 0.702s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:42:31 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-e9c8e63e-a24b-4a9d-a7a1-009ad21d48f7 tempest-VolumesSnapshotTestJSON-1690897005 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.719s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 04:42:31 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-e4de4127-1003-4115-9891-bf31838a2f31 tempest-VolumesActionsTest-532776818 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.928s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 04:42:31 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-e4de4127-1003-4115-9891-bf31838a2f31 tempest-VolumesActionsTest-532776818 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T02:42:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1866653520',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=14eaa034-13c6-4839-956c-d2befd0d4d8d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b7f7c43e073b49e0a1374b22d129ca4d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T02:42:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T02:42:27Z,use_quota=True,user_id='874e82d532e748208db6ac2df2ee0324',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(317e369e-1e06-434d-ae95-a335f0e6c903),volume_type_id=317e369e-1e06-434d-ae95-a335f0e6c903)}" {{(pid=87444) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 04:42:31 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.remotefs [None req-e4de4127-1003-4115-9891-bf31838a2f31 tempest-VolumesActionsTest-532776818 None] Creating volume 14eaa034-13c6-4839-956c-d2befd0d4d8d {{(pid=87444) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 04:42:31 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-e4de4127-1003-4115-9891-bf31838a2f31 tempest-VolumesActionsTest-532776818 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 04:42:31 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-e4de4127-1003-4115-9891-bf31838a2f31 tempest-VolumesActionsTest-532776818 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 04:42:31 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-e4de4127-1003-4115-9891-bf31838a2f31 tempest-VolumesActionsTest-532776818 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922': None} {{(pid=87444) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 04:42:31 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-e4de4127-1003-4115-9891-bf31838a2f31 tempest-VolumesActionsTest-532776818 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922'] {{(pid=87444) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 04:42:31 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-e4de4127-1003-4115-9891-bf31838a2f31 tempest-VolumesActionsTest-532776818 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 04:42:31 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-e4de4127-1003-4115-9891-bf31838a2f31 tempest-VolumesActionsTest-532776818 None] Selected osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922 as target Quobyte volume. {{(pid=87444) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 04:42:31 devstack cinder-volume[87444]: INFO cinder.volume.drivers.remotefs [None req-e4de4127-1003-4115-9891-bf31838a2f31 tempest-VolumesActionsTest-532776818 None] casted to osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922 Jul 10 04:42:31 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-e4de4127-1003-4115-9891-bf31838a2f31 tempest-VolumesActionsTest-532776818 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-14eaa034-13c6-4839-956c-d2befd0d4d8d 1073741824 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:42:31 devstack sudo[97017]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-14eaa034-13c6-4839-956c-d2befd0d4d8d 1073741824 Jul 10 04:42:31 devstack sudo[97017]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:42:31 devstack cinder-volume[87444]: INFO cinder.volume.manager [None req-e9c8e63e-a24b-4a9d-a7a1-009ad21d48f7 tempest-VolumesSnapshotTestJSON-1690897005 None] Create snapshot completed successfully Jul 10 04:42:31 devstack sudo[96976]: pam_unix(sudo:session): session closed for user root Jul 10 04:42:31 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-a692e740-592d-4ea2-8fb2-a071a2d82523 tempest-VolumesDeleteCascade-473852886 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-d9b19f8d-96d4-4eda-8c15-b3f878386b7b" returned: 0 in 0.774s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:42:31 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-a692e740-592d-4ea2-8fb2-a071a2d82523 tempest-VolumesDeleteCascade-473852886 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-d9b19f8d-96d4-4eda-8c15-b3f878386b7b.f48b7140-9e7b-4aed-997a-56065ab747a7 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:42:31 devstack sudo[97020]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-d9b19f8d-96d4-4eda-8c15-b3f878386b7b.f48b7140-9e7b-4aed-997a-56065ab747a7 Jul 10 04:42:31 devstack sudo[97020]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:42:32 devstack sudo[97017]: pam_unix(sudo:session): session closed for user root Jul 10 04:42:32 devstack sudo[97020]: pam_unix(sudo:session): session closed for user root Jul 10 04:42:32 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-a692e740-592d-4ea2-8fb2-a071a2d82523 tempest-VolumesDeleteCascade-473852886 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-d9b19f8d-96d4-4eda-8c15-b3f878386b7b.f48b7140-9e7b-4aed-997a-56065ab747a7" returned: 0 in 0.802s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:42:32 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-a692e740-592d-4ea2-8fb2-a071a2d82523 tempest-VolumesDeleteCascade-473852886 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-d9b19f8d-96d4-4eda-8c15-b3f878386b7b.f48b7140-9e7b-4aed-997a-56065ab747a7 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:42:32 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-e4de4127-1003-4115-9891-bf31838a2f31 tempest-VolumesActionsTest-532776818 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-14eaa034-13c6-4839-956c-d2befd0d4d8d 1073741824" returned: 0 in 0.971s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:42:32 devstack sudo[97030]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-d9b19f8d-96d4-4eda-8c15-b3f878386b7b.f48b7140-9e7b-4aed-997a-56065ab747a7 Jul 10 04:42:32 devstack sudo[97030]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:42:32 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-e4de4127-1003-4115-9891-bf31838a2f31 tempest-VolumesActionsTest-532776818 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-14eaa034-13c6-4839-956c-d2befd0d4d8d {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:42:32 devstack sudo[97032]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-14eaa034-13c6-4839-956c-d2befd0d4d8d Jul 10 04:42:32 devstack sudo[97032]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:42:32 devstack cinder-volume[87444]: DEBUG cinder.volume.flows.manager.create_volume [None req-2db55748-9ffc-49b5-ad78-d6bb51d8edb5 tempest-VolumesSnapshotTestJSON-1690897005 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87444) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 04:42:32 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-2db55748-9ffc-49b5-ad78-d6bb51d8edb5 tempest-VolumesSnapshotTestJSON-1690897005 None] Flow 'volume_create_manager' (96082246-757d-4ac0-b316-e5d7bf4a18b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 04:42:32 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-2db55748-9ffc-49b5-ad78-d6bb51d8edb5 tempest-VolumesSnapshotTestJSON-1690897005 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8833c067-06ea-420d-9b59-d6a0c884effb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:42:32 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-2db55748-9ffc-49b5-ad78-d6bb51d8edb5 tempest-VolumesSnapshotTestJSON-1690897005 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8833c067-06ea-420d-9b59-d6a0c884effb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T02:42:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-672462705',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=47f65e0d-5007-47fc-a78c-bc8800625bc6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='92c5956be8c447b9872943111e4168dc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T02:42:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=13eca88b-eab0-4ab3-a9a0-dc0c6df2c2ff,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T02:42:32Z,use_quota=True,user_id='16ea7041ff434f7890eca88a786ad0f0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(317e369e-1e06-434d-ae95-a335f0e6c903),volume_type_id=317e369e-1e06-434d-ae95-a335f0e6c903)' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:42:32 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-2db55748-9ffc-49b5-ad78-d6bb51d8edb5 tempest-VolumesSnapshotTestJSON-1690897005 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (52d16cec-d5ef-4126-b26c-0c6e32972182) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:42:32 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-2db55748-9ffc-49b5-ad78-d6bb51d8edb5 tempest-VolumesSnapshotTestJSON-1690897005 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (52d16cec-d5ef-4126-b26c-0c6e32972182) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:42:32 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-2db55748-9ffc-49b5-ad78-d6bb51d8edb5 tempest-VolumesSnapshotTestJSON-1690897005 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c3c2350b-714d-479c-b8a2-4894686e526d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:42:32 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-2db55748-9ffc-49b5-ad78-d6bb51d8edb5 tempest-VolumesSnapshotTestJSON-1690897005 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c3c2350b-714d-479c-b8a2-4894686e526d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '47f65e0d-5007-47fc-a78c-bc8800625bc6', 'volume_name': 'volume-47f65e0d-5007-47fc-a78c-bc8800625bc6', 'volume_size': 1, 'snapshot_id': '13eca88b-eab0-4ab3-a9a0-dc0c6df2c2ff'}' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:42:32 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-2db55748-9ffc-49b5-ad78-d6bb51d8edb5 tempest-VolumesSnapshotTestJSON-1690897005 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (21c16cac-3c6e-49d6-9b5f-9fbf69beba1b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:42:32 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-2db55748-9ffc-49b5-ad78-d6bb51d8edb5 tempest-VolumesSnapshotTestJSON-1690897005 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (21c16cac-3c6e-49d6-9b5f-9fbf69beba1b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:42:32 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-2db55748-9ffc-49b5-ad78-d6bb51d8edb5 tempest-VolumesSnapshotTestJSON-1690897005 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (997c7c93-0b08-4e2d-93f3-b89c5302f4ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:42:32 devstack cinder-volume[87444]: INFO cinder.volume.flows.manager.create_volume [None req-2db55748-9ffc-49b5-ad78-d6bb51d8edb5 tempest-VolumesSnapshotTestJSON-1690897005 None] Volume 47f65e0d-5007-47fc-a78c-bc8800625bc6: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-47f65e0d-5007-47fc-a78c-bc8800625bc6', 'volume_size': 1, 'snapshot_id': '13eca88b-eab0-4ab3-a9a0-dc0c6df2c2ff'} Jul 10 04:42:32 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-2db55748-9ffc-49b5-ad78-d6bb51d8edb5 tempest-VolumesSnapshotTestJSON-1690897005 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 04:42:32 devstack cinder-volume[87444]: DEBUG oslo_service.periodic_task [None req-01f0ce3e-6850-4e14-881d-e40d3c4ad6e5 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87444) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 10 04:42:32 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-01f0ce3e-6850-4e14-881d-e40d3c4ad6e5 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 04:42:32 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-01f0ce3e-6850-4e14-881d-e40d3c4ad6e5 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 04:42:32 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-01f0ce3e-6850-4e14-881d-e40d3c4ad6e5 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922': None} {{(pid=87444) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 04:42:33 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-01f0ce3e-6850-4e14-881d-e40d3c4ad6e5 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922'] {{(pid=87444) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 04:42:33 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-01f0ce3e-6850-4e14-881d-e40d3c4ad6e5 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 04:42:33 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-01f0ce3e-6850-4e14-881d-e40d3c4ad6e5 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:42:33 devstack sudo[97036]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097 Jul 10 04:42:33 devstack sudo[97036]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:42:33 devstack sudo[97030]: pam_unix(sudo:session): session closed for user root Jul 10 04:42:33 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-a692e740-592d-4ea2-8fb2-a071a2d82523 tempest-VolumesDeleteCascade-473852886 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-d9b19f8d-96d4-4eda-8c15-b3f878386b7b.f48b7140-9e7b-4aed-997a-56065ab747a7" returned: 0 in 0.724s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:42:33 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-a692e740-592d-4ea2-8fb2-a071a2d82523 tempest-VolumesDeleteCascade-473852886 None] Lock "cinder-quobyte-f48b7140-9e7b-4aed-997a-56065ab747a7" released by "_delete_snapshot" :: held 3.196s {{(pid=87444) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 04:42:33 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-a692e740-592d-4ea2-8fb2-a071a2d82523 tempest-VolumesDeleteCascade-473852886 None] Lock "cinder-quobyte-d9b19f8d-96d4-4eda-8c15-b3f878386b7b" released by "delete_snapshot" :: held 3.221s {{(pid=87444) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 04:42:33 devstack sudo[97032]: pam_unix(sudo:session): session closed for user root Jul 10 04:42:33 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-e4de4127-1003-4115-9891-bf31838a2f31 tempest-VolumesActionsTest-532776818 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-14eaa034-13c6-4839-956c-d2befd0d4d8d" returned: 0 in 0.732s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:42:33 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-e4de4127-1003-4115-9891-bf31838a2f31 tempest-VolumesActionsTest-532776818 None] <== create_volume: return (1761ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922'} {{(pid=87444) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 04:42:33 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-e4de4127-1003-4115-9891-bf31838a2f31 tempest-VolumesActionsTest-532776818 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.765s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 04:42:33 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-0d55f6b7-6e6b-4d26-9712-bb2f9ae27f2a tempest-VolumesTransfersV355Test-1331173015 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.104s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 04:42:33 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-0d55f6b7-6e6b-4d26-9712-bb2f9ae27f2a tempest-VolumesTransfersV355Test-1331173015 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T02:42:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1998774568',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=929136fd-c05b-4954-a10f-27eccf702240,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='55005e2e59f841d3979d0c53b9033ab2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T02:42:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T02:42:29Z,use_quota=True,user_id='aeea6b10dac04cada334ae2e381a4101',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(317e369e-1e06-434d-ae95-a335f0e6c903),volume_type_id=317e369e-1e06-434d-ae95-a335f0e6c903)}" {{(pid=87444) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 04:42:33 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.remotefs [None req-0d55f6b7-6e6b-4d26-9712-bb2f9ae27f2a tempest-VolumesTransfersV355Test-1331173015 None] Creating volume 929136fd-c05b-4954-a10f-27eccf702240 {{(pid=87444) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 04:42:33 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-0d55f6b7-6e6b-4d26-9712-bb2f9ae27f2a tempest-VolumesTransfersV355Test-1331173015 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 04:42:33 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-0d55f6b7-6e6b-4d26-9712-bb2f9ae27f2a tempest-VolumesTransfersV355Test-1331173015 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 04:42:33 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-0d55f6b7-6e6b-4d26-9712-bb2f9ae27f2a tempest-VolumesTransfersV355Test-1331173015 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922': None} {{(pid=87444) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 04:42:33 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-0d55f6b7-6e6b-4d26-9712-bb2f9ae27f2a tempest-VolumesTransfersV355Test-1331173015 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922'] {{(pid=87444) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 04:42:33 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-0d55f6b7-6e6b-4d26-9712-bb2f9ae27f2a tempest-VolumesTransfersV355Test-1331173015 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 04:42:33 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-0d55f6b7-6e6b-4d26-9712-bb2f9ae27f2a tempest-VolumesTransfersV355Test-1331173015 None] Selected osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922 as target Quobyte volume. {{(pid=87444) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 04:42:33 devstack cinder-volume[87444]: INFO cinder.volume.drivers.remotefs [None req-0d55f6b7-6e6b-4d26-9712-bb2f9ae27f2a tempest-VolumesTransfersV355Test-1331173015 None] casted to osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922 Jul 10 04:42:33 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-0d55f6b7-6e6b-4d26-9712-bb2f9ae27f2a tempest-VolumesTransfersV355Test-1331173015 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-929136fd-c05b-4954-a10f-27eccf702240 1073741824 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:42:33 devstack sudo[97039]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-929136fd-c05b-4954-a10f-27eccf702240 1073741824 Jul 10 04:42:33 devstack sudo[97039]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:42:33 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-e4de4127-1003-4115-9891-bf31838a2f31 tempest-VolumesActionsTest-532776818 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3ee12599-b49b-4fe7-837d-405ef5913f73) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-14eaa034-13c6-4839-956c-d2befd0d4d8d', 'volume_size': 1}' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:42:33 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-e4de4127-1003-4115-9891-bf31838a2f31 tempest-VolumesActionsTest-532776818 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (642fea8b-b51e-45d6-9fa6-33812b070510) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:42:33 devstack cinder-volume[87444]: INFO cinder.volume.flows.manager.create_volume [None req-e4de4127-1003-4115-9891-bf31838a2f31 tempest-VolumesActionsTest-532776818 None] Volume volume-14eaa034-13c6-4839-956c-d2befd0d4d8d (14eaa034-13c6-4839-956c-d2befd0d4d8d): created successfully Jul 10 04:42:33 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-e4de4127-1003-4115-9891-bf31838a2f31 tempest-VolumesActionsTest-532776818 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (642fea8b-b51e-45d6-9fa6-33812b070510) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:42:33 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-e4de4127-1003-4115-9891-bf31838a2f31 tempest-VolumesActionsTest-532776818 None] Flow 'volume_create_manager' (f2b26453-b18d-4c4f-b7c7-522a96d25e7b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87444) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 04:42:33 devstack cinder-volume[87444]: DEBUG cinder.quota [None req-a692e740-592d-4ea2-8fb2-a071a2d82523 tempest-VolumesDeleteCascade-473852886 None] Created reservations ['107010c2-766e-436a-80fc-fcc628b8179c', 'b6a4c007-b0b4-4bfb-a19b-46f75be0a483', 'fb96a3a8-19c6-4227-9d51-6a1775463e51', '9215fe69-4466-4c8e-a2e1-6790490ee1f7'] {{(pid=87444) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 04:42:33 devstack cinder-volume[87444]: INFO cinder.volume.manager [None req-e4de4127-1003-4115-9891-bf31838a2f31 tempest-VolumesActionsTest-532776818 None] Created volume successfully. Jul 10 04:42:33 devstack cinder-volume[87444]: INFO cinder.volume.manager [None req-a692e740-592d-4ea2-8fb2-a071a2d82523 tempest-VolumesDeleteCascade-473852886 None] Delete snapshot completed successfully. Jul 10 04:42:33 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-a692e740-592d-4ea2-8fb2-a071a2d82523 tempest-VolumesDeleteCascade-473852886 None] Lock "cinder-f48b7140-9e7b-4aed-997a-56065ab747a7-delete_snapshot" released by "delete_snapshot" :: held 3.477s {{(pid=87444) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 04:42:33 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-a692e740-592d-4ea2-8fb2-a071a2d82523 tempest-VolumesDeleteCascade-473852886 None] Snapshots deleted, issuing volume delete {{(pid=87444) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}} Jul 10 04:42:33 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-a692e740-592d-4ea2-8fb2-a071a2d82523 tempest-VolumesDeleteCascade-473852886 None] Acquiring lock "cinder-quobyte-d9b19f8d-96d4-4eda-8c15-b3f878386b7b" by "delete_volume" {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 04:42:33 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-a692e740-592d-4ea2-8fb2-a071a2d82523 tempest-VolumesDeleteCascade-473852886 None] Lock "cinder-quobyte-d9b19f8d-96d4-4eda-8c15-b3f878386b7b" acquired by "delete_volume" :: waited 0.023s {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 04:42:33 devstack cinder-volume[87444]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c4edda8-1749-441d-9828-0c9ea451b91f]: (4, 'qcow2') {{(pid=88499) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 04:42:33 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-a692e740-592d-4ea2-8fb2-a071a2d82523 tempest-VolumesDeleteCascade-473852886 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-d9b19f8d-96d4-4eda-8c15-b3f878386b7b {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:42:33 devstack sudo[97041]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-d9b19f8d-96d4-4eda-8c15-b3f878386b7b Jul 10 04:42:33 devstack sudo[97041]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:42:33 devstack sudo[97036]: pam_unix(sudo:session): session closed for user root Jul 10 04:42:33 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-01f0ce3e-6850-4e14-881d-e40d3c4ad6e5 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097" returned: 0 in 0.702s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:42:33 devstack cinder-volume[87444]: DEBUG cinder.manager [None req-01f0ce3e-6850-4e14-881d-e40d3c4ad6e5 None None] Notifying Schedulers of capabilities ... {{(pid=87444) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 04:42:33 devstack cinder-volume[87444]: DEBUG oslo_service.periodic_task [None req-01f0ce3e-6850-4e14-881d-e40d3c4ad6e5 None None] Running periodic task VolumeManager._thread_info {{(pid=87444) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 10 04:42:33 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-01f0ce3e-6850-4e14-881d-e40d3c4ad6e5 None None] thread count: 28 {{(pid=87444) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 10 04:42:33 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-01f0ce3e-6850-4e14-881d-e40d3c4ad6e5 None None] thread info: [<_MainThread(MainThread, started 126839257915520)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87444) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 10 04:42:34 devstack sudo[97039]: pam_unix(sudo:session): session closed for user root Jul 10 04:42:34 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-0d55f6b7-6e6b-4d26-9712-bb2f9ae27f2a tempest-VolumesTransfersV355Test-1331173015 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-929136fd-c05b-4954-a10f-27eccf702240 1073741824" returned: 0 in 0.951s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:42:34 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-0d55f6b7-6e6b-4d26-9712-bb2f9ae27f2a tempest-VolumesTransfersV355Test-1331173015 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-929136fd-c05b-4954-a10f-27eccf702240 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:42:34 devstack sudo[97049]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-929136fd-c05b-4954-a10f-27eccf702240 Jul 10 04:42:34 devstack sudo[97049]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:42:34 devstack sudo[97041]: pam_unix(sudo:session): session closed for user root Jul 10 04:42:34 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-a692e740-592d-4ea2-8fb2-a071a2d82523 tempest-VolumesDeleteCascade-473852886 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-d9b19f8d-96d4-4eda-8c15-b3f878386b7b" returned: 0 in 0.886s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:42:34 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-a692e740-592d-4ea2-8fb2-a071a2d82523 tempest-VolumesDeleteCascade-473852886 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-d9b19f8d-96d4-4eda-8c15-b3f878386b7b {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:42:34 devstack sudo[97052]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-d9b19f8d-96d4-4eda-8c15-b3f878386b7b Jul 10 04:42:34 devstack sudo[97052]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:42:34 devstack sudo[97049]: pam_unix(sudo:session): session closed for user root Jul 10 04:42:34 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-0d55f6b7-6e6b-4d26-9712-bb2f9ae27f2a tempest-VolumesTransfersV355Test-1331173015 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-929136fd-c05b-4954-a10f-27eccf702240" returned: 0 in 0.678s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:42:34 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-0d55f6b7-6e6b-4d26-9712-bb2f9ae27f2a tempest-VolumesTransfersV355Test-1331173015 None] <== create_volume: return (1680ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922'} {{(pid=87444) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 04:42:34 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-0d55f6b7-6e6b-4d26-9712-bb2f9ae27f2a tempest-VolumesTransfersV355Test-1331173015 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.683s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 04:42:34 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-2db55748-9ffc-49b5-ad78-d6bb51d8edb5 tempest-VolumesSnapshotTestJSON-1690897005 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 2.235s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 04:42:34 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-2db55748-9ffc-49b5-ad78-d6bb51d8edb5 tempest-VolumesSnapshotTestJSON-1690897005 None] Acquiring lock "cinder-quobyte-13eca88b-eab0-4ab3-a9a0-dc0c6df2c2ff-47f65e0d-5007-47fc-a78c-bc8800625bc6" by "_create_volume_from_snapshot" {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 04:42:34 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-0d55f6b7-6e6b-4d26-9712-bb2f9ae27f2a tempest-VolumesTransfersV355Test-1331173015 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (55699fe7-c522-4ac2-8e71-2696e6555368) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-929136fd-c05b-4954-a10f-27eccf702240', 'volume_size': 1}' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:42:34 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-0d55f6b7-6e6b-4d26-9712-bb2f9ae27f2a tempest-VolumesTransfersV355Test-1331173015 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a6f2b3ce-0e5d-4939-a59f-bfbb42ea7919) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:42:34 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-2db55748-9ffc-49b5-ad78-d6bb51d8edb5 tempest-VolumesSnapshotTestJSON-1690897005 None] Lock "cinder-quobyte-13eca88b-eab0-4ab3-a9a0-dc0c6df2c2ff-47f65e0d-5007-47fc-a78c-bc8800625bc6" acquired by "_create_volume_from_snapshot" :: waited 0.033s {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 04:42:34 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-2db55748-9ffc-49b5-ad78-d6bb51d8edb5 tempest-VolumesSnapshotTestJSON-1690897005 None] Creating volume 47f65e0d-5007-47fc-a78c-bc8800625bc6 from snapshot 13eca88b-eab0-4ab3-a9a0-dc0c6df2c2ff {{(pid=87444) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Jul 10 04:42:34 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-2db55748-9ffc-49b5-ad78-d6bb51d8edb5 tempest-VolumesSnapshotTestJSON-1690897005 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 04:42:34 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-2db55748-9ffc-49b5-ad78-d6bb51d8edb5 tempest-VolumesSnapshotTestJSON-1690897005 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 04:42:34 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-2db55748-9ffc-49b5-ad78-d6bb51d8edb5 tempest-VolumesSnapshotTestJSON-1690897005 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922': None} {{(pid=87444) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 04:42:34 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-2db55748-9ffc-49b5-ad78-d6bb51d8edb5 tempest-VolumesSnapshotTestJSON-1690897005 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922'] {{(pid=87444) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 04:42:34 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-2db55748-9ffc-49b5-ad78-d6bb51d8edb5 tempest-VolumesSnapshotTestJSON-1690897005 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 04:42:34 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-2db55748-9ffc-49b5-ad78-d6bb51d8edb5 tempest-VolumesSnapshotTestJSON-1690897005 None] Selected osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922 as target Quobyte volume. {{(pid=87444) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 04:42:34 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-2db55748-9ffc-49b5-ad78-d6bb51d8edb5 tempest-VolumesSnapshotTestJSON-1690897005 None] Acquiring lock "cinder-quobyte-47f65e0d-5007-47fc-a78c-bc8800625bc6" by "_copy_volume_from_snapshot" {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 04:42:34 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-2db55748-9ffc-49b5-ad78-d6bb51d8edb5 tempest-VolumesSnapshotTestJSON-1690897005 None] Lock "cinder-quobyte-47f65e0d-5007-47fc-a78c-bc8800625bc6" acquired by "_copy_volume_from_snapshot" :: waited 0.019s {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 04:42:34 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-2db55748-9ffc-49b5-ad78-d6bb51d8edb5 tempest-VolumesSnapshotTestJSON-1690897005 None] snapshot: 13eca88b-eab0-4ab3-a9a0-dc0c6df2c2ff, volume: 47f65e0d-5007-47fc-a78c-bc8800625bc6, {{(pid=87444) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jul 10 04:42:34 devstack cinder-volume[87444]: INFO cinder.volume.flows.manager.create_volume [None req-0d55f6b7-6e6b-4d26-9712-bb2f9ae27f2a tempest-VolumesTransfersV355Test-1331173015 None] Volume volume-929136fd-c05b-4954-a10f-27eccf702240 (929136fd-c05b-4954-a10f-27eccf702240): created successfully Jul 10 04:42:34 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-0d55f6b7-6e6b-4d26-9712-bb2f9ae27f2a tempest-VolumesTransfersV355Test-1331173015 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a6f2b3ce-0e5d-4939-a59f-bfbb42ea7919) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:42:34 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-0d55f6b7-6e6b-4d26-9712-bb2f9ae27f2a tempest-VolumesTransfersV355Test-1331173015 None] Flow 'volume_create_manager' (c641a892-0839-4c71-8b2d-c105d71a25de) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87444) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 04:42:34 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-2db55748-9ffc-49b5-ad78-d6bb51d8edb5 tempest-VolumesSnapshotTestJSON-1690897005 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 04:42:34 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-2db55748-9ffc-49b5-ad78-d6bb51d8edb5 tempest-VolumesSnapshotTestJSON-1690897005 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 04:42:34 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-2db55748-9ffc-49b5-ad78-d6bb51d8edb5 tempest-VolumesSnapshotTestJSON-1690897005 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922': None} {{(pid=87444) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 04:42:34 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-2db55748-9ffc-49b5-ad78-d6bb51d8edb5 tempest-VolumesSnapshotTestJSON-1690897005 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922'] {{(pid=87444) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 04:42:34 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-2db55748-9ffc-49b5-ad78-d6bb51d8edb5 tempest-VolumesSnapshotTestJSON-1690897005 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 04:42:35 devstack cinder-volume[87444]: INFO cinder.volume.manager [None req-0d55f6b7-6e6b-4d26-9712-bb2f9ae27f2a tempest-VolumesTransfersV355Test-1331173015 None] Created volume successfully. Jul 10 04:42:35 devstack cinder-volume[87444]: DEBUG oslo.privsep.daemon [-] privsep: reply[4944223c-887d-48ac-b9f6-841e106170fd]: (4, 'qcow2') {{(pid=88499) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 04:42:35 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-2db55748-9ffc-49b5-ad78-d6bb51d8edb5 tempest-VolumesSnapshotTestJSON-1690897005 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-809f59aa-2cd0-4e34-b823-ff4f97fc2ff3.13eca88b-eab0-4ab3-a9a0-dc0c6df2c2ff {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:42:35 devstack sudo[97052]: pam_unix(sudo:session): session closed for user root Jul 10 04:42:35 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-a692e740-592d-4ea2-8fb2-a071a2d82523 tempest-VolumesDeleteCascade-473852886 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-d9b19f8d-96d4-4eda-8c15-b3f878386b7b" returned: 0 in 0.810s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:42:35 devstack sudo[97059]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-809f59aa-2cd0-4e34-b823-ff4f97fc2ff3.13eca88b-eab0-4ab3-a9a0-dc0c6df2c2ff Jul 10 04:42:35 devstack sudo[97059]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:42:35 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-a692e740-592d-4ea2-8fb2-a071a2d82523 tempest-VolumesDeleteCascade-473852886 None] Lock "cinder-quobyte-d9b19f8d-96d4-4eda-8c15-b3f878386b7b" released by "delete_volume" :: held 1.798s {{(pid=87444) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 04:42:35 devstack cinder-volume[87444]: DEBUG cinder.quota [None req-a692e740-592d-4ea2-8fb2-a071a2d82523 tempest-VolumesDeleteCascade-473852886 None] Created reservations ['464b61c1-fd48-478d-a891-8af44ffdad42', 'bd3e838c-a271-4bd1-8103-7d3a2e7699ff', '59904dc5-caff-4d35-af85-4ebe12666924', '8504ccd9-379c-4089-b3e2-bbd67f050ebc'] {{(pid=87444) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 04:42:35 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-a692e740-592d-4ea2-8fb2-a071a2d82523 tempest-VolumesDeleteCascade-473852886 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 04:42:35 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-a692e740-592d-4ea2-8fb2-a071a2d82523 tempest-VolumesDeleteCascade-473852886 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 04:42:35 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-a692e740-592d-4ea2-8fb2-a071a2d82523 tempest-VolumesDeleteCascade-473852886 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922': None} {{(pid=87444) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 04:42:35 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-a692e740-592d-4ea2-8fb2-a071a2d82523 tempest-VolumesDeleteCascade-473852886 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922'] {{(pid=87444) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 04:42:35 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-a692e740-592d-4ea2-8fb2-a071a2d82523 tempest-VolumesDeleteCascade-473852886 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 04:42:35 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-a692e740-592d-4ea2-8fb2-a071a2d82523 tempest-VolumesDeleteCascade-473852886 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:42:35 devstack sudo[97061]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097 Jul 10 04:42:35 devstack sudo[97061]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:42:35 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-8e9591c3-93c7-4089-8da5-c92e324cc8e0 tempest-VolumesTransfersV355Test-878210328 None] Acquiring lock "cinder-929136fd-c05b-4954-a10f-27eccf702240-delete_volume" by "delete_volume" {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 04:42:35 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-8e9591c3-93c7-4089-8da5-c92e324cc8e0 tempest-VolumesTransfersV355Test-878210328 None] Lock "cinder-929136fd-c05b-4954-a10f-27eccf702240-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 04:42:35 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-8e9591c3-93c7-4089-8da5-c92e324cc8e0 tempest-VolumesTransfersV355Test-878210328 None] Acquiring lock "cinder-quobyte-929136fd-c05b-4954-a10f-27eccf702240" by "delete_volume" {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 04:42:35 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-8e9591c3-93c7-4089-8da5-c92e324cc8e0 tempest-VolumesTransfersV355Test-878210328 None] Lock "cinder-quobyte-929136fd-c05b-4954-a10f-27eccf702240" acquired by "delete_volume" :: waited 0.021s {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 04:42:35 devstack cinder-volume[87444]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ca439dd-7d5c-424b-9d52-f44e67bacb47]: (4, 'qcow2') {{(pid=88499) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 04:42:35 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-8e9591c3-93c7-4089-8da5-c92e324cc8e0 tempest-VolumesTransfersV355Test-878210328 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-929136fd-c05b-4954-a10f-27eccf702240 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:42:35 devstack sudo[97066]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-929136fd-c05b-4954-a10f-27eccf702240 Jul 10 04:42:36 devstack sudo[97066]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:42:36 devstack sudo[97059]: pam_unix(sudo:session): session closed for user root Jul 10 04:42:36 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-2db55748-9ffc-49b5-ad78-d6bb51d8edb5 tempest-VolumesSnapshotTestJSON-1690897005 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-809f59aa-2cd0-4e34-b823-ff4f97fc2ff3.13eca88b-eab0-4ab3-a9a0-dc0c6df2c2ff" returned: 0 in 0.987s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:42:36 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.remotefs [None req-2db55748-9ffc-49b5-ad78-d6bb51d8edb5 tempest-VolumesSnapshotTestJSON-1690897005 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-809f59aa-2cd0-4e34-b823-ff4f97fc2ff3(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87444) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 10 04:42:36 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-2db55748-9ffc-49b5-ad78-d6bb51d8edb5 tempest-VolumesSnapshotTestJSON-1690897005 None] will copy from snapshot at /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-809f59aa-2cd0-4e34-b823-ff4f97fc2ff3 {{(pid=87444) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jul 10 04:42:36 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-2db55748-9ffc-49b5-ad78-d6bb51d8edb5 tempest-VolumesSnapshotTestJSON-1690897005 None] Creating direct copy from snapshot {{(pid=87444) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jul 10 04:42:36 devstack cinder-volume[87444]: DEBUG oslo.privsep.daemon [-] privsep: reply[efe75d78-aaf6-4876-a0f8-033af39b56ac]: (4, 'qcow2') {{(pid=88499) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 04:42:36 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-2db55748-9ffc-49b5-ad78-d6bb51d8edb5 tempest-VolumesSnapshotTestJSON-1690897005 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-809f59aa-2cd0-4e34-b823-ff4f97fc2ff3 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:42:36 devstack sudo[97061]: pam_unix(sudo:session): session closed for user root Jul 10 04:42:36 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-a692e740-592d-4ea2-8fb2-a071a2d82523 tempest-VolumesDeleteCascade-473852886 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097" returned: 0 in 0.820s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:42:36 devstack cinder-volume[87444]: DEBUG cinder.manager [None req-a692e740-592d-4ea2-8fb2-a071a2d82523 tempest-VolumesDeleteCascade-473852886 None] Notifying Schedulers of capabilities ... {{(pid=87444) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 04:42:36 devstack cinder-volume[87444]: INFO cinder.volume.manager [None req-a692e740-592d-4ea2-8fb2-a071a2d82523 tempest-VolumesDeleteCascade-473852886 None] Deleted volume successfully. Jul 10 04:42:36 devstack sudo[97069]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-809f59aa-2cd0-4e34-b823-ff4f97fc2ff3 Jul 10 04:42:36 devstack sudo[97069]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:42:36 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-a692e740-592d-4ea2-8fb2-a071a2d82523 tempest-VolumesDeleteCascade-473852886 None] Lock "cinder-d9b19f8d-96d4-4eda-8c15-b3f878386b7b-delete_volume" released by "delete_volume" :: held 14.174s {{(pid=87444) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 04:42:36 devstack sudo[97066]: pam_unix(sudo:session): session closed for user root Jul 10 04:42:36 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-8e9591c3-93c7-4089-8da5-c92e324cc8e0 tempest-VolumesTransfersV355Test-878210328 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-929136fd-c05b-4954-a10f-27eccf702240" returned: 0 in 1.040s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:42:36 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-8e9591c3-93c7-4089-8da5-c92e324cc8e0 tempest-VolumesTransfersV355Test-878210328 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-929136fd-c05b-4954-a10f-27eccf702240 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:42:36 devstack sudo[97078]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-929136fd-c05b-4954-a10f-27eccf702240 Jul 10 04:42:36 devstack sudo[97078]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:42:37 devstack cinder-volume[87444]: DEBUG cinder.volume.flows.manager.create_volume [None req-aa2d2270-8a91-4379-8759-7c4b80181903 tempest-VolumesDeleteCascade-473852886 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87444) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 04:42:37 devstack sudo[97069]: pam_unix(sudo:session): session closed for user root Jul 10 04:42:37 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-aa2d2270-8a91-4379-8759-7c4b80181903 tempest-VolumesDeleteCascade-473852886 None] Flow 'volume_create_manager' (8f95c229-e4c5-472f-803f-0bbedfe7c7e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 04:42:37 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-aa2d2270-8a91-4379-8759-7c4b80181903 tempest-VolumesDeleteCascade-473852886 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c6337fcb-eaa9-4a0b-b341-bc15d5ae1513) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:42:37 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-2db55748-9ffc-49b5-ad78-d6bb51d8edb5 tempest-VolumesSnapshotTestJSON-1690897005 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-809f59aa-2cd0-4e34-b823-ff4f97fc2ff3" returned: 0 in 1.059s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:42:37 devstack cinder-volume[87444]: DEBUG cinder.utils [None req-2db55748-9ffc-49b5-ad78-d6bb51d8edb5 tempest-VolumesSnapshotTestJSON-1690897005 None] Path /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-47f65e0d-5007-47fc-a78c-bc8800625bc6 not found in is_blk_device check {{(pid=87444) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 10 04:42:37 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-2db55748-9ffc-49b5-ad78-d6bb51d8edb5 tempest-VolumesSnapshotTestJSON-1690897005 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-809f59aa-2cd0-4e34-b823-ff4f97fc2ff3 /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-47f65e0d-5007-47fc-a78c-bc8800625bc6 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:42:37 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-aa2d2270-8a91-4379-8759-7c4b80181903 tempest-VolumesDeleteCascade-473852886 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c6337fcb-eaa9-4a0b-b341-bc15d5ae1513) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T02:42:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-2074536573',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=11e8ac43-d499-4bf6-a257-89a3bf968264,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1d1db54813084886981e0b7d83441a9a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T02:42:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T02:42:37Z,use_quota=True,user_id='5631bee5216c42c2b47ceda43dfb6a55',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(317e369e-1e06-434d-ae95-a335f0e6c903),volume_type_id=317e369e-1e06-434d-ae95-a335f0e6c903)' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:42:37 devstack sudo[97080]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-809f59aa-2cd0-4e34-b823-ff4f97fc2ff3 /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-47f65e0d-5007-47fc-a78c-bc8800625bc6 Jul 10 04:42:37 devstack sudo[97080]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:42:37 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-aa2d2270-8a91-4379-8759-7c4b80181903 tempest-VolumesDeleteCascade-473852886 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c1f25fbd-f802-4ca4-b443-b4f1df5346c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:42:37 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-aa2d2270-8a91-4379-8759-7c4b80181903 tempest-VolumesDeleteCascade-473852886 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c1f25fbd-f802-4ca4-b443-b4f1df5346c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:42:37 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-aa2d2270-8a91-4379-8759-7c4b80181903 tempest-VolumesDeleteCascade-473852886 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (272b86cf-0cde-44e6-9e6b-1eda0b6f00f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:42:37 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-aa2d2270-8a91-4379-8759-7c4b80181903 tempest-VolumesDeleteCascade-473852886 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (272b86cf-0cde-44e6-9e6b-1eda0b6f00f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '11e8ac43-d499-4bf6-a257-89a3bf968264', 'volume_name': 'volume-11e8ac43-d499-4bf6-a257-89a3bf968264', 'volume_size': 1}' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:42:37 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-aa2d2270-8a91-4379-8759-7c4b80181903 tempest-VolumesDeleteCascade-473852886 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (34234b3d-f992-4132-95e3-c1f6de6278be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:42:37 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-aa2d2270-8a91-4379-8759-7c4b80181903 tempest-VolumesDeleteCascade-473852886 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (34234b3d-f992-4132-95e3-c1f6de6278be) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:42:37 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-aa2d2270-8a91-4379-8759-7c4b80181903 tempest-VolumesDeleteCascade-473852886 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (50a37304-8703-4307-8dab-b0708955b3b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:42:37 devstack cinder-volume[87444]: INFO cinder.volume.flows.manager.create_volume [None req-aa2d2270-8a91-4379-8759-7c4b80181903 tempest-VolumesDeleteCascade-473852886 None] Volume 11e8ac43-d499-4bf6-a257-89a3bf968264: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-11e8ac43-d499-4bf6-a257-89a3bf968264', 'volume_size': 1} Jul 10 04:42:37 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-aa2d2270-8a91-4379-8759-7c4b80181903 tempest-VolumesDeleteCascade-473852886 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 04:42:37 devstack sudo[97078]: pam_unix(sudo:session): session closed for user root Jul 10 04:42:37 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-8e9591c3-93c7-4089-8da5-c92e324cc8e0 tempest-VolumesTransfersV355Test-878210328 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-929136fd-c05b-4954-a10f-27eccf702240" returned: 0 in 0.699s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:42:37 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-8e9591c3-93c7-4089-8da5-c92e324cc8e0 tempest-VolumesTransfersV355Test-878210328 None] Lock "cinder-quobyte-929136fd-c05b-4954-a10f-27eccf702240" released by "delete_volume" :: held 1.779s {{(pid=87444) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 04:42:37 devstack cinder-volume[87444]: DEBUG cinder.quota [None req-8e9591c3-93c7-4089-8da5-c92e324cc8e0 tempest-VolumesTransfersV355Test-878210328 None] Created reservations ['52bfa103-ccb1-469f-b7bd-991a25bed534', '82ac6359-0b69-4865-bf9a-efa02b12b56d', 'f3f4b069-1bc5-47b4-acc6-cad608efde48', '7ad7a96e-3fd5-436c-9213-b02fad454e72'] {{(pid=87444) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 04:42:37 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-8e9591c3-93c7-4089-8da5-c92e324cc8e0 tempest-VolumesTransfersV355Test-878210328 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 04:42:37 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-8e9591c3-93c7-4089-8da5-c92e324cc8e0 tempest-VolumesTransfersV355Test-878210328 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 04:42:37 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-8e9591c3-93c7-4089-8da5-c92e324cc8e0 tempest-VolumesTransfersV355Test-878210328 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922': None} {{(pid=87444) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 04:42:37 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-8e9591c3-93c7-4089-8da5-c92e324cc8e0 tempest-VolumesTransfersV355Test-878210328 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922'] {{(pid=87444) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 04:42:37 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-8e9591c3-93c7-4089-8da5-c92e324cc8e0 tempest-VolumesTransfersV355Test-878210328 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 04:42:37 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-8e9591c3-93c7-4089-8da5-c92e324cc8e0 tempest-VolumesTransfersV355Test-878210328 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:42:37 devstack sudo[97086]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097 Jul 10 04:42:37 devstack sudo[97086]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:42:39 devstack sudo[97086]: pam_unix(sudo:session): session closed for user root Jul 10 04:42:39 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-8e9591c3-93c7-4089-8da5-c92e324cc8e0 tempest-VolumesTransfersV355Test-878210328 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097" returned: 0 in 1.491s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:42:39 devstack cinder-volume[87444]: DEBUG cinder.manager [None req-8e9591c3-93c7-4089-8da5-c92e324cc8e0 tempest-VolumesTransfersV355Test-878210328 None] Notifying Schedulers of capabilities ... {{(pid=87444) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 04:42:39 devstack cinder-volume[87444]: INFO cinder.volume.manager [None req-8e9591c3-93c7-4089-8da5-c92e324cc8e0 tempest-VolumesTransfersV355Test-878210328 None] Deleted volume successfully. Jul 10 04:42:39 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-8e9591c3-93c7-4089-8da5-c92e324cc8e0 tempest-VolumesTransfersV355Test-878210328 None] Lock "cinder-929136fd-c05b-4954-a10f-27eccf702240-delete_volume" released by "delete_volume" :: held 3.582s {{(pid=87444) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 04:42:43 devstack sudo[97080]: pam_unix(sudo:session): session closed for user root Jul 10 04:42:43 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-2db55748-9ffc-49b5-ad78-d6bb51d8edb5 tempest-VolumesSnapshotTestJSON-1690897005 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-809f59aa-2cd0-4e34-b823-ff4f97fc2ff3 /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-47f65e0d-5007-47fc-a78c-bc8800625bc6" returned: 0 in 6.194s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:42:43 devstack cinder-volume[87444]: DEBUG oslo.privsep.daemon [-] privsep: reply[f31eb2e5-d6c3-43e8-bc3d-ee670407cbb5]: (4, 'qcow2') {{(pid=88499) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 04:42:43 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-2db55748-9ffc-49b5-ad78-d6bb51d8edb5 tempest-VolumesSnapshotTestJSON-1690897005 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-809f59aa-2cd0-4e34-b823-ff4f97fc2ff3 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:42:43 devstack sudo[97108]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-809f59aa-2cd0-4e34-b823-ff4f97fc2ff3 Jul 10 04:42:43 devstack sudo[97108]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:42:44 devstack sudo[97108]: pam_unix(sudo:session): session closed for user root Jul 10 04:42:44 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-2db55748-9ffc-49b5-ad78-d6bb51d8edb5 tempest-VolumesSnapshotTestJSON-1690897005 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-809f59aa-2cd0-4e34-b823-ff4f97fc2ff3" returned: 0 in 1.085s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:42:44 devstack cinder-volume[87444]: DEBUG cinder.image.image_utils [None req-2db55748-9ffc-49b5-ad78-d6bb51d8edb5 tempest-VolumesSnapshotTestJSON-1690897005 None] Image conversion details: src /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-809f59aa-2cd0-4e34-b823-ff4f97fc2ff3, size 1024.00 MB, duration 6.19 sec, destination /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-47f65e0d-5007-47fc-a78c-bc8800625bc6 {{(pid=87444) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:561}} Jul 10 04:42:44 devstack cinder-volume[87444]: INFO cinder.image.image_utils [None req-2db55748-9ffc-49b5-ad78-d6bb51d8edb5 tempest-VolumesSnapshotTestJSON-1690897005 None] Converted 1024.00 MB image at 165.30 MB/s Jul 10 04:42:44 devstack cinder-volume[87444]: WARNING cinder.volume.drivers.remotefs [None req-2db55748-9ffc-49b5-ad78-d6bb51d8edb5 tempest-VolumesSnapshotTestJSON-1690897005 None] /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-47f65e0d-5007-47fc-a78c-bc8800625bc6 is being set with open permissions: ugo+rw Jul 10 04:42:44 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-2db55748-9ffc-49b5-ad78-d6bb51d8edb5 tempest-VolumesSnapshotTestJSON-1690897005 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-47f65e0d-5007-47fc-a78c-bc8800625bc6 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:42:44 devstack sudo[97118]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-47f65e0d-5007-47fc-a78c-bc8800625bc6 Jul 10 04:42:44 devstack sudo[97118]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:42:45 devstack sudo[97118]: pam_unix(sudo:session): session closed for user root Jul 10 04:42:45 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-2db55748-9ffc-49b5-ad78-d6bb51d8edb5 tempest-VolumesSnapshotTestJSON-1690897005 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-47f65e0d-5007-47fc-a78c-bc8800625bc6" returned: 0 in 0.766s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:42:45 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-2db55748-9ffc-49b5-ad78-d6bb51d8edb5 tempest-VolumesSnapshotTestJSON-1690897005 None] Lock "cinder-quobyte-47f65e0d-5007-47fc-a78c-bc8800625bc6" released by "_copy_volume_from_snapshot" :: held 10.239s {{(pid=87444) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 04:42:45 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-2db55748-9ffc-49b5-ad78-d6bb51d8edb5 tempest-VolumesSnapshotTestJSON-1690897005 None] Lock "cinder-quobyte-13eca88b-eab0-4ab3-a9a0-dc0c6df2c2ff-47f65e0d-5007-47fc-a78c-bc8800625bc6" released by "_create_volume_from_snapshot" :: held 10.280s {{(pid=87444) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 04:42:45 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-2db55748-9ffc-49b5-ad78-d6bb51d8edb5 tempest-VolumesSnapshotTestJSON-1690897005 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 10.314s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 04:42:45 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-aa2d2270-8a91-4379-8759-7c4b80181903 tempest-VolumesDeleteCascade-473852886 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 8.034s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 04:42:45 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-aa2d2270-8a91-4379-8759-7c4b80181903 tempest-VolumesDeleteCascade-473852886 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T02:42:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-2074536573',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=11e8ac43-d499-4bf6-a257-89a3bf968264,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1d1db54813084886981e0b7d83441a9a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T02:42:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T02:42:37Z,use_quota=True,user_id='5631bee5216c42c2b47ceda43dfb6a55',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(317e369e-1e06-434d-ae95-a335f0e6c903),volume_type_id=317e369e-1e06-434d-ae95-a335f0e6c903)}" {{(pid=87444) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 04:42:45 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.remotefs [None req-aa2d2270-8a91-4379-8759-7c4b80181903 tempest-VolumesDeleteCascade-473852886 None] Creating volume 11e8ac43-d499-4bf6-a257-89a3bf968264 {{(pid=87444) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 04:42:45 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-aa2d2270-8a91-4379-8759-7c4b80181903 tempest-VolumesDeleteCascade-473852886 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 04:42:45 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-aa2d2270-8a91-4379-8759-7c4b80181903 tempest-VolumesDeleteCascade-473852886 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 04:42:45 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-aa2d2270-8a91-4379-8759-7c4b80181903 tempest-VolumesDeleteCascade-473852886 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922': None} {{(pid=87444) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 04:42:45 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-aa2d2270-8a91-4379-8759-7c4b80181903 tempest-VolumesDeleteCascade-473852886 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922'] {{(pid=87444) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 04:42:45 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-aa2d2270-8a91-4379-8759-7c4b80181903 tempest-VolumesDeleteCascade-473852886 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 04:42:45 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-aa2d2270-8a91-4379-8759-7c4b80181903 tempest-VolumesDeleteCascade-473852886 None] Selected osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922 as target Quobyte volume. {{(pid=87444) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 04:42:45 devstack cinder-volume[87444]: INFO cinder.volume.drivers.remotefs [None req-aa2d2270-8a91-4379-8759-7c4b80181903 tempest-VolumesDeleteCascade-473852886 None] casted to osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922 Jul 10 04:42:45 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-aa2d2270-8a91-4379-8759-7c4b80181903 tempest-VolumesDeleteCascade-473852886 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-11e8ac43-d499-4bf6-a257-89a3bf968264 1073741824 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:42:45 devstack sudo[97122]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-11e8ac43-d499-4bf6-a257-89a3bf968264 1073741824 Jul 10 04:42:45 devstack sudo[97122]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:42:45 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-2db55748-9ffc-49b5-ad78-d6bb51d8edb5 tempest-VolumesSnapshotTestJSON-1690897005 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (997c7c93-0b08-4e2d-93f3-b89c5302f4ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-47f65e0d-5007-47fc-a78c-bc8800625bc6', 'volume_size': 1, 'snapshot_id': '13eca88b-eab0-4ab3-a9a0-dc0c6df2c2ff'}' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:42:45 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-2db55748-9ffc-49b5-ad78-d6bb51d8edb5 tempest-VolumesSnapshotTestJSON-1690897005 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c7444158-63d6-409d-9039-4e6b4183425d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:42:45 devstack cinder-volume[87444]: INFO cinder.volume.flows.manager.create_volume [None req-2db55748-9ffc-49b5-ad78-d6bb51d8edb5 tempest-VolumesSnapshotTestJSON-1690897005 None] Volume volume-47f65e0d-5007-47fc-a78c-bc8800625bc6 (47f65e0d-5007-47fc-a78c-bc8800625bc6): created successfully Jul 10 04:42:45 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-2db55748-9ffc-49b5-ad78-d6bb51d8edb5 tempest-VolumesSnapshotTestJSON-1690897005 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c7444158-63d6-409d-9039-4e6b4183425d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:42:45 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-2db55748-9ffc-49b5-ad78-d6bb51d8edb5 tempest-VolumesSnapshotTestJSON-1690897005 None] Flow 'volume_create_manager' (96082246-757d-4ac0-b316-e5d7bf4a18b7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87444) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 04:42:45 devstack cinder-volume[87444]: INFO cinder.volume.manager [None req-2db55748-9ffc-49b5-ad78-d6bb51d8edb5 tempest-VolumesSnapshotTestJSON-1690897005 None] Created volume successfully. Jul 10 04:42:46 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-b29f64e1-4794-45c1-a837-a8a63ae2964d tempest-VolumesSnapshotTestJSON-1690897005 None] Acquiring lock "cinder-47f65e0d-5007-47fc-a78c-bc8800625bc6-delete_volume" by "delete_volume" {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 04:42:46 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-b29f64e1-4794-45c1-a837-a8a63ae2964d tempest-VolumesSnapshotTestJSON-1690897005 None] Lock "cinder-47f65e0d-5007-47fc-a78c-bc8800625bc6-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 04:42:46 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-b29f64e1-4794-45c1-a837-a8a63ae2964d tempest-VolumesSnapshotTestJSON-1690897005 None] Acquiring lock "cinder-quobyte-47f65e0d-5007-47fc-a78c-bc8800625bc6" by "delete_volume" {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 04:42:46 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-b29f64e1-4794-45c1-a837-a8a63ae2964d tempest-VolumesSnapshotTestJSON-1690897005 None] Lock "cinder-quobyte-47f65e0d-5007-47fc-a78c-bc8800625bc6" acquired by "delete_volume" :: waited 0.022s {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 04:42:46 devstack cinder-volume[87444]: DEBUG oslo.privsep.daemon [-] privsep: reply[0704725c-b98b-4fbf-aa6b-a65b82f61fe9]: (4, 'qcow2') {{(pid=88499) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 04:42:46 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-b29f64e1-4794-45c1-a837-a8a63ae2964d tempest-VolumesSnapshotTestJSON-1690897005 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-47f65e0d-5007-47fc-a78c-bc8800625bc6 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:42:46 devstack sudo[97134]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-47f65e0d-5007-47fc-a78c-bc8800625bc6 Jul 10 04:42:46 devstack sudo[97134]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:42:46 devstack sudo[97122]: pam_unix(sudo:session): session closed for user root Jul 10 04:42:46 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-aa2d2270-8a91-4379-8759-7c4b80181903 tempest-VolumesDeleteCascade-473852886 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-11e8ac43-d499-4bf6-a257-89a3bf968264 1073741824" returned: 0 in 1.097s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:42:46 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-aa2d2270-8a91-4379-8759-7c4b80181903 tempest-VolumesDeleteCascade-473852886 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-11e8ac43-d499-4bf6-a257-89a3bf968264 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:42:46 devstack sudo[97136]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-11e8ac43-d499-4bf6-a257-89a3bf968264 Jul 10 04:42:46 devstack sudo[97136]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:42:46 devstack sudo[97134]: pam_unix(sudo:session): session closed for user root Jul 10 04:42:46 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-b29f64e1-4794-45c1-a837-a8a63ae2964d tempest-VolumesSnapshotTestJSON-1690897005 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-47f65e0d-5007-47fc-a78c-bc8800625bc6" returned: 0 in 0.843s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:42:46 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-b29f64e1-4794-45c1-a837-a8a63ae2964d tempest-VolumesSnapshotTestJSON-1690897005 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-47f65e0d-5007-47fc-a78c-bc8800625bc6 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:42:46 devstack sudo[97141]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-47f65e0d-5007-47fc-a78c-bc8800625bc6 Jul 10 04:42:47 devstack sudo[97141]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:42:47 devstack sudo[97136]: pam_unix(sudo:session): session closed for user root Jul 10 04:42:47 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-aa2d2270-8a91-4379-8759-7c4b80181903 tempest-VolumesDeleteCascade-473852886 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-11e8ac43-d499-4bf6-a257-89a3bf968264" returned: 0 in 0.776s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:42:47 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-aa2d2270-8a91-4379-8759-7c4b80181903 tempest-VolumesDeleteCascade-473852886 None] <== create_volume: return (1947ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922'} {{(pid=87444) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 04:42:47 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-aa2d2270-8a91-4379-8759-7c4b80181903 tempest-VolumesDeleteCascade-473852886 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.951s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 04:42:47 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-aa2d2270-8a91-4379-8759-7c4b80181903 tempest-VolumesDeleteCascade-473852886 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (50a37304-8703-4307-8dab-b0708955b3b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-11e8ac43-d499-4bf6-a257-89a3bf968264', 'volume_size': 1}' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:42:47 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-aa2d2270-8a91-4379-8759-7c4b80181903 tempest-VolumesDeleteCascade-473852886 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c2e2369a-8c43-4337-93bb-3c38dae5b04b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:42:47 devstack cinder-volume[87444]: INFO cinder.volume.flows.manager.create_volume [None req-aa2d2270-8a91-4379-8759-7c4b80181903 tempest-VolumesDeleteCascade-473852886 None] Volume volume-11e8ac43-d499-4bf6-a257-89a3bf968264 (11e8ac43-d499-4bf6-a257-89a3bf968264): created successfully Jul 10 04:42:47 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-aa2d2270-8a91-4379-8759-7c4b80181903 tempest-VolumesDeleteCascade-473852886 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c2e2369a-8c43-4337-93bb-3c38dae5b04b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:42:47 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-aa2d2270-8a91-4379-8759-7c4b80181903 tempest-VolumesDeleteCascade-473852886 None] Flow 'volume_create_manager' (8f95c229-e4c5-472f-803f-0bbedfe7c7e5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87444) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 04:42:47 devstack cinder-volume[87444]: INFO cinder.volume.manager [None req-aa2d2270-8a91-4379-8759-7c4b80181903 tempest-VolumesDeleteCascade-473852886 None] Created volume successfully. Jul 10 04:42:47 devstack cinder-volume[87444]: DEBUG dbcounter [-] [87444] Writing DB stats cinder:DELETE=16,cinder:SELECT=123,cinder:UPDATE=136,cinder:INSERT=37 {{(pid=87444) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 10 04:42:47 devstack cinder-volume[87444]: DEBUG cinder.volume.flows.manager.create_volume [None req-19407819-987f-4fef-b59c-7f95854b39f8 tempest-VolumesCloneTest-2092220422 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87444) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 04:42:47 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-19407819-987f-4fef-b59c-7f95854b39f8 tempest-VolumesCloneTest-2092220422 None] Flow 'volume_create_manager' (221e3c04-0b7a-4867-912a-d27c66401fc2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 04:42:47 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-19407819-987f-4fef-b59c-7f95854b39f8 tempest-VolumesCloneTest-2092220422 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (55ec98dc-6960-4abd-845a-2404a3661dd5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:42:47 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-19407819-987f-4fef-b59c-7f95854b39f8 tempest-VolumesCloneTest-2092220422 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (55ec98dc-6960-4abd-845a-2404a3661dd5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T02:42:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-2127867952',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=88dd004a-c872-437b-9d69-c3610c47fb72,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1b8486da85e8451a9908d1ac8c2ab4f8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T02:42:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T02:42:47Z,use_quota=True,user_id='806a7074b455436185a67449713a3a25',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(317e369e-1e06-434d-ae95-a335f0e6c903),volume_type_id=317e369e-1e06-434d-ae95-a335f0e6c903)' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:42:47 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-19407819-987f-4fef-b59c-7f95854b39f8 tempest-VolumesCloneTest-2092220422 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7077cbce-b405-476e-a279-81aabd74fb32) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:42:47 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-19407819-987f-4fef-b59c-7f95854b39f8 tempest-VolumesCloneTest-2092220422 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7077cbce-b405-476e-a279-81aabd74fb32) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:42:47 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-19407819-987f-4fef-b59c-7f95854b39f8 tempest-VolumesCloneTest-2092220422 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (67402922-edb0-4e98-a60d-4143ac9e3bd1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:42:47 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-19407819-987f-4fef-b59c-7f95854b39f8 tempest-VolumesCloneTest-2092220422 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (67402922-edb0-4e98-a60d-4143ac9e3bd1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '88dd004a-c872-437b-9d69-c3610c47fb72', 'volume_name': 'volume-88dd004a-c872-437b-9d69-c3610c47fb72', 'volume_size': 1}' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:42:47 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-19407819-987f-4fef-b59c-7f95854b39f8 tempest-VolumesCloneTest-2092220422 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1c1855d1-3b01-4636-ab3f-f7f403bb350e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:42:47 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-19407819-987f-4fef-b59c-7f95854b39f8 tempest-VolumesCloneTest-2092220422 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1c1855d1-3b01-4636-ab3f-f7f403bb350e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:42:47 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-19407819-987f-4fef-b59c-7f95854b39f8 tempest-VolumesCloneTest-2092220422 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d9ab4f65-abb5-424b-b0d8-27e348ac92ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:42:47 devstack cinder-volume[87444]: INFO cinder.volume.flows.manager.create_volume [None req-19407819-987f-4fef-b59c-7f95854b39f8 tempest-VolumesCloneTest-2092220422 None] Volume 88dd004a-c872-437b-9d69-c3610c47fb72: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-88dd004a-c872-437b-9d69-c3610c47fb72', 'volume_size': 1} Jul 10 04:42:47 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-19407819-987f-4fef-b59c-7f95854b39f8 tempest-VolumesCloneTest-2092220422 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 04:42:47 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-19407819-987f-4fef-b59c-7f95854b39f8 tempest-VolumesCloneTest-2092220422 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 04:42:47 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-19407819-987f-4fef-b59c-7f95854b39f8 tempest-VolumesCloneTest-2092220422 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T02:42:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-2127867952',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=88dd004a-c872-437b-9d69-c3610c47fb72,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1b8486da85e8451a9908d1ac8c2ab4f8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T02:42:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T02:42:47Z,use_quota=True,user_id='806a7074b455436185a67449713a3a25',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(317e369e-1e06-434d-ae95-a335f0e6c903),volume_type_id=317e369e-1e06-434d-ae95-a335f0e6c903)}" {{(pid=87444) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 04:42:47 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.remotefs [None req-19407819-987f-4fef-b59c-7f95854b39f8 tempest-VolumesCloneTest-2092220422 None] Creating volume 88dd004a-c872-437b-9d69-c3610c47fb72 {{(pid=87444) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 04:42:47 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-19407819-987f-4fef-b59c-7f95854b39f8 tempest-VolumesCloneTest-2092220422 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 04:42:47 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-19407819-987f-4fef-b59c-7f95854b39f8 tempest-VolumesCloneTest-2092220422 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 04:42:47 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-19407819-987f-4fef-b59c-7f95854b39f8 tempest-VolumesCloneTest-2092220422 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922': None} {{(pid=87444) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 04:42:47 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-19407819-987f-4fef-b59c-7f95854b39f8 tempest-VolumesCloneTest-2092220422 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922'] {{(pid=87444) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 04:42:47 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-19407819-987f-4fef-b59c-7f95854b39f8 tempest-VolumesCloneTest-2092220422 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 04:42:47 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-19407819-987f-4fef-b59c-7f95854b39f8 tempest-VolumesCloneTest-2092220422 None] Selected osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922 as target Quobyte volume. {{(pid=87444) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 04:42:47 devstack cinder-volume[87444]: INFO cinder.volume.drivers.remotefs [None req-19407819-987f-4fef-b59c-7f95854b39f8 tempest-VolumesCloneTest-2092220422 None] casted to osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922 Jul 10 04:42:47 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-19407819-987f-4fef-b59c-7f95854b39f8 tempest-VolumesCloneTest-2092220422 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-88dd004a-c872-437b-9d69-c3610c47fb72 1073741824 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:42:47 devstack sudo[97144]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-88dd004a-c872-437b-9d69-c3610c47fb72 1073741824 Jul 10 04:42:47 devstack sudo[97144]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:42:47 devstack sudo[97141]: pam_unix(sudo:session): session closed for user root Jul 10 04:42:47 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-b29f64e1-4794-45c1-a837-a8a63ae2964d tempest-VolumesSnapshotTestJSON-1690897005 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-47f65e0d-5007-47fc-a78c-bc8800625bc6" returned: 0 in 0.790s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:42:47 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-b29f64e1-4794-45c1-a837-a8a63ae2964d tempest-VolumesSnapshotTestJSON-1690897005 None] Lock "cinder-quobyte-47f65e0d-5007-47fc-a78c-bc8800625bc6" released by "delete_volume" :: held 1.687s {{(pid=87444) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 04:42:47 devstack cinder-volume[87444]: DEBUG cinder.quota [None req-b29f64e1-4794-45c1-a837-a8a63ae2964d tempest-VolumesSnapshotTestJSON-1690897005 None] Created reservations ['f07f5f81-07dc-4f72-9faf-dbbcd6120375', '5e02dcf3-6aed-46bf-8f09-32714a0848ef', '8b7aeb0e-3cea-4520-a3a1-05ce010bb5d1', '7c043bb1-bc25-40c4-8708-c7c277c2b31e'] {{(pid=87444) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 04:42:47 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-b29f64e1-4794-45c1-a837-a8a63ae2964d tempest-VolumesSnapshotTestJSON-1690897005 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 04:42:47 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-b29f64e1-4794-45c1-a837-a8a63ae2964d tempest-VolumesSnapshotTestJSON-1690897005 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 04:42:47 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-b29f64e1-4794-45c1-a837-a8a63ae2964d tempest-VolumesSnapshotTestJSON-1690897005 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922': None} {{(pid=87444) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 04:42:47 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-b29f64e1-4794-45c1-a837-a8a63ae2964d tempest-VolumesSnapshotTestJSON-1690897005 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922'] {{(pid=87444) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 04:42:47 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-b29f64e1-4794-45c1-a837-a8a63ae2964d tempest-VolumesSnapshotTestJSON-1690897005 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 04:42:47 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-b29f64e1-4794-45c1-a837-a8a63ae2964d tempest-VolumesSnapshotTestJSON-1690897005 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:42:47 devstack sudo[97147]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097 Jul 10 04:42:47 devstack sudo[97147]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:42:48 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-2ee5d108-d09c-4b5e-ae02-0e9df5d226b0 tempest-VolumesDeleteCascade-473852886 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 04:42:48 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-e1e52986-ade7-4aa5-acc7-34f7ba5f46ae tempest-VolumesSnapshotTestJSON-1690897005 None] Acquiring lock "cinder-13eca88b-eab0-4ab3-a9a0-dc0c6df2c2ff-delete_snapshot" by "delete_snapshot" {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 04:42:48 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-e1e52986-ade7-4aa5-acc7-34f7ba5f46ae tempest-VolumesSnapshotTestJSON-1690897005 None] Lock "cinder-13eca88b-eab0-4ab3-a9a0-dc0c6df2c2ff-delete_snapshot" acquired by "delete_snapshot" :: waited 0.030s {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 04:42:48 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-e1e52986-ade7-4aa5-acc7-34f7ba5f46ae tempest-VolumesSnapshotTestJSON-1690897005 None] Acquiring lock "cinder-quobyte-809f59aa-2cd0-4e34-b823-ff4f97fc2ff3" by "delete_snapshot" {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 04:42:48 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-e1e52986-ade7-4aa5-acc7-34f7ba5f46ae tempest-VolumesSnapshotTestJSON-1690897005 None] Lock "cinder-quobyte-809f59aa-2cd0-4e34-b823-ff4f97fc2ff3" acquired by "delete_snapshot" :: waited 0.025s {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 04:42:48 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-e1e52986-ade7-4aa5-acc7-34f7ba5f46ae tempest-VolumesSnapshotTestJSON-1690897005 None] Acquiring lock "cinder-quobyte-13eca88b-eab0-4ab3-a9a0-dc0c6df2c2ff" by "_delete_snapshot" {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 04:42:48 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-e1e52986-ade7-4aa5-acc7-34f7ba5f46ae tempest-VolumesSnapshotTestJSON-1690897005 None] Lock "cinder-quobyte-13eca88b-eab0-4ab3-a9a0-dc0c6df2c2ff" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 04:42:48 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.remotefs [None req-e1e52986-ade7-4aa5-acc7-34f7ba5f46ae tempest-VolumesSnapshotTestJSON-1690897005 None] Deleting offline snapshot 13eca88b-eab0-4ab3-a9a0-dc0c6df2c2ff of volume 809f59aa-2cd0-4e34-b823-ff4f97fc2ff3 {{(pid=87444) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 10 04:42:48 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.remotefs [None req-e1e52986-ade7-4aa5-acc7-34f7ba5f46ae tempest-VolumesSnapshotTestJSON-1690897005 None] snapshot_file for this snap is: volume-809f59aa-2cd0-4e34-b823-ff4f97fc2ff3.13eca88b-eab0-4ab3-a9a0-dc0c6df2c2ff {{(pid=87444) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 10 04:42:48 devstack cinder-volume[87444]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e1eb504-4ae0-49f7-ad58-5e7904274d99]: (4, 'qcow2') {{(pid=88499) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 04:42:48 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-e1e52986-ade7-4aa5-acc7-34f7ba5f46ae tempest-VolumesSnapshotTestJSON-1690897005 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-809f59aa-2cd0-4e34-b823-ff4f97fc2ff3.13eca88b-eab0-4ab3-a9a0-dc0c6df2c2ff {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:42:48 devstack sudo[97144]: pam_unix(sudo:session): session closed for user root Jul 10 04:42:48 devstack sudo[97154]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-809f59aa-2cd0-4e34-b823-ff4f97fc2ff3.13eca88b-eab0-4ab3-a9a0-dc0c6df2c2ff Jul 10 04:42:48 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-19407819-987f-4fef-b59c-7f95854b39f8 tempest-VolumesCloneTest-2092220422 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-88dd004a-c872-437b-9d69-c3610c47fb72 1073741824" returned: 0 in 0.990s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:42:48 devstack sudo[97154]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:42:48 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-19407819-987f-4fef-b59c-7f95854b39f8 tempest-VolumesCloneTest-2092220422 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-88dd004a-c872-437b-9d69-c3610c47fb72 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:42:48 devstack sudo[97147]: pam_unix(sudo:session): session closed for user root Jul 10 04:42:48 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-b29f64e1-4794-45c1-a837-a8a63ae2964d tempest-VolumesSnapshotTestJSON-1690897005 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097" returned: 0 in 0.795s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:42:48 devstack cinder-volume[87444]: DEBUG cinder.manager [None req-b29f64e1-4794-45c1-a837-a8a63ae2964d tempest-VolumesSnapshotTestJSON-1690897005 None] Notifying Schedulers of capabilities ... {{(pid=87444) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 04:42:48 devstack cinder-volume[87444]: INFO cinder.volume.manager [None req-b29f64e1-4794-45c1-a837-a8a63ae2964d tempest-VolumesSnapshotTestJSON-1690897005 None] Deleted volume successfully. Jul 10 04:42:48 devstack sudo[97160]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-88dd004a-c872-437b-9d69-c3610c47fb72 Jul 10 04:42:48 devstack sudo[97160]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:42:48 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-b29f64e1-4794-45c1-a837-a8a63ae2964d tempest-VolumesSnapshotTestJSON-1690897005 None] Lock "cinder-47f65e0d-5007-47fc-a78c-bc8800625bc6-delete_volume" released by "delete_volume" :: held 2.800s {{(pid=87444) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 04:42:49 devstack sudo[97154]: pam_unix(sudo:session): session closed for user root Jul 10 04:42:49 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-e1e52986-ade7-4aa5-acc7-34f7ba5f46ae tempest-VolumesSnapshotTestJSON-1690897005 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-809f59aa-2cd0-4e34-b823-ff4f97fc2ff3.13eca88b-eab0-4ab3-a9a0-dc0c6df2c2ff" returned: 0 in 1.201s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:42:49 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.remotefs [None req-e1e52986-ade7-4aa5-acc7-34f7ba5f46ae tempest-VolumesSnapshotTestJSON-1690897005 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-809f59aa-2cd0-4e34-b823-ff4f97fc2ff3(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87444) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 10 04:42:49 devstack cinder-volume[87444]: DEBUG oslo.privsep.daemon [-] privsep: reply[73ecb2e5-f0e8-494b-aaa1-0938476217d8]: (4, 'qcow2') {{(pid=88499) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 04:42:49 devstack sudo[97160]: pam_unix(sudo:session): session closed for user root Jul 10 04:42:49 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-e1e52986-ade7-4aa5-acc7-34f7ba5f46ae tempest-VolumesSnapshotTestJSON-1690897005 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-809f59aa-2cd0-4e34-b823-ff4f97fc2ff3 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:42:49 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-19407819-987f-4fef-b59c-7f95854b39f8 tempest-VolumesCloneTest-2092220422 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-88dd004a-c872-437b-9d69-c3610c47fb72" returned: 0 in 1.065s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:42:49 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-19407819-987f-4fef-b59c-7f95854b39f8 tempest-VolumesCloneTest-2092220422 None] <== create_volume: return (2135ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922'} {{(pid=87444) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 04:42:49 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-19407819-987f-4fef-b59c-7f95854b39f8 tempest-VolumesCloneTest-2092220422 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.139s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 04:42:49 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-2ee5d108-d09c-4b5e-ae02-0e9df5d226b0 tempest-VolumesDeleteCascade-473852886 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.406s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 04:42:49 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.remotefs [None req-2ee5d108-d09c-4b5e-ae02-0e9df5d226b0 tempest-VolumesDeleteCascade-473852886 None] Creating offline snapshot 057f2db0-148c-457a-a88d-82d03451ea83 of volume 11e8ac43-d499-4bf6-a257-89a3bf968264 {{(pid=87444) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 10 04:42:49 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-19407819-987f-4fef-b59c-7f95854b39f8 tempest-VolumesCloneTest-2092220422 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d9ab4f65-abb5-424b-b0d8-27e348ac92ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-88dd004a-c872-437b-9d69-c3610c47fb72', 'volume_size': 1}' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:42:49 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-19407819-987f-4fef-b59c-7f95854b39f8 tempest-VolumesCloneTest-2092220422 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (13ab1189-6eff-4950-a40c-c94fd27bf756) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:42:49 devstack cinder-volume[87444]: DEBUG oslo.privsep.daemon [-] privsep: reply[4801258e-334a-4edc-8ec8-19246ee9d662]: (4, 'qcow2') {{(pid=88499) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 04:42:49 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-2ee5d108-d09c-4b5e-ae02-0e9df5d226b0 tempest-VolumesDeleteCascade-473852886 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-11e8ac43-d499-4bf6-a257-89a3bf968264 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:42:49 devstack cinder-volume[87444]: INFO cinder.volume.flows.manager.create_volume [None req-19407819-987f-4fef-b59c-7f95854b39f8 tempest-VolumesCloneTest-2092220422 None] Volume volume-88dd004a-c872-437b-9d69-c3610c47fb72 (88dd004a-c872-437b-9d69-c3610c47fb72): created successfully Jul 10 04:42:49 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-19407819-987f-4fef-b59c-7f95854b39f8 tempest-VolumesCloneTest-2092220422 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (13ab1189-6eff-4950-a40c-c94fd27bf756) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:42:49 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-19407819-987f-4fef-b59c-7f95854b39f8 tempest-VolumesCloneTest-2092220422 None] Flow 'volume_create_manager' (221e3c04-0b7a-4867-912a-d27c66401fc2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87444) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 04:42:49 devstack sudo[97207]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-809f59aa-2cd0-4e34-b823-ff4f97fc2ff3 Jul 10 04:42:49 devstack sudo[97207]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:42:49 devstack cinder-volume[87444]: INFO cinder.volume.manager [None req-19407819-987f-4fef-b59c-7f95854b39f8 tempest-VolumesCloneTest-2092220422 None] Created volume successfully. Jul 10 04:42:49 devstack sudo[97210]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-11e8ac43-d499-4bf6-a257-89a3bf968264 Jul 10 04:42:49 devstack sudo[97210]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:42:50 devstack sudo[97207]: pam_unix(sudo:session): session closed for user root Jul 10 04:42:50 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-e1e52986-ade7-4aa5-acc7-34f7ba5f46ae tempest-VolumesSnapshotTestJSON-1690897005 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-809f59aa-2cd0-4e34-b823-ff4f97fc2ff3" returned: 0 in 0.854s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:42:50 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-e1e52986-ade7-4aa5-acc7-34f7ba5f46ae tempest-VolumesSnapshotTestJSON-1690897005 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-809f59aa-2cd0-4e34-b823-ff4f97fc2ff3.13eca88b-eab0-4ab3-a9a0-dc0c6df2c2ff {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:42:50 devstack sudo[97238]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-809f59aa-2cd0-4e34-b823-ff4f97fc2ff3.13eca88b-eab0-4ab3-a9a0-dc0c6df2c2ff Jul 10 04:42:50 devstack sudo[97238]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:42:50 devstack sudo[97210]: pam_unix(sudo:session): session closed for user root Jul 10 04:42:50 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-2ee5d108-d09c-4b5e-ae02-0e9df5d226b0 tempest-VolumesDeleteCascade-473852886 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-11e8ac43-d499-4bf6-a257-89a3bf968264" returned: 0 in 0.918s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:42:50 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-2ee5d108-d09c-4b5e-ae02-0e9df5d226b0 tempest-VolumesDeleteCascade-473852886 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-11e8ac43-d499-4bf6-a257-89a3bf968264,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-11e8ac43-d499-4bf6-a257-89a3bf968264.057f2db0-148c-457a-a88d-82d03451ea83 1G {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:42:50 devstack sudo[97240]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-11e8ac43-d499-4bf6-a257-89a3bf968264,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-11e8ac43-d499-4bf6-a257-89a3bf968264.057f2db0-148c-457a-a88d-82d03451ea83 1G Jul 10 04:42:50 devstack sudo[97240]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:42:51 devstack cinder-volume[87444]: DEBUG cinder.volume.flows.manager.create_volume [None req-f597cc05-462c-411d-9d96-839107ed9ae9 tempest-VolumesCloneTest-2092220422 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87444) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 04:42:51 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-f597cc05-462c-411d-9d96-839107ed9ae9 tempest-VolumesCloneTest-2092220422 None] Flow 'volume_create_manager' (b5c0d6ce-acfe-4728-bd83-889b7867236e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 04:42:51 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-f597cc05-462c-411d-9d96-839107ed9ae9 tempest-VolumesCloneTest-2092220422 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4512b704-2551-4d40-926e-7a3a1f469282) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:42:51 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-f597cc05-462c-411d-9d96-839107ed9ae9 tempest-VolumesCloneTest-2092220422 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4512b704-2551-4d40-926e-7a3a1f469282) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T02:42:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-1586922223',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dfaf42c5-b6d1-4e8e-87a0-2aa1cca8223d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1b8486da85e8451a9908d1ac8c2ab4f8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T02:42:51Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=88dd004a-c872-437b-9d69-c3610c47fb72,status='creating',terminated_at=None,updated_at=2026-07-10T02:42:51Z,use_quota=True,user_id='806a7074b455436185a67449713a3a25',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(317e369e-1e06-434d-ae95-a335f0e6c903),volume_type_id=317e369e-1e06-434d-ae95-a335f0e6c903)' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:42:51 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-f597cc05-462c-411d-9d96-839107ed9ae9 tempest-VolumesCloneTest-2092220422 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (358e9ede-53fc-4e50-a4dc-efa4ea11e76c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:42:51 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-f597cc05-462c-411d-9d96-839107ed9ae9 tempest-VolumesCloneTest-2092220422 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (358e9ede-53fc-4e50-a4dc-efa4ea11e76c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:42:51 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-f597cc05-462c-411d-9d96-839107ed9ae9 tempest-VolumesCloneTest-2092220422 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7d64c518-8dc7-41ab-a686-c57ffbaad238) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:42:51 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-f597cc05-462c-411d-9d96-839107ed9ae9 tempest-VolumesCloneTest-2092220422 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7d64c518-8dc7-41ab-a686-c57ffbaad238) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': 'dfaf42c5-b6d1-4e8e-87a0-2aa1cca8223d', 'volume_name': 'volume-dfaf42c5-b6d1-4e8e-87a0-2aa1cca8223d', 'volume_size': 2, 'source_volid': '88dd004a-c872-437b-9d69-c3610c47fb72', 'source_volstatus': 'available'}' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:42:51 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-f597cc05-462c-411d-9d96-839107ed9ae9 tempest-VolumesCloneTest-2092220422 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (61191afb-65c1-4e45-88fb-24e4d410392d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:42:51 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-f597cc05-462c-411d-9d96-839107ed9ae9 tempest-VolumesCloneTest-2092220422 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (61191afb-65c1-4e45-88fb-24e4d410392d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:42:51 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-f597cc05-462c-411d-9d96-839107ed9ae9 tempest-VolumesCloneTest-2092220422 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cd5db414-8113-4d9c-92f0-abbf094280de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:42:51 devstack cinder-volume[87444]: INFO cinder.volume.flows.manager.create_volume [None req-f597cc05-462c-411d-9d96-839107ed9ae9 tempest-VolumesCloneTest-2092220422 None] Volume dfaf42c5-b6d1-4e8e-87a0-2aa1cca8223d: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-dfaf42c5-b6d1-4e8e-87a0-2aa1cca8223d', 'volume_size': 2, 'source_volid': '88dd004a-c872-437b-9d69-c3610c47fb72', 'source_volstatus': 'available'} Jul 10 04:42:51 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-f597cc05-462c-411d-9d96-839107ed9ae9 tempest-VolumesCloneTest-2092220422 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 04:42:51 devstack sudo[97238]: pam_unix(sudo:session): session closed for user root Jul 10 04:42:51 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-e1e52986-ade7-4aa5-acc7-34f7ba5f46ae tempest-VolumesSnapshotTestJSON-1690897005 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-809f59aa-2cd0-4e34-b823-ff4f97fc2ff3.13eca88b-eab0-4ab3-a9a0-dc0c6df2c2ff" returned: 0 in 1.211s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:42:51 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-e1e52986-ade7-4aa5-acc7-34f7ba5f46ae tempest-VolumesSnapshotTestJSON-1690897005 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-809f59aa-2cd0-4e34-b823-ff4f97fc2ff3.13eca88b-eab0-4ab3-a9a0-dc0c6df2c2ff {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:42:51 devstack sudo[97252]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-809f59aa-2cd0-4e34-b823-ff4f97fc2ff3.13eca88b-eab0-4ab3-a9a0-dc0c6df2c2ff Jul 10 04:42:51 devstack sudo[97252]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:42:51 devstack sudo[97240]: pam_unix(sudo:session): session closed for user root Jul 10 04:42:51 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-2ee5d108-d09c-4b5e-ae02-0e9df5d226b0 tempest-VolumesDeleteCascade-473852886 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-11e8ac43-d499-4bf6-a257-89a3bf968264,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-11e8ac43-d499-4bf6-a257-89a3bf968264.057f2db0-148c-457a-a88d-82d03451ea83 1G" returned: 0 in 1.224s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:42:51 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-2ee5d108-d09c-4b5e-ae02-0e9df5d226b0 tempest-VolumesDeleteCascade-473852886 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-11e8ac43-d499-4bf6-a257-89a3bf968264 -F qcow2 /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-11e8ac43-d499-4bf6-a257-89a3bf968264.057f2db0-148c-457a-a88d-82d03451ea83 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:42:51 devstack sudo[97254]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-11e8ac43-d499-4bf6-a257-89a3bf968264 -F qcow2 /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-11e8ac43-d499-4bf6-a257-89a3bf968264.057f2db0-148c-457a-a88d-82d03451ea83 Jul 10 04:42:51 devstack sudo[97254]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:42:52 devstack sudo[97252]: pam_unix(sudo:session): session closed for user root Jul 10 04:42:52 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-e1e52986-ade7-4aa5-acc7-34f7ba5f46ae tempest-VolumesSnapshotTestJSON-1690897005 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-809f59aa-2cd0-4e34-b823-ff4f97fc2ff3.13eca88b-eab0-4ab3-a9a0-dc0c6df2c2ff" returned: 0 in 0.767s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:42:52 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-e1e52986-ade7-4aa5-acc7-34f7ba5f46ae tempest-VolumesSnapshotTestJSON-1690897005 None] Lock "cinder-quobyte-13eca88b-eab0-4ab3-a9a0-dc0c6df2c2ff" released by "_delete_snapshot" :: held 4.155s {{(pid=87444) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 04:42:52 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-e1e52986-ade7-4aa5-acc7-34f7ba5f46ae tempest-VolumesSnapshotTestJSON-1690897005 None] Lock "cinder-quobyte-809f59aa-2cd0-4e34-b823-ff4f97fc2ff3" released by "delete_snapshot" :: held 4.186s {{(pid=87444) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 04:42:52 devstack cinder-volume[87444]: DEBUG cinder.quota [None req-e1e52986-ade7-4aa5-acc7-34f7ba5f46ae tempest-VolumesSnapshotTestJSON-1690897005 None] Created reservations ['bb0a366d-4b98-471c-be2f-987829d4323a', 'd3e73c79-c5e1-458b-99dd-40970916a7b8', '09f6394d-c072-44a0-8afa-9c035c82f80b', '91ba0fa9-9757-468f-b3db-3bf7daf9c517'] {{(pid=87444) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 04:42:52 devstack cinder-volume[87444]: INFO cinder.volume.manager [None req-e1e52986-ade7-4aa5-acc7-34f7ba5f46ae tempest-VolumesSnapshotTestJSON-1690897005 None] Delete snapshot completed successfully. Jul 10 04:42:52 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-e1e52986-ade7-4aa5-acc7-34f7ba5f46ae tempest-VolumesSnapshotTestJSON-1690897005 None] Lock "cinder-13eca88b-eab0-4ab3-a9a0-dc0c6df2c2ff-delete_snapshot" released by "delete_snapshot" :: held 4.361s {{(pid=87444) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 04:42:52 devstack sudo[97254]: pam_unix(sudo:session): session closed for user root Jul 10 04:42:52 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-2ee5d108-d09c-4b5e-ae02-0e9df5d226b0 tempest-VolumesDeleteCascade-473852886 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-11e8ac43-d499-4bf6-a257-89a3bf968264 -F qcow2 /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-11e8ac43-d499-4bf6-a257-89a3bf968264.057f2db0-148c-457a-a88d-82d03451ea83" returned: 0 in 0.896s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:42:52 devstack cinder-volume[87444]: WARNING cinder.volume.drivers.remotefs [None req-2ee5d108-d09c-4b5e-ae02-0e9df5d226b0 tempest-VolumesDeleteCascade-473852886 None] /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-11e8ac43-d499-4bf6-a257-89a3bf968264.057f2db0-148c-457a-a88d-82d03451ea83 is being set with open permissions: ugo+rw Jul 10 04:42:52 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-2ee5d108-d09c-4b5e-ae02-0e9df5d226b0 tempest-VolumesDeleteCascade-473852886 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-11e8ac43-d499-4bf6-a257-89a3bf968264.057f2db0-148c-457a-a88d-82d03451ea83 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:42:52 devstack sudo[97260]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-11e8ac43-d499-4bf6-a257-89a3bf968264.057f2db0-148c-457a-a88d-82d03451ea83 Jul 10 04:42:52 devstack sudo[97260]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:42:53 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-b6d2ed84-9cfa-4ea4-839d-809dde580c72 tempest-VolumesActionsTest-532776818 None] Acquiring lock "cinder-14eaa034-13c6-4839-956c-d2befd0d4d8d" by "attach_volume" {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 04:42:53 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-b6d2ed84-9cfa-4ea4-839d-809dde580c72 tempest-VolumesActionsTest-532776818 None] Lock "cinder-14eaa034-13c6-4839-956c-d2befd0d4d8d" acquired by "attach_volume" :: waited 0.028s {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 04:42:53 devstack cinder-volume[87444]: INFO cinder.volume.manager [None req-b6d2ed84-9cfa-4ea4-839d-809dde580c72 tempest-VolumesActionsTest-532776818 None] Attaching volume 14eaa034-13c6-4839-956c-d2befd0d4d8d to instance 178ae67a-b494-4f77-a6ea-8244a3e3f76e at mountpoint /dev/vdb on host None. Jul 10 04:42:53 devstack cinder-volume[87444]: INFO cinder.volume.manager [None req-b6d2ed84-9cfa-4ea4-839d-809dde580c72 tempest-VolumesActionsTest-532776818 None] Attach volume completed successfully. Jul 10 04:42:53 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-b6d2ed84-9cfa-4ea4-839d-809dde580c72 tempest-VolumesActionsTest-532776818 None] Lock "cinder-14eaa034-13c6-4839-956c-d2befd0d4d8d" released by "attach_volume" :: held 0.120s {{(pid=87444) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 04:42:53 devstack sudo[97260]: pam_unix(sudo:session): session closed for user root Jul 10 04:42:53 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-2ee5d108-d09c-4b5e-ae02-0e9df5d226b0 tempest-VolumesDeleteCascade-473852886 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-11e8ac43-d499-4bf6-a257-89a3bf968264.057f2db0-148c-457a-a88d-82d03451ea83" returned: 0 in 0.697s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:42:53 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-2ee5d108-d09c-4b5e-ae02-0e9df5d226b0 tempest-VolumesDeleteCascade-473852886 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-11e8ac43-d499-4bf6-a257-89a3bf968264.info {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:42:53 devstack sudo[97264]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-11e8ac43-d499-4bf6-a257-89a3bf968264.info Jul 10 04:42:53 devstack sudo[97264]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:42:53 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-34a101f0-1ed1-4cbf-bbc3-843a21657837 tempest-VolumesActionsTest-532776818 None] Acquiring lock "cinder-14eaa034-13c6-4839-956c-d2befd0d4d8d-detach_volume" by "detach_volume" {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 04:42:53 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-34a101f0-1ed1-4cbf-bbc3-843a21657837 tempest-VolumesActionsTest-532776818 None] Lock "cinder-14eaa034-13c6-4839-956c-d2befd0d4d8d-detach_volume" acquired by "detach_volume" :: waited 0.031s {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 04:42:53 devstack cinder-volume[87444]: INFO cinder.volume.manager [None req-34a101f0-1ed1-4cbf-bbc3-843a21657837 tempest-VolumesActionsTest-532776818 None] Detaching volume 14eaa034-13c6-4839-956c-d2befd0d4d8d from instance 178ae67a-b494-4f77-a6ea-8244a3e3f76e. Jul 10 04:42:53 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-10f566d8-3a9b-48e7-b34e-d63f5573bfdc tempest-VolumesSnapshotTestJSON-1690897005 None] Acquiring lock "cinder-809f59aa-2cd0-4e34-b823-ff4f97fc2ff3-delete_volume" by "delete_volume" {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 04:42:53 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-10f566d8-3a9b-48e7-b34e-d63f5573bfdc tempest-VolumesSnapshotTestJSON-1690897005 None] Lock "cinder-809f59aa-2cd0-4e34-b823-ff4f97fc2ff3-delete_volume" acquired by "delete_volume" :: waited 0.042s {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 04:42:53 devstack cinder-volume[87444]: INFO cinder.volume.manager [None req-34a101f0-1ed1-4cbf-bbc3-843a21657837 tempest-VolumesActionsTest-532776818 None] Detach volume completed successfully. Jul 10 04:42:53 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-34a101f0-1ed1-4cbf-bbc3-843a21657837 tempest-VolumesActionsTest-532776818 None] Lock "cinder-14eaa034-13c6-4839-956c-d2befd0d4d8d-detach_volume" released by "detach_volume" :: held 0.138s {{(pid=87444) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 04:42:53 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-10f566d8-3a9b-48e7-b34e-d63f5573bfdc tempest-VolumesSnapshotTestJSON-1690897005 None] Acquiring lock "cinder-quobyte-809f59aa-2cd0-4e34-b823-ff4f97fc2ff3" by "delete_volume" {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 04:42:54 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-10f566d8-3a9b-48e7-b34e-d63f5573bfdc tempest-VolumesSnapshotTestJSON-1690897005 None] Lock "cinder-quobyte-809f59aa-2cd0-4e34-b823-ff4f97fc2ff3" acquired by "delete_volume" :: waited 0.022s {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 04:42:54 devstack cinder-volume[87444]: DEBUG oslo.privsep.daemon [-] privsep: reply[f637e450-06b8-4864-bb82-24ddbfd2981b]: (4, 'qcow2') {{(pid=88499) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 04:42:54 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-10f566d8-3a9b-48e7-b34e-d63f5573bfdc tempest-VolumesSnapshotTestJSON-1690897005 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-809f59aa-2cd0-4e34-b823-ff4f97fc2ff3 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:42:54 devstack sudo[97266]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-809f59aa-2cd0-4e34-b823-ff4f97fc2ff3 Jul 10 04:42:54 devstack sudo[97266]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:42:54 devstack sudo[97264]: pam_unix(sudo:session): session closed for user root Jul 10 04:42:54 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-2ee5d108-d09c-4b5e-ae02-0e9df5d226b0 tempest-VolumesDeleteCascade-473852886 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-11e8ac43-d499-4bf6-a257-89a3bf968264.info" returned: 0 in 0.778s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:42:54 devstack cinder-volume[87444]: WARNING cinder.volume.drivers.remotefs [None req-2ee5d108-d09c-4b5e-ae02-0e9df5d226b0 tempest-VolumesDeleteCascade-473852886 None] /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-11e8ac43-d499-4bf6-a257-89a3bf968264.info is being set with open permissions: ugo+rw Jul 10 04:42:54 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-2ee5d108-d09c-4b5e-ae02-0e9df5d226b0 tempest-VolumesDeleteCascade-473852886 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-11e8ac43-d499-4bf6-a257-89a3bf968264.info {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:42:54 devstack sudo[97269]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-11e8ac43-d499-4bf6-a257-89a3bf968264.info Jul 10 04:42:54 devstack sudo[97269]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:42:54 devstack sudo[97266]: pam_unix(sudo:session): session closed for user root Jul 10 04:42:54 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-10f566d8-3a9b-48e7-b34e-d63f5573bfdc tempest-VolumesSnapshotTestJSON-1690897005 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-809f59aa-2cd0-4e34-b823-ff4f97fc2ff3" returned: 0 in 0.882s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:42:54 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-10f566d8-3a9b-48e7-b34e-d63f5573bfdc tempest-VolumesSnapshotTestJSON-1690897005 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-809f59aa-2cd0-4e34-b823-ff4f97fc2ff3 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:42:54 devstack sudo[97274]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-809f59aa-2cd0-4e34-b823-ff4f97fc2ff3 Jul 10 04:42:54 devstack sudo[97274]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:42:55 devstack sudo[97269]: pam_unix(sudo:session): session closed for user root Jul 10 04:42:55 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-2ee5d108-d09c-4b5e-ae02-0e9df5d226b0 tempest-VolumesDeleteCascade-473852886 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-11e8ac43-d499-4bf6-a257-89a3bf968264.info" returned: 0 in 0.835s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:42:55 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-2ee5d108-d09c-4b5e-ae02-0e9df5d226b0 tempest-VolumesDeleteCascade-473852886 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.451s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 04:42:55 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-f597cc05-462c-411d-9d96-839107ed9ae9 tempest-VolumesCloneTest-2092220422 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 3.608s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 04:42:55 devstack cinder-volume[87444]: INFO cinder.volume.drivers.remotefs [None req-f597cc05-462c-411d-9d96-839107ed9ae9 tempest-VolumesCloneTest-2092220422 None] Cloning volume 88dd004a-c872-437b-9d69-c3610c47fb72 to volume dfaf42c5-b6d1-4e8e-87a0-2aa1cca8223d Jul 10 04:42:55 devstack cinder-volume[87444]: INFO cinder.volume.manager [None req-2ee5d108-d09c-4b5e-ae02-0e9df5d226b0 tempest-VolumesDeleteCascade-473852886 None] Create snapshot completed successfully Jul 10 04:42:55 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.remotefs [None req-f597cc05-462c-411d-9d96-839107ed9ae9 tempest-VolumesCloneTest-2092220422 None] Creating offline snapshot f4341e53-4540-4e07-b82d-cf27085e23d0 of volume 88dd004a-c872-437b-9d69-c3610c47fb72 {{(pid=87444) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 10 04:42:55 devstack cinder-volume[87444]: DEBUG oslo.privsep.daemon [-] privsep: reply[eca44c42-b5f7-423f-acd0-9f4a53490954]: (4, 'qcow2') {{(pid=88499) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 04:42:55 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-f597cc05-462c-411d-9d96-839107ed9ae9 tempest-VolumesCloneTest-2092220422 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-88dd004a-c872-437b-9d69-c3610c47fb72 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:42:55 devstack sudo[97277]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-88dd004a-c872-437b-9d69-c3610c47fb72 Jul 10 04:42:55 devstack sudo[97277]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:42:55 devstack sudo[97274]: pam_unix(sudo:session): session closed for user root Jul 10 04:42:55 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-10f566d8-3a9b-48e7-b34e-d63f5573bfdc tempest-VolumesSnapshotTestJSON-1690897005 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-809f59aa-2cd0-4e34-b823-ff4f97fc2ff3" returned: 0 in 0.740s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:42:55 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-10f566d8-3a9b-48e7-b34e-d63f5573bfdc tempest-VolumesSnapshotTestJSON-1690897005 None] Lock "cinder-quobyte-809f59aa-2cd0-4e34-b823-ff4f97fc2ff3" released by "delete_volume" :: held 1.693s {{(pid=87444) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 04:42:55 devstack cinder-volume[87444]: DEBUG cinder.quota [None req-10f566d8-3a9b-48e7-b34e-d63f5573bfdc tempest-VolumesSnapshotTestJSON-1690897005 None] Created reservations ['2d2a1720-c151-49fa-9baf-637dab77159c', '1a07253a-bd84-4aa2-b0ee-cacb2f29e049', '3f8860c3-f7ad-483a-aa88-8b7287a955dd', 'e69d8152-0cee-4e58-bf1d-30f2489b08f9'] {{(pid=87444) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 04:42:55 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-10f566d8-3a9b-48e7-b34e-d63f5573bfdc tempest-VolumesSnapshotTestJSON-1690897005 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 04:42:55 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-10f566d8-3a9b-48e7-b34e-d63f5573bfdc tempest-VolumesSnapshotTestJSON-1690897005 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 04:42:55 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-10f566d8-3a9b-48e7-b34e-d63f5573bfdc tempest-VolumesSnapshotTestJSON-1690897005 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922': None} {{(pid=87444) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 04:42:55 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-10f566d8-3a9b-48e7-b34e-d63f5573bfdc tempest-VolumesSnapshotTestJSON-1690897005 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922'] {{(pid=87444) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 04:42:55 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-10f566d8-3a9b-48e7-b34e-d63f5573bfdc tempest-VolumesSnapshotTestJSON-1690897005 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 04:42:55 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-10f566d8-3a9b-48e7-b34e-d63f5573bfdc tempest-VolumesSnapshotTestJSON-1690897005 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:42:55 devstack sudo[97282]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097 Jul 10 04:42:55 devstack sudo[97282]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:42:56 devstack sudo[97277]: pam_unix(sudo:session): session closed for user root Jul 10 04:42:56 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-f597cc05-462c-411d-9d96-839107ed9ae9 tempest-VolumesCloneTest-2092220422 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-88dd004a-c872-437b-9d69-c3610c47fb72" returned: 0 in 0.887s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:42:56 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-f597cc05-462c-411d-9d96-839107ed9ae9 tempest-VolumesCloneTest-2092220422 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-88dd004a-c872-437b-9d69-c3610c47fb72,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-88dd004a-c872-437b-9d69-c3610c47fb72.f4341e53-4540-4e07-b82d-cf27085e23d0 1G {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:42:56 devstack sudo[97291]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-88dd004a-c872-437b-9d69-c3610c47fb72,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-88dd004a-c872-437b-9d69-c3610c47fb72.f4341e53-4540-4e07-b82d-cf27085e23d0 1G Jul 10 04:42:56 devstack sudo[97291]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:42:56 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-6d921719-d6b0-4e34-a611-1562571f6edd tempest-VolumesSnapshotTestJSON-1690897005 None] Acquiring lock "cinder-6a357083-ca5b-48c8-95e3-902e6d5d5cd4-delete_volume" by "delete_volume" {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 04:42:56 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-6d921719-d6b0-4e34-a611-1562571f6edd tempest-VolumesSnapshotTestJSON-1690897005 None] Lock "cinder-6a357083-ca5b-48c8-95e3-902e6d5d5cd4-delete_volume" acquired by "delete_volume" :: waited 0.069s {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 04:42:56 devstack cinder-volume[87444]: DEBUG cinder.volume.flows.manager.create_volume [None req-dd67d63d-478b-4937-a2cc-7e64ba0404df tempest-VolumesDeleteCascade-473852886 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87444) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 04:42:56 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-dd67d63d-478b-4937-a2cc-7e64ba0404df tempest-VolumesDeleteCascade-473852886 None] Flow 'volume_create_manager' (310413c9-85f8-4fec-a2ae-b5258c6cf1fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 04:42:56 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-dd67d63d-478b-4937-a2cc-7e64ba0404df tempest-VolumesDeleteCascade-473852886 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (114fab08-830f-4199-b2b9-68800dcd6f0d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:42:56 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-dd67d63d-478b-4937-a2cc-7e64ba0404df tempest-VolumesDeleteCascade-473852886 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (114fab08-830f-4199-b2b9-68800dcd6f0d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T02:42:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-100290290',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b7bdc84e-7ca9-4f07-9b44-7ff588f698e1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1d1db54813084886981e0b7d83441a9a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T02:42:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=057f2db0-148c-457a-a88d-82d03451ea83,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T02:42:56Z,use_quota=True,user_id='5631bee5216c42c2b47ceda43dfb6a55',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(317e369e-1e06-434d-ae95-a335f0e6c903),volume_type_id=317e369e-1e06-434d-ae95-a335f0e6c903)' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:42:56 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-dd67d63d-478b-4937-a2cc-7e64ba0404df tempest-VolumesDeleteCascade-473852886 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c29038b9-c775-40f2-a8c2-7259415ee4fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:42:56 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-dd67d63d-478b-4937-a2cc-7e64ba0404df tempest-VolumesDeleteCascade-473852886 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c29038b9-c775-40f2-a8c2-7259415ee4fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:42:56 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-dd67d63d-478b-4937-a2cc-7e64ba0404df tempest-VolumesDeleteCascade-473852886 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (710fa1da-f374-4785-bca0-1f13ef2cd107) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:42:56 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-dd67d63d-478b-4937-a2cc-7e64ba0404df tempest-VolumesDeleteCascade-473852886 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (710fa1da-f374-4785-bca0-1f13ef2cd107) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'b7bdc84e-7ca9-4f07-9b44-7ff588f698e1', 'volume_name': 'volume-b7bdc84e-7ca9-4f07-9b44-7ff588f698e1', 'volume_size': 1, 'snapshot_id': '057f2db0-148c-457a-a88d-82d03451ea83'}' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:42:56 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-dd67d63d-478b-4937-a2cc-7e64ba0404df tempest-VolumesDeleteCascade-473852886 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (370c95dc-0d00-41d4-8dd8-646476e724db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:42:56 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-dd67d63d-478b-4937-a2cc-7e64ba0404df tempest-VolumesDeleteCascade-473852886 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (370c95dc-0d00-41d4-8dd8-646476e724db) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:42:56 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-dd67d63d-478b-4937-a2cc-7e64ba0404df tempest-VolumesDeleteCascade-473852886 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (91584e4e-c9b7-4cad-b726-7965d3d97dd7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:42:56 devstack cinder-volume[87444]: INFO cinder.volume.flows.manager.create_volume [None req-dd67d63d-478b-4937-a2cc-7e64ba0404df tempest-VolumesDeleteCascade-473852886 None] Volume b7bdc84e-7ca9-4f07-9b44-7ff588f698e1: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-b7bdc84e-7ca9-4f07-9b44-7ff588f698e1', 'volume_size': 1, 'snapshot_id': '057f2db0-148c-457a-a88d-82d03451ea83'} Jul 10 04:42:56 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-6d921719-d6b0-4e34-a611-1562571f6edd tempest-VolumesSnapshotTestJSON-1690897005 None] Acquiring lock "cinder-quobyte-6a357083-ca5b-48c8-95e3-902e6d5d5cd4" by "delete_volume" {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 04:42:56 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-dd67d63d-478b-4937-a2cc-7e64ba0404df tempest-VolumesDeleteCascade-473852886 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 04:42:56 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-6d921719-d6b0-4e34-a611-1562571f6edd tempest-VolumesSnapshotTestJSON-1690897005 None] Lock "cinder-quobyte-6a357083-ca5b-48c8-95e3-902e6d5d5cd4" acquired by "delete_volume" :: waited 0.036s {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 04:42:56 devstack cinder-volume[87444]: DEBUG oslo.privsep.daemon [-] privsep: reply[f68a5772-f254-4108-a83b-d58afe930a19]: (4, 'qcow2') {{(pid=88499) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 04:42:56 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-6d921719-d6b0-4e34-a611-1562571f6edd tempest-VolumesSnapshotTestJSON-1690897005 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-6a357083-ca5b-48c8-95e3-902e6d5d5cd4 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:42:56 devstack sudo[97282]: pam_unix(sudo:session): session closed for user root Jul 10 04:42:56 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-10f566d8-3a9b-48e7-b34e-d63f5573bfdc tempest-VolumesSnapshotTestJSON-1690897005 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097" returned: 0 in 1.079s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:42:56 devstack cinder-volume[87444]: DEBUG cinder.manager [None req-10f566d8-3a9b-48e7-b34e-d63f5573bfdc tempest-VolumesSnapshotTestJSON-1690897005 None] Notifying Schedulers of capabilities ... {{(pid=87444) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 04:42:57 devstack cinder-volume[87444]: INFO cinder.volume.manager [None req-10f566d8-3a9b-48e7-b34e-d63f5573bfdc tempest-VolumesSnapshotTestJSON-1690897005 None] Deleted volume successfully. Jul 10 04:42:57 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-10f566d8-3a9b-48e7-b34e-d63f5573bfdc tempest-VolumesSnapshotTestJSON-1690897005 None] Lock "cinder-809f59aa-2cd0-4e34-b823-ff4f97fc2ff3-delete_volume" released by "delete_volume" :: held 3.098s {{(pid=87444) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 04:42:57 devstack sudo[97309]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-6a357083-ca5b-48c8-95e3-902e6d5d5cd4 Jul 10 04:42:57 devstack sudo[97309]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:42:57 devstack sudo[97291]: pam_unix(sudo:session): session closed for user root Jul 10 04:42:57 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-f597cc05-462c-411d-9d96-839107ed9ae9 tempest-VolumesCloneTest-2092220422 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-88dd004a-c872-437b-9d69-c3610c47fb72,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-88dd004a-c872-437b-9d69-c3610c47fb72.f4341e53-4540-4e07-b82d-cf27085e23d0 1G" returned: 0 in 1.307s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:42:57 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-f597cc05-462c-411d-9d96-839107ed9ae9 tempest-VolumesCloneTest-2092220422 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-88dd004a-c872-437b-9d69-c3610c47fb72 -F qcow2 /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-88dd004a-c872-437b-9d69-c3610c47fb72.f4341e53-4540-4e07-b82d-cf27085e23d0 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:42:57 devstack sudo[97318]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-88dd004a-c872-437b-9d69-c3610c47fb72 -F qcow2 /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-88dd004a-c872-437b-9d69-c3610c47fb72.f4341e53-4540-4e07-b82d-cf27085e23d0 Jul 10 04:42:57 devstack sudo[97318]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:42:57 devstack sudo[97309]: pam_unix(sudo:session): session closed for user root Jul 10 04:42:57 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-6d921719-d6b0-4e34-a611-1562571f6edd tempest-VolumesSnapshotTestJSON-1690897005 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-6a357083-ca5b-48c8-95e3-902e6d5d5cd4" returned: 0 in 1.088s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:42:57 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-6d921719-d6b0-4e34-a611-1562571f6edd tempest-VolumesSnapshotTestJSON-1690897005 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-6a357083-ca5b-48c8-95e3-902e6d5d5cd4 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:42:57 devstack sudo[97324]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-6a357083-ca5b-48c8-95e3-902e6d5d5cd4 Jul 10 04:42:57 devstack sudo[97324]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:42:58 devstack sudo[97318]: pam_unix(sudo:session): session closed for user root Jul 10 04:42:58 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-f597cc05-462c-411d-9d96-839107ed9ae9 tempest-VolumesCloneTest-2092220422 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-88dd004a-c872-437b-9d69-c3610c47fb72 -F qcow2 /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-88dd004a-c872-437b-9d69-c3610c47fb72.f4341e53-4540-4e07-b82d-cf27085e23d0" returned: 0 in 0.798s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:42:58 devstack cinder-volume[87444]: WARNING cinder.volume.drivers.remotefs [None req-f597cc05-462c-411d-9d96-839107ed9ae9 tempest-VolumesCloneTest-2092220422 None] /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-88dd004a-c872-437b-9d69-c3610c47fb72.f4341e53-4540-4e07-b82d-cf27085e23d0 is being set with open permissions: ugo+rw Jul 10 04:42:58 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-f597cc05-462c-411d-9d96-839107ed9ae9 tempest-VolumesCloneTest-2092220422 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-88dd004a-c872-437b-9d69-c3610c47fb72.f4341e53-4540-4e07-b82d-cf27085e23d0 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:42:58 devstack sudo[97329]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-88dd004a-c872-437b-9d69-c3610c47fb72.f4341e53-4540-4e07-b82d-cf27085e23d0 Jul 10 04:42:58 devstack sudo[97329]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:42:58 devstack sudo[97324]: pam_unix(sudo:session): session closed for user root Jul 10 04:42:58 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-6d921719-d6b0-4e34-a611-1562571f6edd tempest-VolumesSnapshotTestJSON-1690897005 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-6a357083-ca5b-48c8-95e3-902e6d5d5cd4" returned: 0 in 0.667s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:42:58 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-6d921719-d6b0-4e34-a611-1562571f6edd tempest-VolumesSnapshotTestJSON-1690897005 None] Lock "cinder-quobyte-6a357083-ca5b-48c8-95e3-902e6d5d5cd4" released by "delete_volume" :: held 1.833s {{(pid=87444) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 04:42:58 devstack cinder-volume[87444]: DEBUG dbcounter [-] [87444] Writing DB stats cinder:UPDATE=164,cinder:SELECT=118,cinder:INSERT=45,cinder:DELETE=11 {{(pid=87444) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 10 04:42:58 devstack cinder-volume[87444]: DEBUG cinder.quota [None req-6d921719-d6b0-4e34-a611-1562571f6edd tempest-VolumesSnapshotTestJSON-1690897005 None] Created reservations ['60de3a20-f28f-4bbb-90f8-e5422f130e1d', 'b178dd97-658a-4a75-b30d-7127ddd9d6c4', 'be174fcd-efcc-4b9d-a755-de8e233d009b', '3fb18ffa-ded9-4a77-a8af-1efdae17af29'] {{(pid=87444) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 04:42:58 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-6d921719-d6b0-4e34-a611-1562571f6edd tempest-VolumesSnapshotTestJSON-1690897005 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 04:42:58 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-6d921719-d6b0-4e34-a611-1562571f6edd tempest-VolumesSnapshotTestJSON-1690897005 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 04:42:58 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-6d921719-d6b0-4e34-a611-1562571f6edd tempest-VolumesSnapshotTestJSON-1690897005 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922': None} {{(pid=87444) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 04:42:58 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-6d921719-d6b0-4e34-a611-1562571f6edd tempest-VolumesSnapshotTestJSON-1690897005 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922'] {{(pid=87444) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 04:42:58 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-6d921719-d6b0-4e34-a611-1562571f6edd tempest-VolumesSnapshotTestJSON-1690897005 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 04:42:58 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-6d921719-d6b0-4e34-a611-1562571f6edd tempest-VolumesSnapshotTestJSON-1690897005 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:42:58 devstack sudo[97332]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097 Jul 10 04:42:58 devstack sudo[97332]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:42:58 devstack sudo[97329]: pam_unix(sudo:session): session closed for user root Jul 10 04:42:58 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-f597cc05-462c-411d-9d96-839107ed9ae9 tempest-VolumesCloneTest-2092220422 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-88dd004a-c872-437b-9d69-c3610c47fb72.f4341e53-4540-4e07-b82d-cf27085e23d0" returned: 0 in 0.687s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:42:58 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-f597cc05-462c-411d-9d96-839107ed9ae9 tempest-VolumesCloneTest-2092220422 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-88dd004a-c872-437b-9d69-c3610c47fb72.info {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:42:59 devstack sudo[97335]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-88dd004a-c872-437b-9d69-c3610c47fb72.info Jul 10 04:42:59 devstack sudo[97335]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:42:59 devstack sudo[97332]: pam_unix(sudo:session): session closed for user root Jul 10 04:42:59 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-6d921719-d6b0-4e34-a611-1562571f6edd tempest-VolumesSnapshotTestJSON-1690897005 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097" returned: 0 in 0.669s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:42:59 devstack cinder-volume[87444]: DEBUG cinder.manager [None req-6d921719-d6b0-4e34-a611-1562571f6edd tempest-VolumesSnapshotTestJSON-1690897005 None] Notifying Schedulers of capabilities ... {{(pid=87444) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 04:42:59 devstack cinder-volume[87444]: INFO cinder.volume.manager [None req-6d921719-d6b0-4e34-a611-1562571f6edd tempest-VolumesSnapshotTestJSON-1690897005 None] Deleted volume successfully. Jul 10 04:42:59 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-6d921719-d6b0-4e34-a611-1562571f6edd tempest-VolumesSnapshotTestJSON-1690897005 None] Lock "cinder-6a357083-ca5b-48c8-95e3-902e6d5d5cd4-delete_volume" released by "delete_volume" :: held 3.037s {{(pid=87444) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 04:42:59 devstack sudo[97335]: pam_unix(sudo:session): session closed for user root Jul 10 04:42:59 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-f597cc05-462c-411d-9d96-839107ed9ae9 tempest-VolumesCloneTest-2092220422 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-88dd004a-c872-437b-9d69-c3610c47fb72.info" returned: 0 in 0.676s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:42:59 devstack cinder-volume[87444]: WARNING cinder.volume.drivers.remotefs [None req-f597cc05-462c-411d-9d96-839107ed9ae9 tempest-VolumesCloneTest-2092220422 None] /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-88dd004a-c872-437b-9d69-c3610c47fb72.info is being set with open permissions: ugo+rw Jul 10 04:42:59 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-f597cc05-462c-411d-9d96-839107ed9ae9 tempest-VolumesCloneTest-2092220422 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-88dd004a-c872-437b-9d69-c3610c47fb72.info {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:42:59 devstack sudo[97340]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-88dd004a-c872-437b-9d69-c3610c47fb72.info Jul 10 04:42:59 devstack sudo[97340]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:43:00 devstack sudo[97340]: pam_unix(sudo:session): session closed for user root Jul 10 04:43:00 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-f597cc05-462c-411d-9d96-839107ed9ae9 tempest-VolumesCloneTest-2092220422 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-88dd004a-c872-437b-9d69-c3610c47fb72.info" returned: 0 in 0.638s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:43:00 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-f597cc05-462c-411d-9d96-839107ed9ae9 tempest-VolumesCloneTest-2092220422 None] Acquiring lock "cinder-quobyte-dfaf42c5-b6d1-4e8e-87a0-2aa1cca8223d" by "_copy_volume_from_snapshot" {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 04:43:00 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-f597cc05-462c-411d-9d96-839107ed9ae9 tempest-VolumesCloneTest-2092220422 None] Lock "cinder-quobyte-dfaf42c5-b6d1-4e8e-87a0-2aa1cca8223d" acquired by "_copy_volume_from_snapshot" :: waited 0.021s {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 04:43:00 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-f597cc05-462c-411d-9d96-839107ed9ae9 tempest-VolumesCloneTest-2092220422 None] snapshot: f4341e53-4540-4e07-b82d-cf27085e23d0, volume: dfaf42c5-b6d1-4e8e-87a0-2aa1cca8223d, {{(pid=87444) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jul 10 04:43:00 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-f597cc05-462c-411d-9d96-839107ed9ae9 tempest-VolumesCloneTest-2092220422 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 04:43:00 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-f597cc05-462c-411d-9d96-839107ed9ae9 tempest-VolumesCloneTest-2092220422 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 04:43:00 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-f597cc05-462c-411d-9d96-839107ed9ae9 tempest-VolumesCloneTest-2092220422 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922': None} {{(pid=87444) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 04:43:00 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-f597cc05-462c-411d-9d96-839107ed9ae9 tempest-VolumesCloneTest-2092220422 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922'] {{(pid=87444) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 04:43:00 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-f597cc05-462c-411d-9d96-839107ed9ae9 tempest-VolumesCloneTest-2092220422 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 04:43:00 devstack cinder-volume[87444]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7156fef-c5ac-4223-9644-c8eea60dd3b8]: (4, 'qcow2') {{(pid=88499) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 04:43:00 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-f597cc05-462c-411d-9d96-839107ed9ae9 tempest-VolumesCloneTest-2092220422 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-88dd004a-c872-437b-9d69-c3610c47fb72.f4341e53-4540-4e07-b82d-cf27085e23d0 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:43:00 devstack sudo[97343]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-88dd004a-c872-437b-9d69-c3610c47fb72.f4341e53-4540-4e07-b82d-cf27085e23d0 Jul 10 04:43:00 devstack sudo[97343]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:43:01 devstack sudo[97343]: pam_unix(sudo:session): session closed for user root Jul 10 04:43:01 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-f597cc05-462c-411d-9d96-839107ed9ae9 tempest-VolumesCloneTest-2092220422 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-88dd004a-c872-437b-9d69-c3610c47fb72.f4341e53-4540-4e07-b82d-cf27085e23d0" returned: 0 in 0.891s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:43:01 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.remotefs [None req-f597cc05-462c-411d-9d96-839107ed9ae9 tempest-VolumesCloneTest-2092220422 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-88dd004a-c872-437b-9d69-c3610c47fb72(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87444) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 10 04:43:01 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-f597cc05-462c-411d-9d96-839107ed9ae9 tempest-VolumesCloneTest-2092220422 None] will copy from snapshot at /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-88dd004a-c872-437b-9d69-c3610c47fb72 {{(pid=87444) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jul 10 04:43:01 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-f597cc05-462c-411d-9d96-839107ed9ae9 tempest-VolumesCloneTest-2092220422 None] Creating direct copy from snapshot {{(pid=87444) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jul 10 04:43:01 devstack cinder-volume[87444]: DEBUG oslo.privsep.daemon [-] privsep: reply[4cf84d25-6159-4398-bc99-0ccf1ef88414]: (4, 'qcow2') {{(pid=88499) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 04:43:01 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-f597cc05-462c-411d-9d96-839107ed9ae9 tempest-VolumesCloneTest-2092220422 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-88dd004a-c872-437b-9d69-c3610c47fb72 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:43:01 devstack sudo[97350]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-88dd004a-c872-437b-9d69-c3610c47fb72 Jul 10 04:43:01 devstack sudo[97350]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:43:02 devstack sudo[97350]: pam_unix(sudo:session): session closed for user root Jul 10 04:43:02 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-f597cc05-462c-411d-9d96-839107ed9ae9 tempest-VolumesCloneTest-2092220422 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-88dd004a-c872-437b-9d69-c3610c47fb72" returned: 0 in 0.867s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:43:02 devstack cinder-volume[87444]: DEBUG cinder.utils [None req-f597cc05-462c-411d-9d96-839107ed9ae9 tempest-VolumesCloneTest-2092220422 None] Path /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-dfaf42c5-b6d1-4e8e-87a0-2aa1cca8223d not found in is_blk_device check {{(pid=87444) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 10 04:43:02 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-f597cc05-462c-411d-9d96-839107ed9ae9 tempest-VolumesCloneTest-2092220422 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-88dd004a-c872-437b-9d69-c3610c47fb72 /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-dfaf42c5-b6d1-4e8e-87a0-2aa1cca8223d {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:43:02 devstack sudo[97356]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-88dd004a-c872-437b-9d69-c3610c47fb72 /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-dfaf42c5-b6d1-4e8e-87a0-2aa1cca8223d Jul 10 04:43:02 devstack sudo[97356]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:43:08 devstack sudo[97356]: pam_unix(sudo:session): session closed for user root Jul 10 04:43:08 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-f597cc05-462c-411d-9d96-839107ed9ae9 tempest-VolumesCloneTest-2092220422 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-88dd004a-c872-437b-9d69-c3610c47fb72 /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-dfaf42c5-b6d1-4e8e-87a0-2aa1cca8223d" returned: 0 in 6.042s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:43:08 devstack cinder-volume[87444]: DEBUG oslo.privsep.daemon [-] privsep: reply[32079196-6f2d-47a4-8ec9-4f4ecca3b56d]: (4, 'qcow2') {{(pid=88499) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 04:43:08 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-f597cc05-462c-411d-9d96-839107ed9ae9 tempest-VolumesCloneTest-2092220422 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-88dd004a-c872-437b-9d69-c3610c47fb72 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:43:08 devstack sudo[97376]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-88dd004a-c872-437b-9d69-c3610c47fb72 Jul 10 04:43:08 devstack sudo[97376]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:43:08 devstack cinder-volume[87444]: DEBUG dbcounter [-] [87444] Writing DB stats cinder:INSERT=5,cinder:UPDATE=5,cinder:SELECT=4 {{(pid=87444) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 10 04:43:09 devstack cinder-volume[87444]: DEBUG dbcounter [-] [87444] Writing DB stats cinder:SELECT=37,cinder:INSERT=10,cinder:UPDATE=33,cinder:DELETE=3 {{(pid=87444) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 10 04:43:09 devstack sudo[97376]: pam_unix(sudo:session): session closed for user root Jul 10 04:43:09 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-f597cc05-462c-411d-9d96-839107ed9ae9 tempest-VolumesCloneTest-2092220422 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-88dd004a-c872-437b-9d69-c3610c47fb72" returned: 0 in 1.244s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:43:09 devstack cinder-volume[87444]: DEBUG cinder.image.image_utils [None req-f597cc05-462c-411d-9d96-839107ed9ae9 tempest-VolumesCloneTest-2092220422 None] Image conversion details: src /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-88dd004a-c872-437b-9d69-c3610c47fb72, size 1024.00 MB, duration 6.04 sec, destination /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-dfaf42c5-b6d1-4e8e-87a0-2aa1cca8223d {{(pid=87444) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:561}} Jul 10 04:43:09 devstack cinder-volume[87444]: INFO cinder.image.image_utils [None req-f597cc05-462c-411d-9d96-839107ed9ae9 tempest-VolumesCloneTest-2092220422 None] Converted 1024.00 MB image at 169.44 MB/s Jul 10 04:43:09 devstack cinder-volume[87444]: WARNING cinder.volume.drivers.remotefs [None req-f597cc05-462c-411d-9d96-839107ed9ae9 tempest-VolumesCloneTest-2092220422 None] /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-dfaf42c5-b6d1-4e8e-87a0-2aa1cca8223d is being set with open permissions: ugo+rw Jul 10 04:43:09 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-f597cc05-462c-411d-9d96-839107ed9ae9 tempest-VolumesCloneTest-2092220422 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-dfaf42c5-b6d1-4e8e-87a0-2aa1cca8223d {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:43:09 devstack sudo[97385]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-dfaf42c5-b6d1-4e8e-87a0-2aa1cca8223d Jul 10 04:43:09 devstack sudo[97385]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:43:10 devstack sudo[97385]: pam_unix(sudo:session): session closed for user root Jul 10 04:43:10 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-f597cc05-462c-411d-9d96-839107ed9ae9 tempest-VolumesCloneTest-2092220422 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-dfaf42c5-b6d1-4e8e-87a0-2aa1cca8223d" returned: 0 in 0.934s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:43:10 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-f597cc05-462c-411d-9d96-839107ed9ae9 tempest-VolumesCloneTest-2092220422 None] Lock "cinder-quobyte-dfaf42c5-b6d1-4e8e-87a0-2aa1cca8223d" released by "_copy_volume_from_snapshot" :: held 10.073s {{(pid=87444) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 04:43:10 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-f597cc05-462c-411d-9d96-839107ed9ae9 tempest-VolumesCloneTest-2092220422 None] Acquiring lock "cinder-quobyte-f4341e53-4540-4e07-b82d-cf27085e23d0" by "_delete_snapshot" {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 04:43:10 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-f597cc05-462c-411d-9d96-839107ed9ae9 tempest-VolumesCloneTest-2092220422 None] Lock "cinder-quobyte-f4341e53-4540-4e07-b82d-cf27085e23d0" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 04:43:10 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.remotefs [None req-f597cc05-462c-411d-9d96-839107ed9ae9 tempest-VolumesCloneTest-2092220422 None] Deleting offline snapshot f4341e53-4540-4e07-b82d-cf27085e23d0 of volume 88dd004a-c872-437b-9d69-c3610c47fb72 {{(pid=87444) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 10 04:43:10 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.remotefs [None req-f597cc05-462c-411d-9d96-839107ed9ae9 tempest-VolumesCloneTest-2092220422 None] snapshot_file for this snap is: volume-88dd004a-c872-437b-9d69-c3610c47fb72.f4341e53-4540-4e07-b82d-cf27085e23d0 {{(pid=87444) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 10 04:43:10 devstack cinder-volume[87444]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1d4604d-6ad3-487b-b905-0e761e64ce68]: (4, 'qcow2') {{(pid=88499) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 04:43:10 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-f597cc05-462c-411d-9d96-839107ed9ae9 tempest-VolumesCloneTest-2092220422 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-88dd004a-c872-437b-9d69-c3610c47fb72.f4341e53-4540-4e07-b82d-cf27085e23d0 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:43:10 devstack sudo[97401]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-88dd004a-c872-437b-9d69-c3610c47fb72.f4341e53-4540-4e07-b82d-cf27085e23d0 Jul 10 04:43:10 devstack sudo[97401]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:43:11 devstack sudo[97401]: pam_unix(sudo:session): session closed for user root Jul 10 04:43:11 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-f597cc05-462c-411d-9d96-839107ed9ae9 tempest-VolumesCloneTest-2092220422 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-88dd004a-c872-437b-9d69-c3610c47fb72.f4341e53-4540-4e07-b82d-cf27085e23d0" returned: 0 in 0.831s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:43:11 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.remotefs [None req-f597cc05-462c-411d-9d96-839107ed9ae9 tempest-VolumesCloneTest-2092220422 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-88dd004a-c872-437b-9d69-c3610c47fb72(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87444) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 10 04:43:11 devstack cinder-volume[87444]: DEBUG oslo.privsep.daemon [-] privsep: reply[ecaf8530-f14a-4b91-a0ec-88088617de48]: (4, 'qcow2') {{(pid=88499) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 04:43:11 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-f597cc05-462c-411d-9d96-839107ed9ae9 tempest-VolumesCloneTest-2092220422 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-88dd004a-c872-437b-9d69-c3610c47fb72 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:43:11 devstack sudo[97406]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-88dd004a-c872-437b-9d69-c3610c47fb72 Jul 10 04:43:11 devstack sudo[97406]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:43:12 devstack sudo[97406]: pam_unix(sudo:session): session closed for user root Jul 10 04:43:12 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-f597cc05-462c-411d-9d96-839107ed9ae9 tempest-VolumesCloneTest-2092220422 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-88dd004a-c872-437b-9d69-c3610c47fb72" returned: 0 in 0.869s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:43:12 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-f597cc05-462c-411d-9d96-839107ed9ae9 tempest-VolumesCloneTest-2092220422 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-88dd004a-c872-437b-9d69-c3610c47fb72.f4341e53-4540-4e07-b82d-cf27085e23d0 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:43:12 devstack sudo[97411]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-88dd004a-c872-437b-9d69-c3610c47fb72.f4341e53-4540-4e07-b82d-cf27085e23d0 Jul 10 04:43:12 devstack sudo[97411]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:43:12 devstack sudo[97411]: pam_unix(sudo:session): session closed for user root Jul 10 04:43:12 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-f597cc05-462c-411d-9d96-839107ed9ae9 tempest-VolumesCloneTest-2092220422 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-88dd004a-c872-437b-9d69-c3610c47fb72.f4341e53-4540-4e07-b82d-cf27085e23d0" returned: 0 in 0.776s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:43:12 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-f597cc05-462c-411d-9d96-839107ed9ae9 tempest-VolumesCloneTest-2092220422 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-88dd004a-c872-437b-9d69-c3610c47fb72.f4341e53-4540-4e07-b82d-cf27085e23d0 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:43:13 devstack sudo[97417]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-88dd004a-c872-437b-9d69-c3610c47fb72.f4341e53-4540-4e07-b82d-cf27085e23d0 Jul 10 04:43:13 devstack sudo[97417]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:43:13 devstack sudo[97417]: pam_unix(sudo:session): session closed for user root Jul 10 04:43:13 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-f597cc05-462c-411d-9d96-839107ed9ae9 tempest-VolumesCloneTest-2092220422 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-88dd004a-c872-437b-9d69-c3610c47fb72.f4341e53-4540-4e07-b82d-cf27085e23d0" returned: 0 in 0.944s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:43:13 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-f597cc05-462c-411d-9d96-839107ed9ae9 tempest-VolumesCloneTest-2092220422 None] Lock "cinder-quobyte-f4341e53-4540-4e07-b82d-cf27085e23d0" released by "_delete_snapshot" :: held 3.543s {{(pid=87444) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 04:43:14 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-f597cc05-462c-411d-9d96-839107ed9ae9 tempest-VolumesCloneTest-2092220422 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 18.854s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 04:43:14 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-dd67d63d-478b-4937-a2cc-7e64ba0404df tempest-VolumesDeleteCascade-473852886 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 17.270s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 04:43:14 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-dd67d63d-478b-4937-a2cc-7e64ba0404df tempest-VolumesDeleteCascade-473852886 None] Acquiring lock "cinder-quobyte-057f2db0-148c-457a-a88d-82d03451ea83-b7bdc84e-7ca9-4f07-9b44-7ff588f698e1" by "_create_volume_from_snapshot" {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 04:43:14 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-f597cc05-462c-411d-9d96-839107ed9ae9 tempest-VolumesCloneTest-2092220422 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cd5db414-8113-4d9c-92f0-abbf094280de) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-dfaf42c5-b6d1-4e8e-87a0-2aa1cca8223d', 'volume_size': 2, 'source_volid': '88dd004a-c872-437b-9d69-c3610c47fb72', 'source_volstatus': 'available'}' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:43:14 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-f597cc05-462c-411d-9d96-839107ed9ae9 tempest-VolumesCloneTest-2092220422 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (64472e09-bd84-4edc-bea6-5c7cef4a10cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:43:14 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-dd67d63d-478b-4937-a2cc-7e64ba0404df tempest-VolumesDeleteCascade-473852886 None] Lock "cinder-quobyte-057f2db0-148c-457a-a88d-82d03451ea83-b7bdc84e-7ca9-4f07-9b44-7ff588f698e1" acquired by "_create_volume_from_snapshot" :: waited 0.049s {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 04:43:14 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-dd67d63d-478b-4937-a2cc-7e64ba0404df tempest-VolumesDeleteCascade-473852886 None] Creating volume b7bdc84e-7ca9-4f07-9b44-7ff588f698e1 from snapshot 057f2db0-148c-457a-a88d-82d03451ea83 {{(pid=87444) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Jul 10 04:43:14 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-dd67d63d-478b-4937-a2cc-7e64ba0404df tempest-VolumesDeleteCascade-473852886 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 04:43:14 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-dd67d63d-478b-4937-a2cc-7e64ba0404df tempest-VolumesDeleteCascade-473852886 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 04:43:14 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-dd67d63d-478b-4937-a2cc-7e64ba0404df tempest-VolumesDeleteCascade-473852886 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922': None} {{(pid=87444) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 04:43:14 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-dd67d63d-478b-4937-a2cc-7e64ba0404df tempest-VolumesDeleteCascade-473852886 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922'] {{(pid=87444) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 04:43:14 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-dd67d63d-478b-4937-a2cc-7e64ba0404df tempest-VolumesDeleteCascade-473852886 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 04:43:14 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-dd67d63d-478b-4937-a2cc-7e64ba0404df tempest-VolumesDeleteCascade-473852886 None] Selected osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922 as target Quobyte volume. {{(pid=87444) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 04:43:14 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-dd67d63d-478b-4937-a2cc-7e64ba0404df tempest-VolumesDeleteCascade-473852886 None] Acquiring lock "cinder-quobyte-b7bdc84e-7ca9-4f07-9b44-7ff588f698e1" by "_copy_volume_from_snapshot" {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 04:43:14 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-dd67d63d-478b-4937-a2cc-7e64ba0404df tempest-VolumesDeleteCascade-473852886 None] Lock "cinder-quobyte-b7bdc84e-7ca9-4f07-9b44-7ff588f698e1" acquired by "_copy_volume_from_snapshot" :: waited 0.024s {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 04:43:14 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-dd67d63d-478b-4937-a2cc-7e64ba0404df tempest-VolumesDeleteCascade-473852886 None] snapshot: 057f2db0-148c-457a-a88d-82d03451ea83, volume: b7bdc84e-7ca9-4f07-9b44-7ff588f698e1, {{(pid=87444) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jul 10 04:43:14 devstack cinder-volume[87444]: INFO cinder.volume.flows.manager.create_volume [None req-f597cc05-462c-411d-9d96-839107ed9ae9 tempest-VolumesCloneTest-2092220422 None] Volume volume-dfaf42c5-b6d1-4e8e-87a0-2aa1cca8223d (dfaf42c5-b6d1-4e8e-87a0-2aa1cca8223d): created successfully Jul 10 04:43:14 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-f597cc05-462c-411d-9d96-839107ed9ae9 tempest-VolumesCloneTest-2092220422 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (64472e09-bd84-4edc-bea6-5c7cef4a10cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:43:14 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-f597cc05-462c-411d-9d96-839107ed9ae9 tempest-VolumesCloneTest-2092220422 None] Flow 'volume_create_manager' (b5c0d6ce-acfe-4728-bd83-889b7867236e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87444) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 04:43:14 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-dd67d63d-478b-4937-a2cc-7e64ba0404df tempest-VolumesDeleteCascade-473852886 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 04:43:14 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-dd67d63d-478b-4937-a2cc-7e64ba0404df tempest-VolumesDeleteCascade-473852886 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 04:43:14 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-dd67d63d-478b-4937-a2cc-7e64ba0404df tempest-VolumesDeleteCascade-473852886 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922': None} {{(pid=87444) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 04:43:14 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-dd67d63d-478b-4937-a2cc-7e64ba0404df tempest-VolumesDeleteCascade-473852886 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922'] {{(pid=87444) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 04:43:14 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-dd67d63d-478b-4937-a2cc-7e64ba0404df tempest-VolumesDeleteCascade-473852886 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 04:43:14 devstack cinder-volume[87444]: INFO cinder.volume.manager [None req-f597cc05-462c-411d-9d96-839107ed9ae9 tempest-VolumesCloneTest-2092220422 None] Created volume successfully. Jul 10 04:43:14 devstack cinder-volume[87444]: DEBUG oslo.privsep.daemon [-] privsep: reply[1adff9d0-a92f-49d2-81dc-af135b3e9ea2]: (4, 'qcow2') {{(pid=88499) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 04:43:14 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-dd67d63d-478b-4937-a2cc-7e64ba0404df tempest-VolumesDeleteCascade-473852886 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-11e8ac43-d499-4bf6-a257-89a3bf968264.057f2db0-148c-457a-a88d-82d03451ea83 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:43:14 devstack sudo[97463]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-11e8ac43-d499-4bf6-a257-89a3bf968264.057f2db0-148c-457a-a88d-82d03451ea83 Jul 10 04:43:14 devstack sudo[97463]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:43:14 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-37064067-308d-4936-afbb-a7b89478e4ab tempest-VolumesCloneTest-2092220422 None] Acquiring lock "cinder-dfaf42c5-b6d1-4e8e-87a0-2aa1cca8223d-delete_volume" by "delete_volume" {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 04:43:14 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-37064067-308d-4936-afbb-a7b89478e4ab tempest-VolumesCloneTest-2092220422 None] Lock "cinder-dfaf42c5-b6d1-4e8e-87a0-2aa1cca8223d-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 04:43:14 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-37064067-308d-4936-afbb-a7b89478e4ab tempest-VolumesCloneTest-2092220422 None] Acquiring lock "cinder-quobyte-dfaf42c5-b6d1-4e8e-87a0-2aa1cca8223d" by "delete_volume" {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 04:43:14 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-37064067-308d-4936-afbb-a7b89478e4ab tempest-VolumesCloneTest-2092220422 None] Lock "cinder-quobyte-dfaf42c5-b6d1-4e8e-87a0-2aa1cca8223d" acquired by "delete_volume" :: waited 0.027s {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 04:43:14 devstack cinder-volume[87444]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf40d125-1517-42e7-904d-c52cd6537532]: (4, 'qcow2') {{(pid=88499) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 04:43:14 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-37064067-308d-4936-afbb-a7b89478e4ab tempest-VolumesCloneTest-2092220422 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-dfaf42c5-b6d1-4e8e-87a0-2aa1cca8223d {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:43:15 devstack sudo[97468]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-dfaf42c5-b6d1-4e8e-87a0-2aa1cca8223d Jul 10 04:43:15 devstack sudo[97468]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:43:15 devstack sudo[97463]: pam_unix(sudo:session): session closed for user root Jul 10 04:43:15 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-dd67d63d-478b-4937-a2cc-7e64ba0404df tempest-VolumesDeleteCascade-473852886 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-11e8ac43-d499-4bf6-a257-89a3bf968264.057f2db0-148c-457a-a88d-82d03451ea83" returned: 0 in 1.396s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:43:15 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.remotefs [None req-dd67d63d-478b-4937-a2cc-7e64ba0404df tempest-VolumesDeleteCascade-473852886 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-11e8ac43-d499-4bf6-a257-89a3bf968264(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87444) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 10 04:43:15 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-dd67d63d-478b-4937-a2cc-7e64ba0404df tempest-VolumesDeleteCascade-473852886 None] will copy from snapshot at /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-11e8ac43-d499-4bf6-a257-89a3bf968264 {{(pid=87444) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jul 10 04:43:15 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-dd67d63d-478b-4937-a2cc-7e64ba0404df tempest-VolumesDeleteCascade-473852886 None] Creating direct copy from snapshot {{(pid=87444) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jul 10 04:43:15 devstack cinder-volume[87444]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b77ea24-1fb5-4ff0-a22c-ab42ad0cb496]: (4, 'qcow2') {{(pid=88499) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 04:43:15 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-dd67d63d-478b-4937-a2cc-7e64ba0404df tempest-VolumesDeleteCascade-473852886 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-11e8ac43-d499-4bf6-a257-89a3bf968264 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:43:15 devstack sudo[97495]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-11e8ac43-d499-4bf6-a257-89a3bf968264 Jul 10 04:43:15 devstack sudo[97495]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:43:16 devstack sudo[97468]: pam_unix(sudo:session): session closed for user root Jul 10 04:43:16 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-37064067-308d-4936-afbb-a7b89478e4ab tempest-VolumesCloneTest-2092220422 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-dfaf42c5-b6d1-4e8e-87a0-2aa1cca8223d" returned: 0 in 1.518s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:43:16 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-37064067-308d-4936-afbb-a7b89478e4ab tempest-VolumesCloneTest-2092220422 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-dfaf42c5-b6d1-4e8e-87a0-2aa1cca8223d {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:43:16 devstack sudo[97501]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-dfaf42c5-b6d1-4e8e-87a0-2aa1cca8223d Jul 10 04:43:16 devstack sudo[97501]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:43:17 devstack sudo[97495]: pam_unix(sudo:session): session closed for user root Jul 10 04:43:17 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-dd67d63d-478b-4937-a2cc-7e64ba0404df tempest-VolumesDeleteCascade-473852886 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-11e8ac43-d499-4bf6-a257-89a3bf968264" returned: 0 in 1.665s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:43:17 devstack cinder-volume[87444]: DEBUG cinder.utils [None req-dd67d63d-478b-4937-a2cc-7e64ba0404df tempest-VolumesDeleteCascade-473852886 None] Path /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-b7bdc84e-7ca9-4f07-9b44-7ff588f698e1 not found in is_blk_device check {{(pid=87444) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 10 04:43:17 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-dd67d63d-478b-4937-a2cc-7e64ba0404df tempest-VolumesDeleteCascade-473852886 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-11e8ac43-d499-4bf6-a257-89a3bf968264 /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-b7bdc84e-7ca9-4f07-9b44-7ff588f698e1 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:43:17 devstack sudo[97501]: pam_unix(sudo:session): session closed for user root Jul 10 04:43:17 devstack sudo[97508]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-11e8ac43-d499-4bf6-a257-89a3bf968264 /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-b7bdc84e-7ca9-4f07-9b44-7ff588f698e1 Jul 10 04:43:17 devstack sudo[97508]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:43:17 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-37064067-308d-4936-afbb-a7b89478e4ab tempest-VolumesCloneTest-2092220422 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-dfaf42c5-b6d1-4e8e-87a0-2aa1cca8223d" returned: 0 in 1.010s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:43:17 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-37064067-308d-4936-afbb-a7b89478e4ab tempest-VolumesCloneTest-2092220422 None] Lock "cinder-quobyte-dfaf42c5-b6d1-4e8e-87a0-2aa1cca8223d" released by "delete_volume" :: held 2.612s {{(pid=87444) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 04:43:17 devstack cinder-volume[87444]: DEBUG cinder.quota [None req-37064067-308d-4936-afbb-a7b89478e4ab tempest-VolumesCloneTest-2092220422 None] Created reservations ['4ba38cbd-6bbc-45cd-87b7-e26d07549880', '8e20530e-4bb7-4a56-aa05-903735161e9f', '3b90bf54-73b2-4ecc-a290-36a66bb1ba17', 'ac1c267b-cdd2-40da-907b-491eed01910b'] {{(pid=87444) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 04:43:17 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-37064067-308d-4936-afbb-a7b89478e4ab tempest-VolumesCloneTest-2092220422 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 04:43:17 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-37064067-308d-4936-afbb-a7b89478e4ab tempest-VolumesCloneTest-2092220422 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 04:43:17 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-37064067-308d-4936-afbb-a7b89478e4ab tempest-VolumesCloneTest-2092220422 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922': None} {{(pid=87444) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 04:43:17 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-37064067-308d-4936-afbb-a7b89478e4ab tempest-VolumesCloneTest-2092220422 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922'] {{(pid=87444) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 04:43:17 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-37064067-308d-4936-afbb-a7b89478e4ab tempest-VolumesCloneTest-2092220422 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.026s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 04:43:17 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-37064067-308d-4936-afbb-a7b89478e4ab tempest-VolumesCloneTest-2092220422 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:43:17 devstack sudo[97510]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097 Jul 10 04:43:17 devstack sudo[97510]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:43:18 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-04372783-711b-4ea2-a894-d0085ec61cc0 tempest-VolumesCloneTest-2092220422 None] Acquiring lock "cinder-88dd004a-c872-437b-9d69-c3610c47fb72-delete_volume" by "delete_volume" {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 04:43:18 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-04372783-711b-4ea2-a894-d0085ec61cc0 tempest-VolumesCloneTest-2092220422 None] Lock "cinder-88dd004a-c872-437b-9d69-c3610c47fb72-delete_volume" acquired by "delete_volume" :: waited 0.049s {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 04:43:18 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-04372783-711b-4ea2-a894-d0085ec61cc0 tempest-VolumesCloneTest-2092220422 None] Acquiring lock "cinder-quobyte-88dd004a-c872-437b-9d69-c3610c47fb72" by "delete_volume" {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 04:43:18 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-04372783-711b-4ea2-a894-d0085ec61cc0 tempest-VolumesCloneTest-2092220422 None] Lock "cinder-quobyte-88dd004a-c872-437b-9d69-c3610c47fb72" acquired by "delete_volume" :: waited 0.025s {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 04:43:18 devstack cinder-volume[87444]: DEBUG oslo.privsep.daemon [-] privsep: reply[aed8092f-5078-4dc5-a0dd-db9bf31fb1d6]: (4, 'qcow2') {{(pid=88499) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 04:43:18 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-04372783-711b-4ea2-a894-d0085ec61cc0 tempest-VolumesCloneTest-2092220422 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-88dd004a-c872-437b-9d69-c3610c47fb72 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:43:19 devstack sudo[97512]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-88dd004a-c872-437b-9d69-c3610c47fb72 Jul 10 04:43:19 devstack sudo[97512]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:43:19 devstack sudo[97510]: pam_unix(sudo:session): session closed for user root Jul 10 04:43:19 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-37064067-308d-4936-afbb-a7b89478e4ab tempest-VolumesCloneTest-2092220422 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097" returned: 0 in 1.400s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:43:19 devstack cinder-volume[87444]: DEBUG cinder.manager [None req-37064067-308d-4936-afbb-a7b89478e4ab tempest-VolumesCloneTest-2092220422 None] Notifying Schedulers of capabilities ... {{(pid=87444) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 04:43:19 devstack cinder-volume[87444]: INFO cinder.volume.manager [None req-37064067-308d-4936-afbb-a7b89478e4ab tempest-VolumesCloneTest-2092220422 None] Deleted volume successfully. Jul 10 04:43:19 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-37064067-308d-4936-afbb-a7b89478e4ab tempest-VolumesCloneTest-2092220422 None] Lock "cinder-dfaf42c5-b6d1-4e8e-87a0-2aa1cca8223d-delete_volume" released by "delete_volume" :: held 4.560s {{(pid=87444) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 04:43:20 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-3cbf1b10-6c6e-4578-9041-d5b0dc9eb205 tempest-VolumesActionsTest-532776818 None] Acquiring lock "cinder-14eaa034-13c6-4839-956c-d2befd0d4d8d" by "attach_volume" {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 04:43:20 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-3cbf1b10-6c6e-4578-9041-d5b0dc9eb205 tempest-VolumesActionsTest-532776818 None] Lock "cinder-14eaa034-13c6-4839-956c-d2befd0d4d8d" acquired by "attach_volume" :: waited 0.062s {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 04:43:20 devstack cinder-volume[87444]: INFO cinder.volume.manager [None req-3cbf1b10-6c6e-4578-9041-d5b0dc9eb205 tempest-VolumesActionsTest-532776818 None] Attaching volume 14eaa034-13c6-4839-956c-d2befd0d4d8d to instance 36f16312-97b0-467f-93e1-ff231e38ad6c at mountpoint /dev/vdb on host None. Jul 10 04:43:20 devstack cinder-volume[87444]: INFO cinder.volume.manager [None req-3cbf1b10-6c6e-4578-9041-d5b0dc9eb205 tempest-VolumesActionsTest-532776818 None] Attach volume completed successfully. Jul 10 04:43:21 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-3cbf1b10-6c6e-4578-9041-d5b0dc9eb205 tempest-VolumesActionsTest-532776818 None] Lock "cinder-14eaa034-13c6-4839-956c-d2befd0d4d8d" released by "attach_volume" :: held 0.568s {{(pid=87444) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 04:43:21 devstack sudo[97512]: pam_unix(sudo:session): session closed for user root Jul 10 04:43:21 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-04372783-711b-4ea2-a894-d0085ec61cc0 tempest-VolumesCloneTest-2092220422 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-88dd004a-c872-437b-9d69-c3610c47fb72" returned: 0 in 3.230s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:43:21 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-04372783-711b-4ea2-a894-d0085ec61cc0 tempest-VolumesCloneTest-2092220422 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-88dd004a-c872-437b-9d69-c3610c47fb72 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:43:22 devstack sudo[97528]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-88dd004a-c872-437b-9d69-c3610c47fb72 Jul 10 04:43:22 devstack sudo[97528]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:43:22 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-c70b0202-2993-4fb2-b5dc-ada6fa84bb05 tempest-VolumesActionsTest-532776818 None] Acquiring lock "cinder-14eaa034-13c6-4839-956c-d2befd0d4d8d-detach_volume" by "detach_volume" {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 04:43:22 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-c70b0202-2993-4fb2-b5dc-ada6fa84bb05 tempest-VolumesActionsTest-532776818 None] Lock "cinder-14eaa034-13c6-4839-956c-d2befd0d4d8d-detach_volume" acquired by "detach_volume" :: waited 0.088s {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 04:43:22 devstack cinder-volume[87444]: INFO cinder.volume.manager [None req-c70b0202-2993-4fb2-b5dc-ada6fa84bb05 tempest-VolumesActionsTest-532776818 None] Detaching volume 14eaa034-13c6-4839-956c-d2befd0d4d8d from instance 36f16312-97b0-467f-93e1-ff231e38ad6c. Jul 10 04:43:22 devstack cinder-volume[87444]: INFO cinder.volume.manager [None req-c70b0202-2993-4fb2-b5dc-ada6fa84bb05 tempest-VolumesActionsTest-532776818 None] Detach volume completed successfully. Jul 10 04:43:22 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-c70b0202-2993-4fb2-b5dc-ada6fa84bb05 tempest-VolumesActionsTest-532776818 None] Lock "cinder-14eaa034-13c6-4839-956c-d2befd0d4d8d-detach_volume" released by "detach_volume" :: held 0.317s {{(pid=87444) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 04:43:23 devstack sudo[97528]: pam_unix(sudo:session): session closed for user root Jul 10 04:43:23 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-04372783-711b-4ea2-a894-d0085ec61cc0 tempest-VolumesCloneTest-2092220422 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-88dd004a-c872-437b-9d69-c3610c47fb72" returned: 0 in 1.860s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:43:23 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-04372783-711b-4ea2-a894-d0085ec61cc0 tempest-VolumesCloneTest-2092220422 None] Lock "cinder-quobyte-88dd004a-c872-437b-9d69-c3610c47fb72" released by "delete_volume" :: held 5.267s {{(pid=87444) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 04:43:24 devstack cinder-volume[87444]: DEBUG cinder.quota [None req-04372783-711b-4ea2-a894-d0085ec61cc0 tempest-VolumesCloneTest-2092220422 None] Created reservations ['4ca6fcce-52c7-4c6d-a9a4-78e1fc306250', '1cd271ff-806c-4173-9a2d-aec252f3b09a', 'b25fe98f-ef4b-4388-9a01-ee86bdf0283f', 'f8b6d2b0-1177-4131-b112-cefe81d88293'] {{(pid=87444) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 04:43:24 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-04372783-711b-4ea2-a894-d0085ec61cc0 tempest-VolumesCloneTest-2092220422 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 04:43:24 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-04372783-711b-4ea2-a894-d0085ec61cc0 tempest-VolumesCloneTest-2092220422 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.015s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 04:43:24 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-04372783-711b-4ea2-a894-d0085ec61cc0 tempest-VolumesCloneTest-2092220422 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922': None} {{(pid=87444) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 04:43:24 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-04372783-711b-4ea2-a894-d0085ec61cc0 tempest-VolumesCloneTest-2092220422 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922'] {{(pid=87444) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 04:43:24 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-04372783-711b-4ea2-a894-d0085ec61cc0 tempest-VolumesCloneTest-2092220422 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 04:43:24 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-04372783-711b-4ea2-a894-d0085ec61cc0 tempest-VolumesCloneTest-2092220422 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:43:24 devstack sudo[97533]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097 Jul 10 04:43:24 devstack sudo[97533]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:43:26 devstack sudo[97533]: pam_unix(sudo:session): session closed for user root Jul 10 04:43:26 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-04372783-711b-4ea2-a894-d0085ec61cc0 tempest-VolumesCloneTest-2092220422 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097" returned: 0 in 2.310s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:43:26 devstack cinder-volume[87444]: DEBUG cinder.manager [None req-04372783-711b-4ea2-a894-d0085ec61cc0 tempest-VolumesCloneTest-2092220422 None] Notifying Schedulers of capabilities ... {{(pid=87444) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 04:43:26 devstack cinder-volume[87444]: INFO cinder.volume.manager [None req-04372783-711b-4ea2-a894-d0085ec61cc0 tempest-VolumesCloneTest-2092220422 None] Deleted volume successfully. Jul 10 04:43:26 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-04372783-711b-4ea2-a894-d0085ec61cc0 tempest-VolumesCloneTest-2092220422 None] Lock "cinder-88dd004a-c872-437b-9d69-c3610c47fb72-delete_volume" released by "delete_volume" :: held 8.279s {{(pid=87444) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 04:43:27 devstack sudo[97508]: pam_unix(sudo:session): session closed for user root Jul 10 04:43:27 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-dd67d63d-478b-4937-a2cc-7e64ba0404df tempest-VolumesDeleteCascade-473852886 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-11e8ac43-d499-4bf6-a257-89a3bf968264 /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-b7bdc84e-7ca9-4f07-9b44-7ff588f698e1" returned: 0 in 9.717s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:43:27 devstack cinder-volume[87444]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a7a2ccf-0276-4abc-8a66-e1e31696bd6c]: (4, 'qcow2') {{(pid=88499) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 04:43:27 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-dd67d63d-478b-4937-a2cc-7e64ba0404df tempest-VolumesDeleteCascade-473852886 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-11e8ac43-d499-4bf6-a257-89a3bf968264 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:43:27 devstack sudo[97557]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-11e8ac43-d499-4bf6-a257-89a3bf968264 Jul 10 04:43:27 devstack sudo[97557]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:43:28 devstack sudo[97557]: pam_unix(sudo:session): session closed for user root Jul 10 04:43:28 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-dd67d63d-478b-4937-a2cc-7e64ba0404df tempest-VolumesDeleteCascade-473852886 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-11e8ac43-d499-4bf6-a257-89a3bf968264" returned: 0 in 1.134s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:43:28 devstack cinder-volume[87444]: DEBUG cinder.image.image_utils [None req-dd67d63d-478b-4937-a2cc-7e64ba0404df tempest-VolumesDeleteCascade-473852886 None] Image conversion details: src /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-11e8ac43-d499-4bf6-a257-89a3bf968264, size 1024.00 MB, duration 9.72 sec, destination /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-b7bdc84e-7ca9-4f07-9b44-7ff588f698e1 {{(pid=87444) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:561}} Jul 10 04:43:28 devstack cinder-volume[87444]: INFO cinder.image.image_utils [None req-dd67d63d-478b-4937-a2cc-7e64ba0404df tempest-VolumesDeleteCascade-473852886 None] Converted 1024.00 MB image at 105.36 MB/s Jul 10 04:43:28 devstack cinder-volume[87444]: WARNING cinder.volume.drivers.remotefs [None req-dd67d63d-478b-4937-a2cc-7e64ba0404df tempest-VolumesDeleteCascade-473852886 None] /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-b7bdc84e-7ca9-4f07-9b44-7ff588f698e1 is being set with open permissions: ugo+rw Jul 10 04:43:28 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-dd67d63d-478b-4937-a2cc-7e64ba0404df tempest-VolumesDeleteCascade-473852886 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-b7bdc84e-7ca9-4f07-9b44-7ff588f698e1 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:43:28 devstack sudo[97564]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-b7bdc84e-7ca9-4f07-9b44-7ff588f698e1 Jul 10 04:43:28 devstack sudo[97564]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:43:28 devstack sudo[97564]: pam_unix(sudo:session): session closed for user root Jul 10 04:43:28 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-dd67d63d-478b-4937-a2cc-7e64ba0404df tempest-VolumesDeleteCascade-473852886 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-b7bdc84e-7ca9-4f07-9b44-7ff588f698e1" returned: 0 in 0.759s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:43:29 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-dd67d63d-478b-4937-a2cc-7e64ba0404df tempest-VolumesDeleteCascade-473852886 None] Lock "cinder-quobyte-b7bdc84e-7ca9-4f07-9b44-7ff588f698e1" released by "_copy_volume_from_snapshot" :: held 14.876s {{(pid=87444) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 04:43:29 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-dd67d63d-478b-4937-a2cc-7e64ba0404df tempest-VolumesDeleteCascade-473852886 None] Lock "cinder-quobyte-057f2db0-148c-457a-a88d-82d03451ea83-b7bdc84e-7ca9-4f07-9b44-7ff588f698e1" released by "_create_volume_from_snapshot" :: held 14.924s {{(pid=87444) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 04:43:29 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-dd67d63d-478b-4937-a2cc-7e64ba0404df tempest-VolumesDeleteCascade-473852886 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 14.975s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 04:43:29 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-dd67d63d-478b-4937-a2cc-7e64ba0404df tempest-VolumesDeleteCascade-473852886 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (91584e4e-c9b7-4cad-b726-7965d3d97dd7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b7bdc84e-7ca9-4f07-9b44-7ff588f698e1', 'volume_size': 1, 'snapshot_id': '057f2db0-148c-457a-a88d-82d03451ea83'}' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:43:29 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-dd67d63d-478b-4937-a2cc-7e64ba0404df tempest-VolumesDeleteCascade-473852886 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (af76d1f3-c1c8-436e-bbcb-4a79fba1e07c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:43:29 devstack cinder-volume[87444]: INFO cinder.volume.flows.manager.create_volume [None req-dd67d63d-478b-4937-a2cc-7e64ba0404df tempest-VolumesDeleteCascade-473852886 None] Volume volume-b7bdc84e-7ca9-4f07-9b44-7ff588f698e1 (b7bdc84e-7ca9-4f07-9b44-7ff588f698e1): created successfully Jul 10 04:43:29 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-dd67d63d-478b-4937-a2cc-7e64ba0404df tempest-VolumesDeleteCascade-473852886 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (af76d1f3-c1c8-436e-bbcb-4a79fba1e07c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:43:29 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-dd67d63d-478b-4937-a2cc-7e64ba0404df tempest-VolumesDeleteCascade-473852886 None] Flow 'volume_create_manager' (310413c9-85f8-4fec-a2ae-b5258c6cf1fa) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87444) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 04:43:29 devstack cinder-volume[87444]: INFO cinder.volume.manager [None req-dd67d63d-478b-4937-a2cc-7e64ba0404df tempest-VolumesDeleteCascade-473852886 None] Created volume successfully. Jul 10 04:43:30 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-0ba8e735-7302-4c36-a5ae-c2e7059b2c17 tempest-VolumesDeleteCascade-473852886 None] Acquiring lock "cinder-11e8ac43-d499-4bf6-a257-89a3bf968264-delete_volume" by "delete_volume" {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 04:43:30 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-0ba8e735-7302-4c36-a5ae-c2e7059b2c17 tempest-VolumesDeleteCascade-473852886 None] Lock "cinder-11e8ac43-d499-4bf6-a257-89a3bf968264-delete_volume" acquired by "delete_volume" :: waited 0.052s {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 04:43:30 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-0ba8e735-7302-4c36-a5ae-c2e7059b2c17 tempest-VolumesDeleteCascade-473852886 None] Performing cascade delete. {{(pid=87444) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}} Jul 10 04:43:30 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-0ba8e735-7302-4c36-a5ae-c2e7059b2c17 tempest-VolumesDeleteCascade-473852886 None] Acquiring lock "cinder-057f2db0-148c-457a-a88d-82d03451ea83-delete_snapshot" by "delete_snapshot" {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 04:43:30 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-0ba8e735-7302-4c36-a5ae-c2e7059b2c17 tempest-VolumesDeleteCascade-473852886 None] Lock "cinder-057f2db0-148c-457a-a88d-82d03451ea83-delete_snapshot" acquired by "delete_snapshot" :: waited 0.025s {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 04:43:30 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-0ba8e735-7302-4c36-a5ae-c2e7059b2c17 tempest-VolumesDeleteCascade-473852886 None] Acquiring lock "cinder-quobyte-11e8ac43-d499-4bf6-a257-89a3bf968264" by "delete_snapshot" {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 04:43:30 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-0ba8e735-7302-4c36-a5ae-c2e7059b2c17 tempest-VolumesDeleteCascade-473852886 None] Lock "cinder-quobyte-11e8ac43-d499-4bf6-a257-89a3bf968264" acquired by "delete_snapshot" :: waited 0.021s {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 04:43:30 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-0ba8e735-7302-4c36-a5ae-c2e7059b2c17 tempest-VolumesDeleteCascade-473852886 None] Acquiring lock "cinder-quobyte-057f2db0-148c-457a-a88d-82d03451ea83" by "_delete_snapshot" {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 04:43:30 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-0ba8e735-7302-4c36-a5ae-c2e7059b2c17 tempest-VolumesDeleteCascade-473852886 None] Lock "cinder-quobyte-057f2db0-148c-457a-a88d-82d03451ea83" acquired by "_delete_snapshot" :: waited 0.036s {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 04:43:30 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.remotefs [None req-0ba8e735-7302-4c36-a5ae-c2e7059b2c17 tempest-VolumesDeleteCascade-473852886 None] Deleting offline snapshot 057f2db0-148c-457a-a88d-82d03451ea83 of volume 11e8ac43-d499-4bf6-a257-89a3bf968264 {{(pid=87444) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 10 04:43:30 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.remotefs [None req-0ba8e735-7302-4c36-a5ae-c2e7059b2c17 tempest-VolumesDeleteCascade-473852886 None] snapshot_file for this snap is: volume-11e8ac43-d499-4bf6-a257-89a3bf968264.057f2db0-148c-457a-a88d-82d03451ea83 {{(pid=87444) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 10 04:43:30 devstack cinder-volume[87444]: DEBUG oslo.privsep.daemon [-] privsep: reply[1db19677-1952-4698-ae5e-917be151335d]: (4, 'qcow2') {{(pid=88499) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 04:43:30 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-0ba8e735-7302-4c36-a5ae-c2e7059b2c17 tempest-VolumesDeleteCascade-473852886 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-11e8ac43-d499-4bf6-a257-89a3bf968264.057f2db0-148c-457a-a88d-82d03451ea83 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:43:30 devstack sudo[97569]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-11e8ac43-d499-4bf6-a257-89a3bf968264.057f2db0-148c-457a-a88d-82d03451ea83 Jul 10 04:43:30 devstack sudo[97569]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:43:31 devstack sudo[97569]: pam_unix(sudo:session): session closed for user root Jul 10 04:43:31 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-0ba8e735-7302-4c36-a5ae-c2e7059b2c17 tempest-VolumesDeleteCascade-473852886 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-11e8ac43-d499-4bf6-a257-89a3bf968264.057f2db0-148c-457a-a88d-82d03451ea83" returned: 0 in 0.920s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:43:31 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.remotefs [None req-0ba8e735-7302-4c36-a5ae-c2e7059b2c17 tempest-VolumesDeleteCascade-473852886 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-11e8ac43-d499-4bf6-a257-89a3bf968264(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87444) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 10 04:43:31 devstack cinder-volume[87444]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c069b38-2a0b-4f2d-b0d2-3c60da48f902]: (4, 'qcow2') {{(pid=88499) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 04:43:31 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-0ba8e735-7302-4c36-a5ae-c2e7059b2c17 tempest-VolumesDeleteCascade-473852886 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-11e8ac43-d499-4bf6-a257-89a3bf968264 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:43:31 devstack sudo[97582]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-11e8ac43-d499-4bf6-a257-89a3bf968264 Jul 10 04:43:31 devstack sudo[97582]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:43:32 devstack sudo[97582]: pam_unix(sudo:session): session closed for user root Jul 10 04:43:32 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-0ba8e735-7302-4c36-a5ae-c2e7059b2c17 tempest-VolumesDeleteCascade-473852886 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-11e8ac43-d499-4bf6-a257-89a3bf968264" returned: 0 in 1.039s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:43:32 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-0ba8e735-7302-4c36-a5ae-c2e7059b2c17 tempest-VolumesDeleteCascade-473852886 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-11e8ac43-d499-4bf6-a257-89a3bf968264.057f2db0-148c-457a-a88d-82d03451ea83 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:43:32 devstack sudo[97615]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-11e8ac43-d499-4bf6-a257-89a3bf968264.057f2db0-148c-457a-a88d-82d03451ea83 Jul 10 04:43:32 devstack sudo[97615]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:43:32 devstack cinder-volume[87444]: DEBUG oslo_service.periodic_task [None req-01f0ce3e-6850-4e14-881d-e40d3c4ad6e5 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87444) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 10 04:43:32 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-01f0ce3e-6850-4e14-881d-e40d3c4ad6e5 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 04:43:33 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-01f0ce3e-6850-4e14-881d-e40d3c4ad6e5 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 04:43:33 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-01f0ce3e-6850-4e14-881d-e40d3c4ad6e5 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922': None} {{(pid=87444) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 04:43:33 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-01f0ce3e-6850-4e14-881d-e40d3c4ad6e5 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922'] {{(pid=87444) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 04:43:33 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-01f0ce3e-6850-4e14-881d-e40d3c4ad6e5 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 04:43:33 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-01f0ce3e-6850-4e14-881d-e40d3c4ad6e5 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:43:33 devstack sudo[97620]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097 Jul 10 04:43:33 devstack sudo[97620]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:43:33 devstack sudo[97615]: pam_unix(sudo:session): session closed for user root Jul 10 04:43:33 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-0ba8e735-7302-4c36-a5ae-c2e7059b2c17 tempest-VolumesDeleteCascade-473852886 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-11e8ac43-d499-4bf6-a257-89a3bf968264.057f2db0-148c-457a-a88d-82d03451ea83" returned: 0 in 1.239s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:43:33 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-0ba8e735-7302-4c36-a5ae-c2e7059b2c17 tempest-VolumesDeleteCascade-473852886 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-11e8ac43-d499-4bf6-a257-89a3bf968264.057f2db0-148c-457a-a88d-82d03451ea83 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:43:33 devstack sudo[97625]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-11e8ac43-d499-4bf6-a257-89a3bf968264.057f2db0-148c-457a-a88d-82d03451ea83 Jul 10 04:43:33 devstack sudo[97625]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:43:34 devstack sudo[97620]: pam_unix(sudo:session): session closed for user root Jul 10 04:43:34 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-01f0ce3e-6850-4e14-881d-e40d3c4ad6e5 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097" returned: 0 in 1.286s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:43:34 devstack cinder-volume[87444]: DEBUG cinder.manager [None req-01f0ce3e-6850-4e14-881d-e40d3c4ad6e5 None None] Notifying Schedulers of capabilities ... {{(pid=87444) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 04:43:34 devstack cinder-volume[87444]: DEBUG oslo_service.periodic_task [None req-01f0ce3e-6850-4e14-881d-e40d3c4ad6e5 None None] Running periodic task VolumeManager._thread_info {{(pid=87444) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 10 04:43:34 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-01f0ce3e-6850-4e14-881d-e40d3c4ad6e5 None None] thread count: 28 {{(pid=87444) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 10 04:43:34 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-01f0ce3e-6850-4e14-881d-e40d3c4ad6e5 None None] thread info: [<_MainThread(MainThread, started 126839257915520)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87444) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 10 04:43:34 devstack sudo[97625]: pam_unix(sudo:session): session closed for user root Jul 10 04:43:34 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-0ba8e735-7302-4c36-a5ae-c2e7059b2c17 tempest-VolumesDeleteCascade-473852886 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-11e8ac43-d499-4bf6-a257-89a3bf968264.057f2db0-148c-457a-a88d-82d03451ea83" returned: 0 in 1.089s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:43:34 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-0ba8e735-7302-4c36-a5ae-c2e7059b2c17 tempest-VolumesDeleteCascade-473852886 None] Lock "cinder-quobyte-057f2db0-148c-457a-a88d-82d03451ea83" released by "_delete_snapshot" :: held 4.471s {{(pid=87444) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 04:43:35 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-0ba8e735-7302-4c36-a5ae-c2e7059b2c17 tempest-VolumesDeleteCascade-473852886 None] Lock "cinder-quobyte-11e8ac43-d499-4bf6-a257-89a3bf968264" released by "delete_snapshot" :: held 4.520s {{(pid=87444) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 04:43:35 devstack cinder-volume[87444]: DEBUG cinder.quota [None req-0ba8e735-7302-4c36-a5ae-c2e7059b2c17 tempest-VolumesDeleteCascade-473852886 None] Created reservations ['612c3ba8-ab6d-4881-bc19-10ffac1ae556', '7a5212e4-4403-4635-8ddd-a0cb9fab15c0', '6f4ec688-a89a-4f76-ba93-4be21837c67e', '5b63be23-5e08-4f32-91f2-244ab409a235'] {{(pid=87444) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 04:43:35 devstack cinder-volume[87444]: INFO cinder.volume.manager [None req-0ba8e735-7302-4c36-a5ae-c2e7059b2c17 tempest-VolumesDeleteCascade-473852886 None] Delete snapshot completed successfully. Jul 10 04:43:35 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-0ba8e735-7302-4c36-a5ae-c2e7059b2c17 tempest-VolumesDeleteCascade-473852886 None] Lock "cinder-057f2db0-148c-457a-a88d-82d03451ea83-delete_snapshot" released by "delete_snapshot" :: held 4.757s {{(pid=87444) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 04:43:35 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-0ba8e735-7302-4c36-a5ae-c2e7059b2c17 tempest-VolumesDeleteCascade-473852886 None] Snapshots deleted, issuing volume delete {{(pid=87444) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}} Jul 10 04:43:35 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-0ba8e735-7302-4c36-a5ae-c2e7059b2c17 tempest-VolumesDeleteCascade-473852886 None] Acquiring lock "cinder-quobyte-11e8ac43-d499-4bf6-a257-89a3bf968264" by "delete_volume" {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 04:43:35 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-0ba8e735-7302-4c36-a5ae-c2e7059b2c17 tempest-VolumesDeleteCascade-473852886 None] Lock "cinder-quobyte-11e8ac43-d499-4bf6-a257-89a3bf968264" acquired by "delete_volume" :: waited 0.037s {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 04:43:35 devstack cinder-volume[87444]: DEBUG oslo.privsep.daemon [-] privsep: reply[a333fc72-b601-4242-b0b8-f094d56cc7ab]: (4, 'qcow2') {{(pid=88499) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 04:43:35 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-0ba8e735-7302-4c36-a5ae-c2e7059b2c17 tempest-VolumesDeleteCascade-473852886 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-11e8ac43-d499-4bf6-a257-89a3bf968264 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:43:35 devstack sudo[97629]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-11e8ac43-d499-4bf6-a257-89a3bf968264 Jul 10 04:43:35 devstack sudo[97629]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:43:35 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-384782a6-c3a2-4022-84a0-49302a80f842 tempest-VolumesActionsTest-532776818 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 04:43:35 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-384782a6-c3a2-4022-84a0-49302a80f842 tempest-VolumesActionsTest-532776818 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.003s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 04:43:35 devstack cinder-volume[87444]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9b1c4fe-f70e-40e0-81cb-14aa93b033d8]: (4, 'qcow2') {{(pid=88499) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 04:43:35 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-384782a6-c3a2-4022-84a0-49302a80f842 tempest-VolumesActionsTest-532776818 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-14eaa034-13c6-4839-956c-d2befd0d4d8d {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:43:35 devstack sudo[97631]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-14eaa034-13c6-4839-956c-d2befd0d4d8d Jul 10 04:43:35 devstack sudo[97631]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:43:36 devstack cinder-volume[87444]: DEBUG cinder.volume.flows.manager.create_volume [None req-14463f85-b7ae-4631-8515-0c584da623b2 tempest-VolumesSnapshotListTestJSON-813757709 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87444) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 04:43:36 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-14463f85-b7ae-4631-8515-0c584da623b2 tempest-VolumesSnapshotListTestJSON-813757709 None] Flow 'volume_create_manager' (a619a1d7-061f-4997-8300-e4b73fdd9b2b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 04:43:36 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-14463f85-b7ae-4631-8515-0c584da623b2 tempest-VolumesSnapshotListTestJSON-813757709 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3efde14b-ee84-44bd-ae8b-1c8222bd2826) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:43:36 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-14463f85-b7ae-4631-8515-0c584da623b2 tempest-VolumesSnapshotListTestJSON-813757709 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3efde14b-ee84-44bd-ae8b-1c8222bd2826) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T02:43:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-1501829099',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a1874d97-591e-46ff-9d77-4263321db1b6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a4f3900282c84011bfaa7343594de0c8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T02:43:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T02:43:36Z,use_quota=True,user_id='3599597728d84b8eb0fcad1dc4eb619d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(317e369e-1e06-434d-ae95-a335f0e6c903),volume_type_id=317e369e-1e06-434d-ae95-a335f0e6c903)' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:43:36 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-14463f85-b7ae-4631-8515-0c584da623b2 tempest-VolumesSnapshotListTestJSON-813757709 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bc6ea912-35a5-4f0e-ae07-a7d97c98b3a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:43:36 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-14463f85-b7ae-4631-8515-0c584da623b2 tempest-VolumesSnapshotListTestJSON-813757709 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bc6ea912-35a5-4f0e-ae07-a7d97c98b3a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:43:36 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-14463f85-b7ae-4631-8515-0c584da623b2 tempest-VolumesSnapshotListTestJSON-813757709 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8597a8ed-6895-45cc-ab46-a3115b951498) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:43:36 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-14463f85-b7ae-4631-8515-0c584da623b2 tempest-VolumesSnapshotListTestJSON-813757709 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8597a8ed-6895-45cc-ab46-a3115b951498) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a1874d97-591e-46ff-9d77-4263321db1b6', 'volume_name': 'volume-a1874d97-591e-46ff-9d77-4263321db1b6', 'volume_size': 1}' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:43:36 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-14463f85-b7ae-4631-8515-0c584da623b2 tempest-VolumesSnapshotListTestJSON-813757709 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (83fdad6f-48e3-4afb-92d5-33e1dc074f2b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:43:36 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-14463f85-b7ae-4631-8515-0c584da623b2 tempest-VolumesSnapshotListTestJSON-813757709 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (83fdad6f-48e3-4afb-92d5-33e1dc074f2b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:43:36 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-14463f85-b7ae-4631-8515-0c584da623b2 tempest-VolumesSnapshotListTestJSON-813757709 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (72b0d18d-ffa2-4394-a254-5250b5e78f3a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:43:36 devstack cinder-volume[87444]: INFO cinder.volume.flows.manager.create_volume [None req-14463f85-b7ae-4631-8515-0c584da623b2 tempest-VolumesSnapshotListTestJSON-813757709 None] Volume a1874d97-591e-46ff-9d77-4263321db1b6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a1874d97-591e-46ff-9d77-4263321db1b6', 'volume_size': 1} Jul 10 04:43:36 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-14463f85-b7ae-4631-8515-0c584da623b2 tempest-VolumesSnapshotListTestJSON-813757709 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 04:43:36 devstack sudo[97629]: pam_unix(sudo:session): session closed for user root Jul 10 04:43:36 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-0ba8e735-7302-4c36-a5ae-c2e7059b2c17 tempest-VolumesDeleteCascade-473852886 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-11e8ac43-d499-4bf6-a257-89a3bf968264" returned: 0 in 1.295s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:43:36 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-0ba8e735-7302-4c36-a5ae-c2e7059b2c17 tempest-VolumesDeleteCascade-473852886 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-11e8ac43-d499-4bf6-a257-89a3bf968264 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:43:36 devstack sudo[97636]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-11e8ac43-d499-4bf6-a257-89a3bf968264 Jul 10 04:43:36 devstack sudo[97636]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:43:36 devstack sudo[97631]: pam_unix(sudo:session): session closed for user root Jul 10 04:43:36 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-384782a6-c3a2-4022-84a0-49302a80f842 tempest-VolumesActionsTest-532776818 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-14eaa034-13c6-4839-956c-d2befd0d4d8d" returned: 0 in 1.256s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:43:36 devstack cinder-volume[87444]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ceceeff-0a1b-4f9e-8645-68e179db454f]: (4, 'qcow2') {{(pid=88499) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 04:43:36 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-384782a6-c3a2-4022-84a0-49302a80f842 tempest-VolumesActionsTest-532776818 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-14eaa034-13c6-4839-956c-d2befd0d4d8d {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:43:37 devstack sudo[97641]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-14eaa034-13c6-4839-956c-d2befd0d4d8d Jul 10 04:43:37 devstack sudo[97641]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:43:37 devstack sudo[97636]: pam_unix(sudo:session): session closed for user root Jul 10 04:43:37 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-0ba8e735-7302-4c36-a5ae-c2e7059b2c17 tempest-VolumesDeleteCascade-473852886 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-11e8ac43-d499-4bf6-a257-89a3bf968264" returned: 0 in 0.824s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:43:37 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-0ba8e735-7302-4c36-a5ae-c2e7059b2c17 tempest-VolumesDeleteCascade-473852886 None] Lock "cinder-quobyte-11e8ac43-d499-4bf6-a257-89a3bf968264" released by "delete_volume" :: held 2.215s {{(pid=87444) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 04:43:37 devstack cinder-volume[87444]: DEBUG cinder.quota [None req-0ba8e735-7302-4c36-a5ae-c2e7059b2c17 tempest-VolumesDeleteCascade-473852886 None] Created reservations ['b5bcae06-4f87-4337-bdb3-69362fd84cce', '65130686-5a10-4024-a4ea-71de34bdc475', '60408c1b-2865-4fd3-83e7-b497311689ff', '36aa6306-0d1f-4285-996c-389e5d845448'] {{(pid=87444) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 04:43:37 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-0ba8e735-7302-4c36-a5ae-c2e7059b2c17 tempest-VolumesDeleteCascade-473852886 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 04:43:37 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-0ba8e735-7302-4c36-a5ae-c2e7059b2c17 tempest-VolumesDeleteCascade-473852886 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 04:43:37 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-0ba8e735-7302-4c36-a5ae-c2e7059b2c17 tempest-VolumesDeleteCascade-473852886 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922': None} {{(pid=87444) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 04:43:37 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-0ba8e735-7302-4c36-a5ae-c2e7059b2c17 tempest-VolumesDeleteCascade-473852886 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922'] {{(pid=87444) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 04:43:37 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-0ba8e735-7302-4c36-a5ae-c2e7059b2c17 tempest-VolumesDeleteCascade-473852886 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 04:43:37 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-0ba8e735-7302-4c36-a5ae-c2e7059b2c17 tempest-VolumesDeleteCascade-473852886 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:43:37 devstack sudo[97644]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097 Jul 10 04:43:37 devstack sudo[97644]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:43:37 devstack sudo[97641]: pam_unix(sudo:session): session closed for user root Jul 10 04:43:37 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-384782a6-c3a2-4022-84a0-49302a80f842 tempest-VolumesActionsTest-532776818 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-14eaa034-13c6-4839-956c-d2befd0d4d8d" returned: 0 in 0.999s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:43:37 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-384782a6-c3a2-4022-84a0-49302a80f842 tempest-VolumesActionsTest-532776818 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-14eaa034-13c6-4839-956c-d2befd0d4d8d /opt/stack/data/cinder/conversion/14eaa034-13c6-4839-956c-d2befd0d4d8d.temp_image.5a0e3842-ebea-4f56-8342-6d74a77bb0e0boumzk6d.img {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:43:37 devstack sudo[97649]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-14eaa034-13c6-4839-956c-d2befd0d4d8d /opt/stack/data/cinder/conversion/14eaa034-13c6-4839-956c-d2befd0d4d8d.temp_image.5a0e3842-ebea-4f56-8342-6d74a77bb0e0boumzk6d.img Jul 10 04:43:37 devstack sudo[97649]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:43:38 devstack sudo[97644]: pam_unix(sudo:session): session closed for user root Jul 10 04:43:38 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-0ba8e735-7302-4c36-a5ae-c2e7059b2c17 tempest-VolumesDeleteCascade-473852886 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097" returned: 0 in 0.759s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:43:38 devstack cinder-volume[87444]: DEBUG cinder.manager [None req-0ba8e735-7302-4c36-a5ae-c2e7059b2c17 tempest-VolumesDeleteCascade-473852886 None] Notifying Schedulers of capabilities ... {{(pid=87444) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 04:43:38 devstack cinder-volume[87444]: INFO cinder.volume.manager [None req-0ba8e735-7302-4c36-a5ae-c2e7059b2c17 tempest-VolumesDeleteCascade-473852886 None] Deleted volume successfully. Jul 10 04:43:38 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-c9242d44-ab7d-4882-9ef6-5996396e04ce tempest-VolumesDeleteCascade-473852886 None] Acquiring lock "cinder-b7bdc84e-7ca9-4f07-9b44-7ff588f698e1-delete_volume" by "delete_volume" {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 04:43:38 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-c9242d44-ab7d-4882-9ef6-5996396e04ce tempest-VolumesDeleteCascade-473852886 None] Lock "cinder-b7bdc84e-7ca9-4f07-9b44-7ff588f698e1-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 04:43:38 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-0ba8e735-7302-4c36-a5ae-c2e7059b2c17 tempest-VolumesDeleteCascade-473852886 None] Lock "cinder-11e8ac43-d499-4bf6-a257-89a3bf968264-delete_volume" released by "delete_volume" :: held 8.088s {{(pid=87444) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 04:43:38 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-c9242d44-ab7d-4882-9ef6-5996396e04ce tempest-VolumesDeleteCascade-473852886 None] Acquiring lock "cinder-quobyte-b7bdc84e-7ca9-4f07-9b44-7ff588f698e1" by "delete_volume" {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 04:43:38 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-c9242d44-ab7d-4882-9ef6-5996396e04ce tempest-VolumesDeleteCascade-473852886 None] Lock "cinder-quobyte-b7bdc84e-7ca9-4f07-9b44-7ff588f698e1" acquired by "delete_volume" :: waited 0.028s {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 04:43:38 devstack cinder-volume[87444]: DEBUG oslo.privsep.daemon [-] privsep: reply[613cb463-c03b-40ac-beca-26bc638809f7]: (4, 'qcow2') {{(pid=88499) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 04:43:38 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-c9242d44-ab7d-4882-9ef6-5996396e04ce tempest-VolumesDeleteCascade-473852886 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-b7bdc84e-7ca9-4f07-9b44-7ff588f698e1 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:43:38 devstack sudo[97652]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-b7bdc84e-7ca9-4f07-9b44-7ff588f698e1 Jul 10 04:43:38 devstack sudo[97652]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:43:40 devstack sudo[97652]: pam_unix(sudo:session): session closed for user root Jul 10 04:43:40 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-c9242d44-ab7d-4882-9ef6-5996396e04ce tempest-VolumesDeleteCascade-473852886 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-b7bdc84e-7ca9-4f07-9b44-7ff588f698e1" returned: 0 in 1.590s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:43:40 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-c9242d44-ab7d-4882-9ef6-5996396e04ce tempest-VolumesDeleteCascade-473852886 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-b7bdc84e-7ca9-4f07-9b44-7ff588f698e1 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:43:40 devstack sudo[97668]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-b7bdc84e-7ca9-4f07-9b44-7ff588f698e1 Jul 10 04:43:40 devstack sudo[97668]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:43:41 devstack sudo[97668]: pam_unix(sudo:session): session closed for user root Jul 10 04:43:41 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-c9242d44-ab7d-4882-9ef6-5996396e04ce tempest-VolumesDeleteCascade-473852886 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-b7bdc84e-7ca9-4f07-9b44-7ff588f698e1" returned: 0 in 1.282s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:43:41 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-c9242d44-ab7d-4882-9ef6-5996396e04ce tempest-VolumesDeleteCascade-473852886 None] Lock "cinder-quobyte-b7bdc84e-7ca9-4f07-9b44-7ff588f698e1" released by "delete_volume" :: held 2.928s {{(pid=87444) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 04:43:41 devstack cinder-volume[87444]: DEBUG cinder.quota [None req-c9242d44-ab7d-4882-9ef6-5996396e04ce tempest-VolumesDeleteCascade-473852886 None] Created reservations ['ffb139f5-4952-48e6-b516-dea710685063', '52402590-a45d-4b09-97ca-c2fa8e752d1f', '4ce5d278-eb85-4db8-ad17-e2c770129014', 'd666cc1c-f4ef-435d-aece-0c0dafe1da3b'] {{(pid=87444) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 04:43:41 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-c9242d44-ab7d-4882-9ef6-5996396e04ce tempest-VolumesDeleteCascade-473852886 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 04:43:41 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-c9242d44-ab7d-4882-9ef6-5996396e04ce tempest-VolumesDeleteCascade-473852886 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 04:43:41 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-c9242d44-ab7d-4882-9ef6-5996396e04ce tempest-VolumesDeleteCascade-473852886 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922': None} {{(pid=87444) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 04:43:41 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-c9242d44-ab7d-4882-9ef6-5996396e04ce tempest-VolumesDeleteCascade-473852886 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922'] {{(pid=87444) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 04:43:41 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-c9242d44-ab7d-4882-9ef6-5996396e04ce tempest-VolumesDeleteCascade-473852886 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 04:43:41 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-c9242d44-ab7d-4882-9ef6-5996396e04ce tempest-VolumesDeleteCascade-473852886 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:43:41 devstack sudo[97671]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097 Jul 10 04:43:41 devstack sudo[97671]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:43:42 devstack sudo[97671]: pam_unix(sudo:session): session closed for user root Jul 10 04:43:42 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-c9242d44-ab7d-4882-9ef6-5996396e04ce tempest-VolumesDeleteCascade-473852886 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097" returned: 0 in 1.319s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:43:42 devstack cinder-volume[87444]: DEBUG cinder.manager [None req-c9242d44-ab7d-4882-9ef6-5996396e04ce tempest-VolumesDeleteCascade-473852886 None] Notifying Schedulers of capabilities ... {{(pid=87444) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 04:43:42 devstack cinder-volume[87444]: INFO cinder.volume.manager [None req-c9242d44-ab7d-4882-9ef6-5996396e04ce tempest-VolumesDeleteCascade-473852886 None] Deleted volume successfully. Jul 10 04:43:43 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-c9242d44-ab7d-4882-9ef6-5996396e04ce tempest-VolumesDeleteCascade-473852886 None] Lock "cinder-b7bdc84e-7ca9-4f07-9b44-7ff588f698e1-delete_volume" released by "delete_volume" :: held 4.608s {{(pid=87444) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 04:43:43 devstack sudo[97649]: pam_unix(sudo:session): session closed for user root Jul 10 04:43:43 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-384782a6-c3a2-4022-84a0-49302a80f842 tempest-VolumesActionsTest-532776818 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-14eaa034-13c6-4839-956c-d2befd0d4d8d /opt/stack/data/cinder/conversion/14eaa034-13c6-4839-956c-d2befd0d4d8d.temp_image.5a0e3842-ebea-4f56-8342-6d74a77bb0e0boumzk6d.img" returned: 0 in 5.889s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:43:43 devstack cinder-volume[87444]: DEBUG oslo.privsep.daemon [-] privsep: reply[93319ea5-3b44-4834-a397-15bb0594f978]: (4, 'qcow2') {{(pid=88499) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 04:43:43 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-384782a6-c3a2-4022-84a0-49302a80f842 tempest-VolumesActionsTest-532776818 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-14eaa034-13c6-4839-956c-d2befd0d4d8d {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:43:43 devstack sudo[97675]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-14eaa034-13c6-4839-956c-d2befd0d4d8d Jul 10 04:43:43 devstack sudo[97675]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:43:44 devstack sudo[97675]: pam_unix(sudo:session): session closed for user root Jul 10 04:43:44 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-384782a6-c3a2-4022-84a0-49302a80f842 tempest-VolumesActionsTest-532776818 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-14eaa034-13c6-4839-956c-d2befd0d4d8d" returned: 0 in 1.054s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:43:44 devstack cinder-volume[87444]: DEBUG cinder.image.image_utils [None req-384782a6-c3a2-4022-84a0-49302a80f842 tempest-VolumesActionsTest-532776818 None] Image conversion details: src /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-14eaa034-13c6-4839-956c-d2befd0d4d8d, size 1024.00 MB, duration 5.89 sec, destination /opt/stack/data/cinder/conversion/14eaa034-13c6-4839-956c-d2befd0d4d8d.temp_image.5a0e3842-ebea-4f56-8342-6d74a77bb0e0boumzk6d.img {{(pid=87444) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:561}} Jul 10 04:43:44 devstack cinder-volume[87444]: INFO cinder.image.image_utils [None req-384782a6-c3a2-4022-84a0-49302a80f842 tempest-VolumesActionsTest-532776818 None] Converted 1024.00 MB image at 173.84 MB/s Jul 10 04:43:44 devstack cinder-volume[87444]: DEBUG cinder.image.image_utils [None req-384782a6-c3a2-4022-84a0-49302a80f842 tempest-VolumesActionsTest-532776818 None] 5a0e3842-ebea-4f56-8342-6d74a77bb0e0 was raw, no need to convert to raw {{(pid=87444) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1192}} Jul 10 04:43:46 devstack cinder-volume[87444]: DEBUG cinder.volume.flows.manager.create_volume [None req-410612be-b107-4d65-b6d4-de0a0a45bfef tempest-VolumesMetadataTest-509601608 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87444) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 04:43:46 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-410612be-b107-4d65-b6d4-de0a0a45bfef tempest-VolumesMetadataTest-509601608 None] Flow 'volume_create_manager' (3bf8ec16-6739-417a-a490-f8e5639c9751) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 04:43:46 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-410612be-b107-4d65-b6d4-de0a0a45bfef tempest-VolumesMetadataTest-509601608 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aa372734-b036-46c9-aa25-5724fb47c196) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:43:46 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-410612be-b107-4d65-b6d4-de0a0a45bfef tempest-VolumesMetadataTest-509601608 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aa372734-b036-46c9-aa25-5724fb47c196) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T02:43:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-432940881',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0016c33e-4546-452b-97d5-9bace4ae7aad,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6c40fcaa4a844d78993d14b60b32883f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T02:43:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T02:43:46Z,use_quota=True,user_id='a233d9cede1f46a99786bf28d1973a44',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(317e369e-1e06-434d-ae95-a335f0e6c903),volume_type_id=317e369e-1e06-434d-ae95-a335f0e6c903)' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:43:46 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-410612be-b107-4d65-b6d4-de0a0a45bfef tempest-VolumesMetadataTest-509601608 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ecd5d0e3-6518-4ace-bcda-0e3c9b9b82c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:43:46 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-410612be-b107-4d65-b6d4-de0a0a45bfef tempest-VolumesMetadataTest-509601608 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ecd5d0e3-6518-4ace-bcda-0e3c9b9b82c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:43:46 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-410612be-b107-4d65-b6d4-de0a0a45bfef tempest-VolumesMetadataTest-509601608 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1bce5c5a-91f7-440d-8048-54d98f1f50ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:43:46 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-410612be-b107-4d65-b6d4-de0a0a45bfef tempest-VolumesMetadataTest-509601608 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1bce5c5a-91f7-440d-8048-54d98f1f50ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0016c33e-4546-452b-97d5-9bace4ae7aad', 'volume_name': 'volume-0016c33e-4546-452b-97d5-9bace4ae7aad', 'volume_size': 1}' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:43:46 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-410612be-b107-4d65-b6d4-de0a0a45bfef tempest-VolumesMetadataTest-509601608 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (69379939-5e07-4d3c-a772-dc7cd15aa5ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:43:46 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-410612be-b107-4d65-b6d4-de0a0a45bfef tempest-VolumesMetadataTest-509601608 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (69379939-5e07-4d3c-a772-dc7cd15aa5ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:43:46 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-410612be-b107-4d65-b6d4-de0a0a45bfef tempest-VolumesMetadataTest-509601608 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fc37d554-ae45-471c-a25c-062f3d01f511) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:43:46 devstack cinder-volume[87444]: INFO cinder.volume.flows.manager.create_volume [None req-410612be-b107-4d65-b6d4-de0a0a45bfef tempest-VolumesMetadataTest-509601608 None] Volume 0016c33e-4546-452b-97d5-9bace4ae7aad: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0016c33e-4546-452b-97d5-9bace4ae7aad', 'volume_size': 1} Jul 10 04:43:46 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-410612be-b107-4d65-b6d4-de0a0a45bfef tempest-VolumesMetadataTest-509601608 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 04:43:56 devstack cinder-volume[87444]: DEBUG dbcounter [-] [87444] Writing DB stats cinder:UPDATE=47,cinder:SELECT=39,cinder:INSERT=11,cinder:DELETE=3 {{(pid=87444) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 10 04:43:56 devstack cinder-volume[87444]: DEBUG dbcounter [-] [87444] Writing DB stats cinder:UPDATE=47,cinder:SELECT=37,cinder:INSERT=12,cinder:DELETE=3 {{(pid=87444) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 10 04:44:01 devstack cinder-volume[87444]: DEBUG cinder.volume.flows.manager.create_volume [None req-8628aff5-63dd-43e1-a818-5df6f18e6944 tempest-TestMinimumBasicScenario-2101675754 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87444) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 04:44:01 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-8628aff5-63dd-43e1-a818-5df6f18e6944 tempest-TestMinimumBasicScenario-2101675754 None] Flow 'volume_create_manager' (b1d7270d-ae9f-499c-86ae-cb1ffe5e8190) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 04:44:01 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-8628aff5-63dd-43e1-a818-5df6f18e6944 tempest-TestMinimumBasicScenario-2101675754 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b590959f-9361-4afd-b5da-cafbf191ddf2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:44:01 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-8628aff5-63dd-43e1-a818-5df6f18e6944 tempest-TestMinimumBasicScenario-2101675754 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b590959f-9361-4afd-b5da-cafbf191ddf2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T02:44:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestMinimumBasicScenario-volume-597586752',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5f39620d-7980-4693-aaa0-c873a433f170,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='001cceb0d0fe404face959670fe53915',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T02:44:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T02:44:01Z,use_quota=True,user_id='1f5d8d706e1c40f89769e2044705bd28',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(317e369e-1e06-434d-ae95-a335f0e6c903),volume_type_id=317e369e-1e06-434d-ae95-a335f0e6c903)' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:44:01 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-8628aff5-63dd-43e1-a818-5df6f18e6944 tempest-TestMinimumBasicScenario-2101675754 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0ced34d7-9876-4ecd-b7cc-ee4a80ccf421) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:44:01 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-8628aff5-63dd-43e1-a818-5df6f18e6944 tempest-TestMinimumBasicScenario-2101675754 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0ced34d7-9876-4ecd-b7cc-ee4a80ccf421) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:44:01 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-8628aff5-63dd-43e1-a818-5df6f18e6944 tempest-TestMinimumBasicScenario-2101675754 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aeaf3525-672c-4af3-886d-f2c2d459e5ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:44:01 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-8628aff5-63dd-43e1-a818-5df6f18e6944 tempest-TestMinimumBasicScenario-2101675754 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aeaf3525-672c-4af3-886d-f2c2d459e5ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5f39620d-7980-4693-aaa0-c873a433f170', 'volume_name': 'volume-5f39620d-7980-4693-aaa0-c873a433f170', 'volume_size': 1}' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:44:01 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-8628aff5-63dd-43e1-a818-5df6f18e6944 tempest-TestMinimumBasicScenario-2101675754 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2e0864b3-579d-4104-8fe1-fc68462b0778) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:44:01 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-8628aff5-63dd-43e1-a818-5df6f18e6944 tempest-TestMinimumBasicScenario-2101675754 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2e0864b3-579d-4104-8fe1-fc68462b0778) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:44:01 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-8628aff5-63dd-43e1-a818-5df6f18e6944 tempest-TestMinimumBasicScenario-2101675754 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b689f5dc-a67b-4533-9201-587b92c65f40) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:44:01 devstack cinder-volume[87444]: INFO cinder.volume.flows.manager.create_volume [None req-8628aff5-63dd-43e1-a818-5df6f18e6944 tempest-TestMinimumBasicScenario-2101675754 None] Volume 5f39620d-7980-4693-aaa0-c873a433f170: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5f39620d-7980-4693-aaa0-c873a433f170', 'volume_size': 1} Jul 10 04:44:01 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-8628aff5-63dd-43e1-a818-5df6f18e6944 tempest-TestMinimumBasicScenario-2101675754 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 04:44:06 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-384782a6-c3a2-4022-84a0-49302a80f842 tempest-VolumesActionsTest-532776818 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 31.232s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 04:44:06 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-384782a6-c3a2-4022-84a0-49302a80f842 tempest-VolumesActionsTest-532776818 None] Uploaded volume to glance image-id: 5a0e3842-ebea-4f56-8342-6d74a77bb0e0. {{(pid=87444) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}} Jul 10 04:44:06 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-14463f85-b7ae-4631-8515-0c584da623b2 tempest-VolumesSnapshotListTestJSON-813757709 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 30.387s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 04:44:06 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-14463f85-b7ae-4631-8515-0c584da623b2 tempest-VolumesSnapshotListTestJSON-813757709 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T02:43:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-1501829099',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a1874d97-591e-46ff-9d77-4263321db1b6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a4f3900282c84011bfaa7343594de0c8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T02:43:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T02:43:36Z,use_quota=True,user_id='3599597728d84b8eb0fcad1dc4eb619d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(317e369e-1e06-434d-ae95-a335f0e6c903),volume_type_id=317e369e-1e06-434d-ae95-a335f0e6c903)}" {{(pid=87444) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 04:44:06 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.remotefs [None req-14463f85-b7ae-4631-8515-0c584da623b2 tempest-VolumesSnapshotListTestJSON-813757709 None] Creating volume a1874d97-591e-46ff-9d77-4263321db1b6 {{(pid=87444) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 04:44:06 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-14463f85-b7ae-4631-8515-0c584da623b2 tempest-VolumesSnapshotListTestJSON-813757709 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 04:44:06 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-14463f85-b7ae-4631-8515-0c584da623b2 tempest-VolumesSnapshotListTestJSON-813757709 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 04:44:06 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-14463f85-b7ae-4631-8515-0c584da623b2 tempest-VolumesSnapshotListTestJSON-813757709 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922': None} {{(pid=87444) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 04:44:06 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-14463f85-b7ae-4631-8515-0c584da623b2 tempest-VolumesSnapshotListTestJSON-813757709 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922'] {{(pid=87444) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 04:44:06 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-14463f85-b7ae-4631-8515-0c584da623b2 tempest-VolumesSnapshotListTestJSON-813757709 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 04:44:06 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-14463f85-b7ae-4631-8515-0c584da623b2 tempest-VolumesSnapshotListTestJSON-813757709 None] Selected osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922 as target Quobyte volume. {{(pid=87444) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 04:44:06 devstack cinder-volume[87444]: INFO cinder.volume.drivers.remotefs [None req-14463f85-b7ae-4631-8515-0c584da623b2 tempest-VolumesSnapshotListTestJSON-813757709 None] casted to osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922 Jul 10 04:44:06 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-14463f85-b7ae-4631-8515-0c584da623b2 tempest-VolumesSnapshotListTestJSON-813757709 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-a1874d97-591e-46ff-9d77-4263321db1b6 1073741824 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:44:06 devstack sudo[97795]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-a1874d97-591e-46ff-9d77-4263321db1b6 1073741824 Jul 10 04:44:06 devstack sudo[97795]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:44:06 devstack cinder-volume[87444]: INFO cinder.volume.manager [None req-384782a6-c3a2-4022-84a0-49302a80f842 tempest-VolumesActionsTest-532776818 None] Copy volume to image completed successfully. Jul 10 04:44:07 devstack sudo[97795]: pam_unix(sudo:session): session closed for user root Jul 10 04:44:07 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-14463f85-b7ae-4631-8515-0c584da623b2 tempest-VolumesSnapshotListTestJSON-813757709 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-a1874d97-591e-46ff-9d77-4263321db1b6 1073741824" returned: 0 in 0.919s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:44:07 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-14463f85-b7ae-4631-8515-0c584da623b2 tempest-VolumesSnapshotListTestJSON-813757709 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-a1874d97-591e-46ff-9d77-4263321db1b6 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:44:07 devstack sudo[97800]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-a1874d97-591e-46ff-9d77-4263321db1b6 Jul 10 04:44:07 devstack sudo[97800]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:44:08 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-60b161b0-9ec1-4e57-9353-782d0cd00b4b tempest-VolumesActionsTest-532776818 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 04:44:08 devstack sudo[97800]: pam_unix(sudo:session): session closed for user root Jul 10 04:44:08 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-14463f85-b7ae-4631-8515-0c584da623b2 tempest-VolumesSnapshotListTestJSON-813757709 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-a1874d97-591e-46ff-9d77-4263321db1b6" returned: 0 in 0.701s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:44:08 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-14463f85-b7ae-4631-8515-0c584da623b2 tempest-VolumesSnapshotListTestJSON-813757709 None] <== create_volume: return (1662ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922'} {{(pid=87444) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 04:44:08 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-14463f85-b7ae-4631-8515-0c584da623b2 tempest-VolumesSnapshotListTestJSON-813757709 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.665s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 04:44:08 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-410612be-b107-4d65-b6d4-de0a0a45bfef tempest-VolumesMetadataTest-509601608 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 22.326s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 04:44:08 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-410612be-b107-4d65-b6d4-de0a0a45bfef tempest-VolumesMetadataTest-509601608 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T02:43:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-432940881',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0016c33e-4546-452b-97d5-9bace4ae7aad,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6c40fcaa4a844d78993d14b60b32883f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T02:43:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T02:43:46Z,use_quota=True,user_id='a233d9cede1f46a99786bf28d1973a44',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(317e369e-1e06-434d-ae95-a335f0e6c903),volume_type_id=317e369e-1e06-434d-ae95-a335f0e6c903)}" {{(pid=87444) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 04:44:08 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.remotefs [None req-410612be-b107-4d65-b6d4-de0a0a45bfef tempest-VolumesMetadataTest-509601608 None] Creating volume 0016c33e-4546-452b-97d5-9bace4ae7aad {{(pid=87444) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 04:44:08 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-410612be-b107-4d65-b6d4-de0a0a45bfef tempest-VolumesMetadataTest-509601608 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 04:44:08 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-410612be-b107-4d65-b6d4-de0a0a45bfef tempest-VolumesMetadataTest-509601608 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 04:44:08 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-410612be-b107-4d65-b6d4-de0a0a45bfef tempest-VolumesMetadataTest-509601608 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922': None} {{(pid=87444) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 04:44:08 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-410612be-b107-4d65-b6d4-de0a0a45bfef tempest-VolumesMetadataTest-509601608 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922'] {{(pid=87444) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 04:44:08 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-410612be-b107-4d65-b6d4-de0a0a45bfef tempest-VolumesMetadataTest-509601608 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 04:44:08 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-410612be-b107-4d65-b6d4-de0a0a45bfef tempest-VolumesMetadataTest-509601608 None] Selected osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922 as target Quobyte volume. {{(pid=87444) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 04:44:08 devstack cinder-volume[87444]: INFO cinder.volume.drivers.remotefs [None req-410612be-b107-4d65-b6d4-de0a0a45bfef tempest-VolumesMetadataTest-509601608 None] casted to osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922 Jul 10 04:44:08 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-410612be-b107-4d65-b6d4-de0a0a45bfef tempest-VolumesMetadataTest-509601608 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-0016c33e-4546-452b-97d5-9bace4ae7aad 1073741824 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:44:08 devstack sudo[97803]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-0016c33e-4546-452b-97d5-9bace4ae7aad 1073741824 Jul 10 04:44:08 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-14463f85-b7ae-4631-8515-0c584da623b2 tempest-VolumesSnapshotListTestJSON-813757709 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (72b0d18d-ffa2-4394-a254-5250b5e78f3a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a1874d97-591e-46ff-9d77-4263321db1b6', 'volume_size': 1}' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:44:08 devstack sudo[97803]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:44:08 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-14463f85-b7ae-4631-8515-0c584da623b2 tempest-VolumesSnapshotListTestJSON-813757709 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (98b3d3c3-daac-4d8d-911c-4c71e626e155) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:44:08 devstack cinder-volume[87444]: INFO cinder.volume.flows.manager.create_volume [None req-14463f85-b7ae-4631-8515-0c584da623b2 tempest-VolumesSnapshotListTestJSON-813757709 None] Volume volume-a1874d97-591e-46ff-9d77-4263321db1b6 (a1874d97-591e-46ff-9d77-4263321db1b6): created successfully Jul 10 04:44:08 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-14463f85-b7ae-4631-8515-0c584da623b2 tempest-VolumesSnapshotListTestJSON-813757709 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (98b3d3c3-daac-4d8d-911c-4c71e626e155) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:44:08 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-14463f85-b7ae-4631-8515-0c584da623b2 tempest-VolumesSnapshotListTestJSON-813757709 None] Flow 'volume_create_manager' (a619a1d7-061f-4997-8300-e4b73fdd9b2b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87444) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 04:44:08 devstack cinder-volume[87444]: INFO cinder.volume.manager [None req-14463f85-b7ae-4631-8515-0c584da623b2 tempest-VolumesSnapshotListTestJSON-813757709 None] Created volume successfully. Jul 10 04:44:09 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-52f8cafb-f0bb-4f6d-949f-e96870013b2c tempest-VolumesSnapshotListTestJSON-813757709 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 04:44:09 devstack sudo[97803]: pam_unix(sudo:session): session closed for user root Jul 10 04:44:09 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-410612be-b107-4d65-b6d4-de0a0a45bfef tempest-VolumesMetadataTest-509601608 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-0016c33e-4546-452b-97d5-9bace4ae7aad 1073741824" returned: 0 in 0.907s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:44:09 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-410612be-b107-4d65-b6d4-de0a0a45bfef tempest-VolumesMetadataTest-509601608 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-0016c33e-4546-452b-97d5-9bace4ae7aad {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:44:09 devstack sudo[97808]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-0016c33e-4546-452b-97d5-9bace4ae7aad Jul 10 04:44:09 devstack sudo[97808]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:44:10 devstack sudo[97808]: pam_unix(sudo:session): session closed for user root Jul 10 04:44:10 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-410612be-b107-4d65-b6d4-de0a0a45bfef tempest-VolumesMetadataTest-509601608 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-0016c33e-4546-452b-97d5-9bace4ae7aad" returned: 0 in 0.664s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:44:10 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-410612be-b107-4d65-b6d4-de0a0a45bfef tempest-VolumesMetadataTest-509601608 None] <== create_volume: return (1611ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922'} {{(pid=87444) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 04:44:10 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-410612be-b107-4d65-b6d4-de0a0a45bfef tempest-VolumesMetadataTest-509601608 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.618s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 04:44:10 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-8628aff5-63dd-43e1-a818-5df6f18e6944 tempest-TestMinimumBasicScenario-2101675754 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 8.932s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 04:44:10 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-8628aff5-63dd-43e1-a818-5df6f18e6944 tempest-TestMinimumBasicScenario-2101675754 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T02:44:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestMinimumBasicScenario-volume-597586752',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5f39620d-7980-4693-aaa0-c873a433f170,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='001cceb0d0fe404face959670fe53915',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T02:44:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T02:44:01Z,use_quota=True,user_id='1f5d8d706e1c40f89769e2044705bd28',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(317e369e-1e06-434d-ae95-a335f0e6c903),volume_type_id=317e369e-1e06-434d-ae95-a335f0e6c903)}" {{(pid=87444) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 04:44:10 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.remotefs [None req-8628aff5-63dd-43e1-a818-5df6f18e6944 tempest-TestMinimumBasicScenario-2101675754 None] Creating volume 5f39620d-7980-4693-aaa0-c873a433f170 {{(pid=87444) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 04:44:10 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-8628aff5-63dd-43e1-a818-5df6f18e6944 tempest-TestMinimumBasicScenario-2101675754 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 04:44:10 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-8628aff5-63dd-43e1-a818-5df6f18e6944 tempest-TestMinimumBasicScenario-2101675754 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 04:44:10 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-8628aff5-63dd-43e1-a818-5df6f18e6944 tempest-TestMinimumBasicScenario-2101675754 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922': None} {{(pid=87444) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 04:44:10 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-8628aff5-63dd-43e1-a818-5df6f18e6944 tempest-TestMinimumBasicScenario-2101675754 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922'] {{(pid=87444) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 04:44:10 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-8628aff5-63dd-43e1-a818-5df6f18e6944 tempest-TestMinimumBasicScenario-2101675754 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 04:44:10 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-8628aff5-63dd-43e1-a818-5df6f18e6944 tempest-TestMinimumBasicScenario-2101675754 None] Selected osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922 as target Quobyte volume. {{(pid=87444) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 04:44:10 devstack cinder-volume[87444]: INFO cinder.volume.drivers.remotefs [None req-8628aff5-63dd-43e1-a818-5df6f18e6944 tempest-TestMinimumBasicScenario-2101675754 None] casted to osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922 Jul 10 04:44:10 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-8628aff5-63dd-43e1-a818-5df6f18e6944 tempest-TestMinimumBasicScenario-2101675754 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-5f39620d-7980-4693-aaa0-c873a433f170 1073741824 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:44:10 devstack sudo[97825]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-5f39620d-7980-4693-aaa0-c873a433f170 1073741824 Jul 10 04:44:10 devstack sudo[97825]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:44:10 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-410612be-b107-4d65-b6d4-de0a0a45bfef tempest-VolumesMetadataTest-509601608 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fc37d554-ae45-471c-a25c-062f3d01f511) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0016c33e-4546-452b-97d5-9bace4ae7aad', 'volume_size': 1}' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:44:10 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-410612be-b107-4d65-b6d4-de0a0a45bfef tempest-VolumesMetadataTest-509601608 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7051829a-3778-48af-bbad-9e6035435ef8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:44:10 devstack cinder-volume[87444]: INFO cinder.volume.flows.manager.create_volume [None req-410612be-b107-4d65-b6d4-de0a0a45bfef tempest-VolumesMetadataTest-509601608 None] Volume volume-0016c33e-4546-452b-97d5-9bace4ae7aad (0016c33e-4546-452b-97d5-9bace4ae7aad): created successfully Jul 10 04:44:10 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-410612be-b107-4d65-b6d4-de0a0a45bfef tempest-VolumesMetadataTest-509601608 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7051829a-3778-48af-bbad-9e6035435ef8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:44:10 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-410612be-b107-4d65-b6d4-de0a0a45bfef tempest-VolumesMetadataTest-509601608 None] Flow 'volume_create_manager' (3bf8ec16-6739-417a-a490-f8e5639c9751) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87444) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 04:44:10 devstack cinder-volume[87444]: INFO cinder.volume.manager [None req-410612be-b107-4d65-b6d4-de0a0a45bfef tempest-VolumesMetadataTest-509601608 None] Created volume successfully. Jul 10 04:44:11 devstack sudo[97825]: pam_unix(sudo:session): session closed for user root Jul 10 04:44:11 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-8628aff5-63dd-43e1-a818-5df6f18e6944 tempest-TestMinimumBasicScenario-2101675754 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-5f39620d-7980-4693-aaa0-c873a433f170 1073741824" returned: 0 in 0.870s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:44:11 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-8628aff5-63dd-43e1-a818-5df6f18e6944 tempest-TestMinimumBasicScenario-2101675754 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-5f39620d-7980-4693-aaa0-c873a433f170 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:44:11 devstack sudo[97832]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-5f39620d-7980-4693-aaa0-c873a433f170 Jul 10 04:44:11 devstack sudo[97832]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:44:11 devstack sudo[97832]: pam_unix(sudo:session): session closed for user root Jul 10 04:44:11 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-8628aff5-63dd-43e1-a818-5df6f18e6944 tempest-TestMinimumBasicScenario-2101675754 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-5f39620d-7980-4693-aaa0-c873a433f170" returned: 0 in 0.678s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:44:11 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-8628aff5-63dd-43e1-a818-5df6f18e6944 tempest-TestMinimumBasicScenario-2101675754 None] <== create_volume: return (1589ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922'} {{(pid=87444) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 04:44:11 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-8628aff5-63dd-43e1-a818-5df6f18e6944 tempest-TestMinimumBasicScenario-2101675754 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.592s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 04:44:11 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-60b161b0-9ec1-4e57-9353-782d0cd00b4b tempest-VolumesActionsTest-532776818 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 3.523s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 04:44:11 devstack cinder-volume[87444]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e941c0c-1459-4692-8f2e-0324fc348ad9]: (4, 'qcow2') {{(pid=88499) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 04:44:11 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-60b161b0-9ec1-4e57-9353-782d0cd00b4b tempest-VolumesActionsTest-532776818 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-14eaa034-13c6-4839-956c-d2befd0d4d8d {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:44:11 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-8628aff5-63dd-43e1-a818-5df6f18e6944 tempest-TestMinimumBasicScenario-2101675754 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b689f5dc-a67b-4533-9201-587b92c65f40) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5f39620d-7980-4693-aaa0-c873a433f170', 'volume_size': 1}' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:44:11 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-8628aff5-63dd-43e1-a818-5df6f18e6944 tempest-TestMinimumBasicScenario-2101675754 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6058342f-4393-475a-b955-084b88b2b0a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:44:11 devstack cinder-volume[87444]: INFO cinder.volume.flows.manager.create_volume [None req-8628aff5-63dd-43e1-a818-5df6f18e6944 tempest-TestMinimumBasicScenario-2101675754 None] Volume volume-5f39620d-7980-4693-aaa0-c873a433f170 (5f39620d-7980-4693-aaa0-c873a433f170): created successfully Jul 10 04:44:11 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-8628aff5-63dd-43e1-a818-5df6f18e6944 tempest-TestMinimumBasicScenario-2101675754 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6058342f-4393-475a-b955-084b88b2b0a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:44:11 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-8628aff5-63dd-43e1-a818-5df6f18e6944 tempest-TestMinimumBasicScenario-2101675754 None] Flow 'volume_create_manager' (b1d7270d-ae9f-499c-86ae-cb1ffe5e8190) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87444) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 04:44:11 devstack cinder-volume[87444]: INFO cinder.volume.manager [None req-8628aff5-63dd-43e1-a818-5df6f18e6944 tempest-TestMinimumBasicScenario-2101675754 None] Created volume successfully. Jul 10 04:44:11 devstack sudo[97835]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-14eaa034-13c6-4839-956c-d2befd0d4d8d Jul 10 04:44:11 devstack sudo[97835]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:44:11 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-04acc97a-d42b-4dea-84f0-9af6da2e4bab tempest-VolumesMetadataTest-509601608 None] Acquiring lock "cinder-0016c33e-4546-452b-97d5-9bace4ae7aad-delete_volume" by "delete_volume" {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 04:44:11 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-04acc97a-d42b-4dea-84f0-9af6da2e4bab tempest-VolumesMetadataTest-509601608 None] Lock "cinder-0016c33e-4546-452b-97d5-9bace4ae7aad-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 04:44:11 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-04acc97a-d42b-4dea-84f0-9af6da2e4bab tempest-VolumesMetadataTest-509601608 None] Acquiring lock "cinder-quobyte-0016c33e-4546-452b-97d5-9bace4ae7aad" by "delete_volume" {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 04:44:12 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-04acc97a-d42b-4dea-84f0-9af6da2e4bab tempest-VolumesMetadataTest-509601608 None] Lock "cinder-quobyte-0016c33e-4546-452b-97d5-9bace4ae7aad" acquired by "delete_volume" :: waited 0.016s {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 04:44:12 devstack cinder-volume[87444]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f3d8352-2492-456f-8649-71b36b7049f0]: (4, 'qcow2') {{(pid=88499) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 04:44:12 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-04acc97a-d42b-4dea-84f0-9af6da2e4bab tempest-VolumesMetadataTest-509601608 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-0016c33e-4546-452b-97d5-9bace4ae7aad {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:44:12 devstack sudo[97837]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-0016c33e-4546-452b-97d5-9bace4ae7aad Jul 10 04:44:12 devstack sudo[97837]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:44:12 devstack sudo[97835]: pam_unix(sudo:session): session closed for user root Jul 10 04:44:12 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-60b161b0-9ec1-4e57-9353-782d0cd00b4b tempest-VolumesActionsTest-532776818 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-14eaa034-13c6-4839-956c-d2befd0d4d8d" returned: 0 in 0.790s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:44:12 devstack cinder-volume[87444]: DEBUG oslo.privsep.daemon [-] privsep: reply[c864d95a-6a3d-42c2-924f-e6de5b5ece6e]: (4, 'qcow2') {{(pid=88499) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 04:44:12 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-60b161b0-9ec1-4e57-9353-782d0cd00b4b tempest-VolumesActionsTest-532776818 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-14eaa034-13c6-4839-956c-d2befd0d4d8d {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:44:12 devstack sudo[97842]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-14eaa034-13c6-4839-956c-d2befd0d4d8d Jul 10 04:44:12 devstack sudo[97842]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:44:12 devstack sudo[97837]: pam_unix(sudo:session): session closed for user root Jul 10 04:44:12 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-04acc97a-d42b-4dea-84f0-9af6da2e4bab tempest-VolumesMetadataTest-509601608 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-0016c33e-4546-452b-97d5-9bace4ae7aad" returned: 0 in 0.812s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:44:12 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-04acc97a-d42b-4dea-84f0-9af6da2e4bab tempest-VolumesMetadataTest-509601608 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-0016c33e-4546-452b-97d5-9bace4ae7aad {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:44:12 devstack sudo[97847]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-0016c33e-4546-452b-97d5-9bace4ae7aad Jul 10 04:44:12 devstack sudo[97847]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:44:13 devstack sudo[97842]: pam_unix(sudo:session): session closed for user root Jul 10 04:44:13 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-60b161b0-9ec1-4e57-9353-782d0cd00b4b tempest-VolumesActionsTest-532776818 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-14eaa034-13c6-4839-956c-d2befd0d4d8d" returned: 0 in 0.812s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:44:13 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-60b161b0-9ec1-4e57-9353-782d0cd00b4b tempest-VolumesActionsTest-532776818 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-14eaa034-13c6-4839-956c-d2befd0d4d8d /opt/stack/data/cinder/conversion/14eaa034-13c6-4839-956c-d2befd0d4d8d.temp_image.614b8c32-4093-4d1d-9791-ce72129afacbecqe6r_w.img {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:44:13 devstack sudo[97857]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-14eaa034-13c6-4839-956c-d2befd0d4d8d /opt/stack/data/cinder/conversion/14eaa034-13c6-4839-956c-d2befd0d4d8d.temp_image.614b8c32-4093-4d1d-9791-ce72129afacbecqe6r_w.img Jul 10 04:44:13 devstack sudo[97857]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:44:13 devstack sudo[97847]: pam_unix(sudo:session): session closed for user root Jul 10 04:44:13 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-04acc97a-d42b-4dea-84f0-9af6da2e4bab tempest-VolumesMetadataTest-509601608 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-0016c33e-4546-452b-97d5-9bace4ae7aad" returned: 0 in 0.648s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:44:13 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-04acc97a-d42b-4dea-84f0-9af6da2e4bab tempest-VolumesMetadataTest-509601608 None] Lock "cinder-quobyte-0016c33e-4546-452b-97d5-9bace4ae7aad" released by "delete_volume" :: held 1.504s {{(pid=87444) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 04:44:13 devstack cinder-volume[87444]: DEBUG cinder.quota [None req-04acc97a-d42b-4dea-84f0-9af6da2e4bab tempest-VolumesMetadataTest-509601608 None] Created reservations ['a42e047b-acd4-4811-9ca8-63e9ee5950a8', '85d1246a-140c-44c7-bce4-99db7b6e996c', 'b2b7c017-2f65-456c-8427-fd9e7862cc2f', '13ccefd2-0a30-420f-a729-cb53f6a8d61f'] {{(pid=87444) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 04:44:13 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-04acc97a-d42b-4dea-84f0-9af6da2e4bab tempest-VolumesMetadataTest-509601608 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 04:44:13 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-04acc97a-d42b-4dea-84f0-9af6da2e4bab tempest-VolumesMetadataTest-509601608 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 04:44:13 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-04acc97a-d42b-4dea-84f0-9af6da2e4bab tempest-VolumesMetadataTest-509601608 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922': None} {{(pid=87444) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 04:44:13 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-04acc97a-d42b-4dea-84f0-9af6da2e4bab tempest-VolumesMetadataTest-509601608 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922'] {{(pid=87444) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 04:44:13 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-04acc97a-d42b-4dea-84f0-9af6da2e4bab tempest-VolumesMetadataTest-509601608 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 04:44:13 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-04acc97a-d42b-4dea-84f0-9af6da2e4bab tempest-VolumesMetadataTest-509601608 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:44:13 devstack sudo[97859]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097 Jul 10 04:44:13 devstack sudo[97859]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:44:14 devstack sudo[97859]: pam_unix(sudo:session): session closed for user root Jul 10 04:44:14 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-04acc97a-d42b-4dea-84f0-9af6da2e4bab tempest-VolumesMetadataTest-509601608 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097" returned: 0 in 0.855s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:44:14 devstack cinder-volume[87444]: DEBUG cinder.manager [None req-04acc97a-d42b-4dea-84f0-9af6da2e4bab tempest-VolumesMetadataTest-509601608 None] Notifying Schedulers of capabilities ... {{(pid=87444) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 04:44:14 devstack cinder-volume[87444]: INFO cinder.volume.manager [None req-04acc97a-d42b-4dea-84f0-9af6da2e4bab tempest-VolumesMetadataTest-509601608 None] Deleted volume successfully. Jul 10 04:44:14 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-04acc97a-d42b-4dea-84f0-9af6da2e4bab tempest-VolumesMetadataTest-509601608 None] Lock "cinder-0016c33e-4546-452b-97d5-9bace4ae7aad-delete_volume" released by "delete_volume" :: held 2.646s {{(pid=87444) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 04:44:17 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [req-99f264c8-b8eb-4b94-9273-809a1b7ecd89 req-9e461bbf-19df-4f74-a922-70f4700cfc0e tempest-TestMinimumBasicScenario-2101675754 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 04:44:18 devstack sudo[97857]: pam_unix(sudo:session): session closed for user root Jul 10 04:44:18 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-60b161b0-9ec1-4e57-9353-782d0cd00b4b tempest-VolumesActionsTest-532776818 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-14eaa034-13c6-4839-956c-d2befd0d4d8d /opt/stack/data/cinder/conversion/14eaa034-13c6-4839-956c-d2befd0d4d8d.temp_image.614b8c32-4093-4d1d-9791-ce72129afacbecqe6r_w.img" returned: 0 in 5.489s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:44:18 devstack cinder-volume[87444]: DEBUG oslo.privsep.daemon [-] privsep: reply[37b2f81a-8398-4a7f-8146-b143929abca1]: (4, 'qcow2') {{(pid=88499) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 04:44:18 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-60b161b0-9ec1-4e57-9353-782d0cd00b4b tempest-VolumesActionsTest-532776818 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-14eaa034-13c6-4839-956c-d2befd0d4d8d {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:44:19 devstack sudo[97882]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-14eaa034-13c6-4839-956c-d2befd0d4d8d Jul 10 04:44:19 devstack sudo[97882]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:44:19 devstack sudo[97882]: pam_unix(sudo:session): session closed for user root Jul 10 04:44:19 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-60b161b0-9ec1-4e57-9353-782d0cd00b4b tempest-VolumesActionsTest-532776818 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-14eaa034-13c6-4839-956c-d2befd0d4d8d" returned: 0 in 1.082s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:44:19 devstack cinder-volume[87444]: DEBUG cinder.image.image_utils [None req-60b161b0-9ec1-4e57-9353-782d0cd00b4b tempest-VolumesActionsTest-532776818 None] Image conversion details: src /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-14eaa034-13c6-4839-956c-d2befd0d4d8d, size 1024.00 MB, duration 5.49 sec, destination /opt/stack/data/cinder/conversion/14eaa034-13c6-4839-956c-d2befd0d4d8d.temp_image.614b8c32-4093-4d1d-9791-ce72129afacbecqe6r_w.img {{(pid=87444) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:561}} Jul 10 04:44:19 devstack cinder-volume[87444]: INFO cinder.image.image_utils [None req-60b161b0-9ec1-4e57-9353-782d0cd00b4b tempest-VolumesActionsTest-532776818 None] Converted 1024.00 MB image at 186.51 MB/s Jul 10 04:44:19 devstack cinder-volume[87444]: DEBUG cinder.image.image_utils [None req-60b161b0-9ec1-4e57-9353-782d0cd00b4b tempest-VolumesActionsTest-532776818 None] 614b8c32-4093-4d1d-9791-ce72129afacb was raw, converting to qcow2 {{(pid=87444) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1209}} Jul 10 04:44:20 devstack cinder-volume[87444]: DEBUG oslo.privsep.daemon [-] privsep: reply[e34e8387-cdfb-4a43-9b00-51ea5189d6fb]: (4, 'raw') {{(pid=88499) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 04:44:20 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-60b161b0-9ec1-4e57-9353-782d0cd00b4b tempest-VolumesActionsTest-532776818 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/14eaa034-13c6-4839-956c-d2befd0d4d8d.temp_image.614b8c32-4093-4d1d-9791-ce72129afacbecqe6r_w.img {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:44:20 devstack sudo[97887]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/14eaa034-13c6-4839-956c-d2befd0d4d8d.temp_image.614b8c32-4093-4d1d-9791-ce72129afacbecqe6r_w.img Jul 10 04:44:20 devstack sudo[97887]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:44:20 devstack sudo[97887]: pam_unix(sudo:session): session closed for user root Jul 10 04:44:20 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-60b161b0-9ec1-4e57-9353-782d0cd00b4b tempest-VolumesActionsTest-532776818 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/14eaa034-13c6-4839-956c-d2befd0d4d8d.temp_image.614b8c32-4093-4d1d-9791-ce72129afacbecqe6r_w.img" returned: 0 in 0.743s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:44:20 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-60b161b0-9ec1-4e57-9353-782d0cd00b4b tempest-VolumesActionsTest-532776818 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/14eaa034-13c6-4839-956c-d2befd0d4d8d.temp_image.614b8c32-4093-4d1d-9791-ce72129afacbecqe6r_w.img {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:44:20 devstack sudo[97891]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/14eaa034-13c6-4839-956c-d2befd0d4d8d.temp_image.614b8c32-4093-4d1d-9791-ce72129afacbecqe6r_w.img Jul 10 04:44:20 devstack sudo[97891]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:44:21 devstack cinder-volume[87444]: DEBUG cinder.volume.flows.manager.create_volume [None req-aee19970-db2f-46f7-b951-ef06aa5738ca tempest-VolumesTransfersTest-1211214858 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87444) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 04:44:21 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-aee19970-db2f-46f7-b951-ef06aa5738ca tempest-VolumesTransfersTest-1211214858 None] Flow 'volume_create_manager' (f6174efe-d45a-4eb5-aa49-ac418ea6010b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 04:44:21 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-aee19970-db2f-46f7-b951-ef06aa5738ca tempest-VolumesTransfersTest-1211214858 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4b839200-906f-4c16-ab7d-8ef89b04f8c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:44:21 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-aee19970-db2f-46f7-b951-ef06aa5738ca tempest-VolumesTransfersTest-1211214858 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4b839200-906f-4c16-ab7d-8ef89b04f8c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T02:44:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-556624212',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ca359181-05a0-47c6-a8ab-f18504228e70,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2f865f0b496d4e21b0c2ad5693a6366d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T02:44:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T02:44:21Z,use_quota=True,user_id='0909583f356842d1937f4a044f44fc71',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(317e369e-1e06-434d-ae95-a335f0e6c903),volume_type_id=317e369e-1e06-434d-ae95-a335f0e6c903)' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:44:21 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-aee19970-db2f-46f7-b951-ef06aa5738ca tempest-VolumesTransfersTest-1211214858 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8df876cb-b9f1-438a-872c-3049bbe84e00) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:44:21 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-aee19970-db2f-46f7-b951-ef06aa5738ca tempest-VolumesTransfersTest-1211214858 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8df876cb-b9f1-438a-872c-3049bbe84e00) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:44:21 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-aee19970-db2f-46f7-b951-ef06aa5738ca tempest-VolumesTransfersTest-1211214858 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (daae8619-b226-4daa-b23e-5514681b9ce6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:44:21 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-aee19970-db2f-46f7-b951-ef06aa5738ca tempest-VolumesTransfersTest-1211214858 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (daae8619-b226-4daa-b23e-5514681b9ce6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ca359181-05a0-47c6-a8ab-f18504228e70', 'volume_name': 'volume-ca359181-05a0-47c6-a8ab-f18504228e70', 'volume_size': 1}' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:44:21 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-aee19970-db2f-46f7-b951-ef06aa5738ca tempest-VolumesTransfersTest-1211214858 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4498d572-4f6e-494c-b6de-96212b4de4f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:44:21 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-aee19970-db2f-46f7-b951-ef06aa5738ca tempest-VolumesTransfersTest-1211214858 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4498d572-4f6e-494c-b6de-96212b4de4f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:44:21 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-aee19970-db2f-46f7-b951-ef06aa5738ca tempest-VolumesTransfersTest-1211214858 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f39c5dff-b912-4c58-a724-548e6fa7f6e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:44:21 devstack cinder-volume[87444]: INFO cinder.volume.flows.manager.create_volume [None req-aee19970-db2f-46f7-b951-ef06aa5738ca tempest-VolumesTransfersTest-1211214858 None] Volume ca359181-05a0-47c6-a8ab-f18504228e70: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ca359181-05a0-47c6-a8ab-f18504228e70', 'volume_size': 1} Jul 10 04:44:21 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-aee19970-db2f-46f7-b951-ef06aa5738ca tempest-VolumesTransfersTest-1211214858 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 04:44:21 devstack sudo[97891]: pam_unix(sudo:session): session closed for user root Jul 10 04:44:21 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-60b161b0-9ec1-4e57-9353-782d0cd00b4b tempest-VolumesActionsTest-532776818 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/14eaa034-13c6-4839-956c-d2befd0d4d8d.temp_image.614b8c32-4093-4d1d-9791-ce72129afacbecqe6r_w.img" returned: 1 in 0.754s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:44:21 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-60b161b0-9ec1-4e57-9353-782d0cd00b4b tempest-VolumesActionsTest-532776818 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/14eaa034-13c6-4839-956c-d2befd0d4d8d.temp_image.614b8c32-4093-4d1d-9791-ce72129afacbecqe6r_w.img' failed. Not Retrying. {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 10 04:44:21 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-60b161b0-9ec1-4e57-9353-782d0cd00b4b tempest-VolumesActionsTest-532776818 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/14eaa034-13c6-4839-956c-d2befd0d4d8d.temp_image.614b8c32-4093-4d1d-9791-ce72129afacbecqe6r_w.img /opt/stack/data/cinder/conversion/vol_upload_lbp8igkk {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:44:21 devstack sudo[97896]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/14eaa034-13c6-4839-956c-d2befd0d4d8d.temp_image.614b8c32-4093-4d1d-9791-ce72129afacbecqe6r_w.img /opt/stack/data/cinder/conversion/vol_upload_lbp8igkk Jul 10 04:44:21 devstack sudo[97896]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:44:22 devstack sudo[97896]: pam_unix(sudo:session): session closed for user root Jul 10 04:44:22 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-60b161b0-9ec1-4e57-9353-782d0cd00b4b tempest-VolumesActionsTest-532776818 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/14eaa034-13c6-4839-956c-d2befd0d4d8d.temp_image.614b8c32-4093-4d1d-9791-ce72129afacbecqe6r_w.img /opt/stack/data/cinder/conversion/vol_upload_lbp8igkk" returned: 0 in 0.673s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:44:22 devstack cinder-volume[87444]: DEBUG cinder.image.image_utils [None req-60b161b0-9ec1-4e57-9353-782d0cd00b4b tempest-VolumesActionsTest-532776818 None] Image conversion details: src /opt/stack/data/cinder/conversion/14eaa034-13c6-4839-956c-d2befd0d4d8d.temp_image.614b8c32-4093-4d1d-9791-ce72129afacbecqe6r_w.img, size 1024.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/conversion/vol_upload_lbp8igkk {{(pid=87444) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:561}} Jul 10 04:44:22 devstack cinder-volume[87444]: INFO cinder.image.image_utils [None req-60b161b0-9ec1-4e57-9353-782d0cd00b4b tempest-VolumesActionsTest-532776818 None] Converted 1024.00 MB image at 1024.00 MB/s Jul 10 04:44:22 devstack cinder-volume[87444]: DEBUG oslo.privsep.daemon [-] privsep: reply[124caa30-0666-4384-b818-e0f849980695]: (4, 'qcow2') {{(pid=88499) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 04:44:22 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-60b161b0-9ec1-4e57-9353-782d0cd00b4b tempest-VolumesActionsTest-532776818 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_lbp8igkk {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:44:22 devstack sudo[97901]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_lbp8igkk Jul 10 04:44:22 devstack sudo[97901]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:44:22 devstack sudo[97901]: pam_unix(sudo:session): session closed for user root Jul 10 04:44:22 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-60b161b0-9ec1-4e57-9353-782d0cd00b4b tempest-VolumesActionsTest-532776818 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_lbp8igkk" returned: 0 in 0.719s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:44:24 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-60b161b0-9ec1-4e57-9353-782d0cd00b4b tempest-VolumesActionsTest-532776818 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 12.516s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 04:44:24 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-60b161b0-9ec1-4e57-9353-782d0cd00b4b tempest-VolumesActionsTest-532776818 None] Uploaded volume to glance image-id: 614b8c32-4093-4d1d-9791-ce72129afacb. {{(pid=87444) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}} Jul 10 04:44:24 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-52f8cafb-f0bb-4f6d-949f-e96870013b2c tempest-VolumesSnapshotListTestJSON-813757709 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 15.103s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 04:44:24 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.remotefs [None req-52f8cafb-f0bb-4f6d-949f-e96870013b2c tempest-VolumesSnapshotListTestJSON-813757709 None] Creating offline snapshot f952da89-cc16-4789-964f-a9c4b60360df of volume a1874d97-591e-46ff-9d77-4263321db1b6 {{(pid=87444) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 10 04:44:24 devstack cinder-volume[87444]: INFO cinder.volume.manager [None req-60b161b0-9ec1-4e57-9353-782d0cd00b4b tempest-VolumesActionsTest-532776818 None] Copy volume to image completed successfully. Jul 10 04:44:24 devstack cinder-volume[87444]: DEBUG oslo.privsep.daemon [-] privsep: reply[42f3df8c-d359-4b1d-b97e-6a8935b52b2d]: (4, 'qcow2') {{(pid=88499) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 04:44:24 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-52f8cafb-f0bb-4f6d-949f-e96870013b2c tempest-VolumesSnapshotListTestJSON-813757709 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-a1874d97-591e-46ff-9d77-4263321db1b6 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:44:24 devstack sudo[97907]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-a1874d97-591e-46ff-9d77-4263321db1b6 Jul 10 04:44:24 devstack sudo[97907]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:44:25 devstack sudo[97907]: pam_unix(sudo:session): session closed for user root Jul 10 04:44:25 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-52f8cafb-f0bb-4f6d-949f-e96870013b2c tempest-VolumesSnapshotListTestJSON-813757709 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-a1874d97-591e-46ff-9d77-4263321db1b6" returned: 0 in 0.761s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:44:25 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-52f8cafb-f0bb-4f6d-949f-e96870013b2c tempest-VolumesSnapshotListTestJSON-813757709 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-a1874d97-591e-46ff-9d77-4263321db1b6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-a1874d97-591e-46ff-9d77-4263321db1b6.f952da89-cc16-4789-964f-a9c4b60360df 1G {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:44:25 devstack sudo[97912]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-a1874d97-591e-46ff-9d77-4263321db1b6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-a1874d97-591e-46ff-9d77-4263321db1b6.f952da89-cc16-4789-964f-a9c4b60360df 1G Jul 10 04:44:25 devstack sudo[97912]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:44:25 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-bb2a1322-7a6c-4771-8ff9-d59d54e171cc tempest-VolumesActionsTest-532776818 None] Acquiring lock "cinder-14eaa034-13c6-4839-956c-d2befd0d4d8d-delete_volume" by "delete_volume" {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 04:44:25 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-bb2a1322-7a6c-4771-8ff9-d59d54e171cc tempest-VolumesActionsTest-532776818 None] Lock "cinder-14eaa034-13c6-4839-956c-d2befd0d4d8d-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 04:44:25 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-bb2a1322-7a6c-4771-8ff9-d59d54e171cc tempest-VolumesActionsTest-532776818 None] Acquiring lock "cinder-quobyte-14eaa034-13c6-4839-956c-d2befd0d4d8d" by "delete_volume" {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 04:44:25 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-bb2a1322-7a6c-4771-8ff9-d59d54e171cc tempest-VolumesActionsTest-532776818 None] Lock "cinder-quobyte-14eaa034-13c6-4839-956c-d2befd0d4d8d" acquired by "delete_volume" :: waited 0.014s {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 04:44:25 devstack cinder-volume[87444]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d418899-6f2f-4f54-afb9-70f00114c832]: (4, 'qcow2') {{(pid=88499) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 04:44:25 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-bb2a1322-7a6c-4771-8ff9-d59d54e171cc tempest-VolumesActionsTest-532776818 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-14eaa034-13c6-4839-956c-d2befd0d4d8d {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:44:25 devstack sudo[97918]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-14eaa034-13c6-4839-956c-d2befd0d4d8d Jul 10 04:44:25 devstack sudo[97918]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:44:25 devstack sudo[97912]: pam_unix(sudo:session): session closed for user root Jul 10 04:44:25 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-52f8cafb-f0bb-4f6d-949f-e96870013b2c tempest-VolumesSnapshotListTestJSON-813757709 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-a1874d97-591e-46ff-9d77-4263321db1b6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-a1874d97-591e-46ff-9d77-4263321db1b6.f952da89-cc16-4789-964f-a9c4b60360df 1G" returned: 0 in 0.887s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:44:25 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-52f8cafb-f0bb-4f6d-949f-e96870013b2c tempest-VolumesSnapshotListTestJSON-813757709 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a1874d97-591e-46ff-9d77-4263321db1b6 -F qcow2 /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-a1874d97-591e-46ff-9d77-4263321db1b6.f952da89-cc16-4789-964f-a9c4b60360df {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:44:25 devstack sudo[97920]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a1874d97-591e-46ff-9d77-4263321db1b6 -F qcow2 /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-a1874d97-591e-46ff-9d77-4263321db1b6.f952da89-cc16-4789-964f-a9c4b60360df Jul 10 04:44:25 devstack sudo[97920]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:44:26 devstack sudo[97918]: pam_unix(sudo:session): session closed for user root Jul 10 04:44:26 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-bb2a1322-7a6c-4771-8ff9-d59d54e171cc tempest-VolumesActionsTest-532776818 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-14eaa034-13c6-4839-956c-d2befd0d4d8d" returned: 0 in 0.858s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:44:26 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-bb2a1322-7a6c-4771-8ff9-d59d54e171cc tempest-VolumesActionsTest-532776818 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-14eaa034-13c6-4839-956c-d2befd0d4d8d {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:44:26 devstack sudo[97928]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-14eaa034-13c6-4839-956c-d2befd0d4d8d Jul 10 04:44:26 devstack sudo[97928]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:44:26 devstack sudo[97920]: pam_unix(sudo:session): session closed for user root Jul 10 04:44:26 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-52f8cafb-f0bb-4f6d-949f-e96870013b2c tempest-VolumesSnapshotListTestJSON-813757709 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a1874d97-591e-46ff-9d77-4263321db1b6 -F qcow2 /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-a1874d97-591e-46ff-9d77-4263321db1b6.f952da89-cc16-4789-964f-a9c4b60360df" returned: 0 in 0.731s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:44:26 devstack cinder-volume[87444]: WARNING cinder.volume.drivers.remotefs [None req-52f8cafb-f0bb-4f6d-949f-e96870013b2c tempest-VolumesSnapshotListTestJSON-813757709 None] /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-a1874d97-591e-46ff-9d77-4263321db1b6.f952da89-cc16-4789-964f-a9c4b60360df is being set with open permissions: ugo+rw Jul 10 04:44:26 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-52f8cafb-f0bb-4f6d-949f-e96870013b2c tempest-VolumesSnapshotListTestJSON-813757709 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-a1874d97-591e-46ff-9d77-4263321db1b6.f952da89-cc16-4789-964f-a9c4b60360df {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:44:26 devstack sudo[97930]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-a1874d97-591e-46ff-9d77-4263321db1b6.f952da89-cc16-4789-964f-a9c4b60360df Jul 10 04:44:26 devstack sudo[97930]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:44:27 devstack sudo[97928]: pam_unix(sudo:session): session closed for user root Jul 10 04:44:27 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-bb2a1322-7a6c-4771-8ff9-d59d54e171cc tempest-VolumesActionsTest-532776818 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-14eaa034-13c6-4839-956c-d2befd0d4d8d" returned: 0 in 0.651s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:44:27 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-bb2a1322-7a6c-4771-8ff9-d59d54e171cc tempest-VolumesActionsTest-532776818 None] Lock "cinder-quobyte-14eaa034-13c6-4839-956c-d2befd0d4d8d" released by "delete_volume" :: held 1.553s {{(pid=87444) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 04:44:27 devstack cinder-volume[87444]: DEBUG cinder.quota [None req-bb2a1322-7a6c-4771-8ff9-d59d54e171cc tempest-VolumesActionsTest-532776818 None] Created reservations ['638130ee-5cb4-4ac2-ba88-2e0b8d8c7d8f', 'ab667e0e-c6a1-46fb-bc8b-d3209a9022a2', '390faa35-7281-4641-aa72-4ea8a6c685bc', '72925e1f-1586-4ede-b4a6-e86ca6b36fd6'] {{(pid=87444) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 04:44:27 devstack sudo[97930]: pam_unix(sudo:session): session closed for user root Jul 10 04:44:27 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-52f8cafb-f0bb-4f6d-949f-e96870013b2c tempest-VolumesSnapshotListTestJSON-813757709 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-a1874d97-591e-46ff-9d77-4263321db1b6.f952da89-cc16-4789-964f-a9c4b60360df" returned: 0 in 0.660s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:44:27 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-52f8cafb-f0bb-4f6d-949f-e96870013b2c tempest-VolumesSnapshotListTestJSON-813757709 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-a1874d97-591e-46ff-9d77-4263321db1b6.info {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:44:27 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-bb2a1322-7a6c-4771-8ff9-d59d54e171cc tempest-VolumesActionsTest-532776818 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 04:44:27 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-bb2a1322-7a6c-4771-8ff9-d59d54e171cc tempest-VolumesActionsTest-532776818 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 04:44:27 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-bb2a1322-7a6c-4771-8ff9-d59d54e171cc tempest-VolumesActionsTest-532776818 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922': None} {{(pid=87444) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 04:44:27 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-bb2a1322-7a6c-4771-8ff9-d59d54e171cc tempest-VolumesActionsTest-532776818 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922'] {{(pid=87444) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 04:44:27 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-bb2a1322-7a6c-4771-8ff9-d59d54e171cc tempest-VolumesActionsTest-532776818 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 04:44:27 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-bb2a1322-7a6c-4771-8ff9-d59d54e171cc tempest-VolumesActionsTest-532776818 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:44:27 devstack sudo[97934]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-a1874d97-591e-46ff-9d77-4263321db1b6.info Jul 10 04:44:27 devstack sudo[97934]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:44:27 devstack sudo[97935]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097 Jul 10 04:44:27 devstack sudo[97935]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:44:28 devstack sudo[97934]: pam_unix(sudo:session): session closed for user root Jul 10 04:44:28 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-52f8cafb-f0bb-4f6d-949f-e96870013b2c tempest-VolumesSnapshotListTestJSON-813757709 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-a1874d97-591e-46ff-9d77-4263321db1b6.info" returned: 0 in 0.668s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:44:28 devstack sudo[97935]: pam_unix(sudo:session): session closed for user root Jul 10 04:44:28 devstack cinder-volume[87444]: WARNING cinder.volume.drivers.remotefs [None req-52f8cafb-f0bb-4f6d-949f-e96870013b2c tempest-VolumesSnapshotListTestJSON-813757709 None] /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-a1874d97-591e-46ff-9d77-4263321db1b6.info is being set with open permissions: ugo+rw Jul 10 04:44:28 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-52f8cafb-f0bb-4f6d-949f-e96870013b2c tempest-VolumesSnapshotListTestJSON-813757709 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-a1874d97-591e-46ff-9d77-4263321db1b6.info {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:44:28 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-bb2a1322-7a6c-4771-8ff9-d59d54e171cc tempest-VolumesActionsTest-532776818 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097" returned: 0 in 0.661s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:44:28 devstack cinder-volume[87444]: DEBUG cinder.manager [None req-bb2a1322-7a6c-4771-8ff9-d59d54e171cc tempest-VolumesActionsTest-532776818 None] Notifying Schedulers of capabilities ... {{(pid=87444) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 04:44:28 devstack cinder-volume[87444]: INFO cinder.volume.manager [None req-bb2a1322-7a6c-4771-8ff9-d59d54e171cc tempest-VolumesActionsTest-532776818 None] Deleted volume successfully. Jul 10 04:44:28 devstack sudo[97940]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-a1874d97-591e-46ff-9d77-4263321db1b6.info Jul 10 04:44:28 devstack sudo[97940]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:44:28 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-bb2a1322-7a6c-4771-8ff9-d59d54e171cc tempest-VolumesActionsTest-532776818 None] Lock "cinder-14eaa034-13c6-4839-956c-d2befd0d4d8d-delete_volume" released by "delete_volume" :: held 2.442s {{(pid=87444) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 04:44:28 devstack sudo[97940]: pam_unix(sudo:session): session closed for user root Jul 10 04:44:28 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-52f8cafb-f0bb-4f6d-949f-e96870013b2c tempest-VolumesSnapshotListTestJSON-813757709 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-a1874d97-591e-46ff-9d77-4263321db1b6.info" returned: 0 in 0.679s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:44:28 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-52f8cafb-f0bb-4f6d-949f-e96870013b2c tempest-VolumesSnapshotListTestJSON-813757709 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.494s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 04:44:28 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [req-99f264c8-b8eb-4b94-9273-809a1b7ecd89 req-9e461bbf-19df-4f74-a922-70f4700cfc0e tempest-TestMinimumBasicScenario-2101675754 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 11.309s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 04:44:28 devstack cinder-volume[87444]: DEBUG oslo.privsep.daemon [-] privsep: reply[9fad764e-3344-423b-b140-e5da9824495a]: (4, 'qcow2') {{(pid=88499) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 04:44:28 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [req-99f264c8-b8eb-4b94-9273-809a1b7ecd89 req-9e461bbf-19df-4f74-a922-70f4700cfc0e tempest-TestMinimumBasicScenario-2101675754 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-5f39620d-7980-4693-aaa0-c873a433f170 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:44:28 devstack cinder-volume[87444]: INFO cinder.volume.manager [None req-52f8cafb-f0bb-4f6d-949f-e96870013b2c tempest-VolumesSnapshotListTestJSON-813757709 None] Create snapshot completed successfully Jul 10 04:44:28 devstack sudo[97943]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-5f39620d-7980-4693-aaa0-c873a433f170 Jul 10 04:44:28 devstack sudo[97943]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:44:29 devstack sudo[97943]: pam_unix(sudo:session): session closed for user root Jul 10 04:44:29 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-a934287c-05ea-4b62-95d0-5c595f34908b tempest-VolumesSnapshotListTestJSON-813757709 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 04:44:29 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [req-99f264c8-b8eb-4b94-9273-809a1b7ecd89 req-9e461bbf-19df-4f74-a922-70f4700cfc0e tempest-TestMinimumBasicScenario-2101675754 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-5f39620d-7980-4693-aaa0-c873a433f170" returned: 0 in 0.832s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:44:29 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [req-99f264c8-b8eb-4b94-9273-809a1b7ecd89 req-9e461bbf-19df-4f74-a922-70f4700cfc0e tempest-TestMinimumBasicScenario-2101675754 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.852s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 04:44:29 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-aee19970-db2f-46f7-b951-ef06aa5738ca tempest-VolumesTransfersTest-1211214858 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 8.274s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 04:44:29 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-aee19970-db2f-46f7-b951-ef06aa5738ca tempest-VolumesTransfersTest-1211214858 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T02:44:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-556624212',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ca359181-05a0-47c6-a8ab-f18504228e70,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2f865f0b496d4e21b0c2ad5693a6366d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T02:44:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T02:44:21Z,use_quota=True,user_id='0909583f356842d1937f4a044f44fc71',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(317e369e-1e06-434d-ae95-a335f0e6c903),volume_type_id=317e369e-1e06-434d-ae95-a335f0e6c903)}" {{(pid=87444) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 04:44:29 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.remotefs [None req-aee19970-db2f-46f7-b951-ef06aa5738ca tempest-VolumesTransfersTest-1211214858 None] Creating volume ca359181-05a0-47c6-a8ab-f18504228e70 {{(pid=87444) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 04:44:29 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-aee19970-db2f-46f7-b951-ef06aa5738ca tempest-VolumesTransfersTest-1211214858 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 04:44:29 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-aee19970-db2f-46f7-b951-ef06aa5738ca tempest-VolumesTransfersTest-1211214858 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 04:44:29 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-aee19970-db2f-46f7-b951-ef06aa5738ca tempest-VolumesTransfersTest-1211214858 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922': None} {{(pid=87444) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 04:44:29 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-aee19970-db2f-46f7-b951-ef06aa5738ca tempest-VolumesTransfersTest-1211214858 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922'] {{(pid=87444) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 04:44:29 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-aee19970-db2f-46f7-b951-ef06aa5738ca tempest-VolumesTransfersTest-1211214858 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 04:44:29 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-aee19970-db2f-46f7-b951-ef06aa5738ca tempest-VolumesTransfersTest-1211214858 None] Selected osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922 as target Quobyte volume. {{(pid=87444) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 04:44:29 devstack cinder-volume[87444]: INFO cinder.volume.drivers.remotefs [None req-aee19970-db2f-46f7-b951-ef06aa5738ca tempest-VolumesTransfersTest-1211214858 None] casted to osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922 Jul 10 04:44:29 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-aee19970-db2f-46f7-b951-ef06aa5738ca tempest-VolumesTransfersTest-1211214858 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-ca359181-05a0-47c6-a8ab-f18504228e70 1073741824 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:44:29 devstack sudo[97949]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-ca359181-05a0-47c6-a8ab-f18504228e70 1073741824 Jul 10 04:44:29 devstack sudo[97949]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:44:29 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [req-99f264c8-b8eb-4b94-9273-809a1b7ecd89 req-9e461bbf-19df-4f74-a922-70f4700cfc0e tempest-TestMinimumBasicScenario-2101675754 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922', 'name': 'volume-5f39620d-7980-4693-aaa0-c873a433f170', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '8175c77b-a505-4f41-ab5f-2fc086ba6f6d', 'enforce_multipath': True} {{(pid=87444) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 10 04:44:29 devstack cinder-volume[87444]: INFO cinder.volume.manager [req-99f264c8-b8eb-4b94-9273-809a1b7ecd89 req-9e461bbf-19df-4f74-a922-70f4700cfc0e tempest-TestMinimumBasicScenario-2101675754 None] attachment_update completed successfully. Jul 10 04:44:30 devstack sudo[97949]: pam_unix(sudo:session): session closed for user root Jul 10 04:44:30 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-aee19970-db2f-46f7-b951-ef06aa5738ca tempest-VolumesTransfersTest-1211214858 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-ca359181-05a0-47c6-a8ab-f18504228e70 1073741824" returned: 0 in 0.915s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:44:30 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-aee19970-db2f-46f7-b951-ef06aa5738ca tempest-VolumesTransfersTest-1211214858 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-ca359181-05a0-47c6-a8ab-f18504228e70 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:44:30 devstack sudo[98021]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-ca359181-05a0-47c6-a8ab-f18504228e70 Jul 10 04:44:30 devstack sudo[98021]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:44:31 devstack sudo[98021]: pam_unix(sudo:session): session closed for user root Jul 10 04:44:31 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-aee19970-db2f-46f7-b951-ef06aa5738ca tempest-VolumesTransfersTest-1211214858 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-ca359181-05a0-47c6-a8ab-f18504228e70" returned: 0 in 0.816s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:44:31 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-aee19970-db2f-46f7-b951-ef06aa5738ca tempest-VolumesTransfersTest-1211214858 None] <== create_volume: return (1791ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922'} {{(pid=87444) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 04:44:31 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-aee19970-db2f-46f7-b951-ef06aa5738ca tempest-VolumesTransfersTest-1211214858 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.794s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 04:44:31 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-a934287c-05ea-4b62-95d0-5c595f34908b tempest-VolumesSnapshotListTestJSON-813757709 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.806s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 04:44:31 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-aee19970-db2f-46f7-b951-ef06aa5738ca tempest-VolumesTransfersTest-1211214858 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f39c5dff-b912-4c58-a724-548e6fa7f6e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ca359181-05a0-47c6-a8ab-f18504228e70', 'volume_size': 1}' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:44:31 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-aee19970-db2f-46f7-b951-ef06aa5738ca tempest-VolumesTransfersTest-1211214858 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cc79230a-b945-475d-89cb-7dcf25c3f9e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:44:31 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.remotefs [None req-a934287c-05ea-4b62-95d0-5c595f34908b tempest-VolumesSnapshotListTestJSON-813757709 None] Creating offline snapshot c24bebff-30b5-4f88-873f-89e3467dfe50 of volume a1874d97-591e-46ff-9d77-4263321db1b6 {{(pid=87444) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 10 04:44:31 devstack cinder-volume[87444]: INFO cinder.volume.flows.manager.create_volume [None req-aee19970-db2f-46f7-b951-ef06aa5738ca tempest-VolumesTransfersTest-1211214858 None] Volume volume-ca359181-05a0-47c6-a8ab-f18504228e70 (ca359181-05a0-47c6-a8ab-f18504228e70): created successfully Jul 10 04:44:31 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-aee19970-db2f-46f7-b951-ef06aa5738ca tempest-VolumesTransfersTest-1211214858 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cc79230a-b945-475d-89cb-7dcf25c3f9e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:44:31 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-aee19970-db2f-46f7-b951-ef06aa5738ca tempest-VolumesTransfersTest-1211214858 None] Flow 'volume_create_manager' (f6174efe-d45a-4eb5-aa49-ac418ea6010b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87444) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 04:44:31 devstack cinder-volume[87444]: DEBUG oslo.privsep.daemon [-] privsep: reply[42a8d8a4-bfa8-4f58-9439-dd0eca8e8c2d]: (4, 'qcow2') {{(pid=88499) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 04:44:31 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-a934287c-05ea-4b62-95d0-5c595f34908b tempest-VolumesSnapshotListTestJSON-813757709 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-a1874d97-591e-46ff-9d77-4263321db1b6.f952da89-cc16-4789-964f-a9c4b60360df {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:44:31 devstack cinder-volume[87444]: INFO cinder.volume.manager [None req-aee19970-db2f-46f7-b951-ef06aa5738ca tempest-VolumesTransfersTest-1211214858 None] Created volume successfully. Jul 10 04:44:31 devstack sudo[98340]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-a1874d97-591e-46ff-9d77-4263321db1b6.f952da89-cc16-4789-964f-a9c4b60360df Jul 10 04:44:31 devstack sudo[98340]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:44:32 devstack sudo[98340]: pam_unix(sudo:session): session closed for user root Jul 10 04:44:32 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-a934287c-05ea-4b62-95d0-5c595f34908b tempest-VolumesSnapshotListTestJSON-813757709 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-a1874d97-591e-46ff-9d77-4263321db1b6.f952da89-cc16-4789-964f-a9c4b60360df" returned: 0 in 0.874s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:44:32 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.remotefs [None req-a934287c-05ea-4b62-95d0-5c595f34908b tempest-VolumesSnapshotListTestJSON-813757709 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a1874d97-591e-46ff-9d77-4263321db1b6(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87444) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 10 04:44:32 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-a934287c-05ea-4b62-95d0-5c595f34908b tempest-VolumesSnapshotListTestJSON-813757709 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-a1874d97-591e-46ff-9d77-4263321db1b6.f952da89-cc16-4789-964f-a9c4b60360df,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-a1874d97-591e-46ff-9d77-4263321db1b6.c24bebff-30b5-4f88-873f-89e3467dfe50 1G {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:44:32 devstack sudo[98380]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-a1874d97-591e-46ff-9d77-4263321db1b6.f952da89-cc16-4789-964f-a9c4b60360df,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-a1874d97-591e-46ff-9d77-4263321db1b6.c24bebff-30b5-4f88-873f-89e3467dfe50 1G Jul 10 04:44:32 devstack sudo[98380]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:44:32 devstack cinder-volume[87444]: INFO cinder.volume.manager [None req-e7868cb1-944e-424a-8f5e-b14b288e27a7 tempest-VolumesTransfersTest-431857035 None] Transfer volume completed successfully. Jul 10 04:44:32 devstack cinder-volume[87444]: DEBUG oslo_service.periodic_task [None req-01f0ce3e-6850-4e14-881d-e40d3c4ad6e5 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87444) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 10 04:44:32 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-01f0ce3e-6850-4e14-881d-e40d3c4ad6e5 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 04:44:32 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-01f0ce3e-6850-4e14-881d-e40d3c4ad6e5 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 04:44:32 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-01f0ce3e-6850-4e14-881d-e40d3c4ad6e5 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922': None} {{(pid=87444) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 04:44:33 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-01f0ce3e-6850-4e14-881d-e40d3c4ad6e5 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922'] {{(pid=87444) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 04:44:33 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-01f0ce3e-6850-4e14-881d-e40d3c4ad6e5 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 04:44:33 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-01f0ce3e-6850-4e14-881d-e40d3c4ad6e5 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:44:33 devstack sudo[98384]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097 Jul 10 04:44:33 devstack sudo[98384]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:44:33 devstack sudo[98380]: pam_unix(sudo:session): session closed for user root Jul 10 04:44:33 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-a934287c-05ea-4b62-95d0-5c595f34908b tempest-VolumesSnapshotListTestJSON-813757709 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-a1874d97-591e-46ff-9d77-4263321db1b6.f952da89-cc16-4789-964f-a9c4b60360df,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-a1874d97-591e-46ff-9d77-4263321db1b6.c24bebff-30b5-4f88-873f-89e3467dfe50 1G" returned: 0 in 0.996s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:44:33 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-a934287c-05ea-4b62-95d0-5c595f34908b tempest-VolumesSnapshotListTestJSON-813757709 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a1874d97-591e-46ff-9d77-4263321db1b6.f952da89-cc16-4789-964f-a9c4b60360df -F qcow2 /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-a1874d97-591e-46ff-9d77-4263321db1b6.c24bebff-30b5-4f88-873f-89e3467dfe50 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:44:33 devstack sudo[98390]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a1874d97-591e-46ff-9d77-4263321db1b6.f952da89-cc16-4789-964f-a9c4b60360df -F qcow2 /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-a1874d97-591e-46ff-9d77-4263321db1b6.c24bebff-30b5-4f88-873f-89e3467dfe50 Jul 10 04:44:33 devstack sudo[98390]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:44:33 devstack sudo[98384]: pam_unix(sudo:session): session closed for user root Jul 10 04:44:33 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-01f0ce3e-6850-4e14-881d-e40d3c4ad6e5 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097" returned: 0 in 0.770s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:44:33 devstack cinder-volume[87444]: DEBUG cinder.manager [None req-01f0ce3e-6850-4e14-881d-e40d3c4ad6e5 None None] Notifying Schedulers of capabilities ... {{(pid=87444) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 04:44:33 devstack cinder-volume[87444]: DEBUG oslo_service.periodic_task [None req-01f0ce3e-6850-4e14-881d-e40d3c4ad6e5 None None] Running periodic task VolumeManager._thread_info {{(pid=87444) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 10 04:44:33 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-01f0ce3e-6850-4e14-881d-e40d3c4ad6e5 None None] thread count: 28 {{(pid=87444) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 10 04:44:33 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-01f0ce3e-6850-4e14-881d-e40d3c4ad6e5 None None] thread info: [<_MainThread(MainThread, started 126839257915520)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87444) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 10 04:44:34 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-e9693ae6-5944-4152-82f5-27b17bbf637f tempest-VolumesTransfersTest-1640061394 None] Acquiring lock "cinder-ca359181-05a0-47c6-a8ab-f18504228e70-delete_volume" by "delete_volume" {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 04:44:34 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-e9693ae6-5944-4152-82f5-27b17bbf637f tempest-VolumesTransfersTest-1640061394 None] Lock "cinder-ca359181-05a0-47c6-a8ab-f18504228e70-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 04:44:34 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-e9693ae6-5944-4152-82f5-27b17bbf637f tempest-VolumesTransfersTest-1640061394 None] Acquiring lock "cinder-quobyte-ca359181-05a0-47c6-a8ab-f18504228e70" by "delete_volume" {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 04:44:34 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-e9693ae6-5944-4152-82f5-27b17bbf637f tempest-VolumesTransfersTest-1640061394 None] Lock "cinder-quobyte-ca359181-05a0-47c6-a8ab-f18504228e70" acquired by "delete_volume" :: waited 0.019s {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 04:44:34 devstack cinder-volume[87444]: DEBUG oslo.privsep.daemon [-] privsep: reply[9370e264-d397-4ddc-8723-3ab008dc108a]: (4, 'qcow2') {{(pid=88499) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 04:44:34 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-e9693ae6-5944-4152-82f5-27b17bbf637f tempest-VolumesTransfersTest-1640061394 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-ca359181-05a0-47c6-a8ab-f18504228e70 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:44:34 devstack sudo[98390]: pam_unix(sudo:session): session closed for user root Jul 10 04:44:34 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-a934287c-05ea-4b62-95d0-5c595f34908b tempest-VolumesSnapshotListTestJSON-813757709 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a1874d97-591e-46ff-9d77-4263321db1b6.f952da89-cc16-4789-964f-a9c4b60360df -F qcow2 /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-a1874d97-591e-46ff-9d77-4263321db1b6.c24bebff-30b5-4f88-873f-89e3467dfe50" returned: 0 in 0.862s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:44:34 devstack cinder-volume[87444]: WARNING cinder.volume.drivers.remotefs [None req-a934287c-05ea-4b62-95d0-5c595f34908b tempest-VolumesSnapshotListTestJSON-813757709 None] /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-a1874d97-591e-46ff-9d77-4263321db1b6.c24bebff-30b5-4f88-873f-89e3467dfe50 is being set with open permissions: ugo+rw Jul 10 04:44:34 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-a934287c-05ea-4b62-95d0-5c595f34908b tempest-VolumesSnapshotListTestJSON-813757709 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-a1874d97-591e-46ff-9d77-4263321db1b6.c24bebff-30b5-4f88-873f-89e3467dfe50 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:44:34 devstack sudo[98397]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-a1874d97-591e-46ff-9d77-4263321db1b6.c24bebff-30b5-4f88-873f-89e3467dfe50 Jul 10 04:44:34 devstack sudo[98397]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:44:34 devstack sudo[98396]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-ca359181-05a0-47c6-a8ab-f18504228e70 Jul 10 04:44:34 devstack sudo[98396]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:44:34 devstack cinder-volume[87444]: DEBUG cinder.volume.flows.manager.create_volume [None req-0dea4aeb-291b-48ee-a005-667abae7454b tempest-VolumesCloneNegativeTest-845102133 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87444) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 04:44:34 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-0dea4aeb-291b-48ee-a005-667abae7454b tempest-VolumesCloneNegativeTest-845102133 None] Flow 'volume_create_manager' (2199a27f-4a8e-4ed6-9e66-2f0fbe156fd9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 04:44:34 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-0dea4aeb-291b-48ee-a005-667abae7454b tempest-VolumesCloneNegativeTest-845102133 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (71ca88aa-0706-4a1e-948c-5f9c0c365f0a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:44:34 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-0dea4aeb-291b-48ee-a005-667abae7454b tempest-VolumesCloneNegativeTest-845102133 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (71ca88aa-0706-4a1e-948c-5f9c0c365f0a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T02:44:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-1253755513',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e53de457-472c-4659-885c-45b002b693c1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1d1e05bfdd364cd59c1e77655889541d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T02:44:35Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T02:44:35Z,use_quota=True,user_id='63f45621ebef4c0885720fce7a9fbcc1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(317e369e-1e06-434d-ae95-a335f0e6c903),volume_type_id=317e369e-1e06-434d-ae95-a335f0e6c903)' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:44:34 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-0dea4aeb-291b-48ee-a005-667abae7454b tempest-VolumesCloneNegativeTest-845102133 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9997fe91-9648-4c90-9ed4-a952ec789402) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:44:34 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-0dea4aeb-291b-48ee-a005-667abae7454b tempest-VolumesCloneNegativeTest-845102133 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9997fe91-9648-4c90-9ed4-a952ec789402) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:44:34 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-0dea4aeb-291b-48ee-a005-667abae7454b tempest-VolumesCloneNegativeTest-845102133 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fbc33fc5-cff3-4058-a2d5-171351081db2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:44:34 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-0dea4aeb-291b-48ee-a005-667abae7454b tempest-VolumesCloneNegativeTest-845102133 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fbc33fc5-cff3-4058-a2d5-171351081db2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e53de457-472c-4659-885c-45b002b693c1', 'volume_name': 'volume-e53de457-472c-4659-885c-45b002b693c1', 'volume_size': 2}' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:44:34 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-0dea4aeb-291b-48ee-a005-667abae7454b tempest-VolumesCloneNegativeTest-845102133 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cb5c4a70-01cb-4d4d-b569-134023ee24a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:44:34 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-0dea4aeb-291b-48ee-a005-667abae7454b tempest-VolumesCloneNegativeTest-845102133 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cb5c4a70-01cb-4d4d-b569-134023ee24a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:44:34 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-0dea4aeb-291b-48ee-a005-667abae7454b tempest-VolumesCloneNegativeTest-845102133 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f26e54ab-b0e7-4db3-b8f3-8eff2b1130dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:44:34 devstack cinder-volume[87444]: INFO cinder.volume.flows.manager.create_volume [None req-0dea4aeb-291b-48ee-a005-667abae7454b tempest-VolumesCloneNegativeTest-845102133 None] Volume e53de457-472c-4659-885c-45b002b693c1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e53de457-472c-4659-885c-45b002b693c1', 'volume_size': 2} Jul 10 04:44:34 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-0dea4aeb-291b-48ee-a005-667abae7454b tempest-VolumesCloneNegativeTest-845102133 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 04:44:35 devstack sudo[98397]: pam_unix(sudo:session): session closed for user root Jul 10 04:44:35 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-a934287c-05ea-4b62-95d0-5c595f34908b tempest-VolumesSnapshotListTestJSON-813757709 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-a1874d97-591e-46ff-9d77-4263321db1b6.c24bebff-30b5-4f88-873f-89e3467dfe50" returned: 0 in 0.786s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:44:35 devstack sudo[98396]: pam_unix(sudo:session): session closed for user root Jul 10 04:44:35 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-a934287c-05ea-4b62-95d0-5c595f34908b tempest-VolumesSnapshotListTestJSON-813757709 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.704s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 04:44:35 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-0dea4aeb-291b-48ee-a005-667abae7454b tempest-VolumesCloneNegativeTest-845102133 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.454s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 04:44:35 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-0dea4aeb-291b-48ee-a005-667abae7454b tempest-VolumesCloneNegativeTest-845102133 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T02:44:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-1253755513',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e53de457-472c-4659-885c-45b002b693c1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1d1e05bfdd364cd59c1e77655889541d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T02:44:35Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T02:44:35Z,use_quota=True,user_id='63f45621ebef4c0885720fce7a9fbcc1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(317e369e-1e06-434d-ae95-a335f0e6c903),volume_type_id=317e369e-1e06-434d-ae95-a335f0e6c903)}" {{(pid=87444) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 04:44:35 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.remotefs [None req-0dea4aeb-291b-48ee-a005-667abae7454b tempest-VolumesCloneNegativeTest-845102133 None] Creating volume e53de457-472c-4659-885c-45b002b693c1 {{(pid=87444) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 04:44:35 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-0dea4aeb-291b-48ee-a005-667abae7454b tempest-VolumesCloneNegativeTest-845102133 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 04:44:35 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-0dea4aeb-291b-48ee-a005-667abae7454b tempest-VolumesCloneNegativeTest-845102133 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 04:44:35 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-0dea4aeb-291b-48ee-a005-667abae7454b tempest-VolumesCloneNegativeTest-845102133 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922': None} {{(pid=87444) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 04:44:35 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-0dea4aeb-291b-48ee-a005-667abae7454b tempest-VolumesCloneNegativeTest-845102133 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922'] {{(pid=87444) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 04:44:35 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-0dea4aeb-291b-48ee-a005-667abae7454b tempest-VolumesCloneNegativeTest-845102133 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 04:44:35 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-0dea4aeb-291b-48ee-a005-667abae7454b tempest-VolumesCloneNegativeTest-845102133 None] Selected osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922 as target Quobyte volume. {{(pid=87444) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 04:44:35 devstack cinder-volume[87444]: INFO cinder.volume.drivers.remotefs [None req-0dea4aeb-291b-48ee-a005-667abae7454b tempest-VolumesCloneNegativeTest-845102133 None] casted to osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922 Jul 10 04:44:35 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-0dea4aeb-291b-48ee-a005-667abae7454b tempest-VolumesCloneNegativeTest-845102133 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-e53de457-472c-4659-885c-45b002b693c1 2147483648 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:44:35 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-e9693ae6-5944-4152-82f5-27b17bbf637f tempest-VolumesTransfersTest-1640061394 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-ca359181-05a0-47c6-a8ab-f18504228e70" returned: 0 in 0.940s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:44:35 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-e9693ae6-5944-4152-82f5-27b17bbf637f tempest-VolumesTransfersTest-1640061394 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-ca359181-05a0-47c6-a8ab-f18504228e70 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:44:35 devstack sudo[98405]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-e53de457-472c-4659-885c-45b002b693c1 2147483648 Jul 10 04:44:35 devstack sudo[98405]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:44:35 devstack sudo[98406]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-ca359181-05a0-47c6-a8ab-f18504228e70 Jul 10 04:44:35 devstack sudo[98406]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:44:35 devstack cinder-volume[87444]: INFO cinder.volume.manager [None req-a934287c-05ea-4b62-95d0-5c595f34908b tempest-VolumesSnapshotListTestJSON-813757709 None] Create snapshot completed successfully Jul 10 04:44:35 devstack sudo[98406]: pam_unix(sudo:session): session closed for user root Jul 10 04:44:35 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-e9693ae6-5944-4152-82f5-27b17bbf637f tempest-VolumesTransfersTest-1640061394 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-ca359181-05a0-47c6-a8ab-f18504228e70" returned: 0 in 0.781s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:44:35 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-e9693ae6-5944-4152-82f5-27b17bbf637f tempest-VolumesTransfersTest-1640061394 None] Lock "cinder-quobyte-ca359181-05a0-47c6-a8ab-f18504228e70" released by "delete_volume" :: held 1.797s {{(pid=87444) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 04:44:36 devstack cinder-volume[87444]: DEBUG cinder.quota [None req-e9693ae6-5944-4152-82f5-27b17bbf637f tempest-VolumesTransfersTest-1640061394 None] Created reservations ['b20381fc-61f9-4ebc-89d8-7061f48152f8', '92e464ea-318f-4012-8102-54fef6954e45', '21af5fb0-e926-49ab-b88f-623930445591', '54bafd55-1e93-415b-a51f-e448cf337dc1'] {{(pid=87444) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 04:44:36 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-e9693ae6-5944-4152-82f5-27b17bbf637f tempest-VolumesTransfersTest-1640061394 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 04:44:36 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-e9693ae6-5944-4152-82f5-27b17bbf637f tempest-VolumesTransfersTest-1640061394 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 04:44:36 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-e9693ae6-5944-4152-82f5-27b17bbf637f tempest-VolumesTransfersTest-1640061394 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922': None} {{(pid=87444) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 04:44:36 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-e9693ae6-5944-4152-82f5-27b17bbf637f tempest-VolumesTransfersTest-1640061394 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922'] {{(pid=87444) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 04:44:36 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-e9693ae6-5944-4152-82f5-27b17bbf637f tempest-VolumesTransfersTest-1640061394 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 04:44:36 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-e9693ae6-5944-4152-82f5-27b17bbf637f tempest-VolumesTransfersTest-1640061394 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:44:36 devstack sudo[98422]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097 Jul 10 04:44:36 devstack sudo[98422]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:44:36 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-5d49368e-f676-458f-b02e-d07455d43899 tempest-VolumesSnapshotListTestJSON-813757709 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 04:44:36 devstack sudo[98405]: pam_unix(sudo:session): session closed for user root Jul 10 04:44:36 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-0dea4aeb-291b-48ee-a005-667abae7454b tempest-VolumesCloneNegativeTest-845102133 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-e53de457-472c-4659-885c-45b002b693c1 2147483648" returned: 0 in 1.165s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:44:36 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-0dea4aeb-291b-48ee-a005-667abae7454b tempest-VolumesCloneNegativeTest-845102133 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-e53de457-472c-4659-885c-45b002b693c1 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:44:36 devstack sudo[98424]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-e53de457-472c-4659-885c-45b002b693c1 Jul 10 04:44:36 devstack sudo[98424]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:44:37 devstack sudo[98422]: pam_unix(sudo:session): session closed for user root Jul 10 04:44:37 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-e9693ae6-5944-4152-82f5-27b17bbf637f tempest-VolumesTransfersTest-1640061394 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097" returned: 0 in 0.848s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:44:37 devstack cinder-volume[87444]: DEBUG cinder.manager [None req-e9693ae6-5944-4152-82f5-27b17bbf637f tempest-VolumesTransfersTest-1640061394 None] Notifying Schedulers of capabilities ... {{(pid=87444) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 04:44:37 devstack cinder-volume[87444]: INFO cinder.volume.manager [None req-e9693ae6-5944-4152-82f5-27b17bbf637f tempest-VolumesTransfersTest-1640061394 None] Deleted volume successfully. Jul 10 04:44:37 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-e9693ae6-5944-4152-82f5-27b17bbf637f tempest-VolumesTransfersTest-1640061394 None] Lock "cinder-ca359181-05a0-47c6-a8ab-f18504228e70-delete_volume" released by "delete_volume" :: held 2.988s {{(pid=87444) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 04:44:37 devstack cinder-volume[87444]: DEBUG cinder.volume.flows.manager.create_volume [None req-79606f4e-67d8-426a-9a0b-8fffb77ce744 tempest-VolumesTransfersTest-1211214858 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87444) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 04:44:37 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-79606f4e-67d8-426a-9a0b-8fffb77ce744 tempest-VolumesTransfersTest-1211214858 None] Flow 'volume_create_manager' (8d3c0dee-c2ba-4273-bd76-4f99c5e442b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 04:44:37 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-79606f4e-67d8-426a-9a0b-8fffb77ce744 tempest-VolumesTransfersTest-1211214858 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ea99b733-3d0a-4f69-ad27-4e00348aff9c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:44:37 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-79606f4e-67d8-426a-9a0b-8fffb77ce744 tempest-VolumesTransfersTest-1211214858 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ea99b733-3d0a-4f69-ad27-4e00348aff9c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T02:44:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-854779974',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=170e571d-82b2-4ff2-b0b6-fac5a57e4dd2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2f865f0b496d4e21b0c2ad5693a6366d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T02:44:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T02:44:37Z,use_quota=True,user_id='0909583f356842d1937f4a044f44fc71',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(317e369e-1e06-434d-ae95-a335f0e6c903),volume_type_id=317e369e-1e06-434d-ae95-a335f0e6c903)' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:44:37 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-79606f4e-67d8-426a-9a0b-8fffb77ce744 tempest-VolumesTransfersTest-1211214858 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (12909551-18df-41c3-a344-66124c815a00) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:44:37 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-79606f4e-67d8-426a-9a0b-8fffb77ce744 tempest-VolumesTransfersTest-1211214858 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (12909551-18df-41c3-a344-66124c815a00) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:44:37 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-79606f4e-67d8-426a-9a0b-8fffb77ce744 tempest-VolumesTransfersTest-1211214858 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (45bdca77-70e6-48b1-9217-c1a12a0cc591) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:44:37 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-79606f4e-67d8-426a-9a0b-8fffb77ce744 tempest-VolumesTransfersTest-1211214858 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (45bdca77-70e6-48b1-9217-c1a12a0cc591) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '170e571d-82b2-4ff2-b0b6-fac5a57e4dd2', 'volume_name': 'volume-170e571d-82b2-4ff2-b0b6-fac5a57e4dd2', 'volume_size': 1}' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:44:37 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-79606f4e-67d8-426a-9a0b-8fffb77ce744 tempest-VolumesTransfersTest-1211214858 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bb8a34bc-7921-43eb-9282-e2fd7d16f979) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:44:37 devstack sudo[98424]: pam_unix(sudo:session): session closed for user root Jul 10 04:44:37 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-79606f4e-67d8-426a-9a0b-8fffb77ce744 tempest-VolumesTransfersTest-1211214858 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bb8a34bc-7921-43eb-9282-e2fd7d16f979) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:44:37 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-79606f4e-67d8-426a-9a0b-8fffb77ce744 tempest-VolumesTransfersTest-1211214858 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7a16accc-4026-4676-9474-5e66f7a5c663) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:44:37 devstack cinder-volume[87444]: INFO cinder.volume.flows.manager.create_volume [None req-79606f4e-67d8-426a-9a0b-8fffb77ce744 tempest-VolumesTransfersTest-1211214858 None] Volume 170e571d-82b2-4ff2-b0b6-fac5a57e4dd2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-170e571d-82b2-4ff2-b0b6-fac5a57e4dd2', 'volume_size': 1} Jul 10 04:44:37 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-79606f4e-67d8-426a-9a0b-8fffb77ce744 tempest-VolumesTransfersTest-1211214858 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 04:44:37 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-0dea4aeb-291b-48ee-a005-667abae7454b tempest-VolumesCloneNegativeTest-845102133 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-e53de457-472c-4659-885c-45b002b693c1" returned: 0 in 0.971s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:44:37 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-0dea4aeb-291b-48ee-a005-667abae7454b tempest-VolumesCloneNegativeTest-845102133 None] <== create_volume: return (2179ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922'} {{(pid=87444) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 04:44:37 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-0dea4aeb-291b-48ee-a005-667abae7454b tempest-VolumesCloneNegativeTest-845102133 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.182s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 04:44:37 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-5d49368e-f676-458f-b02e-d07455d43899 tempest-VolumesSnapshotListTestJSON-813757709 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.036s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 04:44:37 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.remotefs [None req-5d49368e-f676-458f-b02e-d07455d43899 tempest-VolumesSnapshotListTestJSON-813757709 None] Creating offline snapshot cde30344-00ab-4243-90ac-c432cb3cd88e of volume a1874d97-591e-46ff-9d77-4263321db1b6 {{(pid=87444) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 10 04:44:37 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-0dea4aeb-291b-48ee-a005-667abae7454b tempest-VolumesCloneNegativeTest-845102133 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f26e54ab-b0e7-4db3-b8f3-8eff2b1130dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e53de457-472c-4659-885c-45b002b693c1', 'volume_size': 2}' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:44:37 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-0dea4aeb-291b-48ee-a005-667abae7454b tempest-VolumesCloneNegativeTest-845102133 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3c60b2b1-2022-4509-9c94-ff6a1488e411) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:44:37 devstack cinder-volume[87444]: DEBUG oslo.privsep.daemon [-] privsep: reply[9714a7b2-d8b5-4a31-9f25-33e1d5bd8f3b]: (4, 'qcow2') {{(pid=88499) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 04:44:37 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-5d49368e-f676-458f-b02e-d07455d43899 tempest-VolumesSnapshotListTestJSON-813757709 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-a1874d97-591e-46ff-9d77-4263321db1b6.c24bebff-30b5-4f88-873f-89e3467dfe50 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:44:37 devstack cinder-volume[87444]: INFO cinder.volume.flows.manager.create_volume [None req-0dea4aeb-291b-48ee-a005-667abae7454b tempest-VolumesCloneNegativeTest-845102133 None] Volume volume-e53de457-472c-4659-885c-45b002b693c1 (e53de457-472c-4659-885c-45b002b693c1): created successfully Jul 10 04:44:37 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-0dea4aeb-291b-48ee-a005-667abae7454b tempest-VolumesCloneNegativeTest-845102133 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3c60b2b1-2022-4509-9c94-ff6a1488e411) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:44:37 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-0dea4aeb-291b-48ee-a005-667abae7454b tempest-VolumesCloneNegativeTest-845102133 None] Flow 'volume_create_manager' (2199a27f-4a8e-4ed6-9e66-2f0fbe156fd9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87444) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 04:44:37 devstack cinder-volume[87444]: INFO cinder.volume.manager [None req-0dea4aeb-291b-48ee-a005-667abae7454b tempest-VolumesCloneNegativeTest-845102133 None] Created volume successfully. Jul 10 04:44:37 devstack sudo[98429]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-a1874d97-591e-46ff-9d77-4263321db1b6.c24bebff-30b5-4f88-873f-89e3467dfe50 Jul 10 04:44:37 devstack sudo[98429]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:44:38 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-79f422a2-3e2c-4886-afe0-befcbdf72388 tempest-VolumesCloneNegativeTest-845102133 None] Acquiring lock "cinder-e53de457-472c-4659-885c-45b002b693c1-delete_volume" by "delete_volume" {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 04:44:38 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-79f422a2-3e2c-4886-afe0-befcbdf72388 tempest-VolumesCloneNegativeTest-845102133 None] Lock "cinder-e53de457-472c-4659-885c-45b002b693c1-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 04:44:38 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-79f422a2-3e2c-4886-afe0-befcbdf72388 tempest-VolumesCloneNegativeTest-845102133 None] Acquiring lock "cinder-quobyte-e53de457-472c-4659-885c-45b002b693c1" by "delete_volume" {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 04:44:38 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-79f422a2-3e2c-4886-afe0-befcbdf72388 tempest-VolumesCloneNegativeTest-845102133 None] Lock "cinder-quobyte-e53de457-472c-4659-885c-45b002b693c1" acquired by "delete_volume" :: waited 0.023s {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 04:44:38 devstack cinder-volume[87444]: DEBUG oslo.privsep.daemon [-] privsep: reply[126ea1a2-20ed-466f-b9eb-f3eabeced2e4]: (4, 'qcow2') {{(pid=88499) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 04:44:38 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-79f422a2-3e2c-4886-afe0-befcbdf72388 tempest-VolumesCloneNegativeTest-845102133 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-e53de457-472c-4659-885c-45b002b693c1 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:44:38 devstack sudo[98432]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-e53de457-472c-4659-885c-45b002b693c1 Jul 10 04:44:38 devstack sudo[98432]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:44:38 devstack sudo[98429]: pam_unix(sudo:session): session closed for user root Jul 10 04:44:38 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-5d49368e-f676-458f-b02e-d07455d43899 tempest-VolumesSnapshotListTestJSON-813757709 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-a1874d97-591e-46ff-9d77-4263321db1b6.c24bebff-30b5-4f88-873f-89e3467dfe50" returned: 0 in 1.361s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:44:38 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.remotefs [None req-5d49368e-f676-458f-b02e-d07455d43899 tempest-VolumesSnapshotListTestJSON-813757709 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a1874d97-591e-46ff-9d77-4263321db1b6(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87444) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 10 04:44:38 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-5d49368e-f676-458f-b02e-d07455d43899 tempest-VolumesSnapshotListTestJSON-813757709 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-a1874d97-591e-46ff-9d77-4263321db1b6.c24bebff-30b5-4f88-873f-89e3467dfe50,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-a1874d97-591e-46ff-9d77-4263321db1b6.cde30344-00ab-4243-90ac-c432cb3cd88e 1G {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:44:38 devstack sudo[98437]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-a1874d97-591e-46ff-9d77-4263321db1b6.c24bebff-30b5-4f88-873f-89e3467dfe50,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-a1874d97-591e-46ff-9d77-4263321db1b6.cde30344-00ab-4243-90ac-c432cb3cd88e 1G Jul 10 04:44:38 devstack sudo[98437]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:44:39 devstack sudo[98432]: pam_unix(sudo:session): session closed for user root Jul 10 04:44:39 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-79f422a2-3e2c-4886-afe0-befcbdf72388 tempest-VolumesCloneNegativeTest-845102133 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-e53de457-472c-4659-885c-45b002b693c1" returned: 0 in 0.971s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:44:39 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-79f422a2-3e2c-4886-afe0-befcbdf72388 tempest-VolumesCloneNegativeTest-845102133 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-e53de457-472c-4659-885c-45b002b693c1 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:44:39 devstack sudo[98442]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-e53de457-472c-4659-885c-45b002b693c1 Jul 10 04:44:39 devstack sudo[98442]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:44:39 devstack sudo[98437]: pam_unix(sudo:session): session closed for user root Jul 10 04:44:39 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-5d49368e-f676-458f-b02e-d07455d43899 tempest-VolumesSnapshotListTestJSON-813757709 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-a1874d97-591e-46ff-9d77-4263321db1b6.c24bebff-30b5-4f88-873f-89e3467dfe50,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-a1874d97-591e-46ff-9d77-4263321db1b6.cde30344-00ab-4243-90ac-c432cb3cd88e 1G" returned: 0 in 1.127s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:44:39 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-5d49368e-f676-458f-b02e-d07455d43899 tempest-VolumesSnapshotListTestJSON-813757709 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a1874d97-591e-46ff-9d77-4263321db1b6.c24bebff-30b5-4f88-873f-89e3467dfe50 -F qcow2 /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-a1874d97-591e-46ff-9d77-4263321db1b6.cde30344-00ab-4243-90ac-c432cb3cd88e {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:44:39 devstack sudo[98442]: pam_unix(sudo:session): session closed for user root Jul 10 04:44:39 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-79f422a2-3e2c-4886-afe0-befcbdf72388 tempest-VolumesCloneNegativeTest-845102133 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-e53de457-472c-4659-885c-45b002b693c1" returned: 0 in 0.785s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:44:39 devstack sudo[98449]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a1874d97-591e-46ff-9d77-4263321db1b6.c24bebff-30b5-4f88-873f-89e3467dfe50 -F qcow2 /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-a1874d97-591e-46ff-9d77-4263321db1b6.cde30344-00ab-4243-90ac-c432cb3cd88e Jul 10 04:44:39 devstack sudo[98449]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:44:39 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-79f422a2-3e2c-4886-afe0-befcbdf72388 tempest-VolumesCloneNegativeTest-845102133 None] Lock "cinder-quobyte-e53de457-472c-4659-885c-45b002b693c1" released by "delete_volume" :: held 1.820s {{(pid=87444) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 04:44:40 devstack cinder-volume[87444]: DEBUG cinder.quota [None req-79f422a2-3e2c-4886-afe0-befcbdf72388 tempest-VolumesCloneNegativeTest-845102133 None] Created reservations ['92842575-ad4c-40ee-83f5-3ba665d70dad', 'bf4f5e65-e72f-413d-903f-d66542dde8d5', 'fb8be5a4-3186-4923-a55a-acce74b01563', '1312bc13-5254-45b6-9359-124d8732f593'] {{(pid=87444) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 04:44:40 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-79f422a2-3e2c-4886-afe0-befcbdf72388 tempest-VolumesCloneNegativeTest-845102133 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 04:44:40 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-79f422a2-3e2c-4886-afe0-befcbdf72388 tempest-VolumesCloneNegativeTest-845102133 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 04:44:40 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-79f422a2-3e2c-4886-afe0-befcbdf72388 tempest-VolumesCloneNegativeTest-845102133 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922': None} {{(pid=87444) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 04:44:40 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-79f422a2-3e2c-4886-afe0-befcbdf72388 tempest-VolumesCloneNegativeTest-845102133 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922'] {{(pid=87444) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 04:44:40 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-79f422a2-3e2c-4886-afe0-befcbdf72388 tempest-VolumesCloneNegativeTest-845102133 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 04:44:40 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-79f422a2-3e2c-4886-afe0-befcbdf72388 tempest-VolumesCloneNegativeTest-845102133 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:44:40 devstack sudo[98451]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097 Jul 10 04:44:40 devstack sudo[98451]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:44:40 devstack sudo[98449]: pam_unix(sudo:session): session closed for user root Jul 10 04:44:40 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-5d49368e-f676-458f-b02e-d07455d43899 tempest-VolumesSnapshotListTestJSON-813757709 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a1874d97-591e-46ff-9d77-4263321db1b6.c24bebff-30b5-4f88-873f-89e3467dfe50 -F qcow2 /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-a1874d97-591e-46ff-9d77-4263321db1b6.cde30344-00ab-4243-90ac-c432cb3cd88e" returned: 0 in 0.825s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:44:40 devstack cinder-volume[87444]: WARNING cinder.volume.drivers.remotefs [None req-5d49368e-f676-458f-b02e-d07455d43899 tempest-VolumesSnapshotListTestJSON-813757709 None] /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-a1874d97-591e-46ff-9d77-4263321db1b6.cde30344-00ab-4243-90ac-c432cb3cd88e is being set with open permissions: ugo+rw Jul 10 04:44:40 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-5d49368e-f676-458f-b02e-d07455d43899 tempest-VolumesSnapshotListTestJSON-813757709 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-a1874d97-591e-46ff-9d77-4263321db1b6.cde30344-00ab-4243-90ac-c432cb3cd88e {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:44:40 devstack sudo[98458]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-a1874d97-591e-46ff-9d77-4263321db1b6.cde30344-00ab-4243-90ac-c432cb3cd88e Jul 10 04:44:40 devstack sudo[98458]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:44:40 devstack sudo[98451]: pam_unix(sudo:session): session closed for user root Jul 10 04:44:40 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-79f422a2-3e2c-4886-afe0-befcbdf72388 tempest-VolumesCloneNegativeTest-845102133 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097" returned: 0 in 0.831s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:44:40 devstack cinder-volume[87444]: DEBUG cinder.manager [None req-79f422a2-3e2c-4886-afe0-befcbdf72388 tempest-VolumesCloneNegativeTest-845102133 None] Notifying Schedulers of capabilities ... {{(pid=87444) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 04:44:40 devstack cinder-volume[87444]: INFO cinder.volume.manager [None req-79f422a2-3e2c-4886-afe0-befcbdf72388 tempest-VolumesCloneNegativeTest-845102133 None] Deleted volume successfully. Jul 10 04:44:40 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-79f422a2-3e2c-4886-afe0-befcbdf72388 tempest-VolumesCloneNegativeTest-845102133 None] Lock "cinder-e53de457-472c-4659-885c-45b002b693c1-delete_volume" released by "delete_volume" :: held 2.937s {{(pid=87444) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 04:44:41 devstack sudo[98458]: pam_unix(sudo:session): session closed for user root Jul 10 04:44:41 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-5d49368e-f676-458f-b02e-d07455d43899 tempest-VolumesSnapshotListTestJSON-813757709 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-a1874d97-591e-46ff-9d77-4263321db1b6.cde30344-00ab-4243-90ac-c432cb3cd88e" returned: 0 in 0.748s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:44:41 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-5d49368e-f676-458f-b02e-d07455d43899 tempest-VolumesSnapshotListTestJSON-813757709 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.207s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 04:44:41 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-79606f4e-67d8-426a-9a0b-8fffb77ce744 tempest-VolumesTransfersTest-1211214858 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.219s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 04:44:41 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-79606f4e-67d8-426a-9a0b-8fffb77ce744 tempest-VolumesTransfersTest-1211214858 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T02:44:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-854779974',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=170e571d-82b2-4ff2-b0b6-fac5a57e4dd2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2f865f0b496d4e21b0c2ad5693a6366d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T02:44:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T02:44:37Z,use_quota=True,user_id='0909583f356842d1937f4a044f44fc71',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(317e369e-1e06-434d-ae95-a335f0e6c903),volume_type_id=317e369e-1e06-434d-ae95-a335f0e6c903)}" {{(pid=87444) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 04:44:41 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.remotefs [None req-79606f4e-67d8-426a-9a0b-8fffb77ce744 tempest-VolumesTransfersTest-1211214858 None] Creating volume 170e571d-82b2-4ff2-b0b6-fac5a57e4dd2 {{(pid=87444) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 04:44:41 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-79606f4e-67d8-426a-9a0b-8fffb77ce744 tempest-VolumesTransfersTest-1211214858 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 04:44:41 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-79606f4e-67d8-426a-9a0b-8fffb77ce744 tempest-VolumesTransfersTest-1211214858 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 04:44:41 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-79606f4e-67d8-426a-9a0b-8fffb77ce744 tempest-VolumesTransfersTest-1211214858 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922': None} {{(pid=87444) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 04:44:41 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-79606f4e-67d8-426a-9a0b-8fffb77ce744 tempest-VolumesTransfersTest-1211214858 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922'] {{(pid=87444) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 04:44:41 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-79606f4e-67d8-426a-9a0b-8fffb77ce744 tempest-VolumesTransfersTest-1211214858 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 04:44:41 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-79606f4e-67d8-426a-9a0b-8fffb77ce744 tempest-VolumesTransfersTest-1211214858 None] Selected osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922 as target Quobyte volume. {{(pid=87444) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 04:44:41 devstack cinder-volume[87444]: INFO cinder.volume.drivers.remotefs [None req-79606f4e-67d8-426a-9a0b-8fffb77ce744 tempest-VolumesTransfersTest-1211214858 None] casted to osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922 Jul 10 04:44:41 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-79606f4e-67d8-426a-9a0b-8fffb77ce744 tempest-VolumesTransfersTest-1211214858 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-170e571d-82b2-4ff2-b0b6-fac5a57e4dd2 1073741824 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:44:41 devstack sudo[98463]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-170e571d-82b2-4ff2-b0b6-fac5a57e4dd2 1073741824 Jul 10 04:44:41 devstack sudo[98463]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:44:41 devstack cinder-volume[87444]: INFO cinder.volume.manager [None req-5d49368e-f676-458f-b02e-d07455d43899 tempest-VolumesSnapshotListTestJSON-813757709 None] Create snapshot completed successfully Jul 10 04:44:42 devstack sudo[98463]: pam_unix(sudo:session): session closed for user root Jul 10 04:44:42 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-79606f4e-67d8-426a-9a0b-8fffb77ce744 tempest-VolumesTransfersTest-1211214858 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-170e571d-82b2-4ff2-b0b6-fac5a57e4dd2 1073741824" returned: 0 in 1.340s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:44:42 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-79606f4e-67d8-426a-9a0b-8fffb77ce744 tempest-VolumesTransfersTest-1211214858 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-170e571d-82b2-4ff2-b0b6-fac5a57e4dd2 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:44:42 devstack sudo[98471]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-170e571d-82b2-4ff2-b0b6-fac5a57e4dd2 Jul 10 04:44:42 devstack sudo[98471]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:44:43 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-33eecbbf-e04b-435c-8947-c036afcde69a tempest-VolumesSnapshotListTestJSON-813757709 None] Acquiring lock "cinder-cde30344-00ab-4243-90ac-c432cb3cd88e-delete_snapshot" by "delete_snapshot" {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 04:44:43 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-33eecbbf-e04b-435c-8947-c036afcde69a tempest-VolumesSnapshotListTestJSON-813757709 None] Lock "cinder-cde30344-00ab-4243-90ac-c432cb3cd88e-delete_snapshot" acquired by "delete_snapshot" :: waited 0.028s {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 04:44:43 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-33eecbbf-e04b-435c-8947-c036afcde69a tempest-VolumesSnapshotListTestJSON-813757709 None] Acquiring lock "cinder-quobyte-a1874d97-591e-46ff-9d77-4263321db1b6" by "delete_snapshot" {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 04:44:43 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-33eecbbf-e04b-435c-8947-c036afcde69a tempest-VolumesSnapshotListTestJSON-813757709 None] Lock "cinder-quobyte-a1874d97-591e-46ff-9d77-4263321db1b6" acquired by "delete_snapshot" :: waited 0.025s {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 04:44:43 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-33eecbbf-e04b-435c-8947-c036afcde69a tempest-VolumesSnapshotListTestJSON-813757709 None] Acquiring lock "cinder-quobyte-cde30344-00ab-4243-90ac-c432cb3cd88e" by "_delete_snapshot" {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 04:44:43 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-33eecbbf-e04b-435c-8947-c036afcde69a tempest-VolumesSnapshotListTestJSON-813757709 None] Lock "cinder-quobyte-cde30344-00ab-4243-90ac-c432cb3cd88e" acquired by "_delete_snapshot" :: waited 0.031s {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 04:44:43 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.remotefs [None req-33eecbbf-e04b-435c-8947-c036afcde69a tempest-VolumesSnapshotListTestJSON-813757709 None] Deleting offline snapshot cde30344-00ab-4243-90ac-c432cb3cd88e of volume a1874d97-591e-46ff-9d77-4263321db1b6 {{(pid=87444) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 10 04:44:43 devstack sudo[98471]: pam_unix(sudo:session): session closed for user root Jul 10 04:44:43 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.remotefs [None req-33eecbbf-e04b-435c-8947-c036afcde69a tempest-VolumesSnapshotListTestJSON-813757709 None] snapshot_file for this snap is: volume-a1874d97-591e-46ff-9d77-4263321db1b6.cde30344-00ab-4243-90ac-c432cb3cd88e {{(pid=87444) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 10 04:44:43 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-79606f4e-67d8-426a-9a0b-8fffb77ce744 tempest-VolumesTransfersTest-1211214858 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-170e571d-82b2-4ff2-b0b6-fac5a57e4dd2" returned: 0 in 0.798s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:44:43 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-79606f4e-67d8-426a-9a0b-8fffb77ce744 tempest-VolumesTransfersTest-1211214858 None] <== create_volume: return (2206ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922'} {{(pid=87444) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 04:44:43 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-79606f4e-67d8-426a-9a0b-8fffb77ce744 tempest-VolumesTransfersTest-1211214858 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.210s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 04:44:43 devstack cinder-volume[87444]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4cf35f8-f562-424b-b74a-e86d9c9d6d7b]: (4, 'qcow2') {{(pid=88499) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 04:44:43 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-33eecbbf-e04b-435c-8947-c036afcde69a tempest-VolumesSnapshotListTestJSON-813757709 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-a1874d97-591e-46ff-9d77-4263321db1b6.cde30344-00ab-4243-90ac-c432cb3cd88e {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:44:43 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-79606f4e-67d8-426a-9a0b-8fffb77ce744 tempest-VolumesTransfersTest-1211214858 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7a16accc-4026-4676-9474-5e66f7a5c663) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-170e571d-82b2-4ff2-b0b6-fac5a57e4dd2', 'volume_size': 1}' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:44:43 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-79606f4e-67d8-426a-9a0b-8fffb77ce744 tempest-VolumesTransfersTest-1211214858 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (14578e34-6d1b-4544-b5c2-92cb6c9f4173) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:44:43 devstack cinder-volume[87444]: INFO cinder.volume.flows.manager.create_volume [None req-79606f4e-67d8-426a-9a0b-8fffb77ce744 tempest-VolumesTransfersTest-1211214858 None] Volume volume-170e571d-82b2-4ff2-b0b6-fac5a57e4dd2 (170e571d-82b2-4ff2-b0b6-fac5a57e4dd2): created successfully Jul 10 04:44:43 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-79606f4e-67d8-426a-9a0b-8fffb77ce744 tempest-VolumesTransfersTest-1211214858 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (14578e34-6d1b-4544-b5c2-92cb6c9f4173) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:44:43 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-79606f4e-67d8-426a-9a0b-8fffb77ce744 tempest-VolumesTransfersTest-1211214858 None] Flow 'volume_create_manager' (8d3c0dee-c2ba-4273-bd76-4f99c5e442b8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87444) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 04:44:43 devstack cinder-volume[87444]: INFO cinder.volume.manager [None req-79606f4e-67d8-426a-9a0b-8fffb77ce744 tempest-VolumesTransfersTest-1211214858 None] Created volume successfully. Jul 10 04:44:43 devstack sudo[98475]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-a1874d97-591e-46ff-9d77-4263321db1b6.cde30344-00ab-4243-90ac-c432cb3cd88e Jul 10 04:44:43 devstack sudo[98475]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:44:44 devstack cinder-volume[87444]: DEBUG cinder.volume.flows.manager.create_volume [None req-ee5ea77a-71f4-4a3b-92b0-dfb9f3ca8e72 tempest-VolumesExtendTest-564624957 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87444) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 04:44:44 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-ee5ea77a-71f4-4a3b-92b0-dfb9f3ca8e72 tempest-VolumesExtendTest-564624957 None] Flow 'volume_create_manager' (fdd3b386-8306-420b-87e5-a4d5b9c9edf7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 04:44:44 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-ee5ea77a-71f4-4a3b-92b0-dfb9f3ca8e72 tempest-VolumesExtendTest-564624957 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (18a7d410-cc62-4932-bb37-23257049cb2d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:44:44 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-ee5ea77a-71f4-4a3b-92b0-dfb9f3ca8e72 tempest-VolumesExtendTest-564624957 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (18a7d410-cc62-4932-bb37-23257049cb2d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T02:44:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-800374874',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=222a08a6-db3d-47ef-928f-da61571b7262,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6bd98184f6244876b4ed95a08c59063f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T02:44:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T02:44:44Z,use_quota=True,user_id='b8c426901e684c64bb86939eeb86e678',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(317e369e-1e06-434d-ae95-a335f0e6c903),volume_type_id=317e369e-1e06-434d-ae95-a335f0e6c903)' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:44:44 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-ee5ea77a-71f4-4a3b-92b0-dfb9f3ca8e72 tempest-VolumesExtendTest-564624957 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (be4a8d8d-3117-451c-a299-4050d59290de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:44:44 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-ee5ea77a-71f4-4a3b-92b0-dfb9f3ca8e72 tempest-VolumesExtendTest-564624957 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (be4a8d8d-3117-451c-a299-4050d59290de) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:44:44 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-ee5ea77a-71f4-4a3b-92b0-dfb9f3ca8e72 tempest-VolumesExtendTest-564624957 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e454e521-8b9f-45cc-9c4e-6d9cbec5cc0e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:44:44 devstack cinder-volume[87444]: DEBUG cinder.image.glance [None req-ee5ea77a-71f4-4a3b-92b0-dfb9f3ca8e72 tempest-VolumesExtendTest-564624957 None] Creating Keystone auth plugin from conf {{(pid=87444) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jul 10 04:44:44 devstack sudo[98475]: pam_unix(sudo:session): session closed for user root Jul 10 04:44:44 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-33eecbbf-e04b-435c-8947-c036afcde69a tempest-VolumesSnapshotListTestJSON-813757709 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-a1874d97-591e-46ff-9d77-4263321db1b6.cde30344-00ab-4243-90ac-c432cb3cd88e" returned: 0 in 0.850s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:44:44 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.remotefs [None req-33eecbbf-e04b-435c-8947-c036afcde69a tempest-VolumesSnapshotListTestJSON-813757709 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a1874d97-591e-46ff-9d77-4263321db1b6(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87444) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 10 04:44:44 devstack cinder-volume[87444]: DEBUG oslo.privsep.daemon [-] privsep: reply[60f3d1d4-28da-498c-b060-74501203c8c9]: (4, 'qcow2') {{(pid=88499) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 04:44:44 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-33eecbbf-e04b-435c-8947-c036afcde69a tempest-VolumesSnapshotListTestJSON-813757709 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-a1874d97-591e-46ff-9d77-4263321db1b6.c24bebff-30b5-4f88-873f-89e3467dfe50 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:44:44 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-ee5ea77a-71f4-4a3b-92b0-dfb9f3ca8e72 tempest-VolumesExtendTest-564624957 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e454e521-8b9f-45cc-9c4e-6d9cbec5cc0e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '222a08a6-db3d-47ef-928f-da61571b7262', 'volume_name': 'volume-222a08a6-db3d-47ef-928f-da61571b7262', 'volume_size': 1, 'image_id': '5ac2ee4b-64bc-499a-b553-ae96ba343fc0', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/5ac2ee4b-64bc-499a-b553-ae96ba343fc0', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'ca4bb946b593473194351a84617cf92e', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '5ac2ee4b-64bc-499a-b553-ae96ba343fc0', 'created_at': datetime.datetime(2026, 7, 10, 2, 26, 36, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 10, 2, 26, 38, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/5ac2ee4b-64bc-499a-b553-ae96ba343fc0/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:44:44 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-ee5ea77a-71f4-4a3b-92b0-dfb9f3ca8e72 tempest-VolumesExtendTest-564624957 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (62f3f7c0-8573-47b5-8a2b-e0451ba4c52c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:44:44 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-ee5ea77a-71f4-4a3b-92b0-dfb9f3ca8e72 tempest-VolumesExtendTest-564624957 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (62f3f7c0-8573-47b5-8a2b-e0451ba4c52c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:44:44 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-ee5ea77a-71f4-4a3b-92b0-dfb9f3ca8e72 tempest-VolumesExtendTest-564624957 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4559b242-8956-49c4-82ba-7c8291de7d96) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:44:44 devstack cinder-volume[87444]: INFO cinder.volume.flows.manager.create_volume [None req-ee5ea77a-71f4-4a3b-92b0-dfb9f3ca8e72 tempest-VolumesExtendTest-564624957 None] Volume 222a08a6-db3d-47ef-928f-da61571b7262: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-222a08a6-db3d-47ef-928f-da61571b7262', 'volume_size': 1, 'image_id': '5ac2ee4b-64bc-499a-b553-ae96ba343fc0', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/5ac2ee4b-64bc-499a-b553-ae96ba343fc0', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'ca4bb946b593473194351a84617cf92e', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '5ac2ee4b-64bc-499a-b553-ae96ba343fc0', 'created_at': datetime.datetime(2026, 7, 10, 2, 26, 36, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 10, 2, 26, 38, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/5ac2ee4b-64bc-499a-b553-ae96ba343fc0/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Jul 10 04:44:44 devstack cinder-volume[87444]: DEBUG cinder.volume.flows.manager.create_volume [None req-ee5ea77a-71f4-4a3b-92b0-dfb9f3ca8e72 tempest-VolumesExtendTest-564624957 None] Trying to clone 222a08a6-db3d-47ef-928f-da61571b7262 from image 5ac2ee4b-64bc-499a-b553-ae96ba343fc0 at location (None, [{'url': 'file:///opt/stack/data/glance/images/5ac2ee4b-64bc-499a-b553-ae96ba343fc0', 'metadata': {}}]). {{(pid=87444) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jul 10 04:44:44 devstack sudo[98480]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-a1874d97-591e-46ff-9d77-4263321db1b6.c24bebff-30b5-4f88-873f-89e3467dfe50 Jul 10 04:44:44 devstack sudo[98480]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:44:45 devstack cinder-volume[87444]: DEBUG cinder.image.image_utils [None req-ee5ea77a-71f4-4a3b-92b0-dfb9f3ca8e72 tempest-VolumesExtendTest-564624957 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_5ac2ee4b-64bc-499a-b553-ae96ba343fc0_lk79n6ucdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=87444) fetch /opt/stack/cinder/cinder/image/image_utils.py:765}} Jul 10 04:44:45 devstack cinder-volume[87444]: INFO cinder.image.image_utils [None req-ee5ea77a-71f4-4a3b-92b0-dfb9f3ca8e72 tempest-VolumesExtendTest-564624957 None] Image download 20.69 MB at 20.69 MB/s Jul 10 04:44:45 devstack cinder-volume[87444]: DEBUG oslo.privsep.daemon [-] privsep: reply[3fa19726-69e5-42d7-a723-10ef75803105]: (4, 'qcow2') {{(pid=88499) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 04:44:45 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-ee5ea77a-71f4-4a3b-92b0-dfb9f3ca8e72 tempest-VolumesExtendTest-564624957 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_5ac2ee4b-64bc-499a-b553-ae96ba343fc0_lk79n6ucdevstack@QuobyteHD {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:44:45 devstack sudo[98483]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_5ac2ee4b-64bc-499a-b553-ae96ba343fc0_lk79n6ucdevstack@QuobyteHD Jul 10 04:44:45 devstack sudo[98483]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:44:45 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-de50f907-eb6c-407f-8ee8-8397ad94d1e3 tempest-VolumesTransfersTest-1640061394 None] Acquiring lock "cinder-170e571d-82b2-4ff2-b0b6-fac5a57e4dd2-delete_volume" by "delete_volume" {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 04:44:45 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-de50f907-eb6c-407f-8ee8-8397ad94d1e3 tempest-VolumesTransfersTest-1640061394 None] Lock "cinder-170e571d-82b2-4ff2-b0b6-fac5a57e4dd2-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 04:44:45 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-de50f907-eb6c-407f-8ee8-8397ad94d1e3 tempest-VolumesTransfersTest-1640061394 None] Acquiring lock "cinder-quobyte-170e571d-82b2-4ff2-b0b6-fac5a57e4dd2" by "delete_volume" {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 04:44:45 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-de50f907-eb6c-407f-8ee8-8397ad94d1e3 tempest-VolumesTransfersTest-1640061394 None] Lock "cinder-quobyte-170e571d-82b2-4ff2-b0b6-fac5a57e4dd2" acquired by "delete_volume" :: waited 0.019s {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 04:44:45 devstack cinder-volume[87444]: DEBUG oslo.privsep.daemon [-] privsep: reply[8dd55d0f-0f08-49e1-9e08-90d935e45075]: (4, 'qcow2') {{(pid=88499) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 04:44:45 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-de50f907-eb6c-407f-8ee8-8397ad94d1e3 tempest-VolumesTransfersTest-1640061394 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-170e571d-82b2-4ff2-b0b6-fac5a57e4dd2 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:44:45 devstack sudo[98487]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-170e571d-82b2-4ff2-b0b6-fac5a57e4dd2 Jul 10 04:44:45 devstack sudo[98487]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:44:45 devstack sudo[98480]: pam_unix(sudo:session): session closed for user root Jul 10 04:44:45 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-33eecbbf-e04b-435c-8947-c036afcde69a tempest-VolumesSnapshotListTestJSON-813757709 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-a1874d97-591e-46ff-9d77-4263321db1b6.c24bebff-30b5-4f88-873f-89e3467dfe50" returned: 0 in 0.957s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:44:45 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.remotefs [None req-33eecbbf-e04b-435c-8947-c036afcde69a tempest-VolumesSnapshotListTestJSON-813757709 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a1874d97-591e-46ff-9d77-4263321db1b6(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87444) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 10 04:44:45 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-33eecbbf-e04b-435c-8947-c036afcde69a tempest-VolumesSnapshotListTestJSON-813757709 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-a1874d97-591e-46ff-9d77-4263321db1b6.cde30344-00ab-4243-90ac-c432cb3cd88e {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:44:45 devstack sudo[98496]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-a1874d97-591e-46ff-9d77-4263321db1b6.cde30344-00ab-4243-90ac-c432cb3cd88e Jul 10 04:44:45 devstack sudo[98496]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:44:45 devstack sudo[98483]: pam_unix(sudo:session): session closed for user root Jul 10 04:44:45 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-ee5ea77a-71f4-4a3b-92b0-dfb9f3ca8e72 tempest-VolumesExtendTest-564624957 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_5ac2ee4b-64bc-499a-b553-ae96ba343fc0_lk79n6ucdevstack@QuobyteHD" returned: 0 in 0.833s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:44:45 devstack cinder-volume[87444]: DEBUG cinder.image.image_utils [None req-ee5ea77a-71f4-4a3b-92b0-dfb9f3ca8e72 tempest-VolumesExtendTest-564624957 None] Temporary image 5ac2ee4b-64bc-499a-b553-ae96ba343fc0 is fetched for user b8c426901e684c64bb86939eeb86e678. {{(pid=87444) fetch /opt/stack/cinder/cinder/image/image_utils.py:1464}} Jul 10 04:44:46 devstack cinder-volume[87444]: DEBUG oslo.privsep.daemon [-] privsep: reply[75e2dfe5-4337-4658-844a-0e8c80ab73cd]: (4, 'qcow2') {{(pid=88499) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 04:44:46 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-ee5ea77a-71f4-4a3b-92b0-dfb9f3ca8e72 tempest-VolumesExtendTest-564624957 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_5ac2ee4b-64bc-499a-b553-ae96ba343fc0_lk79n6ucdevstack@QuobyteHD {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:44:46 devstack sudo[98502]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_5ac2ee4b-64bc-499a-b553-ae96ba343fc0_lk79n6ucdevstack@QuobyteHD Jul 10 04:44:46 devstack sudo[98502]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:44:46 devstack sudo[98487]: pam_unix(sudo:session): session closed for user root Jul 10 04:44:46 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-de50f907-eb6c-407f-8ee8-8397ad94d1e3 tempest-VolumesTransfersTest-1640061394 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-170e571d-82b2-4ff2-b0b6-fac5a57e4dd2" returned: 0 in 0.909s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:44:46 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-de50f907-eb6c-407f-8ee8-8397ad94d1e3 tempest-VolumesTransfersTest-1640061394 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-170e571d-82b2-4ff2-b0b6-fac5a57e4dd2 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:44:46 devstack sudo[98510]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-170e571d-82b2-4ff2-b0b6-fac5a57e4dd2 Jul 10 04:44:46 devstack sudo[98510]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:44:46 devstack sudo[98496]: pam_unix(sudo:session): session closed for user root Jul 10 04:44:46 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-33eecbbf-e04b-435c-8947-c036afcde69a tempest-VolumesSnapshotListTestJSON-813757709 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-a1874d97-591e-46ff-9d77-4263321db1b6.cde30344-00ab-4243-90ac-c432cb3cd88e" returned: 0 in 1.009s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:44:46 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-33eecbbf-e04b-435c-8947-c036afcde69a tempest-VolumesSnapshotListTestJSON-813757709 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-a1874d97-591e-46ff-9d77-4263321db1b6.cde30344-00ab-4243-90ac-c432cb3cd88e {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:44:46 devstack sudo[98512]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-a1874d97-591e-46ff-9d77-4263321db1b6.cde30344-00ab-4243-90ac-c432cb3cd88e Jul 10 04:44:46 devstack sudo[98512]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:44:46 devstack sudo[98502]: pam_unix(sudo:session): session closed for user root Jul 10 04:44:46 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-ee5ea77a-71f4-4a3b-92b0-dfb9f3ca8e72 tempest-VolumesExtendTest-564624957 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_5ac2ee4b-64bc-499a-b553-ae96ba343fc0_lk79n6ucdevstack@QuobyteHD" returned: 0 in 0.843s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:44:46 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-ee5ea77a-71f4-4a3b-92b0-dfb9f3ca8e72 tempest-VolumesExtendTest-564624957 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 04:44:46 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-ee5ea77a-71f4-4a3b-92b0-dfb9f3ca8e72 tempest-VolumesExtendTest-564624957 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 04:44:46 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-ee5ea77a-71f4-4a3b-92b0-dfb9f3ca8e72 tempest-VolumesExtendTest-564624957 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T02:44:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-800374874',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=222a08a6-db3d-47ef-928f-da61571b7262,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6bd98184f6244876b4ed95a08c59063f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T02:44:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T02:44:44Z,use_quota=True,user_id='b8c426901e684c64bb86939eeb86e678',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(317e369e-1e06-434d-ae95-a335f0e6c903),volume_type_id=317e369e-1e06-434d-ae95-a335f0e6c903)}" {{(pid=87444) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 04:44:46 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.remotefs [None req-ee5ea77a-71f4-4a3b-92b0-dfb9f3ca8e72 tempest-VolumesExtendTest-564624957 None] Creating volume 222a08a6-db3d-47ef-928f-da61571b7262 {{(pid=87444) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 04:44:46 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-ee5ea77a-71f4-4a3b-92b0-dfb9f3ca8e72 tempest-VolumesExtendTest-564624957 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 04:44:46 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-ee5ea77a-71f4-4a3b-92b0-dfb9f3ca8e72 tempest-VolumesExtendTest-564624957 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 04:44:46 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-ee5ea77a-71f4-4a3b-92b0-dfb9f3ca8e72 tempest-VolumesExtendTest-564624957 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922': None} {{(pid=87444) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 04:44:46 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-ee5ea77a-71f4-4a3b-92b0-dfb9f3ca8e72 tempest-VolumesExtendTest-564624957 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922'] {{(pid=87444) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 04:44:46 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-ee5ea77a-71f4-4a3b-92b0-dfb9f3ca8e72 tempest-VolumesExtendTest-564624957 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 04:44:46 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-ee5ea77a-71f4-4a3b-92b0-dfb9f3ca8e72 tempest-VolumesExtendTest-564624957 None] Selected osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922 as target Quobyte volume. {{(pid=87444) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 04:44:46 devstack cinder-volume[87444]: INFO cinder.volume.drivers.remotefs [None req-ee5ea77a-71f4-4a3b-92b0-dfb9f3ca8e72 tempest-VolumesExtendTest-564624957 None] casted to osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922 Jul 10 04:44:46 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-ee5ea77a-71f4-4a3b-92b0-dfb9f3ca8e72 tempest-VolumesExtendTest-564624957 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-222a08a6-db3d-47ef-928f-da61571b7262 1073741824 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:44:46 devstack sudo[98517]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-222a08a6-db3d-47ef-928f-da61571b7262 1073741824 Jul 10 04:44:46 devstack sudo[98517]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:44:47 devstack sudo[98510]: pam_unix(sudo:session): session closed for user root Jul 10 04:44:47 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-de50f907-eb6c-407f-8ee8-8397ad94d1e3 tempest-VolumesTransfersTest-1640061394 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-170e571d-82b2-4ff2-b0b6-fac5a57e4dd2" returned: 0 in 0.777s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:44:47 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-de50f907-eb6c-407f-8ee8-8397ad94d1e3 tempest-VolumesTransfersTest-1640061394 None] Lock "cinder-quobyte-170e571d-82b2-4ff2-b0b6-fac5a57e4dd2" released by "delete_volume" :: held 1.730s {{(pid=87444) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 04:44:47 devstack cinder-volume[87444]: DEBUG cinder.quota [None req-de50f907-eb6c-407f-8ee8-8397ad94d1e3 tempest-VolumesTransfersTest-1640061394 None] Created reservations ['2d72bd1f-1dae-4bfa-842a-dfc5f7c3c2bd', '4ab500bc-bcc6-4cb9-b888-5535164e644a', '9d96400c-8813-472e-9baf-e6081cd39e25', 'e69d0118-e1df-47d7-a2da-80a3366c018e'] {{(pid=87444) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 04:44:47 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-de50f907-eb6c-407f-8ee8-8397ad94d1e3 tempest-VolumesTransfersTest-1640061394 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 04:44:47 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-de50f907-eb6c-407f-8ee8-8397ad94d1e3 tempest-VolumesTransfersTest-1640061394 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 04:44:47 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-de50f907-eb6c-407f-8ee8-8397ad94d1e3 tempest-VolumesTransfersTest-1640061394 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922': None} {{(pid=87444) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 04:44:47 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-de50f907-eb6c-407f-8ee8-8397ad94d1e3 tempest-VolumesTransfersTest-1640061394 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922'] {{(pid=87444) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 04:44:47 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-de50f907-eb6c-407f-8ee8-8397ad94d1e3 tempest-VolumesTransfersTest-1640061394 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 04:44:47 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-de50f907-eb6c-407f-8ee8-8397ad94d1e3 tempest-VolumesTransfersTest-1640061394 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:44:47 devstack sudo[98512]: pam_unix(sudo:session): session closed for user root Jul 10 04:44:47 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-33eecbbf-e04b-435c-8947-c036afcde69a tempest-VolumesSnapshotListTestJSON-813757709 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-a1874d97-591e-46ff-9d77-4263321db1b6.cde30344-00ab-4243-90ac-c432cb3cd88e" returned: 0 in 0.693s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:44:47 devstack sudo[98521]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097 Jul 10 04:44:47 devstack sudo[98521]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:44:47 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-33eecbbf-e04b-435c-8947-c036afcde69a tempest-VolumesSnapshotListTestJSON-813757709 None] Lock "cinder-quobyte-cde30344-00ab-4243-90ac-c432cb3cd88e" released by "_delete_snapshot" :: held 3.642s {{(pid=87444) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 04:44:47 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-33eecbbf-e04b-435c-8947-c036afcde69a tempest-VolumesSnapshotListTestJSON-813757709 None] Lock "cinder-quobyte-a1874d97-591e-46ff-9d77-4263321db1b6" released by "delete_snapshot" :: held 3.683s {{(pid=87444) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 04:44:47 devstack cinder-volume[87444]: DEBUG cinder.quota [None req-33eecbbf-e04b-435c-8947-c036afcde69a tempest-VolumesSnapshotListTestJSON-813757709 None] Created reservations ['8ff6ac8f-859d-4f1c-8fdb-5e7a4210482e', 'd4392f35-774b-49d1-8eaf-b1c1aaf3439a', '0a590933-b0d3-40b3-b1f8-206ec75ebb1f', '71bacf62-e007-4246-9924-136a37d5f890'] {{(pid=87444) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 04:44:47 devstack cinder-volume[87444]: INFO cinder.volume.manager [None req-33eecbbf-e04b-435c-8947-c036afcde69a tempest-VolumesSnapshotListTestJSON-813757709 None] Delete snapshot completed successfully. Jul 10 04:44:47 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-33eecbbf-e04b-435c-8947-c036afcde69a tempest-VolumesSnapshotListTestJSON-813757709 None] Lock "cinder-cde30344-00ab-4243-90ac-c432cb3cd88e-delete_snapshot" released by "delete_snapshot" :: held 3.861s {{(pid=87444) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 04:44:47 devstack sudo[98517]: pam_unix(sudo:session): session closed for user root Jul 10 04:44:47 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-ee5ea77a-71f4-4a3b-92b0-dfb9f3ca8e72 tempest-VolumesExtendTest-564624957 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-222a08a6-db3d-47ef-928f-da61571b7262 1073741824" returned: 0 in 0.988s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:44:47 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-28c529e7-a46e-4fc9-9658-e54e711b208f tempest-VolumesSnapshotListTestJSON-813757709 None] Acquiring lock "cinder-c24bebff-30b5-4f88-873f-89e3467dfe50-delete_snapshot" by "delete_snapshot" {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 04:44:47 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-ee5ea77a-71f4-4a3b-92b0-dfb9f3ca8e72 tempest-VolumesExtendTest-564624957 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-222a08a6-db3d-47ef-928f-da61571b7262 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:44:47 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-28c529e7-a46e-4fc9-9658-e54e711b208f tempest-VolumesSnapshotListTestJSON-813757709 None] Lock "cinder-c24bebff-30b5-4f88-873f-89e3467dfe50-delete_snapshot" acquired by "delete_snapshot" :: waited 0.045s {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 04:44:47 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-28c529e7-a46e-4fc9-9658-e54e711b208f tempest-VolumesSnapshotListTestJSON-813757709 None] Acquiring lock "cinder-quobyte-a1874d97-591e-46ff-9d77-4263321db1b6" by "delete_snapshot" {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 04:44:47 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-28c529e7-a46e-4fc9-9658-e54e711b208f tempest-VolumesSnapshotListTestJSON-813757709 None] Lock "cinder-quobyte-a1874d97-591e-46ff-9d77-4263321db1b6" acquired by "delete_snapshot" :: waited 0.023s {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 04:44:47 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-28c529e7-a46e-4fc9-9658-e54e711b208f tempest-VolumesSnapshotListTestJSON-813757709 None] Acquiring lock "cinder-quobyte-c24bebff-30b5-4f88-873f-89e3467dfe50" by "_delete_snapshot" {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 04:44:47 devstack sudo[98527]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-222a08a6-db3d-47ef-928f-da61571b7262 Jul 10 04:44:47 devstack sudo[98527]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:44:48 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-28c529e7-a46e-4fc9-9658-e54e711b208f tempest-VolumesSnapshotListTestJSON-813757709 None] Lock "cinder-quobyte-c24bebff-30b5-4f88-873f-89e3467dfe50" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 04:44:48 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.remotefs [None req-28c529e7-a46e-4fc9-9658-e54e711b208f tempest-VolumesSnapshotListTestJSON-813757709 None] Deleting offline snapshot c24bebff-30b5-4f88-873f-89e3467dfe50 of volume a1874d97-591e-46ff-9d77-4263321db1b6 {{(pid=87444) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 10 04:44:48 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.remotefs [None req-28c529e7-a46e-4fc9-9658-e54e711b208f tempest-VolumesSnapshotListTestJSON-813757709 None] snapshot_file for this snap is: volume-a1874d97-591e-46ff-9d77-4263321db1b6.c24bebff-30b5-4f88-873f-89e3467dfe50 {{(pid=87444) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 10 04:44:48 devstack cinder-volume[87444]: DEBUG oslo.privsep.daemon [-] privsep: reply[a90d0c47-25dd-4e54-b2c2-f18aff03a726]: (4, 'qcow2') {{(pid=88499) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 04:44:48 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-28c529e7-a46e-4fc9-9658-e54e711b208f tempest-VolumesSnapshotListTestJSON-813757709 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-a1874d97-591e-46ff-9d77-4263321db1b6.c24bebff-30b5-4f88-873f-89e3467dfe50 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:44:48 devstack sudo[98521]: pam_unix(sudo:session): session closed for user root Jul 10 04:44:48 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-de50f907-eb6c-407f-8ee8-8397ad94d1e3 tempest-VolumesTransfersTest-1640061394 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097" returned: 0 in 0.865s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:44:48 devstack cinder-volume[87444]: DEBUG cinder.manager [None req-de50f907-eb6c-407f-8ee8-8397ad94d1e3 tempest-VolumesTransfersTest-1640061394 None] Notifying Schedulers of capabilities ... {{(pid=87444) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 04:44:48 devstack cinder-volume[87444]: INFO cinder.volume.manager [None req-de50f907-eb6c-407f-8ee8-8397ad94d1e3 tempest-VolumesTransfersTest-1640061394 None] Deleted volume successfully. Jul 10 04:44:48 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-de50f907-eb6c-407f-8ee8-8397ad94d1e3 tempest-VolumesTransfersTest-1640061394 None] Lock "cinder-170e571d-82b2-4ff2-b0b6-fac5a57e4dd2-delete_volume" released by "delete_volume" :: held 2.829s {{(pid=87444) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 04:44:48 devstack sudo[98531]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-a1874d97-591e-46ff-9d77-4263321db1b6.c24bebff-30b5-4f88-873f-89e3467dfe50 Jul 10 04:44:48 devstack sudo[98531]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:44:48 devstack sudo[98527]: pam_unix(sudo:session): session closed for user root Jul 10 04:44:48 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-ee5ea77a-71f4-4a3b-92b0-dfb9f3ca8e72 tempest-VolumesExtendTest-564624957 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-222a08a6-db3d-47ef-928f-da61571b7262" returned: 0 in 0.741s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:44:48 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-ee5ea77a-71f4-4a3b-92b0-dfb9f3ca8e72 tempest-VolumesExtendTest-564624957 None] <== create_volume: return (1804ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922'} {{(pid=87444) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 04:44:48 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-ee5ea77a-71f4-4a3b-92b0-dfb9f3ca8e72 tempest-VolumesExtendTest-564624957 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.809s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 04:44:48 devstack cinder-volume[87444]: DEBUG cinder.volume.volume_utils [None req-ee5ea77a-71f4-4a3b-92b0-dfb9f3ca8e72 tempest-VolumesExtendTest-564624957 None] Attempting download of 5ac2ee4b-64bc-499a-b553-ae96ba343fc0 ((None, [{'url': 'file:///opt/stack/data/glance/images/5ac2ee4b-64bc-499a-b553-ae96ba343fc0', 'metadata': {}}])) to volume 222a08a6-db3d-47ef-928f-da61571b7262. {{(pid=87444) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jul 10 04:44:48 devstack cinder-volume[87444]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed6d7114-7370-41af-97d5-3a11a337fd4f]: (4, 'raw') {{(pid=88499) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 04:44:48 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-ee5ea77a-71f4-4a3b-92b0-dfb9f3ca8e72 tempest-VolumesExtendTest-564624957 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_5ac2ee4b-64bc-499a-b553-ae96ba343fc0_fgmlcjub {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:44:48 devstack sudo[98531]: pam_unix(sudo:session): session closed for user root Jul 10 04:44:48 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-28c529e7-a46e-4fc9-9658-e54e711b208f tempest-VolumesSnapshotListTestJSON-813757709 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-a1874d97-591e-46ff-9d77-4263321db1b6.c24bebff-30b5-4f88-873f-89e3467dfe50" returned: 0 in 0.871s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:44:48 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.remotefs [None req-28c529e7-a46e-4fc9-9658-e54e711b208f tempest-VolumesSnapshotListTestJSON-813757709 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a1874d97-591e-46ff-9d77-4263321db1b6(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87444) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 10 04:44:48 devstack sudo[98539]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_5ac2ee4b-64bc-499a-b553-ae96ba343fc0_fgmlcjub Jul 10 04:44:48 devstack sudo[98539]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:44:49 devstack cinder-volume[87444]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d6867e1-e24d-4b02-80ae-2fa15b78de1c]: (4, 'qcow2') {{(pid=88499) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 04:44:49 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-28c529e7-a46e-4fc9-9658-e54e711b208f tempest-VolumesSnapshotListTestJSON-813757709 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-a1874d97-591e-46ff-9d77-4263321db1b6.f952da89-cc16-4789-964f-a9c4b60360df {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:44:49 devstack sudo[98543]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-a1874d97-591e-46ff-9d77-4263321db1b6.f952da89-cc16-4789-964f-a9c4b60360df Jul 10 04:44:49 devstack sudo[98543]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:44:49 devstack sudo[98539]: pam_unix(sudo:session): session closed for user root Jul 10 04:44:49 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-ee5ea77a-71f4-4a3b-92b0-dfb9f3ca8e72 tempest-VolumesExtendTest-564624957 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_5ac2ee4b-64bc-499a-b553-ae96ba343fc0_fgmlcjub" returned: 0 in 0.862s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:44:49 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-ee5ea77a-71f4-4a3b-92b0-dfb9f3ca8e72 tempest-VolumesExtendTest-564624957 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_5ac2ee4b-64bc-499a-b553-ae96ba343fc0_fgmlcjub {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:44:49 devstack sudo[98554]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_5ac2ee4b-64bc-499a-b553-ae96ba343fc0_fgmlcjub Jul 10 04:44:49 devstack sudo[98554]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:44:49 devstack sudo[98543]: pam_unix(sudo:session): session closed for user root Jul 10 04:44:49 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-28c529e7-a46e-4fc9-9658-e54e711b208f tempest-VolumesSnapshotListTestJSON-813757709 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-a1874d97-591e-46ff-9d77-4263321db1b6.f952da89-cc16-4789-964f-a9c4b60360df" returned: 0 in 0.937s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:44:49 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.remotefs [None req-28c529e7-a46e-4fc9-9658-e54e711b208f tempest-VolumesSnapshotListTestJSON-813757709 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a1874d97-591e-46ff-9d77-4263321db1b6(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87444) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 10 04:44:49 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-28c529e7-a46e-4fc9-9658-e54e711b208f tempest-VolumesSnapshotListTestJSON-813757709 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-a1874d97-591e-46ff-9d77-4263321db1b6.c24bebff-30b5-4f88-873f-89e3467dfe50 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:44:50 devstack sudo[98568]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-a1874d97-591e-46ff-9d77-4263321db1b6.c24bebff-30b5-4f88-873f-89e3467dfe50 Jul 10 04:44:50 devstack sudo[98568]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:44:50 devstack sudo[98554]: pam_unix(sudo:session): session closed for user root Jul 10 04:44:50 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-ee5ea77a-71f4-4a3b-92b0-dfb9f3ca8e72 tempest-VolumesExtendTest-564624957 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_5ac2ee4b-64bc-499a-b553-ae96ba343fc0_fgmlcjub" returned: 1 in 0.872s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:44:50 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-ee5ea77a-71f4-4a3b-92b0-dfb9f3ca8e72 tempest-VolumesExtendTest-564624957 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_5ac2ee4b-64bc-499a-b553-ae96ba343fc0_fgmlcjub' failed. Not Retrying. {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 10 04:44:50 devstack cinder-volume[87444]: DEBUG oslo.privsep.daemon [-] privsep: reply[e55867ab-a152-4e0c-92a5-cdca831362df]: (4, 'qcow2') {{(pid=88499) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 04:44:50 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-ee5ea77a-71f4-4a3b-92b0-dfb9f3ca8e72 tempest-VolumesExtendTest-564624957 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_5ac2ee4b-64bc-499a-b553-ae96ba343fc0_lk79n6ucdevstack@QuobyteHD {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:44:50 devstack sudo[98604]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_5ac2ee4b-64bc-499a-b553-ae96ba343fc0_lk79n6ucdevstack@QuobyteHD Jul 10 04:44:50 devstack sudo[98604]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:44:51 devstack sudo[98568]: pam_unix(sudo:session): session closed for user root Jul 10 04:44:51 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-28c529e7-a46e-4fc9-9658-e54e711b208f tempest-VolumesSnapshotListTestJSON-813757709 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-a1874d97-591e-46ff-9d77-4263321db1b6.c24bebff-30b5-4f88-873f-89e3467dfe50" returned: 0 in 1.290s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:44:51 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-28c529e7-a46e-4fc9-9658-e54e711b208f tempest-VolumesSnapshotListTestJSON-813757709 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-a1874d97-591e-46ff-9d77-4263321db1b6.c24bebff-30b5-4f88-873f-89e3467dfe50 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:44:51 devstack sudo[98612]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-a1874d97-591e-46ff-9d77-4263321db1b6.c24bebff-30b5-4f88-873f-89e3467dfe50 Jul 10 04:44:51 devstack sudo[98612]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:44:51 devstack sudo[98604]: pam_unix(sudo:session): session closed for user root Jul 10 04:44:51 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-ee5ea77a-71f4-4a3b-92b0-dfb9f3ca8e72 tempest-VolumesExtendTest-564624957 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_5ac2ee4b-64bc-499a-b553-ae96ba343fc0_lk79n6ucdevstack@QuobyteHD" returned: 0 in 0.979s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:44:51 devstack cinder-volume[87444]: DEBUG cinder.image.image_utils [None req-ee5ea77a-71f4-4a3b-92b0-dfb9f3ca8e72 tempest-VolumesExtendTest-564624957 None] 5ac2ee4b-64bc-499a-b553-ae96ba343fc0 was qcow2, converting to raw {{(pid=87444) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1153}} Jul 10 04:44:51 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-ee5ea77a-71f4-4a3b-92b0-dfb9f3ca8e72 tempest-VolumesExtendTest-564624957 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_5ac2ee4b-64bc-499a-b553-ae96ba343fc0_lk79n6ucdevstack@QuobyteHD /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-222a08a6-db3d-47ef-928f-da61571b7262 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:44:51 devstack sudo[98617]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_5ac2ee4b-64bc-499a-b553-ae96ba343fc0_lk79n6ucdevstack@QuobyteHD /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-222a08a6-db3d-47ef-928f-da61571b7262 Jul 10 04:44:51 devstack sudo[98617]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:44:52 devstack sudo[98612]: pam_unix(sudo:session): session closed for user root Jul 10 04:44:52 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-28c529e7-a46e-4fc9-9658-e54e711b208f tempest-VolumesSnapshotListTestJSON-813757709 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-a1874d97-591e-46ff-9d77-4263321db1b6.c24bebff-30b5-4f88-873f-89e3467dfe50" returned: 0 in 0.963s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:44:52 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-28c529e7-a46e-4fc9-9658-e54e711b208f tempest-VolumesSnapshotListTestJSON-813757709 None] Lock "cinder-quobyte-c24bebff-30b5-4f88-873f-89e3467dfe50" released by "_delete_snapshot" :: held 4.251s {{(pid=87444) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 04:44:52 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-28c529e7-a46e-4fc9-9658-e54e711b208f tempest-VolumesSnapshotListTestJSON-813757709 None] Lock "cinder-quobyte-a1874d97-591e-46ff-9d77-4263321db1b6" released by "delete_snapshot" :: held 4.282s {{(pid=87444) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 04:44:52 devstack cinder-volume[87444]: DEBUG cinder.quota [None req-28c529e7-a46e-4fc9-9658-e54e711b208f tempest-VolumesSnapshotListTestJSON-813757709 None] Created reservations ['daf378d4-bbb8-481c-b9d0-c41fcf8e004e', '5d03b4ec-d123-41af-baf8-d56e20b1f567', '96920578-fe21-4af0-bed3-c0f5c0044a37', '047cd5ae-4ce6-4791-bfb9-9d9bec00df34'] {{(pid=87444) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 04:44:52 devstack cinder-volume[87444]: INFO cinder.volume.manager [None req-28c529e7-a46e-4fc9-9658-e54e711b208f tempest-VolumesSnapshotListTestJSON-813757709 None] Delete snapshot completed successfully. Jul 10 04:44:52 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-28c529e7-a46e-4fc9-9658-e54e711b208f tempest-VolumesSnapshotListTestJSON-813757709 None] Lock "cinder-c24bebff-30b5-4f88-873f-89e3467dfe50-delete_snapshot" released by "delete_snapshot" :: held 4.496s {{(pid=87444) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 04:44:53 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-a8d71762-5f0d-46ca-97fc-a4c935225661 tempest-VolumesSnapshotListTestJSON-813757709 None] Acquiring lock "cinder-f952da89-cc16-4789-964f-a9c4b60360df-delete_snapshot" by "delete_snapshot" {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 04:44:53 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-a8d71762-5f0d-46ca-97fc-a4c935225661 tempest-VolumesSnapshotListTestJSON-813757709 None] Lock "cinder-f952da89-cc16-4789-964f-a9c4b60360df-delete_snapshot" acquired by "delete_snapshot" :: waited 0.023s {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 04:44:53 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-a8d71762-5f0d-46ca-97fc-a4c935225661 tempest-VolumesSnapshotListTestJSON-813757709 None] Acquiring lock "cinder-quobyte-a1874d97-591e-46ff-9d77-4263321db1b6" by "delete_snapshot" {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 04:44:53 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-a8d71762-5f0d-46ca-97fc-a4c935225661 tempest-VolumesSnapshotListTestJSON-813757709 None] Lock "cinder-quobyte-a1874d97-591e-46ff-9d77-4263321db1b6" acquired by "delete_snapshot" :: waited 0.022s {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 04:44:53 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-a8d71762-5f0d-46ca-97fc-a4c935225661 tempest-VolumesSnapshotListTestJSON-813757709 None] Acquiring lock "cinder-quobyte-f952da89-cc16-4789-964f-a9c4b60360df" by "_delete_snapshot" {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 04:44:53 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-a8d71762-5f0d-46ca-97fc-a4c935225661 tempest-VolumesSnapshotListTestJSON-813757709 None] Lock "cinder-quobyte-f952da89-cc16-4789-964f-a9c4b60360df" acquired by "_delete_snapshot" :: waited 0.030s {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 04:44:53 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.remotefs [None req-a8d71762-5f0d-46ca-97fc-a4c935225661 tempest-VolumesSnapshotListTestJSON-813757709 None] Deleting offline snapshot f952da89-cc16-4789-964f-a9c4b60360df of volume a1874d97-591e-46ff-9d77-4263321db1b6 {{(pid=87444) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 10 04:44:53 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.remotefs [None req-a8d71762-5f0d-46ca-97fc-a4c935225661 tempest-VolumesSnapshotListTestJSON-813757709 None] snapshot_file for this snap is: volume-a1874d97-591e-46ff-9d77-4263321db1b6.f952da89-cc16-4789-964f-a9c4b60360df {{(pid=87444) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 10 04:44:53 devstack cinder-volume[87444]: DEBUG oslo.privsep.daemon [-] privsep: reply[e60b07c5-7219-4f14-a88d-9e7c5bf2371b]: (4, 'qcow2') {{(pid=88499) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 04:44:53 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-a8d71762-5f0d-46ca-97fc-a4c935225661 tempest-VolumesSnapshotListTestJSON-813757709 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-a1874d97-591e-46ff-9d77-4263321db1b6.f952da89-cc16-4789-964f-a9c4b60360df {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:44:53 devstack sudo[98628]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-a1874d97-591e-46ff-9d77-4263321db1b6.f952da89-cc16-4789-964f-a9c4b60360df Jul 10 04:44:53 devstack sudo[98628]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:44:54 devstack sudo[98617]: pam_unix(sudo:session): session closed for user root Jul 10 04:44:54 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-ee5ea77a-71f4-4a3b-92b0-dfb9f3ca8e72 tempest-VolumesExtendTest-564624957 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_5ac2ee4b-64bc-499a-b553-ae96ba343fc0_lk79n6ucdevstack@QuobyteHD /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-222a08a6-db3d-47ef-928f-da61571b7262" returned: 0 in 2.661s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:44:54 devstack cinder-volume[87444]: DEBUG cinder.image.image_utils [None req-ee5ea77a-71f4-4a3b-92b0-dfb9f3ca8e72 tempest-VolumesExtendTest-564624957 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_5ac2ee4b-64bc-499a-b553-ae96ba343fc0_lk79n6ucdevstack@QuobyteHD, size 112.00 MB, duration 2.66 sec, destination /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-222a08a6-db3d-47ef-928f-da61571b7262 {{(pid=87444) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:561}} Jul 10 04:44:54 devstack cinder-volume[87444]: INFO cinder.image.image_utils [None req-ee5ea77a-71f4-4a3b-92b0-dfb9f3ca8e72 tempest-VolumesExtendTest-564624957 None] Converted 112.00 MB image at 42.04 MB/s Jul 10 04:44:54 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-ee5ea77a-71f4-4a3b-92b0-dfb9f3ca8e72 tempest-VolumesExtendTest-564624957 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-222a08a6-db3d-47ef-928f-da61571b7262 1G {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:44:54 devstack sudo[98631]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-222a08a6-db3d-47ef-928f-da61571b7262 1G Jul 10 04:44:54 devstack sudo[98631]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:44:54 devstack sudo[98628]: pam_unix(sudo:session): session closed for user root Jul 10 04:44:54 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-a8d71762-5f0d-46ca-97fc-a4c935225661 tempest-VolumesSnapshotListTestJSON-813757709 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-a1874d97-591e-46ff-9d77-4263321db1b6.f952da89-cc16-4789-964f-a9c4b60360df" returned: 0 in 0.990s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:44:54 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.remotefs [None req-a8d71762-5f0d-46ca-97fc-a4c935225661 tempest-VolumesSnapshotListTestJSON-813757709 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a1874d97-591e-46ff-9d77-4263321db1b6(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87444) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 10 04:44:54 devstack cinder-volume[87444]: DEBUG oslo.privsep.daemon [-] privsep: reply[61a6186b-dbc4-4c05-8ac6-0865c1d9c2d4]: (4, 'qcow2') {{(pid=88499) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 04:44:54 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-a8d71762-5f0d-46ca-97fc-a4c935225661 tempest-VolumesSnapshotListTestJSON-813757709 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-a1874d97-591e-46ff-9d77-4263321db1b6 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:44:54 devstack sudo[98637]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-a1874d97-591e-46ff-9d77-4263321db1b6 Jul 10 04:44:54 devstack sudo[98637]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:44:55 devstack sudo[98631]: pam_unix(sudo:session): session closed for user root Jul 10 04:44:55 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-ee5ea77a-71f4-4a3b-92b0-dfb9f3ca8e72 tempest-VolumesExtendTest-564624957 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-222a08a6-db3d-47ef-928f-da61571b7262 1G" returned: 0 in 0.827s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:44:55 devstack cinder-volume[87444]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1c81fd9-0e69-4634-a3a8-3a1ae68ec1fd]: (4, 'raw') {{(pid=88499) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 04:44:55 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-ee5ea77a-71f4-4a3b-92b0-dfb9f3ca8e72 tempest-VolumesExtendTest-564624957 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-222a08a6-db3d-47ef-928f-da61571b7262 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:44:55 devstack sudo[98642]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-222a08a6-db3d-47ef-928f-da61571b7262 Jul 10 04:44:55 devstack sudo[98642]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:44:55 devstack sudo[98637]: pam_unix(sudo:session): session closed for user root Jul 10 04:44:55 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-a8d71762-5f0d-46ca-97fc-a4c935225661 tempest-VolumesSnapshotListTestJSON-813757709 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-a1874d97-591e-46ff-9d77-4263321db1b6" returned: 0 in 0.948s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:44:55 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-a8d71762-5f0d-46ca-97fc-a4c935225661 tempest-VolumesSnapshotListTestJSON-813757709 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-a1874d97-591e-46ff-9d77-4263321db1b6.f952da89-cc16-4789-964f-a9c4b60360df {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:44:55 devstack sudo[98647]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-a1874d97-591e-46ff-9d77-4263321db1b6.f952da89-cc16-4789-964f-a9c4b60360df Jul 10 04:44:55 devstack sudo[98647]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:44:55 devstack sudo[98642]: pam_unix(sudo:session): session closed for user root Jul 10 04:44:55 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-ee5ea77a-71f4-4a3b-92b0-dfb9f3ca8e72 tempest-VolumesExtendTest-564624957 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-222a08a6-db3d-47ef-928f-da61571b7262" returned: 0 in 0.891s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:44:55 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-ee5ea77a-71f4-4a3b-92b0-dfb9f3ca8e72 tempest-VolumesExtendTest-564624957 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-222a08a6-db3d-47ef-928f-da61571b7262 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:44:56 devstack cinder-volume[87444]: DEBUG cinder.volume.flows.manager.create_volume [None req-cd266bba-6e02-44d4-a1af-d74e9181135b tempest-VolumesTransfersV357Test-265589655 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87444) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 04:44:56 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-cd266bba-6e02-44d4-a1af-d74e9181135b tempest-VolumesTransfersV357Test-265589655 None] Flow 'volume_create_manager' (10b98b71-c800-4928-8ac4-adf464a04ce8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 04:44:56 devstack sudo[98651]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-222a08a6-db3d-47ef-928f-da61571b7262 Jul 10 04:44:56 devstack sudo[98651]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:44:56 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-cd266bba-6e02-44d4-a1af-d74e9181135b tempest-VolumesTransfersV357Test-265589655 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7f7065aa-75f8-446f-bb9b-f91b2b5dc21f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:44:56 devstack cinder-volume[87444]: DEBUG dbcounter [-] [87444] Writing DB stats cinder:SELECT=60,cinder:UPDATE=76,cinder:INSERT=20,cinder:DELETE=7 {{(pid=87444) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 10 04:44:56 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-cd266bba-6e02-44d4-a1af-d74e9181135b tempest-VolumesTransfersV357Test-265589655 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7f7065aa-75f8-446f-bb9b-f91b2b5dc21f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T02:44:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-310465280',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bcda8d43-6fb2-49d0-a722-64c5d04c0017,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b612e859c41f4166a96891ea04044505',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T02:44:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T02:44:56Z,use_quota=True,user_id='363b0f499ea64f11ac1e72ea670270dd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(317e369e-1e06-434d-ae95-a335f0e6c903),volume_type_id=317e369e-1e06-434d-ae95-a335f0e6c903)' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:44:56 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-cd266bba-6e02-44d4-a1af-d74e9181135b tempest-VolumesTransfersV357Test-265589655 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3bb457f2-94fe-478c-951e-cfca7b94cf5f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:44:56 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-cd266bba-6e02-44d4-a1af-d74e9181135b tempest-VolumesTransfersV357Test-265589655 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3bb457f2-94fe-478c-951e-cfca7b94cf5f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:44:56 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-cd266bba-6e02-44d4-a1af-d74e9181135b tempest-VolumesTransfersV357Test-265589655 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e5140f6e-476e-4acc-bc3a-a7aa61d7b28a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:44:56 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-cd266bba-6e02-44d4-a1af-d74e9181135b tempest-VolumesTransfersV357Test-265589655 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e5140f6e-476e-4acc-bc3a-a7aa61d7b28a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bcda8d43-6fb2-49d0-a722-64c5d04c0017', 'volume_name': 'volume-bcda8d43-6fb2-49d0-a722-64c5d04c0017', 'volume_size': 1}' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:44:56 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-cd266bba-6e02-44d4-a1af-d74e9181135b tempest-VolumesTransfersV357Test-265589655 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dbdcccdc-9e03-4019-a560-bacf872bfd40) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:44:56 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-cd266bba-6e02-44d4-a1af-d74e9181135b tempest-VolumesTransfersV357Test-265589655 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dbdcccdc-9e03-4019-a560-bacf872bfd40) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:44:56 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-cd266bba-6e02-44d4-a1af-d74e9181135b tempest-VolumesTransfersV357Test-265589655 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (780c831f-9ec8-4447-9729-128b5b9a4f1d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:44:56 devstack cinder-volume[87444]: INFO cinder.volume.flows.manager.create_volume [None req-cd266bba-6e02-44d4-a1af-d74e9181135b tempest-VolumesTransfersV357Test-265589655 None] Volume bcda8d43-6fb2-49d0-a722-64c5d04c0017: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bcda8d43-6fb2-49d0-a722-64c5d04c0017', 'volume_size': 1} Jul 10 04:44:56 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-cd266bba-6e02-44d4-a1af-d74e9181135b tempest-VolumesTransfersV357Test-265589655 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 04:44:56 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-cd266bba-6e02-44d4-a1af-d74e9181135b tempest-VolumesTransfersV357Test-265589655 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 04:44:56 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-cd266bba-6e02-44d4-a1af-d74e9181135b tempest-VolumesTransfersV357Test-265589655 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T02:44:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-310465280',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bcda8d43-6fb2-49d0-a722-64c5d04c0017,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b612e859c41f4166a96891ea04044505',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T02:44:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T02:44:56Z,use_quota=True,user_id='363b0f499ea64f11ac1e72ea670270dd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(317e369e-1e06-434d-ae95-a335f0e6c903),volume_type_id=317e369e-1e06-434d-ae95-a335f0e6c903)}" {{(pid=87444) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 04:44:56 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.remotefs [None req-cd266bba-6e02-44d4-a1af-d74e9181135b tempest-VolumesTransfersV357Test-265589655 None] Creating volume bcda8d43-6fb2-49d0-a722-64c5d04c0017 {{(pid=87444) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 04:44:56 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-cd266bba-6e02-44d4-a1af-d74e9181135b tempest-VolumesTransfersV357Test-265589655 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 04:44:56 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-cd266bba-6e02-44d4-a1af-d74e9181135b tempest-VolumesTransfersV357Test-265589655 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 04:44:56 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-cd266bba-6e02-44d4-a1af-d74e9181135b tempest-VolumesTransfersV357Test-265589655 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922': None} {{(pid=87444) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 04:44:56 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-cd266bba-6e02-44d4-a1af-d74e9181135b tempest-VolumesTransfersV357Test-265589655 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922'] {{(pid=87444) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 04:44:56 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-cd266bba-6e02-44d4-a1af-d74e9181135b tempest-VolumesTransfersV357Test-265589655 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 04:44:56 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-cd266bba-6e02-44d4-a1af-d74e9181135b tempest-VolumesTransfersV357Test-265589655 None] Selected osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922 as target Quobyte volume. {{(pid=87444) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 04:44:56 devstack cinder-volume[87444]: INFO cinder.volume.drivers.remotefs [None req-cd266bba-6e02-44d4-a1af-d74e9181135b tempest-VolumesTransfersV357Test-265589655 None] casted to osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922 Jul 10 04:44:56 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-cd266bba-6e02-44d4-a1af-d74e9181135b tempest-VolumesTransfersV357Test-265589655 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-bcda8d43-6fb2-49d0-a722-64c5d04c0017 1073741824 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:44:56 devstack sudo[98656]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-bcda8d43-6fb2-49d0-a722-64c5d04c0017 1073741824 Jul 10 04:44:56 devstack sudo[98656]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:44:56 devstack sudo[98647]: pam_unix(sudo:session): session closed for user root Jul 10 04:44:56 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-a8d71762-5f0d-46ca-97fc-a4c935225661 tempest-VolumesSnapshotListTestJSON-813757709 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-a1874d97-591e-46ff-9d77-4263321db1b6.f952da89-cc16-4789-964f-a9c4b60360df" returned: 0 in 0.942s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:44:56 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-a8d71762-5f0d-46ca-97fc-a4c935225661 tempest-VolumesSnapshotListTestJSON-813757709 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-a1874d97-591e-46ff-9d77-4263321db1b6.f952da89-cc16-4789-964f-a9c4b60360df {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:44:56 devstack sudo[98658]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-a1874d97-591e-46ff-9d77-4263321db1b6.f952da89-cc16-4789-964f-a9c4b60360df Jul 10 04:44:56 devstack sudo[98658]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:44:57 devstack sudo[98651]: pam_unix(sudo:session): session closed for user root Jul 10 04:44:57 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-ee5ea77a-71f4-4a3b-92b0-dfb9f3ca8e72 tempest-VolumesExtendTest-564624957 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-222a08a6-db3d-47ef-928f-da61571b7262" returned: 1 in 1.137s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:44:57 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-ee5ea77a-71f4-4a3b-92b0-dfb9f3ca8e72 tempest-VolumesExtendTest-564624957 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-222a08a6-db3d-47ef-928f-da61571b7262' failed. Not Retrying. {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 10 04:44:57 devstack cinder-volume[87444]: DEBUG cinder.volume.volume_utils [None req-ee5ea77a-71f4-4a3b-92b0-dfb9f3ca8e72 tempest-VolumesExtendTest-564624957 None] Downloaded image 5ac2ee4b-64bc-499a-b553-ae96ba343fc0 ((None, [{'url': 'file:///opt/stack/data/glance/images/5ac2ee4b-64bc-499a-b553-ae96ba343fc0', 'metadata': {}}])) to volume 222a08a6-db3d-47ef-928f-da61571b7262 successfully. {{(pid=87444) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jul 10 04:44:57 devstack cinder-volume[87444]: DEBUG cinder.image.image_utils [None req-ee5ea77a-71f4-4a3b-92b0-dfb9f3ca8e72 tempest-VolumesExtendTest-564624957 None] Temporary image 5ac2ee4b-64bc-499a-b553-ae96ba343fc0 for user b8c426901e684c64bb86939eeb86e678 is deleted. {{(pid=87444) fetch /opt/stack/cinder/cinder/image/image_utils.py:1468}} Jul 10 04:44:57 devstack cinder-volume[87444]: DEBUG cinder.volume.volume_utils [None req-ee5ea77a-71f4-4a3b-92b0-dfb9f3ca8e72 tempest-VolumesExtendTest-564624957 None] Marking volume 222a08a6-db3d-47ef-928f-da61571b7262 as bootable. {{(pid=87444) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jul 10 04:44:57 devstack cinder-volume[87444]: DEBUG dbcounter [-] [87444] Writing DB stats cinder:UPDATE=79,cinder:SELECT=70,cinder:INSERT=17,cinder:DELETE=7 {{(pid=87444) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 10 04:44:57 devstack cinder-volume[87444]: DEBUG cinder.volume.flows.manager.create_volume [None req-ee5ea77a-71f4-4a3b-92b0-dfb9f3ca8e72 tempest-VolumesExtendTest-564624957 None] Copying metadata from image 5ac2ee4b-64bc-499a-b553-ae96ba343fc0 to 222a08a6-db3d-47ef-928f-da61571b7262. {{(pid=87444) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jul 10 04:44:57 devstack cinder-volume[87444]: DEBUG cinder.volume.flows.manager.create_volume [None req-ee5ea77a-71f4-4a3b-92b0-dfb9f3ca8e72 tempest-VolumesExtendTest-564624957 None] Creating volume glance metadata for volume 222a08a6-db3d-47ef-928f-da61571b7262 backed by image 5ac2ee4b-64bc-499a-b553-ae96ba343fc0 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '5ac2ee4b-64bc-499a-b553-ae96ba343fc0', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=87444) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jul 10 04:44:57 devstack sudo[98658]: pam_unix(sudo:session): session closed for user root Jul 10 04:44:57 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-a8d71762-5f0d-46ca-97fc-a4c935225661 tempest-VolumesSnapshotListTestJSON-813757709 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-a1874d97-591e-46ff-9d77-4263321db1b6.f952da89-cc16-4789-964f-a9c4b60360df" returned: 0 in 0.790s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:44:57 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-a8d71762-5f0d-46ca-97fc-a4c935225661 tempest-VolumesSnapshotListTestJSON-813757709 None] Lock "cinder-quobyte-f952da89-cc16-4789-964f-a9c4b60360df" released by "_delete_snapshot" :: held 3.818s {{(pid=87444) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 04:44:57 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-a8d71762-5f0d-46ca-97fc-a4c935225661 tempest-VolumesSnapshotListTestJSON-813757709 None] Lock "cinder-quobyte-a1874d97-591e-46ff-9d77-4263321db1b6" released by "delete_snapshot" :: held 3.859s {{(pid=87444) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 04:44:57 devstack sudo[98656]: pam_unix(sudo:session): session closed for user root Jul 10 04:44:57 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-cd266bba-6e02-44d4-a1af-d74e9181135b tempest-VolumesTransfersV357Test-265589655 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-bcda8d43-6fb2-49d0-a722-64c5d04c0017 1073741824" returned: 0 in 1.032s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:44:57 devstack cinder-volume[87444]: DEBUG cinder.quota [None req-a8d71762-5f0d-46ca-97fc-a4c935225661 tempest-VolumesSnapshotListTestJSON-813757709 None] Created reservations ['982e0caa-f177-421c-bd13-9a61e22e685d', 'd0e36e00-eb45-45ab-b626-501a07fe7e06', 'f2b1ef39-fd07-4886-9634-02d7a83887b9', '7b5ce2b5-5494-47bb-8497-caf8c6899e43'] {{(pid=87444) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 04:44:57 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-ee5ea77a-71f4-4a3b-92b0-dfb9f3ca8e72 tempest-VolumesExtendTest-564624957 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4559b242-8956-49c4-82ba-7c8291de7d96) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-222a08a6-db3d-47ef-928f-da61571b7262', 'volume_size': 1, 'image_id': '5ac2ee4b-64bc-499a-b553-ae96ba343fc0', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/5ac2ee4b-64bc-499a-b553-ae96ba343fc0', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'ca4bb946b593473194351a84617cf92e', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '5ac2ee4b-64bc-499a-b553-ae96ba343fc0', 'created_at': datetime.datetime(2026, 7, 10, 2, 26, 36, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 10, 2, 26, 38, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/5ac2ee4b-64bc-499a-b553-ae96ba343fc0/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:44:57 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-ee5ea77a-71f4-4a3b-92b0-dfb9f3ca8e72 tempest-VolumesExtendTest-564624957 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3e8a6f00-081b-4452-82d7-7fc0c1cf9a34) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:44:57 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-cd266bba-6e02-44d4-a1af-d74e9181135b tempest-VolumesTransfersV357Test-265589655 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-bcda8d43-6fb2-49d0-a722-64c5d04c0017 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:44:57 devstack sudo[98667]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-bcda8d43-6fb2-49d0-a722-64c5d04c0017 Jul 10 04:44:57 devstack sudo[98667]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:44:57 devstack cinder-volume[87444]: INFO cinder.volume.flows.manager.create_volume [None req-ee5ea77a-71f4-4a3b-92b0-dfb9f3ca8e72 tempest-VolumesExtendTest-564624957 None] Volume volume-222a08a6-db3d-47ef-928f-da61571b7262 (222a08a6-db3d-47ef-928f-da61571b7262): created successfully Jul 10 04:44:57 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-ee5ea77a-71f4-4a3b-92b0-dfb9f3ca8e72 tempest-VolumesExtendTest-564624957 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3e8a6f00-081b-4452-82d7-7fc0c1cf9a34) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:44:57 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-ee5ea77a-71f4-4a3b-92b0-dfb9f3ca8e72 tempest-VolumesExtendTest-564624957 None] Flow 'volume_create_manager' (fdd3b386-8306-420b-87e5-a4d5b9c9edf7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87444) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 04:44:57 devstack cinder-volume[87444]: INFO cinder.volume.manager [None req-ee5ea77a-71f4-4a3b-92b0-dfb9f3ca8e72 tempest-VolumesExtendTest-564624957 None] Created volume successfully. Jul 10 04:44:57 devstack cinder-volume[87444]: INFO cinder.volume.manager [None req-a8d71762-5f0d-46ca-97fc-a4c935225661 tempest-VolumesSnapshotListTestJSON-813757709 None] Delete snapshot completed successfully. Jul 10 04:44:57 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-a8d71762-5f0d-46ca-97fc-a4c935225661 tempest-VolumesSnapshotListTestJSON-813757709 None] Lock "cinder-f952da89-cc16-4789-964f-a9c4b60360df-delete_snapshot" released by "delete_snapshot" :: held 4.105s {{(pid=87444) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 04:44:57 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-c8579fc0-a90d-426a-8a24-81ba348f7cb6 tempest-VolumesSnapshotListTestJSON-813757709 None] Acquiring lock "cinder-a1874d97-591e-46ff-9d77-4263321db1b6-delete_volume" by "delete_volume" {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 04:44:57 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-c8579fc0-a90d-426a-8a24-81ba348f7cb6 tempest-VolumesSnapshotListTestJSON-813757709 None] Lock "cinder-a1874d97-591e-46ff-9d77-4263321db1b6-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 04:44:57 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-c8579fc0-a90d-426a-8a24-81ba348f7cb6 tempest-VolumesSnapshotListTestJSON-813757709 None] Acquiring lock "cinder-quobyte-a1874d97-591e-46ff-9d77-4263321db1b6" by "delete_volume" {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 04:44:57 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-c8579fc0-a90d-426a-8a24-81ba348f7cb6 tempest-VolumesSnapshotListTestJSON-813757709 None] Lock "cinder-quobyte-a1874d97-591e-46ff-9d77-4263321db1b6" acquired by "delete_volume" :: waited 0.031s {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 04:44:57 devstack cinder-volume[87444]: DEBUG oslo.privsep.daemon [-] privsep: reply[c26e9f16-d7a9-416e-85c7-1c8871afabfc]: (4, 'qcow2') {{(pid=88499) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 04:44:57 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-c8579fc0-a90d-426a-8a24-81ba348f7cb6 tempest-VolumesSnapshotListTestJSON-813757709 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-a1874d97-591e-46ff-9d77-4263321db1b6 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:44:58 devstack sudo[98669]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-a1874d97-591e-46ff-9d77-4263321db1b6 Jul 10 04:44:58 devstack sudo[98669]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:44:58 devstack sudo[98667]: pam_unix(sudo:session): session closed for user root Jul 10 04:44:58 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-cd266bba-6e02-44d4-a1af-d74e9181135b tempest-VolumesTransfersV357Test-265589655 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-bcda8d43-6fb2-49d0-a722-64c5d04c0017" returned: 0 in 0.713s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:44:58 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-cd266bba-6e02-44d4-a1af-d74e9181135b tempest-VolumesTransfersV357Test-265589655 None] <== create_volume: return (1870ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922'} {{(pid=87444) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 04:44:58 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-cd266bba-6e02-44d4-a1af-d74e9181135b tempest-VolumesTransfersV357Test-265589655 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.873s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 04:44:58 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-cd266bba-6e02-44d4-a1af-d74e9181135b tempest-VolumesTransfersV357Test-265589655 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (780c831f-9ec8-4447-9729-128b5b9a4f1d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bcda8d43-6fb2-49d0-a722-64c5d04c0017', 'volume_size': 1}' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:44:58 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-cd266bba-6e02-44d4-a1af-d74e9181135b tempest-VolumesTransfersV357Test-265589655 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fe8531e4-09bc-49d2-a85e-e69e8c1f3c0a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:44:58 devstack cinder-volume[87444]: INFO cinder.volume.flows.manager.create_volume [None req-cd266bba-6e02-44d4-a1af-d74e9181135b tempest-VolumesTransfersV357Test-265589655 None] Volume volume-bcda8d43-6fb2-49d0-a722-64c5d04c0017 (bcda8d43-6fb2-49d0-a722-64c5d04c0017): created successfully Jul 10 04:44:58 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-cd266bba-6e02-44d4-a1af-d74e9181135b tempest-VolumesTransfersV357Test-265589655 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fe8531e4-09bc-49d2-a85e-e69e8c1f3c0a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:44:58 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-cd266bba-6e02-44d4-a1af-d74e9181135b tempest-VolumesTransfersV357Test-265589655 None] Flow 'volume_create_manager' (10b98b71-c800-4928-8ac4-adf464a04ce8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87444) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 04:44:58 devstack cinder-volume[87444]: INFO cinder.volume.manager [None req-cd266bba-6e02-44d4-a1af-d74e9181135b tempest-VolumesTransfersV357Test-265589655 None] Created volume successfully. Jul 10 04:44:58 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-de891940-6db8-4efd-a486-3ca1ae8180e5 tempest-VolumesExtendTest-564624957 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 04:44:58 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-de891940-6db8-4efd-a486-3ca1ae8180e5 tempest-VolumesExtendTest-564624957 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 0.001s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 04:44:58 devstack cinder-volume[87444]: DEBUG oslo.privsep.daemon [-] privsep: reply[90c467d8-54c3-44b2-a471-a30d27cdc72c]: (4, 'raw') {{(pid=88499) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 04:44:58 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-de891940-6db8-4efd-a486-3ca1ae8180e5 tempest-VolumesExtendTest-564624957 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-222a08a6-db3d-47ef-928f-da61571b7262 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:44:58 devstack sudo[98675]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-222a08a6-db3d-47ef-928f-da61571b7262 Jul 10 04:44:58 devstack sudo[98675]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:44:58 devstack sudo[98669]: pam_unix(sudo:session): session closed for user root Jul 10 04:44:58 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-c8579fc0-a90d-426a-8a24-81ba348f7cb6 tempest-VolumesSnapshotListTestJSON-813757709 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-a1874d97-591e-46ff-9d77-4263321db1b6" returned: 0 in 0.861s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:44:58 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-c8579fc0-a90d-426a-8a24-81ba348f7cb6 tempest-VolumesSnapshotListTestJSON-813757709 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-a1874d97-591e-46ff-9d77-4263321db1b6 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:44:58 devstack sudo[98677]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-a1874d97-591e-46ff-9d77-4263321db1b6 Jul 10 04:44:58 devstack sudo[98677]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:44:59 devstack sudo[98677]: pam_unix(sudo:session): session closed for user root Jul 10 04:44:59 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-c8579fc0-a90d-426a-8a24-81ba348f7cb6 tempest-VolumesSnapshotListTestJSON-813757709 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-a1874d97-591e-46ff-9d77-4263321db1b6" returned: 0 in 0.685s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:44:59 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-c8579fc0-a90d-426a-8a24-81ba348f7cb6 tempest-VolumesSnapshotListTestJSON-813757709 None] Lock "cinder-quobyte-a1874d97-591e-46ff-9d77-4263321db1b6" released by "delete_volume" :: held 1.627s {{(pid=87444) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 04:44:59 devstack sudo[98675]: pam_unix(sudo:session): session closed for user root Jul 10 04:44:59 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-de891940-6db8-4efd-a486-3ca1ae8180e5 tempest-VolumesExtendTest-564624957 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-222a08a6-db3d-47ef-928f-da61571b7262" returned: 0 in 0.875s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:44:59 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-de891940-6db8-4efd-a486-3ca1ae8180e5 tempest-VolumesExtendTest-564624957 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-222a08a6-db3d-47ef-928f-da61571b7262 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:44:59 devstack cinder-volume[87444]: DEBUG cinder.quota [None req-c8579fc0-a90d-426a-8a24-81ba348f7cb6 tempest-VolumesSnapshotListTestJSON-813757709 None] Created reservations ['baa1957b-6ef0-41e1-acdd-cff0d7aa5f25', '9ed478c5-49de-4443-ac9f-c10acfe2708c', '64d679f6-1fd8-4371-9840-b7ec855a3e2f', '307b036c-5b37-4ce5-91e3-693e4eae9023'] {{(pid=87444) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 04:44:59 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-c8579fc0-a90d-426a-8a24-81ba348f7cb6 tempest-VolumesSnapshotListTestJSON-813757709 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 04:44:59 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-c8579fc0-a90d-426a-8a24-81ba348f7cb6 tempest-VolumesSnapshotListTestJSON-813757709 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 04:44:59 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-c8579fc0-a90d-426a-8a24-81ba348f7cb6 tempest-VolumesSnapshotListTestJSON-813757709 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922': None} {{(pid=87444) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 04:44:59 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-c8579fc0-a90d-426a-8a24-81ba348f7cb6 tempest-VolumesSnapshotListTestJSON-813757709 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922'] {{(pid=87444) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 04:44:59 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-c8579fc0-a90d-426a-8a24-81ba348f7cb6 tempest-VolumesSnapshotListTestJSON-813757709 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 04:44:59 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-c8579fc0-a90d-426a-8a24-81ba348f7cb6 tempest-VolumesSnapshotListTestJSON-813757709 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:44:59 devstack sudo[98682]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-222a08a6-db3d-47ef-928f-da61571b7262 Jul 10 04:44:59 devstack sudo[98682]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:44:59 devstack sudo[98684]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097 Jul 10 04:44:59 devstack sudo[98684]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:45:00 devstack cinder-volume[87444]: INFO cinder.volume.manager [None req-58212466-f2e2-4787-a5cf-8acf56a2e3ba tempest-VolumesTransfersV357Test-1291251864 None] Transfer volume completed successfully. Jul 10 04:45:00 devstack sudo[98684]: pam_unix(sudo:session): session closed for user root Jul 10 04:45:00 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-c8579fc0-a90d-426a-8a24-81ba348f7cb6 tempest-VolumesSnapshotListTestJSON-813757709 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097" returned: 0 in 0.793s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:45:00 devstack cinder-volume[87444]: DEBUG cinder.manager [None req-c8579fc0-a90d-426a-8a24-81ba348f7cb6 tempest-VolumesSnapshotListTestJSON-813757709 None] Notifying Schedulers of capabilities ... {{(pid=87444) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 04:45:00 devstack cinder-volume[87444]: INFO cinder.volume.manager [None req-c8579fc0-a90d-426a-8a24-81ba348f7cb6 tempest-VolumesSnapshotListTestJSON-813757709 None] Deleted volume successfully. Jul 10 04:45:00 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-c8579fc0-a90d-426a-8a24-81ba348f7cb6 tempest-VolumesSnapshotListTestJSON-813757709 None] Lock "cinder-a1874d97-591e-46ff-9d77-4263321db1b6-delete_volume" released by "delete_volume" :: held 2.706s {{(pid=87444) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 04:45:00 devstack sudo[98682]: pam_unix(sudo:session): session closed for user root Jul 10 04:45:00 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-de891940-6db8-4efd-a486-3ca1ae8180e5 tempest-VolumesExtendTest-564624957 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-222a08a6-db3d-47ef-928f-da61571b7262" returned: 1 in 1.167s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:45:00 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-de891940-6db8-4efd-a486-3ca1ae8180e5 tempest-VolumesExtendTest-564624957 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-222a08a6-db3d-47ef-928f-da61571b7262' failed. Not Retrying. {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 10 04:45:00 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-de891940-6db8-4efd-a486-3ca1ae8180e5 tempest-VolumesExtendTest-564624957 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-222a08a6-db3d-47ef-928f-da61571b7262 2G {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:45:00 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-de891940-6db8-4efd-a486-3ca1ae8180e5 tempest-VolumesExtendTest-564624957 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-222a08a6-db3d-47ef-928f-da61571b7262 2G" returned: 0 in 0.109s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:45:00 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-de891940-6db8-4efd-a486-3ca1ae8180e5 tempest-VolumesExtendTest-564624957 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 2.208s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 04:45:00 devstack cinder-volume[87444]: INFO cinder.volume.manager [None req-de891940-6db8-4efd-a486-3ca1ae8180e5 tempest-VolumesExtendTest-564624957 None] Extend volume completed successfully. Jul 10 04:45:01 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-8283acce-643f-44c6-925f-3021c60b7e8b tempest-VolumesTransfersV357Test-1004894908 None] Acquiring lock "cinder-bcda8d43-6fb2-49d0-a722-64c5d04c0017-delete_volume" by "delete_volume" {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 04:45:01 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-8283acce-643f-44c6-925f-3021c60b7e8b tempest-VolumesTransfersV357Test-1004894908 None] Lock "cinder-bcda8d43-6fb2-49d0-a722-64c5d04c0017-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 04:45:01 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-8283acce-643f-44c6-925f-3021c60b7e8b tempest-VolumesTransfersV357Test-1004894908 None] Acquiring lock "cinder-quobyte-bcda8d43-6fb2-49d0-a722-64c5d04c0017" by "delete_volume" {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 04:45:01 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-8283acce-643f-44c6-925f-3021c60b7e8b tempest-VolumesTransfersV357Test-1004894908 None] Lock "cinder-quobyte-bcda8d43-6fb2-49d0-a722-64c5d04c0017" acquired by "delete_volume" :: waited 0.023s {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 04:45:01 devstack cinder-volume[87444]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4215a83-67d9-4761-9e53-c01bb46609bb]: (4, 'qcow2') {{(pid=88499) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 04:45:01 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-8283acce-643f-44c6-925f-3021c60b7e8b tempest-VolumesTransfersV357Test-1004894908 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-bcda8d43-6fb2-49d0-a722-64c5d04c0017 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:45:01 devstack sudo[98694]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-bcda8d43-6fb2-49d0-a722-64c5d04c0017 Jul 10 04:45:01 devstack sudo[98694]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:45:02 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-f5476afe-d2b6-414e-adb4-d0bfade8a8d0 tempest-VolumesExtendTest-564624957 None] Acquiring lock "cinder-222a08a6-db3d-47ef-928f-da61571b7262-delete_volume" by "delete_volume" {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 04:45:02 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-f5476afe-d2b6-414e-adb4-d0bfade8a8d0 tempest-VolumesExtendTest-564624957 None] Lock "cinder-222a08a6-db3d-47ef-928f-da61571b7262-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 04:45:02 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-f5476afe-d2b6-414e-adb4-d0bfade8a8d0 tempest-VolumesExtendTest-564624957 None] Acquiring lock "cinder-quobyte-222a08a6-db3d-47ef-928f-da61571b7262" by "delete_volume" {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 04:45:02 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-f5476afe-d2b6-414e-adb4-d0bfade8a8d0 tempest-VolumesExtendTest-564624957 None] Lock "cinder-quobyte-222a08a6-db3d-47ef-928f-da61571b7262" acquired by "delete_volume" :: waited 0.029s {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 04:45:02 devstack cinder-volume[87444]: DEBUG oslo.privsep.daemon [-] privsep: reply[0cff5c91-0fac-42f1-a52e-5ea683d0ebb2]: (4, 'raw') {{(pid=88499) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 04:45:02 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-f5476afe-d2b6-414e-adb4-d0bfade8a8d0 tempest-VolumesExtendTest-564624957 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-222a08a6-db3d-47ef-928f-da61571b7262 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:45:02 devstack sudo[98701]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-222a08a6-db3d-47ef-928f-da61571b7262 Jul 10 04:45:02 devstack sudo[98701]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:45:02 devstack sudo[98694]: pam_unix(sudo:session): session closed for user root Jul 10 04:45:02 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-8283acce-643f-44c6-925f-3021c60b7e8b tempest-VolumesTransfersV357Test-1004894908 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-bcda8d43-6fb2-49d0-a722-64c5d04c0017" returned: 0 in 0.984s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:45:02 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-8283acce-643f-44c6-925f-3021c60b7e8b tempest-VolumesTransfersV357Test-1004894908 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-bcda8d43-6fb2-49d0-a722-64c5d04c0017 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:45:02 devstack sudo[98707]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-bcda8d43-6fb2-49d0-a722-64c5d04c0017 Jul 10 04:45:02 devstack sudo[98707]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:45:03 devstack sudo[98701]: pam_unix(sudo:session): session closed for user root Jul 10 04:45:03 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-f5476afe-d2b6-414e-adb4-d0bfade8a8d0 tempest-VolumesExtendTest-564624957 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-222a08a6-db3d-47ef-928f-da61571b7262" returned: 0 in 1.140s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:45:03 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-f5476afe-d2b6-414e-adb4-d0bfade8a8d0 tempest-VolumesExtendTest-564624957 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-222a08a6-db3d-47ef-928f-da61571b7262 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:45:03 devstack sudo[98707]: pam_unix(sudo:session): session closed for user root Jul 10 04:45:03 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-8283acce-643f-44c6-925f-3021c60b7e8b tempest-VolumesTransfersV357Test-1004894908 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-bcda8d43-6fb2-49d0-a722-64c5d04c0017" returned: 0 in 0.821s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:45:03 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-8283acce-643f-44c6-925f-3021c60b7e8b tempest-VolumesTransfersV357Test-1004894908 None] Lock "cinder-quobyte-bcda8d43-6fb2-49d0-a722-64c5d04c0017" released by "delete_volume" :: held 1.874s {{(pid=87444) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 04:45:03 devstack sudo[98713]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-222a08a6-db3d-47ef-928f-da61571b7262 Jul 10 04:45:03 devstack sudo[98713]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:45:03 devstack cinder-volume[87444]: DEBUG cinder.quota [None req-8283acce-643f-44c6-925f-3021c60b7e8b tempest-VolumesTransfersV357Test-1004894908 None] Created reservations ['3778495d-b6f0-4d4b-840d-8c6d3913133b', '16d6afda-a4bc-4775-bf48-027434fb8cd3', 'e7a1b293-e891-48be-9b3a-475c720322dd', '3574f96d-9986-4183-8e6a-29867056bbdf'] {{(pid=87444) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 04:45:03 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-8283acce-643f-44c6-925f-3021c60b7e8b tempest-VolumesTransfersV357Test-1004894908 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 04:45:03 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-8283acce-643f-44c6-925f-3021c60b7e8b tempest-VolumesTransfersV357Test-1004894908 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 04:45:03 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-8283acce-643f-44c6-925f-3021c60b7e8b tempest-VolumesTransfersV357Test-1004894908 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922': None} {{(pid=87444) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 04:45:03 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-8283acce-643f-44c6-925f-3021c60b7e8b tempest-VolumesTransfersV357Test-1004894908 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922'] {{(pid=87444) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 04:45:03 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-8283acce-643f-44c6-925f-3021c60b7e8b tempest-VolumesTransfersV357Test-1004894908 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 04:45:03 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-8283acce-643f-44c6-925f-3021c60b7e8b tempest-VolumesTransfersV357Test-1004894908 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:45:03 devstack sudo[98719]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097 Jul 10 04:45:03 devstack sudo[98719]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:45:04 devstack sudo[98713]: pam_unix(sudo:session): session closed for user root Jul 10 04:45:04 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-f5476afe-d2b6-414e-adb4-d0bfade8a8d0 tempest-VolumesExtendTest-564624957 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-222a08a6-db3d-47ef-928f-da61571b7262" returned: 1 in 1.196s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:45:04 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-f5476afe-d2b6-414e-adb4-d0bfade8a8d0 tempest-VolumesExtendTest-564624957 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-222a08a6-db3d-47ef-928f-da61571b7262' failed. Not Retrying. {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 10 04:45:04 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-f5476afe-d2b6-414e-adb4-d0bfade8a8d0 tempest-VolumesExtendTest-564624957 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-222a08a6-db3d-47ef-928f-da61571b7262 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:45:04 devstack sudo[98732]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-222a08a6-db3d-47ef-928f-da61571b7262 Jul 10 04:45:04 devstack sudo[98732]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:45:04 devstack sudo[98719]: pam_unix(sudo:session): session closed for user root Jul 10 04:45:04 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-8283acce-643f-44c6-925f-3021c60b7e8b tempest-VolumesTransfersV357Test-1004894908 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097" returned: 0 in 1.009s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:45:04 devstack cinder-volume[87444]: DEBUG cinder.manager [None req-8283acce-643f-44c6-925f-3021c60b7e8b tempest-VolumesTransfersV357Test-1004894908 None] Notifying Schedulers of capabilities ... {{(pid=87444) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 04:45:04 devstack cinder-volume[87444]: INFO cinder.volume.manager [None req-8283acce-643f-44c6-925f-3021c60b7e8b tempest-VolumesTransfersV357Test-1004894908 None] Deleted volume successfully. Jul 10 04:45:04 devstack cinder-volume[87444]: DEBUG cinder.volume.flows.manager.create_volume [None req-a3c2b3a9-6b85-404d-9d70-29aec517ea7e tempest-VolumesTransfersV357Test-265589655 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87444) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 04:45:04 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-a3c2b3a9-6b85-404d-9d70-29aec517ea7e tempest-VolumesTransfersV357Test-265589655 None] Flow 'volume_create_manager' (37fc9318-5101-493a-82ba-6aadf72174a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 04:45:04 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-a3c2b3a9-6b85-404d-9d70-29aec517ea7e tempest-VolumesTransfersV357Test-265589655 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (68fa8407-c161-40ce-bf36-1b1cb5459682) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:45:04 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-8283acce-643f-44c6-925f-3021c60b7e8b tempest-VolumesTransfersV357Test-1004894908 None] Lock "cinder-bcda8d43-6fb2-49d0-a722-64c5d04c0017-delete_volume" released by "delete_volume" :: held 3.277s {{(pid=87444) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 04:45:04 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-a3c2b3a9-6b85-404d-9d70-29aec517ea7e tempest-VolumesTransfersV357Test-265589655 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (68fa8407-c161-40ce-bf36-1b1cb5459682) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T02:45:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1954544448',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b6f4b81d-095e-40eb-aaa0-1be1f694a6fc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b612e859c41f4166a96891ea04044505',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T02:45:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T02:45:05Z,use_quota=True,user_id='363b0f499ea64f11ac1e72ea670270dd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(317e369e-1e06-434d-ae95-a335f0e6c903),volume_type_id=317e369e-1e06-434d-ae95-a335f0e6c903)' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:45:04 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-a3c2b3a9-6b85-404d-9d70-29aec517ea7e tempest-VolumesTransfersV357Test-265589655 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (797195a3-b714-4a22-abcb-c1a9a9c35303) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:45:04 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-a3c2b3a9-6b85-404d-9d70-29aec517ea7e tempest-VolumesTransfersV357Test-265589655 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (797195a3-b714-4a22-abcb-c1a9a9c35303) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:45:04 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-a3c2b3a9-6b85-404d-9d70-29aec517ea7e tempest-VolumesTransfersV357Test-265589655 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (77a35115-2be1-4a7b-ac4e-66efb982b1c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:45:04 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-a3c2b3a9-6b85-404d-9d70-29aec517ea7e tempest-VolumesTransfersV357Test-265589655 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (77a35115-2be1-4a7b-ac4e-66efb982b1c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b6f4b81d-095e-40eb-aaa0-1be1f694a6fc', 'volume_name': 'volume-b6f4b81d-095e-40eb-aaa0-1be1f694a6fc', 'volume_size': 1}' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:45:04 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-a3c2b3a9-6b85-404d-9d70-29aec517ea7e tempest-VolumesTransfersV357Test-265589655 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1c5c1fe5-384f-44e9-bd29-a38ec8846509) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:45:04 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-a3c2b3a9-6b85-404d-9d70-29aec517ea7e tempest-VolumesTransfersV357Test-265589655 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1c5c1fe5-384f-44e9-bd29-a38ec8846509) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:45:04 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-a3c2b3a9-6b85-404d-9d70-29aec517ea7e tempest-VolumesTransfersV357Test-265589655 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ec5d0d8c-ed6a-4689-ba57-0f77a368953f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:45:04 devstack cinder-volume[87444]: INFO cinder.volume.flows.manager.create_volume [None req-a3c2b3a9-6b85-404d-9d70-29aec517ea7e tempest-VolumesTransfersV357Test-265589655 None] Volume b6f4b81d-095e-40eb-aaa0-1be1f694a6fc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b6f4b81d-095e-40eb-aaa0-1be1f694a6fc', 'volume_size': 1} Jul 10 04:45:04 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-a3c2b3a9-6b85-404d-9d70-29aec517ea7e tempest-VolumesTransfersV357Test-265589655 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 04:45:04 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-a3c2b3a9-6b85-404d-9d70-29aec517ea7e tempest-VolumesTransfersV357Test-265589655 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 04:45:04 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-a3c2b3a9-6b85-404d-9d70-29aec517ea7e tempest-VolumesTransfersV357Test-265589655 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T02:45:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1954544448',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b6f4b81d-095e-40eb-aaa0-1be1f694a6fc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b612e859c41f4166a96891ea04044505',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T02:45:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T02:45:05Z,use_quota=True,user_id='363b0f499ea64f11ac1e72ea670270dd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(317e369e-1e06-434d-ae95-a335f0e6c903),volume_type_id=317e369e-1e06-434d-ae95-a335f0e6c903)}" {{(pid=87444) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 04:45:04 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.remotefs [None req-a3c2b3a9-6b85-404d-9d70-29aec517ea7e tempest-VolumesTransfersV357Test-265589655 None] Creating volume b6f4b81d-095e-40eb-aaa0-1be1f694a6fc {{(pid=87444) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 04:45:04 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-a3c2b3a9-6b85-404d-9d70-29aec517ea7e tempest-VolumesTransfersV357Test-265589655 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 04:45:04 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-a3c2b3a9-6b85-404d-9d70-29aec517ea7e tempest-VolumesTransfersV357Test-265589655 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 04:45:04 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-a3c2b3a9-6b85-404d-9d70-29aec517ea7e tempest-VolumesTransfersV357Test-265589655 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922': None} {{(pid=87444) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 04:45:04 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-a3c2b3a9-6b85-404d-9d70-29aec517ea7e tempest-VolumesTransfersV357Test-265589655 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922'] {{(pid=87444) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 04:45:04 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-a3c2b3a9-6b85-404d-9d70-29aec517ea7e tempest-VolumesTransfersV357Test-265589655 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 04:45:04 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-a3c2b3a9-6b85-404d-9d70-29aec517ea7e tempest-VolumesTransfersV357Test-265589655 None] Selected osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922 as target Quobyte volume. {{(pid=87444) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 04:45:04 devstack cinder-volume[87444]: INFO cinder.volume.drivers.remotefs [None req-a3c2b3a9-6b85-404d-9d70-29aec517ea7e tempest-VolumesTransfersV357Test-265589655 None] casted to osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922 Jul 10 04:45:04 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-a3c2b3a9-6b85-404d-9d70-29aec517ea7e tempest-VolumesTransfersV357Test-265589655 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-b6f4b81d-095e-40eb-aaa0-1be1f694a6fc 1073741824 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:45:05 devstack sudo[98734]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-b6f4b81d-095e-40eb-aaa0-1be1f694a6fc 1073741824 Jul 10 04:45:05 devstack sudo[98734]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:45:05 devstack sudo[98732]: pam_unix(sudo:session): session closed for user root Jul 10 04:45:05 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-f5476afe-d2b6-414e-adb4-d0bfade8a8d0 tempest-VolumesExtendTest-564624957 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-222a08a6-db3d-47ef-928f-da61571b7262" returned: 0 in 0.738s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:45:05 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-f5476afe-d2b6-414e-adb4-d0bfade8a8d0 tempest-VolumesExtendTest-564624957 None] Lock "cinder-quobyte-222a08a6-db3d-47ef-928f-da61571b7262" released by "delete_volume" :: held 3.165s {{(pid=87444) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 04:45:05 devstack cinder-volume[87444]: DEBUG cinder.quota [None req-f5476afe-d2b6-414e-adb4-d0bfade8a8d0 tempest-VolumesExtendTest-564624957 None] Created reservations ['8c778c90-af79-49db-9e50-affd6a19e992', '119e6550-7ad1-4f7b-9715-5211063dde9b', '26324975-8f69-4cdc-a0e4-1a479854687a', 'aea6a4f9-f322-4992-9fc4-46ee6617a0fb'] {{(pid=87444) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 04:45:05 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-f5476afe-d2b6-414e-adb4-d0bfade8a8d0 tempest-VolumesExtendTest-564624957 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 04:45:05 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-f5476afe-d2b6-414e-adb4-d0bfade8a8d0 tempest-VolumesExtendTest-564624957 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 04:45:05 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-f5476afe-d2b6-414e-adb4-d0bfade8a8d0 tempest-VolumesExtendTest-564624957 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922': None} {{(pid=87444) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 04:45:05 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-f5476afe-d2b6-414e-adb4-d0bfade8a8d0 tempest-VolumesExtendTest-564624957 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922'] {{(pid=87444) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 04:45:05 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-f5476afe-d2b6-414e-adb4-d0bfade8a8d0 tempest-VolumesExtendTest-564624957 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 04:45:05 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-f5476afe-d2b6-414e-adb4-d0bfade8a8d0 tempest-VolumesExtendTest-564624957 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:45:05 devstack sudo[98740]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097 Jul 10 04:45:05 devstack sudo[98740]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:45:06 devstack sudo[98734]: pam_unix(sudo:session): session closed for user root Jul 10 04:45:06 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-a3c2b3a9-6b85-404d-9d70-29aec517ea7e tempest-VolumesTransfersV357Test-265589655 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-b6f4b81d-095e-40eb-aaa0-1be1f694a6fc 1073741824" returned: 0 in 1.012s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:45:06 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-a3c2b3a9-6b85-404d-9d70-29aec517ea7e tempest-VolumesTransfersV357Test-265589655 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-b6f4b81d-095e-40eb-aaa0-1be1f694a6fc {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:45:06 devstack sudo[98743]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-b6f4b81d-095e-40eb-aaa0-1be1f694a6fc Jul 10 04:45:06 devstack sudo[98743]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:45:06 devstack sudo[98740]: pam_unix(sudo:session): session closed for user root Jul 10 04:45:06 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-f5476afe-d2b6-414e-adb4-d0bfade8a8d0 tempest-VolumesExtendTest-564624957 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097" returned: 0 in 0.720s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:45:06 devstack cinder-volume[87444]: DEBUG cinder.manager [None req-f5476afe-d2b6-414e-adb4-d0bfade8a8d0 tempest-VolumesExtendTest-564624957 None] Notifying Schedulers of capabilities ... {{(pid=87444) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 04:45:06 devstack cinder-volume[87444]: INFO cinder.volume.manager [None req-f5476afe-d2b6-414e-adb4-d0bfade8a8d0 tempest-VolumesExtendTest-564624957 None] Deleted volume successfully. Jul 10 04:45:06 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-f5476afe-d2b6-414e-adb4-d0bfade8a8d0 tempest-VolumesExtendTest-564624957 None] Lock "cinder-222a08a6-db3d-47ef-928f-da61571b7262-delete_volume" released by "delete_volume" :: held 4.171s {{(pid=87444) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 04:45:06 devstack sudo[98743]: pam_unix(sudo:session): session closed for user root Jul 10 04:45:06 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-a3c2b3a9-6b85-404d-9d70-29aec517ea7e tempest-VolumesTransfersV357Test-265589655 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-b6f4b81d-095e-40eb-aaa0-1be1f694a6fc" returned: 0 in 0.720s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:45:06 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-a3c2b3a9-6b85-404d-9d70-29aec517ea7e tempest-VolumesTransfersV357Test-265589655 None] <== create_volume: return (1771ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922'} {{(pid=87444) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 04:45:06 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-a3c2b3a9-6b85-404d-9d70-29aec517ea7e tempest-VolumesTransfersV357Test-265589655 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.774s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 04:45:06 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-a3c2b3a9-6b85-404d-9d70-29aec517ea7e tempest-VolumesTransfersV357Test-265589655 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ec5d0d8c-ed6a-4689-ba57-0f77a368953f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b6f4b81d-095e-40eb-aaa0-1be1f694a6fc', 'volume_size': 1}' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:45:06 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-a3c2b3a9-6b85-404d-9d70-29aec517ea7e tempest-VolumesTransfersV357Test-265589655 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (33a8825f-0f49-46ce-bc8d-11580564210b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:45:06 devstack cinder-volume[87444]: INFO cinder.volume.flows.manager.create_volume [None req-a3c2b3a9-6b85-404d-9d70-29aec517ea7e tempest-VolumesTransfersV357Test-265589655 None] Volume volume-b6f4b81d-095e-40eb-aaa0-1be1f694a6fc (b6f4b81d-095e-40eb-aaa0-1be1f694a6fc): created successfully Jul 10 04:45:06 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-a3c2b3a9-6b85-404d-9d70-29aec517ea7e tempest-VolumesTransfersV357Test-265589655 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (33a8825f-0f49-46ce-bc8d-11580564210b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:45:06 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-a3c2b3a9-6b85-404d-9d70-29aec517ea7e tempest-VolumesTransfersV357Test-265589655 None] Flow 'volume_create_manager' (37fc9318-5101-493a-82ba-6aadf72174a1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87444) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 04:45:06 devstack cinder-volume[87444]: INFO cinder.volume.manager [None req-a3c2b3a9-6b85-404d-9d70-29aec517ea7e tempest-VolumesTransfersV357Test-265589655 None] Created volume successfully. Jul 10 04:45:07 devstack cinder-volume[87444]: DEBUG cinder.volume.flows.manager.create_volume [None req-209e8395-5efd-4870-8002-429bc27ea03c tempest-VolumesExtendTest-564624957 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87444) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 04:45:07 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-209e8395-5efd-4870-8002-429bc27ea03c tempest-VolumesExtendTest-564624957 None] Flow 'volume_create_manager' (c0dbb735-42a7-4531-a577-4a4412eaf713) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 04:45:07 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-209e8395-5efd-4870-8002-429bc27ea03c tempest-VolumesExtendTest-564624957 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d028738b-9f11-4a2e-b29a-090fc2dded05) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:45:07 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-209e8395-5efd-4870-8002-429bc27ea03c tempest-VolumesExtendTest-564624957 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d028738b-9f11-4a2e-b29a-090fc2dded05) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T02:45:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-782609382',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=793653ec-a902-4198-aa9b-cc2878684232,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6bd98184f6244876b4ed95a08c59063f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T02:45:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T02:45:07Z,use_quota=True,user_id='b8c426901e684c64bb86939eeb86e678',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(317e369e-1e06-434d-ae95-a335f0e6c903),volume_type_id=317e369e-1e06-434d-ae95-a335f0e6c903)' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:45:07 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-209e8395-5efd-4870-8002-429bc27ea03c tempest-VolumesExtendTest-564624957 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1969932a-7f5a-471a-aa59-04784b8b0473) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:45:07 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-209e8395-5efd-4870-8002-429bc27ea03c tempest-VolumesExtendTest-564624957 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1969932a-7f5a-471a-aa59-04784b8b0473) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:45:07 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-209e8395-5efd-4870-8002-429bc27ea03c tempest-VolumesExtendTest-564624957 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f233d331-4ad1-45a9-b643-744aaea2a7ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:45:07 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-209e8395-5efd-4870-8002-429bc27ea03c tempest-VolumesExtendTest-564624957 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f233d331-4ad1-45a9-b643-744aaea2a7ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '793653ec-a902-4198-aa9b-cc2878684232', 'volume_name': 'volume-793653ec-a902-4198-aa9b-cc2878684232', 'volume_size': 1}' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:45:07 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-209e8395-5efd-4870-8002-429bc27ea03c tempest-VolumesExtendTest-564624957 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (201ceffe-97f4-4fd7-9d8a-6ea2e773da19) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:45:07 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-209e8395-5efd-4870-8002-429bc27ea03c tempest-VolumesExtendTest-564624957 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (201ceffe-97f4-4fd7-9d8a-6ea2e773da19) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:45:07 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-209e8395-5efd-4870-8002-429bc27ea03c tempest-VolumesExtendTest-564624957 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (92648785-8446-4a14-96eb-ba007fd49c83) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:45:07 devstack cinder-volume[87444]: INFO cinder.volume.flows.manager.create_volume [None req-209e8395-5efd-4870-8002-429bc27ea03c tempest-VolumesExtendTest-564624957 None] Volume 793653ec-a902-4198-aa9b-cc2878684232: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-793653ec-a902-4198-aa9b-cc2878684232', 'volume_size': 1} Jul 10 04:45:07 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-209e8395-5efd-4870-8002-429bc27ea03c tempest-VolumesExtendTest-564624957 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 04:45:07 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-209e8395-5efd-4870-8002-429bc27ea03c tempest-VolumesExtendTest-564624957 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 04:45:07 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-209e8395-5efd-4870-8002-429bc27ea03c tempest-VolumesExtendTest-564624957 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T02:45:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-782609382',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=793653ec-a902-4198-aa9b-cc2878684232,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6bd98184f6244876b4ed95a08c59063f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T02:45:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T02:45:07Z,use_quota=True,user_id='b8c426901e684c64bb86939eeb86e678',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(317e369e-1e06-434d-ae95-a335f0e6c903),volume_type_id=317e369e-1e06-434d-ae95-a335f0e6c903)}" {{(pid=87444) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 04:45:07 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.remotefs [None req-209e8395-5efd-4870-8002-429bc27ea03c tempest-VolumesExtendTest-564624957 None] Creating volume 793653ec-a902-4198-aa9b-cc2878684232 {{(pid=87444) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 04:45:07 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-209e8395-5efd-4870-8002-429bc27ea03c tempest-VolumesExtendTest-564624957 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 04:45:07 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-209e8395-5efd-4870-8002-429bc27ea03c tempest-VolumesExtendTest-564624957 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 04:45:07 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-209e8395-5efd-4870-8002-429bc27ea03c tempest-VolumesExtendTest-564624957 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922': None} {{(pid=87444) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 04:45:07 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-209e8395-5efd-4870-8002-429bc27ea03c tempest-VolumesExtendTest-564624957 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922'] {{(pid=87444) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 04:45:07 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-209e8395-5efd-4870-8002-429bc27ea03c tempest-VolumesExtendTest-564624957 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 04:45:07 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-209e8395-5efd-4870-8002-429bc27ea03c tempest-VolumesExtendTest-564624957 None] Selected osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922 as target Quobyte volume. {{(pid=87444) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 04:45:07 devstack cinder-volume[87444]: INFO cinder.volume.drivers.remotefs [None req-209e8395-5efd-4870-8002-429bc27ea03c tempest-VolumesExtendTest-564624957 None] casted to osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922 Jul 10 04:45:07 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-209e8395-5efd-4870-8002-429bc27ea03c tempest-VolumesExtendTest-564624957 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-793653ec-a902-4198-aa9b-cc2878684232 1073741824 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:45:07 devstack sudo[98747]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-793653ec-a902-4198-aa9b-cc2878684232 1073741824 Jul 10 04:45:07 devstack sudo[98747]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:45:08 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-dce82fcf-9466-46b2-9630-dfb56461dbae tempest-VolumesTransfersV357Test-1004894908 None] Acquiring lock "cinder-b6f4b81d-095e-40eb-aaa0-1be1f694a6fc-delete_volume" by "delete_volume" {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 04:45:08 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-dce82fcf-9466-46b2-9630-dfb56461dbae tempest-VolumesTransfersV357Test-1004894908 None] Lock "cinder-b6f4b81d-095e-40eb-aaa0-1be1f694a6fc-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 04:45:08 devstack sudo[98747]: pam_unix(sudo:session): session closed for user root Jul 10 04:45:08 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-209e8395-5efd-4870-8002-429bc27ea03c tempest-VolumesExtendTest-564624957 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-793653ec-a902-4198-aa9b-cc2878684232 1073741824" returned: 0 in 0.946s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:45:08 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-dce82fcf-9466-46b2-9630-dfb56461dbae tempest-VolumesTransfersV357Test-1004894908 None] Acquiring lock "cinder-quobyte-b6f4b81d-095e-40eb-aaa0-1be1f694a6fc" by "delete_volume" {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 04:45:08 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-dce82fcf-9466-46b2-9630-dfb56461dbae tempest-VolumesTransfersV357Test-1004894908 None] Lock "cinder-quobyte-b6f4b81d-095e-40eb-aaa0-1be1f694a6fc" acquired by "delete_volume" :: waited 0.043s {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 04:45:08 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-209e8395-5efd-4870-8002-429bc27ea03c tempest-VolumesExtendTest-564624957 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-793653ec-a902-4198-aa9b-cc2878684232 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:45:08 devstack cinder-volume[87444]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ccf982b-10fa-4d11-ae31-e148790271fa]: (4, 'qcow2') {{(pid=88499) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 04:45:08 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-dce82fcf-9466-46b2-9630-dfb56461dbae tempest-VolumesTransfersV357Test-1004894908 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-b6f4b81d-095e-40eb-aaa0-1be1f694a6fc {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:45:08 devstack sudo[98754]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-793653ec-a902-4198-aa9b-cc2878684232 Jul 10 04:45:08 devstack sudo[98754]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:45:08 devstack sudo[98756]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-b6f4b81d-095e-40eb-aaa0-1be1f694a6fc Jul 10 04:45:08 devstack sudo[98756]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:45:09 devstack sudo[98754]: pam_unix(sudo:session): session closed for user root Jul 10 04:45:09 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-209e8395-5efd-4870-8002-429bc27ea03c tempest-VolumesExtendTest-564624957 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-793653ec-a902-4198-aa9b-cc2878684232" returned: 0 in 0.763s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:45:09 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-209e8395-5efd-4870-8002-429bc27ea03c tempest-VolumesExtendTest-564624957 None] <== create_volume: return (1808ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922'} {{(pid=87444) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 04:45:09 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-209e8395-5efd-4870-8002-429bc27ea03c tempest-VolumesExtendTest-564624957 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.810s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 04:45:09 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-209e8395-5efd-4870-8002-429bc27ea03c tempest-VolumesExtendTest-564624957 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (92648785-8446-4a14-96eb-ba007fd49c83) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-793653ec-a902-4198-aa9b-cc2878684232', 'volume_size': 1}' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:45:09 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-209e8395-5efd-4870-8002-429bc27ea03c tempest-VolumesExtendTest-564624957 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d23bfb58-e2ec-44b1-b189-50f89ae2e1ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:45:09 devstack cinder-volume[87444]: INFO cinder.volume.flows.manager.create_volume [None req-209e8395-5efd-4870-8002-429bc27ea03c tempest-VolumesExtendTest-564624957 None] Volume volume-793653ec-a902-4198-aa9b-cc2878684232 (793653ec-a902-4198-aa9b-cc2878684232): created successfully Jul 10 04:45:09 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-209e8395-5efd-4870-8002-429bc27ea03c tempest-VolumesExtendTest-564624957 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d23bfb58-e2ec-44b1-b189-50f89ae2e1ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:45:09 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-209e8395-5efd-4870-8002-429bc27ea03c tempest-VolumesExtendTest-564624957 None] Flow 'volume_create_manager' (c0dbb735-42a7-4531-a577-4a4412eaf713) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87444) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 04:45:09 devstack cinder-volume[87444]: INFO cinder.volume.manager [None req-209e8395-5efd-4870-8002-429bc27ea03c tempest-VolumesExtendTest-564624957 None] Created volume successfully. Jul 10 04:45:09 devstack sudo[98756]: pam_unix(sudo:session): session closed for user root Jul 10 04:45:09 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-dce82fcf-9466-46b2-9630-dfb56461dbae tempest-VolumesTransfersV357Test-1004894908 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-b6f4b81d-095e-40eb-aaa0-1be1f694a6fc" returned: 0 in 0.955s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:45:09 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-dce82fcf-9466-46b2-9630-dfb56461dbae tempest-VolumesTransfersV357Test-1004894908 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-b6f4b81d-095e-40eb-aaa0-1be1f694a6fc {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:45:09 devstack sudo[98762]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-b6f4b81d-095e-40eb-aaa0-1be1f694a6fc Jul 10 04:45:09 devstack sudo[98762]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:45:09 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-57f382af-692f-4867-af42-bf11188a7346 tempest-VolumesExtendTest-564624957 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 04:45:09 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-57f382af-692f-4867-af42-bf11188a7346 tempest-VolumesExtendTest-564624957 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 04:45:09 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.remotefs [None req-57f382af-692f-4867-af42-bf11188a7346 tempest-VolumesExtendTest-564624957 None] Creating offline snapshot 78c51607-22bf-4664-9f47-17dad42ca93d of volume 793653ec-a902-4198-aa9b-cc2878684232 {{(pid=87444) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 10 04:45:09 devstack cinder-volume[87444]: DEBUG oslo.privsep.daemon [-] privsep: reply[6538099d-18e7-4e2f-836d-b04591db8d3f]: (4, 'qcow2') {{(pid=88499) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 04:45:09 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-57f382af-692f-4867-af42-bf11188a7346 tempest-VolumesExtendTest-564624957 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-793653ec-a902-4198-aa9b-cc2878684232 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:45:09 devstack sudo[98764]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-793653ec-a902-4198-aa9b-cc2878684232 Jul 10 04:45:09 devstack sudo[98764]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:45:10 devstack sudo[98762]: pam_unix(sudo:session): session closed for user root Jul 10 04:45:10 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-dce82fcf-9466-46b2-9630-dfb56461dbae tempest-VolumesTransfersV357Test-1004894908 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-b6f4b81d-095e-40eb-aaa0-1be1f694a6fc" returned: 0 in 0.771s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:45:10 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-dce82fcf-9466-46b2-9630-dfb56461dbae tempest-VolumesTransfersV357Test-1004894908 None] Lock "cinder-quobyte-b6f4b81d-095e-40eb-aaa0-1be1f694a6fc" released by "delete_volume" :: held 1.837s {{(pid=87444) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 04:45:10 devstack cinder-volume[87444]: DEBUG cinder.quota [None req-dce82fcf-9466-46b2-9630-dfb56461dbae tempest-VolumesTransfersV357Test-1004894908 None] Created reservations ['3ebba8b2-7111-4950-a009-95192480d217', 'b91d5ebe-be8b-4d7f-b36e-938bdd735bf1', '8c773e35-008b-4613-aea7-a314f3892181', 'ca28863d-2d2d-4443-8778-ced030818048'] {{(pid=87444) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 04:45:10 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-dce82fcf-9466-46b2-9630-dfb56461dbae tempest-VolumesTransfersV357Test-1004894908 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 04:45:10 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-dce82fcf-9466-46b2-9630-dfb56461dbae tempest-VolumesTransfersV357Test-1004894908 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 04:45:10 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-dce82fcf-9466-46b2-9630-dfb56461dbae tempest-VolumesTransfersV357Test-1004894908 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922': None} {{(pid=87444) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 04:45:10 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-dce82fcf-9466-46b2-9630-dfb56461dbae tempest-VolumesTransfersV357Test-1004894908 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922'] {{(pid=87444) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 04:45:10 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-dce82fcf-9466-46b2-9630-dfb56461dbae tempest-VolumesTransfersV357Test-1004894908 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 04:45:10 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-dce82fcf-9466-46b2-9630-dfb56461dbae tempest-VolumesTransfersV357Test-1004894908 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:45:10 devstack sudo[98767]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097 Jul 10 04:45:10 devstack sudo[98767]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:45:10 devstack sudo[98764]: pam_unix(sudo:session): session closed for user root Jul 10 04:45:10 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-57f382af-692f-4867-af42-bf11188a7346 tempest-VolumesExtendTest-564624957 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-793653ec-a902-4198-aa9b-cc2878684232" returned: 0 in 0.967s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:45:10 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-57f382af-692f-4867-af42-bf11188a7346 tempest-VolumesExtendTest-564624957 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-793653ec-a902-4198-aa9b-cc2878684232,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-793653ec-a902-4198-aa9b-cc2878684232.78c51607-22bf-4664-9f47-17dad42ca93d 1G {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:45:10 devstack sudo[98773]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-793653ec-a902-4198-aa9b-cc2878684232,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-793653ec-a902-4198-aa9b-cc2878684232.78c51607-22bf-4664-9f47-17dad42ca93d 1G Jul 10 04:45:10 devstack sudo[98773]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:45:11 devstack sudo[98767]: pam_unix(sudo:session): session closed for user root Jul 10 04:45:11 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-dce82fcf-9466-46b2-9630-dfb56461dbae tempest-VolumesTransfersV357Test-1004894908 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097" returned: 0 in 1.135s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:45:11 devstack cinder-volume[87444]: DEBUG cinder.manager [None req-dce82fcf-9466-46b2-9630-dfb56461dbae tempest-VolumesTransfersV357Test-1004894908 None] Notifying Schedulers of capabilities ... {{(pid=87444) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 04:45:11 devstack cinder-volume[87444]: INFO cinder.volume.manager [None req-dce82fcf-9466-46b2-9630-dfb56461dbae tempest-VolumesTransfersV357Test-1004894908 None] Deleted volume successfully. Jul 10 04:45:11 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-dce82fcf-9466-46b2-9630-dfb56461dbae tempest-VolumesTransfersV357Test-1004894908 None] Lock "cinder-b6f4b81d-095e-40eb-aaa0-1be1f694a6fc-delete_volume" released by "delete_volume" :: held 3.272s {{(pid=87444) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 04:45:11 devstack sudo[98773]: pam_unix(sudo:session): session closed for user root Jul 10 04:45:11 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-57f382af-692f-4867-af42-bf11188a7346 tempest-VolumesExtendTest-564624957 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-793653ec-a902-4198-aa9b-cc2878684232,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-793653ec-a902-4198-aa9b-cc2878684232.78c51607-22bf-4664-9f47-17dad42ca93d 1G" returned: 0 in 1.387s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:45:11 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-57f382af-692f-4867-af42-bf11188a7346 tempest-VolumesExtendTest-564624957 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-793653ec-a902-4198-aa9b-cc2878684232 -F qcow2 /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-793653ec-a902-4198-aa9b-cc2878684232.78c51607-22bf-4664-9f47-17dad42ca93d {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:45:11 devstack sudo[98780]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-793653ec-a902-4198-aa9b-cc2878684232 -F qcow2 /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-793653ec-a902-4198-aa9b-cc2878684232.78c51607-22bf-4664-9f47-17dad42ca93d Jul 10 04:45:11 devstack sudo[98780]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:45:12 devstack sudo[98780]: pam_unix(sudo:session): session closed for user root Jul 10 04:45:12 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-57f382af-692f-4867-af42-bf11188a7346 tempest-VolumesExtendTest-564624957 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-793653ec-a902-4198-aa9b-cc2878684232 -F qcow2 /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-793653ec-a902-4198-aa9b-cc2878684232.78c51607-22bf-4664-9f47-17dad42ca93d" returned: 0 in 0.925s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:45:12 devstack cinder-volume[87444]: WARNING cinder.volume.drivers.remotefs [None req-57f382af-692f-4867-af42-bf11188a7346 tempest-VolumesExtendTest-564624957 None] /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-793653ec-a902-4198-aa9b-cc2878684232.78c51607-22bf-4664-9f47-17dad42ca93d is being set with open permissions: ugo+rw Jul 10 04:45:12 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-57f382af-692f-4867-af42-bf11188a7346 tempest-VolumesExtendTest-564624957 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-793653ec-a902-4198-aa9b-cc2878684232.78c51607-22bf-4664-9f47-17dad42ca93d {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:45:12 devstack sudo[98785]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-793653ec-a902-4198-aa9b-cc2878684232.78c51607-22bf-4664-9f47-17dad42ca93d Jul 10 04:45:12 devstack sudo[98785]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:45:13 devstack sudo[98785]: pam_unix(sudo:session): session closed for user root Jul 10 04:45:13 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-57f382af-692f-4867-af42-bf11188a7346 tempest-VolumesExtendTest-564624957 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-793653ec-a902-4198-aa9b-cc2878684232.78c51607-22bf-4664-9f47-17dad42ca93d" returned: 0 in 0.995s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:45:13 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-57f382af-692f-4867-af42-bf11188a7346 tempest-VolumesExtendTest-564624957 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-793653ec-a902-4198-aa9b-cc2878684232.info {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:45:13 devstack sudo[98789]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-793653ec-a902-4198-aa9b-cc2878684232.info Jul 10 04:45:13 devstack sudo[98789]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:45:14 devstack sudo[98789]: pam_unix(sudo:session): session closed for user root Jul 10 04:45:14 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-57f382af-692f-4867-af42-bf11188a7346 tempest-VolumesExtendTest-564624957 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-793653ec-a902-4198-aa9b-cc2878684232.info" returned: 0 in 0.790s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:45:14 devstack cinder-volume[87444]: WARNING cinder.volume.drivers.remotefs [None req-57f382af-692f-4867-af42-bf11188a7346 tempest-VolumesExtendTest-564624957 None] /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-793653ec-a902-4198-aa9b-cc2878684232.info is being set with open permissions: ugo+rw Jul 10 04:45:14 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-57f382af-692f-4867-af42-bf11188a7346 tempest-VolumesExtendTest-564624957 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-793653ec-a902-4198-aa9b-cc2878684232.info {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:45:14 devstack sudo[98796]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-793653ec-a902-4198-aa9b-cc2878684232.info Jul 10 04:45:14 devstack sudo[98796]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:45:15 devstack sudo[98796]: pam_unix(sudo:session): session closed for user root Jul 10 04:45:15 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-57f382af-692f-4867-af42-bf11188a7346 tempest-VolumesExtendTest-564624957 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-793653ec-a902-4198-aa9b-cc2878684232.info" returned: 0 in 0.888s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:45:15 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-57f382af-692f-4867-af42-bf11188a7346 tempest-VolumesExtendTest-564624957 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 6.090s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 04:45:15 devstack cinder-volume[87444]: INFO cinder.volume.manager [None req-57f382af-692f-4867-af42-bf11188a7346 tempest-VolumesExtendTest-564624957 None] Create snapshot completed successfully Jul 10 04:45:16 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-00222488-9e5f-4f79-97f2-4415d9746ab8 tempest-VolumesExtendTest-564624957 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 04:45:16 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-00222488-9e5f-4f79-97f2-4415d9746ab8 tempest-VolumesExtendTest-564624957 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 0.001s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 04:45:16 devstack cinder-volume[87444]: DEBUG oslo.privsep.daemon [-] privsep: reply[33e1088d-9a18-4e95-a6a8-ee9984ddb549]: (4, 'qcow2') {{(pid=88499) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 04:45:16 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-00222488-9e5f-4f79-97f2-4415d9746ab8 tempest-VolumesExtendTest-564624957 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-793653ec-a902-4198-aa9b-cc2878684232 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:45:16 devstack sudo[98801]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-793653ec-a902-4198-aa9b-cc2878684232 Jul 10 04:45:16 devstack sudo[98801]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:45:17 devstack sudo[98801]: pam_unix(sudo:session): session closed for user root Jul 10 04:45:17 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-00222488-9e5f-4f79-97f2-4415d9746ab8 tempest-VolumesExtendTest-564624957 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-793653ec-a902-4198-aa9b-cc2878684232" returned: 0 in 1.315s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:45:17 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-00222488-9e5f-4f79-97f2-4415d9746ab8 tempest-VolumesExtendTest-564624957 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-793653ec-a902-4198-aa9b-cc2878684232.78c51607-22bf-4664-9f47-17dad42ca93d 2G {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:45:17 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-00222488-9e5f-4f79-97f2-4415d9746ab8 tempest-VolumesExtendTest-564624957 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-793653ec-a902-4198-aa9b-cc2878684232.78c51607-22bf-4664-9f47-17dad42ca93d 2G" returned: 0 in 0.165s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:45:17 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-00222488-9e5f-4f79-97f2-4415d9746ab8 tempest-VolumesExtendTest-564624957 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 1.534s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 04:45:17 devstack cinder-volume[87444]: INFO cinder.volume.manager [None req-00222488-9e5f-4f79-97f2-4415d9746ab8 tempest-VolumesExtendTest-564624957 None] Extend volume completed successfully. Jul 10 04:45:18 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-fa9e0b9d-bea5-4a5e-ba7c-fd7eb375d771 tempest-VolumesExtendTest-564624957 None] Acquiring lock "cinder-78c51607-22bf-4664-9f47-17dad42ca93d-delete_snapshot" by "delete_snapshot" {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 04:45:18 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-fa9e0b9d-bea5-4a5e-ba7c-fd7eb375d771 tempest-VolumesExtendTest-564624957 None] Lock "cinder-78c51607-22bf-4664-9f47-17dad42ca93d-delete_snapshot" acquired by "delete_snapshot" :: waited 0.039s {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 04:45:18 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-fa9e0b9d-bea5-4a5e-ba7c-fd7eb375d771 tempest-VolumesExtendTest-564624957 None] Acquiring lock "cinder-quobyte-793653ec-a902-4198-aa9b-cc2878684232" by "delete_snapshot" {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 04:45:18 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-fa9e0b9d-bea5-4a5e-ba7c-fd7eb375d771 tempest-VolumesExtendTest-564624957 None] Lock "cinder-quobyte-793653ec-a902-4198-aa9b-cc2878684232" acquired by "delete_snapshot" :: waited 0.022s {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 04:45:18 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-fa9e0b9d-bea5-4a5e-ba7c-fd7eb375d771 tempest-VolumesExtendTest-564624957 None] Acquiring lock "cinder-quobyte-78c51607-22bf-4664-9f47-17dad42ca93d" by "_delete_snapshot" {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 04:45:18 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-fa9e0b9d-bea5-4a5e-ba7c-fd7eb375d771 tempest-VolumesExtendTest-564624957 None] Lock "cinder-quobyte-78c51607-22bf-4664-9f47-17dad42ca93d" acquired by "_delete_snapshot" :: waited 0.025s {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 04:45:18 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.remotefs [None req-fa9e0b9d-bea5-4a5e-ba7c-fd7eb375d771 tempest-VolumesExtendTest-564624957 None] Deleting offline snapshot 78c51607-22bf-4664-9f47-17dad42ca93d of volume 793653ec-a902-4198-aa9b-cc2878684232 {{(pid=87444) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 10 04:45:18 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.remotefs [None req-fa9e0b9d-bea5-4a5e-ba7c-fd7eb375d771 tempest-VolumesExtendTest-564624957 None] snapshot_file for this snap is: volume-793653ec-a902-4198-aa9b-cc2878684232.78c51607-22bf-4664-9f47-17dad42ca93d {{(pid=87444) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 10 04:45:18 devstack cinder-volume[87444]: DEBUG oslo.privsep.daemon [-] privsep: reply[71cf261c-6940-48aa-81bb-816830c65199]: (4, 'qcow2') {{(pid=88499) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 04:45:18 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-fa9e0b9d-bea5-4a5e-ba7c-fd7eb375d771 tempest-VolumesExtendTest-564624957 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-793653ec-a902-4198-aa9b-cc2878684232.78c51607-22bf-4664-9f47-17dad42ca93d {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:45:18 devstack sudo[98814]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-793653ec-a902-4198-aa9b-cc2878684232.78c51607-22bf-4664-9f47-17dad42ca93d Jul 10 04:45:18 devstack sudo[98814]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:45:19 devstack cinder-volume[87444]: DEBUG cinder.volume.flows.manager.create_volume [None req-876c7a31-8e0d-457c-8231-da0c75ad4ee7 tempest-VolumesGetTest-423200778 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87444) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 04:45:19 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-876c7a31-8e0d-457c-8231-da0c75ad4ee7 tempest-VolumesGetTest-423200778 None] Flow 'volume_create_manager' (a09cfedb-046d-4977-829e-7272ca6bc836) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 04:45:19 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-876c7a31-8e0d-457c-8231-da0c75ad4ee7 tempest-VolumesGetTest-423200778 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8fab1c17-b562-4d09-8102-41eb7ee64cc2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:45:19 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-876c7a31-8e0d-457c-8231-da0c75ad4ee7 tempest-VolumesGetTest-423200778 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8fab1c17-b562-4d09-8102-41eb7ee64cc2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T02:45:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1981473894',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=addeab11-568e-44aa-bdea-b21abc4e570d,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='761a9e430aba4ae18bd6ef42f16015f4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T02:45:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T02:45:19Z,use_quota=True,user_id='ae02b9a0cfaa4f7d8fd6393dfd0bb7b6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(317e369e-1e06-434d-ae95-a335f0e6c903),volume_type_id=317e369e-1e06-434d-ae95-a335f0e6c903)' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:45:19 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-876c7a31-8e0d-457c-8231-da0c75ad4ee7 tempest-VolumesGetTest-423200778 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e392b3ae-90dd-416c-8bf1-c8e5b2c203fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:45:19 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-876c7a31-8e0d-457c-8231-da0c75ad4ee7 tempest-VolumesGetTest-423200778 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e392b3ae-90dd-416c-8bf1-c8e5b2c203fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:45:19 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-876c7a31-8e0d-457c-8231-da0c75ad4ee7 tempest-VolumesGetTest-423200778 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (284fb820-0a90-4b55-b102-3caa8e4b3a66) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:45:19 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-876c7a31-8e0d-457c-8231-da0c75ad4ee7 tempest-VolumesGetTest-423200778 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (284fb820-0a90-4b55-b102-3caa8e4b3a66) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'addeab11-568e-44aa-bdea-b21abc4e570d', 'volume_name': 'volume-addeab11-568e-44aa-bdea-b21abc4e570d', 'volume_size': 1}' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:45:19 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-876c7a31-8e0d-457c-8231-da0c75ad4ee7 tempest-VolumesGetTest-423200778 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7087b576-5a30-41d1-ab28-1dce700236ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:45:19 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-876c7a31-8e0d-457c-8231-da0c75ad4ee7 tempest-VolumesGetTest-423200778 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7087b576-5a30-41d1-ab28-1dce700236ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:45:19 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-876c7a31-8e0d-457c-8231-da0c75ad4ee7 tempest-VolumesGetTest-423200778 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b8da2fc4-ba82-4235-855c-8e36e6eabb34) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:45:19 devstack cinder-volume[87444]: INFO cinder.volume.flows.manager.create_volume [None req-876c7a31-8e0d-457c-8231-da0c75ad4ee7 tempest-VolumesGetTest-423200778 None] Volume addeab11-568e-44aa-bdea-b21abc4e570d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-addeab11-568e-44aa-bdea-b21abc4e570d', 'volume_size': 1} Jul 10 04:45:19 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-876c7a31-8e0d-457c-8231-da0c75ad4ee7 tempest-VolumesGetTest-423200778 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 04:45:19 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-876c7a31-8e0d-457c-8231-da0c75ad4ee7 tempest-VolumesGetTest-423200778 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 04:45:19 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-876c7a31-8e0d-457c-8231-da0c75ad4ee7 tempest-VolumesGetTest-423200778 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T02:45:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1981473894',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=addeab11-568e-44aa-bdea-b21abc4e570d,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='761a9e430aba4ae18bd6ef42f16015f4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T02:45:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T02:45:19Z,use_quota=True,user_id='ae02b9a0cfaa4f7d8fd6393dfd0bb7b6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(317e369e-1e06-434d-ae95-a335f0e6c903),volume_type_id=317e369e-1e06-434d-ae95-a335f0e6c903)}" {{(pid=87444) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 04:45:19 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.remotefs [None req-876c7a31-8e0d-457c-8231-da0c75ad4ee7 tempest-VolumesGetTest-423200778 None] Creating volume addeab11-568e-44aa-bdea-b21abc4e570d {{(pid=87444) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 04:45:19 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-876c7a31-8e0d-457c-8231-da0c75ad4ee7 tempest-VolumesGetTest-423200778 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 04:45:19 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-876c7a31-8e0d-457c-8231-da0c75ad4ee7 tempest-VolumesGetTest-423200778 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 04:45:19 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-876c7a31-8e0d-457c-8231-da0c75ad4ee7 tempest-VolumesGetTest-423200778 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922': None} {{(pid=87444) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 04:45:19 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-876c7a31-8e0d-457c-8231-da0c75ad4ee7 tempest-VolumesGetTest-423200778 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922'] {{(pid=87444) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 04:45:19 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-876c7a31-8e0d-457c-8231-da0c75ad4ee7 tempest-VolumesGetTest-423200778 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 04:45:19 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-876c7a31-8e0d-457c-8231-da0c75ad4ee7 tempest-VolumesGetTest-423200778 None] Selected osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922 as target Quobyte volume. {{(pid=87444) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 04:45:19 devstack cinder-volume[87444]: INFO cinder.volume.drivers.remotefs [None req-876c7a31-8e0d-457c-8231-da0c75ad4ee7 tempest-VolumesGetTest-423200778 None] casted to osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922 Jul 10 04:45:19 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-876c7a31-8e0d-457c-8231-da0c75ad4ee7 tempest-VolumesGetTest-423200778 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-addeab11-568e-44aa-bdea-b21abc4e570d 1073741824 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:45:19 devstack sudo[98816]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-addeab11-568e-44aa-bdea-b21abc4e570d 1073741824 Jul 10 04:45:19 devstack sudo[98816]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:45:19 devstack sudo[98814]: pam_unix(sudo:session): session closed for user root Jul 10 04:45:19 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-fa9e0b9d-bea5-4a5e-ba7c-fd7eb375d771 tempest-VolumesExtendTest-564624957 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-793653ec-a902-4198-aa9b-cc2878684232.78c51607-22bf-4664-9f47-17dad42ca93d" returned: 0 in 0.938s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:45:19 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.remotefs [None req-fa9e0b9d-bea5-4a5e-ba7c-fd7eb375d771 tempest-VolumesExtendTest-564624957 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-793653ec-a902-4198-aa9b-cc2878684232(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87444) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 10 04:45:19 devstack cinder-volume[87444]: DEBUG oslo.privsep.daemon [-] privsep: reply[09a51ff0-1614-4253-8283-1333a68f6023]: (4, 'qcow2') {{(pid=88499) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 04:45:19 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-fa9e0b9d-bea5-4a5e-ba7c-fd7eb375d771 tempest-VolumesExtendTest-564624957 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-793653ec-a902-4198-aa9b-cc2878684232 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:45:19 devstack sudo[98822]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-793653ec-a902-4198-aa9b-cc2878684232 Jul 10 04:45:19 devstack sudo[98822]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:45:20 devstack sudo[98816]: pam_unix(sudo:session): session closed for user root Jul 10 04:45:20 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-876c7a31-8e0d-457c-8231-da0c75ad4ee7 tempest-VolumesGetTest-423200778 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-addeab11-568e-44aa-bdea-b21abc4e570d 1073741824" returned: 0 in 0.977s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:45:20 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-876c7a31-8e0d-457c-8231-da0c75ad4ee7 tempest-VolumesGetTest-423200778 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-addeab11-568e-44aa-bdea-b21abc4e570d {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:45:20 devstack sudo[98830]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-addeab11-568e-44aa-bdea-b21abc4e570d Jul 10 04:45:20 devstack sudo[98830]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:45:20 devstack cinder-volume[87444]: INFO cinder.volume.manager [req-6351933d-52e7-4bdb-9271-1249ba1383e1 req-705c44b7-d8cb-4f49-bd46-f79608ae6e73 tempest-TestMinimumBasicScenario-2101675754 None] Terminate volume connection completed successfully. Jul 10 04:45:20 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [req-6351933d-52e7-4bdb-9271-1249ba1383e1 req-705c44b7-d8cb-4f49-bd46-f79608ae6e73 tempest-TestMinimumBasicScenario-2101675754 None] Deleting attachment 8175c77b-a505-4f41-ab5f-2fc086ba6f6d. {{(pid=87444) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 10 04:45:20 devstack sudo[98822]: pam_unix(sudo:session): session closed for user root Jul 10 04:45:20 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-fa9e0b9d-bea5-4a5e-ba7c-fd7eb375d771 tempest-VolumesExtendTest-564624957 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-793653ec-a902-4198-aa9b-cc2878684232" returned: 0 in 0.918s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:45:20 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-fa9e0b9d-bea5-4a5e-ba7c-fd7eb375d771 tempest-VolumesExtendTest-564624957 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-793653ec-a902-4198-aa9b-cc2878684232.78c51607-22bf-4664-9f47-17dad42ca93d {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:45:20 devstack sudo[98836]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-793653ec-a902-4198-aa9b-cc2878684232.78c51607-22bf-4664-9f47-17dad42ca93d Jul 10 04:45:20 devstack sudo[98836]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:45:20 devstack sudo[98830]: pam_unix(sudo:session): session closed for user root Jul 10 04:45:20 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-876c7a31-8e0d-457c-8231-da0c75ad4ee7 tempest-VolumesGetTest-423200778 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-addeab11-568e-44aa-bdea-b21abc4e570d" returned: 0 in 0.862s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:45:20 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-876c7a31-8e0d-457c-8231-da0c75ad4ee7 tempest-VolumesGetTest-423200778 None] <== create_volume: return (1898ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922'} {{(pid=87444) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 04:45:20 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-876c7a31-8e0d-457c-8231-da0c75ad4ee7 tempest-VolumesGetTest-423200778 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.901s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 04:45:21 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-876c7a31-8e0d-457c-8231-da0c75ad4ee7 tempest-VolumesGetTest-423200778 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b8da2fc4-ba82-4235-855c-8e36e6eabb34) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-addeab11-568e-44aa-bdea-b21abc4e570d', 'volume_size': 1}' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:45:21 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-876c7a31-8e0d-457c-8231-da0c75ad4ee7 tempest-VolumesGetTest-423200778 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (63c0c53f-16cd-4fd3-995b-459887f698cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:45:21 devstack cinder-volume[87444]: INFO cinder.volume.flows.manager.create_volume [None req-876c7a31-8e0d-457c-8231-da0c75ad4ee7 tempest-VolumesGetTest-423200778 None] Volume volume-addeab11-568e-44aa-bdea-b21abc4e570d (addeab11-568e-44aa-bdea-b21abc4e570d): created successfully Jul 10 04:45:21 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-876c7a31-8e0d-457c-8231-da0c75ad4ee7 tempest-VolumesGetTest-423200778 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (63c0c53f-16cd-4fd3-995b-459887f698cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:45:21 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-876c7a31-8e0d-457c-8231-da0c75ad4ee7 tempest-VolumesGetTest-423200778 None] Flow 'volume_create_manager' (a09cfedb-046d-4977-829e-7272ca6bc836) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87444) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 04:45:21 devstack cinder-volume[87444]: INFO cinder.volume.manager [None req-876c7a31-8e0d-457c-8231-da0c75ad4ee7 tempest-VolumesGetTest-423200778 None] Created volume successfully. Jul 10 04:45:21 devstack sudo[98836]: pam_unix(sudo:session): session closed for user root Jul 10 04:45:21 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-fa9e0b9d-bea5-4a5e-ba7c-fd7eb375d771 tempest-VolumesExtendTest-564624957 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-793653ec-a902-4198-aa9b-cc2878684232.78c51607-22bf-4664-9f47-17dad42ca93d" returned: 0 in 0.920s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:45:21 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-fa9e0b9d-bea5-4a5e-ba7c-fd7eb375d771 tempest-VolumesExtendTest-564624957 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-793653ec-a902-4198-aa9b-cc2878684232.78c51607-22bf-4664-9f47-17dad42ca93d {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:45:21 devstack sudo[98843]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-793653ec-a902-4198-aa9b-cc2878684232.78c51607-22bf-4664-9f47-17dad42ca93d Jul 10 04:45:21 devstack sudo[98843]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:45:22 devstack sudo[98843]: pam_unix(sudo:session): session closed for user root Jul 10 04:45:22 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-fa9e0b9d-bea5-4a5e-ba7c-fd7eb375d771 tempest-VolumesExtendTest-564624957 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-793653ec-a902-4198-aa9b-cc2878684232.78c51607-22bf-4664-9f47-17dad42ca93d" returned: 0 in 0.803s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:45:22 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-fa9e0b9d-bea5-4a5e-ba7c-fd7eb375d771 tempest-VolumesExtendTest-564624957 None] Lock "cinder-quobyte-78c51607-22bf-4664-9f47-17dad42ca93d" released by "_delete_snapshot" :: held 3.742s {{(pid=87444) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 04:45:22 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-fa9e0b9d-bea5-4a5e-ba7c-fd7eb375d771 tempest-VolumesExtendTest-564624957 None] Lock "cinder-quobyte-793653ec-a902-4198-aa9b-cc2878684232" released by "delete_snapshot" :: held 3.783s {{(pid=87444) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 04:45:22 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-908803ac-cc7c-486d-a8ff-12bcf8d26e2d tempest-TestMinimumBasicScenario-2101675754 None] Acquiring lock "cinder-5f39620d-7980-4693-aaa0-c873a433f170-delete_volume" by "delete_volume" {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 04:45:22 devstack cinder-volume[87444]: DEBUG cinder.quota [None req-fa9e0b9d-bea5-4a5e-ba7c-fd7eb375d771 tempest-VolumesExtendTest-564624957 None] Created reservations ['99d76a42-e636-4622-adec-79a20f6d7010', 'bb584c03-714b-4e39-9054-c276340d7907', 'd4b53fa1-738e-42de-a951-e1f46d5d996e', '0960bf66-a09c-4bb4-81cc-6f0379405333'] {{(pid=87444) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 04:45:22 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-908803ac-cc7c-486d-a8ff-12bcf8d26e2d tempest-TestMinimumBasicScenario-2101675754 None] Lock "cinder-5f39620d-7980-4693-aaa0-c873a433f170-delete_volume" acquired by "delete_volume" :: waited 0.051s {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 04:45:22 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-908803ac-cc7c-486d-a8ff-12bcf8d26e2d tempest-TestMinimumBasicScenario-2101675754 None] Acquiring lock "cinder-quobyte-5f39620d-7980-4693-aaa0-c873a433f170" by "delete_volume" {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 04:45:22 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-908803ac-cc7c-486d-a8ff-12bcf8d26e2d tempest-TestMinimumBasicScenario-2101675754 None] Lock "cinder-quobyte-5f39620d-7980-4693-aaa0-c873a433f170" acquired by "delete_volume" :: waited 0.021s {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 04:45:22 devstack cinder-volume[87444]: INFO cinder.volume.manager [None req-fa9e0b9d-bea5-4a5e-ba7c-fd7eb375d771 tempest-VolumesExtendTest-564624957 None] Delete snapshot completed successfully. Jul 10 04:45:22 devstack cinder-volume[87444]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e9fb01e-9719-447b-afaf-0387ad41eba7]: (4, 'qcow2') {{(pid=88499) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 04:45:22 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-908803ac-cc7c-486d-a8ff-12bcf8d26e2d tempest-TestMinimumBasicScenario-2101675754 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-5f39620d-7980-4693-aaa0-c873a433f170 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:45:22 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-fa9e0b9d-bea5-4a5e-ba7c-fd7eb375d771 tempest-VolumesExtendTest-564624957 None] Lock "cinder-78c51607-22bf-4664-9f47-17dad42ca93d-delete_snapshot" released by "delete_snapshot" :: held 4.125s {{(pid=87444) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 04:45:22 devstack sudo[98846]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-5f39620d-7980-4693-aaa0-c873a433f170 Jul 10 04:45:22 devstack sudo[98846]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:45:22 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-8a957b5d-8f6b-4fec-8381-e132de9ff29e tempest-VolumesExtendTest-564624957 None] Acquiring lock "cinder-793653ec-a902-4198-aa9b-cc2878684232-delete_volume" by "delete_volume" {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 04:45:22 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-8a957b5d-8f6b-4fec-8381-e132de9ff29e tempest-VolumesExtendTest-564624957 None] Lock "cinder-793653ec-a902-4198-aa9b-cc2878684232-delete_volume" acquired by "delete_volume" :: waited 0.042s {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 04:45:22 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-8a957b5d-8f6b-4fec-8381-e132de9ff29e tempest-VolumesExtendTest-564624957 None] Acquiring lock "cinder-quobyte-793653ec-a902-4198-aa9b-cc2878684232" by "delete_volume" {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 04:45:22 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-8a957b5d-8f6b-4fec-8381-e132de9ff29e tempest-VolumesExtendTest-564624957 None] Lock "cinder-quobyte-793653ec-a902-4198-aa9b-cc2878684232" acquired by "delete_volume" :: waited 0.021s {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 04:45:23 devstack cinder-volume[87444]: DEBUG oslo.privsep.daemon [-] privsep: reply[7bd38af1-0962-4d46-be7e-99789e5d6259]: (4, 'qcow2') {{(pid=88499) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 04:45:23 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-8a957b5d-8f6b-4fec-8381-e132de9ff29e tempest-VolumesExtendTest-564624957 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-793653ec-a902-4198-aa9b-cc2878684232 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:45:23 devstack sudo[98849]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-793653ec-a902-4198-aa9b-cc2878684232 Jul 10 04:45:23 devstack sudo[98849]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:45:23 devstack cinder-volume[87444]: DEBUG cinder.volume.flows.manager.create_volume [None req-a65a34bc-7f5e-4ab8-8cba-75699014c34f tempest-VolumesGetTest-423200778 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87444) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 04:45:23 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-a65a34bc-7f5e-4ab8-8cba-75699014c34f tempest-VolumesGetTest-423200778 None] Flow 'volume_create_manager' (f4a38bc5-e47a-4489-abb0-55df20e7ba89) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 04:45:23 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-a65a34bc-7f5e-4ab8-8cba-75699014c34f tempest-VolumesGetTest-423200778 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b8a7a20a-896f-4993-8d57-0c6838315573) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:45:23 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-a65a34bc-7f5e-4ab8-8cba-75699014c34f tempest-VolumesGetTest-423200778 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b8a7a20a-896f-4993-8d57-0c6838315573) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T02:45:23Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-515872488',display_name='tempest-VolumesGetTest-Volume-2081462751',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cb786c8c-c46d-4fa0-8fbe-7e87ce1ee7d7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='761a9e430aba4ae18bd6ef42f16015f4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T02:45:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T02:45:23Z,use_quota=True,user_id='ae02b9a0cfaa4f7d8fd6393dfd0bb7b6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(317e369e-1e06-434d-ae95-a335f0e6c903),volume_type_id=317e369e-1e06-434d-ae95-a335f0e6c903)' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:45:23 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-a65a34bc-7f5e-4ab8-8cba-75699014c34f tempest-VolumesGetTest-423200778 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2f305406-98db-4fd3-91c4-29667e38d254) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:45:23 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-a65a34bc-7f5e-4ab8-8cba-75699014c34f tempest-VolumesGetTest-423200778 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2f305406-98db-4fd3-91c4-29667e38d254) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:45:23 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-a65a34bc-7f5e-4ab8-8cba-75699014c34f tempest-VolumesGetTest-423200778 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6c84a632-8711-4249-b950-a27f478c8289) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:45:23 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-a65a34bc-7f5e-4ab8-8cba-75699014c34f tempest-VolumesGetTest-423200778 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6c84a632-8711-4249-b950-a27f478c8289) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cb786c8c-c46d-4fa0-8fbe-7e87ce1ee7d7', 'volume_name': 'volume-cb786c8c-c46d-4fa0-8fbe-7e87ce1ee7d7', 'volume_size': 1}' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:45:23 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-a65a34bc-7f5e-4ab8-8cba-75699014c34f tempest-VolumesGetTest-423200778 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ef7f2e81-f743-4eb2-a997-a13e9e461845) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:45:23 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-a65a34bc-7f5e-4ab8-8cba-75699014c34f tempest-VolumesGetTest-423200778 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ef7f2e81-f743-4eb2-a997-a13e9e461845) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:45:23 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-a65a34bc-7f5e-4ab8-8cba-75699014c34f tempest-VolumesGetTest-423200778 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d9914dfb-7ad1-4a10-97e5-4181d6646ec8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:45:23 devstack cinder-volume[87444]: INFO cinder.volume.flows.manager.create_volume [None req-a65a34bc-7f5e-4ab8-8cba-75699014c34f tempest-VolumesGetTest-423200778 None] Volume cb786c8c-c46d-4fa0-8fbe-7e87ce1ee7d7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cb786c8c-c46d-4fa0-8fbe-7e87ce1ee7d7', 'volume_size': 1} Jul 10 04:45:23 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-a65a34bc-7f5e-4ab8-8cba-75699014c34f tempest-VolumesGetTest-423200778 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 04:45:23 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-a65a34bc-7f5e-4ab8-8cba-75699014c34f tempest-VolumesGetTest-423200778 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 04:45:23 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-a65a34bc-7f5e-4ab8-8cba-75699014c34f tempest-VolumesGetTest-423200778 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T02:45:23Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-515872488',display_name='tempest-VolumesGetTest-Volume-2081462751',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cb786c8c-c46d-4fa0-8fbe-7e87ce1ee7d7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='761a9e430aba4ae18bd6ef42f16015f4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T02:45:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T02:45:23Z,use_quota=True,user_id='ae02b9a0cfaa4f7d8fd6393dfd0bb7b6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(317e369e-1e06-434d-ae95-a335f0e6c903),volume_type_id=317e369e-1e06-434d-ae95-a335f0e6c903)}" {{(pid=87444) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 04:45:23 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.remotefs [None req-a65a34bc-7f5e-4ab8-8cba-75699014c34f tempest-VolumesGetTest-423200778 None] Creating volume cb786c8c-c46d-4fa0-8fbe-7e87ce1ee7d7 {{(pid=87444) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 04:45:23 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-a65a34bc-7f5e-4ab8-8cba-75699014c34f tempest-VolumesGetTest-423200778 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 04:45:23 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-a65a34bc-7f5e-4ab8-8cba-75699014c34f tempest-VolumesGetTest-423200778 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 04:45:23 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-a65a34bc-7f5e-4ab8-8cba-75699014c34f tempest-VolumesGetTest-423200778 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922': None} {{(pid=87444) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 04:45:23 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-a65a34bc-7f5e-4ab8-8cba-75699014c34f tempest-VolumesGetTest-423200778 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922'] {{(pid=87444) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 04:45:23 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-a65a34bc-7f5e-4ab8-8cba-75699014c34f tempest-VolumesGetTest-423200778 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 04:45:23 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-a65a34bc-7f5e-4ab8-8cba-75699014c34f tempest-VolumesGetTest-423200778 None] Selected osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922 as target Quobyte volume. {{(pid=87444) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 04:45:23 devstack cinder-volume[87444]: INFO cinder.volume.drivers.remotefs [None req-a65a34bc-7f5e-4ab8-8cba-75699014c34f tempest-VolumesGetTest-423200778 None] casted to osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922 Jul 10 04:45:23 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-a65a34bc-7f5e-4ab8-8cba-75699014c34f tempest-VolumesGetTest-423200778 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-cb786c8c-c46d-4fa0-8fbe-7e87ce1ee7d7 1073741824 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:45:23 devstack sudo[98854]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-cb786c8c-c46d-4fa0-8fbe-7e87ce1ee7d7 1073741824 Jul 10 04:45:23 devstack sudo[98854]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:45:23 devstack sudo[98846]: pam_unix(sudo:session): session closed for user root Jul 10 04:45:23 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-908803ac-cc7c-486d-a8ff-12bcf8d26e2d tempest-TestMinimumBasicScenario-2101675754 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-5f39620d-7980-4693-aaa0-c873a433f170" returned: 0 in 1.234s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:45:23 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-908803ac-cc7c-486d-a8ff-12bcf8d26e2d tempest-TestMinimumBasicScenario-2101675754 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-5f39620d-7980-4693-aaa0-c873a433f170 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:45:23 devstack sudo[98856]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-5f39620d-7980-4693-aaa0-c873a433f170 Jul 10 04:45:23 devstack sudo[98856]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:45:24 devstack sudo[98849]: pam_unix(sudo:session): session closed for user root Jul 10 04:45:24 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-8a957b5d-8f6b-4fec-8381-e132de9ff29e tempest-VolumesExtendTest-564624957 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-793653ec-a902-4198-aa9b-cc2878684232" returned: 0 in 1.148s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:45:24 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-8a957b5d-8f6b-4fec-8381-e132de9ff29e tempest-VolumesExtendTest-564624957 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-793653ec-a902-4198-aa9b-cc2878684232 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:45:24 devstack sudo[98861]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-793653ec-a902-4198-aa9b-cc2878684232 Jul 10 04:45:24 devstack sudo[98861]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:45:24 devstack sudo[98854]: pam_unix(sudo:session): session closed for user root Jul 10 04:45:24 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-a65a34bc-7f5e-4ab8-8cba-75699014c34f tempest-VolumesGetTest-423200778 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-cb786c8c-c46d-4fa0-8fbe-7e87ce1ee7d7 1073741824" returned: 0 in 1.179s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:45:24 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-a65a34bc-7f5e-4ab8-8cba-75699014c34f tempest-VolumesGetTest-423200778 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-cb786c8c-c46d-4fa0-8fbe-7e87ce1ee7d7 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:45:24 devstack sudo[98868]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-cb786c8c-c46d-4fa0-8fbe-7e87ce1ee7d7 Jul 10 04:45:24 devstack sudo[98868]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:45:24 devstack sudo[98856]: pam_unix(sudo:session): session closed for user root Jul 10 04:45:24 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-908803ac-cc7c-486d-a8ff-12bcf8d26e2d tempest-TestMinimumBasicScenario-2101675754 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-5f39620d-7980-4693-aaa0-c873a433f170" returned: 0 in 1.061s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:45:24 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-908803ac-cc7c-486d-a8ff-12bcf8d26e2d tempest-TestMinimumBasicScenario-2101675754 None] Lock "cinder-quobyte-5f39620d-7980-4693-aaa0-c873a433f170" released by "delete_volume" :: held 2.364s {{(pid=87444) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 04:45:25 devstack cinder-volume[87444]: DEBUG cinder.quota [None req-908803ac-cc7c-486d-a8ff-12bcf8d26e2d tempest-TestMinimumBasicScenario-2101675754 None] Created reservations ['db8d3de7-955e-4fc8-b38d-130875fa579f', '72c41682-e803-40a0-bfe5-145154c68574', '77e97f4b-e9bf-4511-99d4-98cc21ba0675', '9c87efd4-0734-47c9-a633-a4f6b7ff9fae'] {{(pid=87444) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 04:45:25 devstack sudo[98861]: pam_unix(sudo:session): session closed for user root Jul 10 04:45:25 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-8a957b5d-8f6b-4fec-8381-e132de9ff29e tempest-VolumesExtendTest-564624957 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-793653ec-a902-4198-aa9b-cc2878684232" returned: 0 in 0.897s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:45:25 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-8a957b5d-8f6b-4fec-8381-e132de9ff29e tempest-VolumesExtendTest-564624957 None] Lock "cinder-quobyte-793653ec-a902-4198-aa9b-cc2878684232" released by "delete_volume" :: held 2.183s {{(pid=87444) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 04:45:25 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-908803ac-cc7c-486d-a8ff-12bcf8d26e2d tempest-TestMinimumBasicScenario-2101675754 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 04:45:25 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-908803ac-cc7c-486d-a8ff-12bcf8d26e2d tempest-TestMinimumBasicScenario-2101675754 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 04:45:25 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-908803ac-cc7c-486d-a8ff-12bcf8d26e2d tempest-TestMinimumBasicScenario-2101675754 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922': None} {{(pid=87444) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 04:45:25 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-908803ac-cc7c-486d-a8ff-12bcf8d26e2d tempest-TestMinimumBasicScenario-2101675754 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922'] {{(pid=87444) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 04:45:25 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-908803ac-cc7c-486d-a8ff-12bcf8d26e2d tempest-TestMinimumBasicScenario-2101675754 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 04:45:25 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-908803ac-cc7c-486d-a8ff-12bcf8d26e2d tempest-TestMinimumBasicScenario-2101675754 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:45:25 devstack sudo[98871]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097 Jul 10 04:45:25 devstack sudo[98871]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:45:25 devstack cinder-volume[87444]: DEBUG cinder.quota [None req-8a957b5d-8f6b-4fec-8381-e132de9ff29e tempest-VolumesExtendTest-564624957 None] Created reservations ['3638aa2b-d220-4ae9-a61b-88bccc47e0e5', '989b92c5-1954-4761-be6b-743d009bddd7', '4dddb088-736b-4a8d-a657-91f8f12a3472', '6d3f8660-e458-4014-b399-8e570a99c94b'] {{(pid=87444) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 04:45:25 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-8a957b5d-8f6b-4fec-8381-e132de9ff29e tempest-VolumesExtendTest-564624957 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 04:45:25 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-8a957b5d-8f6b-4fec-8381-e132de9ff29e tempest-VolumesExtendTest-564624957 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 04:45:25 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-8a957b5d-8f6b-4fec-8381-e132de9ff29e tempest-VolumesExtendTest-564624957 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922': None} {{(pid=87444) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 04:45:25 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-8a957b5d-8f6b-4fec-8381-e132de9ff29e tempest-VolumesExtendTest-564624957 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922'] {{(pid=87444) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 04:45:25 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-8a957b5d-8f6b-4fec-8381-e132de9ff29e tempest-VolumesExtendTest-564624957 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 04:45:25 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-8a957b5d-8f6b-4fec-8381-e132de9ff29e tempest-VolumesExtendTest-564624957 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:45:25 devstack sudo[98873]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097 Jul 10 04:45:25 devstack sudo[98873]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:45:25 devstack sudo[98868]: pam_unix(sudo:session): session closed for user root Jul 10 04:45:25 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-a65a34bc-7f5e-4ab8-8cba-75699014c34f tempest-VolumesGetTest-423200778 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-cb786c8c-c46d-4fa0-8fbe-7e87ce1ee7d7" returned: 0 in 0.874s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:45:25 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-a65a34bc-7f5e-4ab8-8cba-75699014c34f tempest-VolumesGetTest-423200778 None] <== create_volume: return (2105ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922'} {{(pid=87444) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 04:45:25 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-a65a34bc-7f5e-4ab8-8cba-75699014c34f tempest-VolumesGetTest-423200778 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.109s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 04:45:25 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-a65a34bc-7f5e-4ab8-8cba-75699014c34f tempest-VolumesGetTest-423200778 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d9914dfb-7ad1-4a10-97e5-4181d6646ec8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cb786c8c-c46d-4fa0-8fbe-7e87ce1ee7d7', 'volume_size': 1}' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:45:25 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-a65a34bc-7f5e-4ab8-8cba-75699014c34f tempest-VolumesGetTest-423200778 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d8ec96b7-54d5-43e0-b25e-77dfcf310fd2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:45:25 devstack cinder-volume[87444]: INFO cinder.volume.flows.manager.create_volume [None req-a65a34bc-7f5e-4ab8-8cba-75699014c34f tempest-VolumesGetTest-423200778 None] Volume volume-cb786c8c-c46d-4fa0-8fbe-7e87ce1ee7d7 (cb786c8c-c46d-4fa0-8fbe-7e87ce1ee7d7): created successfully Jul 10 04:45:25 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-a65a34bc-7f5e-4ab8-8cba-75699014c34f tempest-VolumesGetTest-423200778 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d8ec96b7-54d5-43e0-b25e-77dfcf310fd2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:45:25 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-a65a34bc-7f5e-4ab8-8cba-75699014c34f tempest-VolumesGetTest-423200778 None] Flow 'volume_create_manager' (f4a38bc5-e47a-4489-abb0-55df20e7ba89) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87444) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 04:45:25 devstack cinder-volume[87444]: INFO cinder.volume.manager [None req-a65a34bc-7f5e-4ab8-8cba-75699014c34f tempest-VolumesGetTest-423200778 None] Created volume successfully. Jul 10 04:45:26 devstack sudo[98871]: pam_unix(sudo:session): session closed for user root Jul 10 04:45:26 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-908803ac-cc7c-486d-a8ff-12bcf8d26e2d tempest-TestMinimumBasicScenario-2101675754 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097" returned: 0 in 0.822s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:45:26 devstack cinder-volume[87444]: DEBUG cinder.manager [None req-908803ac-cc7c-486d-a8ff-12bcf8d26e2d tempest-TestMinimumBasicScenario-2101675754 None] Notifying Schedulers of capabilities ... {{(pid=87444) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 04:45:26 devstack cinder-volume[87444]: INFO cinder.volume.manager [None req-908803ac-cc7c-486d-a8ff-12bcf8d26e2d tempest-TestMinimumBasicScenario-2101675754 None] Deleted volume successfully. Jul 10 04:45:26 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-908803ac-cc7c-486d-a8ff-12bcf8d26e2d tempest-TestMinimumBasicScenario-2101675754 None] Lock "cinder-5f39620d-7980-4693-aaa0-c873a433f170-delete_volume" released by "delete_volume" :: held 3.629s {{(pid=87444) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 04:45:26 devstack sudo[98873]: pam_unix(sudo:session): session closed for user root Jul 10 04:45:26 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-8a957b5d-8f6b-4fec-8381-e132de9ff29e tempest-VolumesExtendTest-564624957 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097" returned: 0 in 0.887s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:45:26 devstack cinder-volume[87444]: DEBUG cinder.manager [None req-8a957b5d-8f6b-4fec-8381-e132de9ff29e tempest-VolumesExtendTest-564624957 None] Notifying Schedulers of capabilities ... {{(pid=87444) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 04:45:26 devstack cinder-volume[87444]: INFO cinder.volume.manager [None req-8a957b5d-8f6b-4fec-8381-e132de9ff29e tempest-VolumesExtendTest-564624957 None] Deleted volume successfully. Jul 10 04:45:26 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-8a957b5d-8f6b-4fec-8381-e132de9ff29e tempest-VolumesExtendTest-564624957 None] Lock "cinder-793653ec-a902-4198-aa9b-cc2878684232-delete_volume" released by "delete_volume" :: held 3.414s {{(pid=87444) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 04:45:26 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-88dcec94-f3ce-470f-8b64-ad3269b051d8 tempest-VolumesGetTest-423200778 None] Acquiring lock "cinder-cb786c8c-c46d-4fa0-8fbe-7e87ce1ee7d7-delete_volume" by "delete_volume" {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 04:45:26 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-88dcec94-f3ce-470f-8b64-ad3269b051d8 tempest-VolumesGetTest-423200778 None] Lock "cinder-cb786c8c-c46d-4fa0-8fbe-7e87ce1ee7d7-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 04:45:26 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-88dcec94-f3ce-470f-8b64-ad3269b051d8 tempest-VolumesGetTest-423200778 None] Acquiring lock "cinder-quobyte-cb786c8c-c46d-4fa0-8fbe-7e87ce1ee7d7" by "delete_volume" {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 04:45:26 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-88dcec94-f3ce-470f-8b64-ad3269b051d8 tempest-VolumesGetTest-423200778 None] Lock "cinder-quobyte-cb786c8c-c46d-4fa0-8fbe-7e87ce1ee7d7" acquired by "delete_volume" :: waited 0.016s {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 04:45:26 devstack cinder-volume[87444]: DEBUG oslo.privsep.daemon [-] privsep: reply[9493de8b-03bc-42ec-8fcf-e1ed0bcebd84]: (4, 'qcow2') {{(pid=88499) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 04:45:26 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-88dcec94-f3ce-470f-8b64-ad3269b051d8 tempest-VolumesGetTest-423200778 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-cb786c8c-c46d-4fa0-8fbe-7e87ce1ee7d7 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:45:26 devstack sudo[98878]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-cb786c8c-c46d-4fa0-8fbe-7e87ce1ee7d7 Jul 10 04:45:26 devstack sudo[98878]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:45:27 devstack sudo[98878]: pam_unix(sudo:session): session closed for user root Jul 10 04:45:27 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-88dcec94-f3ce-470f-8b64-ad3269b051d8 tempest-VolumesGetTest-423200778 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-cb786c8c-c46d-4fa0-8fbe-7e87ce1ee7d7" returned: 0 in 1.049s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:45:27 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-88dcec94-f3ce-470f-8b64-ad3269b051d8 tempest-VolumesGetTest-423200778 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-cb786c8c-c46d-4fa0-8fbe-7e87ce1ee7d7 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:45:27 devstack sudo[98893]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-cb786c8c-c46d-4fa0-8fbe-7e87ce1ee7d7 Jul 10 04:45:27 devstack sudo[98893]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:45:28 devstack sudo[98893]: pam_unix(sudo:session): session closed for user root Jul 10 04:45:28 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-88dcec94-f3ce-470f-8b64-ad3269b051d8 tempest-VolumesGetTest-423200778 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-cb786c8c-c46d-4fa0-8fbe-7e87ce1ee7d7" returned: 0 in 1.020s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:45:28 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-88dcec94-f3ce-470f-8b64-ad3269b051d8 tempest-VolumesGetTest-423200778 None] Lock "cinder-quobyte-cb786c8c-c46d-4fa0-8fbe-7e87ce1ee7d7" released by "delete_volume" :: held 2.135s {{(pid=87444) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 04:45:28 devstack cinder-volume[87444]: DEBUG cinder.quota [None req-88dcec94-f3ce-470f-8b64-ad3269b051d8 tempest-VolumesGetTest-423200778 None] Created reservations ['70f5c30a-8559-4977-81e9-d75d3ac509b4', 'af2fead7-2a07-467a-ad33-3bf8fb37c98a', 'f944b7f3-1f64-4a9e-85f1-bfd719d55d26', '6d6befbd-5f06-41dd-84d8-656cdaab7737'] {{(pid=87444) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 04:45:29 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-88dcec94-f3ce-470f-8b64-ad3269b051d8 tempest-VolumesGetTest-423200778 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 04:45:29 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-88dcec94-f3ce-470f-8b64-ad3269b051d8 tempest-VolumesGetTest-423200778 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 04:45:29 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-88dcec94-f3ce-470f-8b64-ad3269b051d8 tempest-VolumesGetTest-423200778 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922': None} {{(pid=87444) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 04:45:29 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-88dcec94-f3ce-470f-8b64-ad3269b051d8 tempest-VolumesGetTest-423200778 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922'] {{(pid=87444) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 04:45:29 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-88dcec94-f3ce-470f-8b64-ad3269b051d8 tempest-VolumesGetTest-423200778 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 04:45:29 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-88dcec94-f3ce-470f-8b64-ad3269b051d8 tempest-VolumesGetTest-423200778 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:45:29 devstack sudo[98909]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097 Jul 10 04:45:29 devstack sudo[98909]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:45:29 devstack sudo[98909]: pam_unix(sudo:session): session closed for user root Jul 10 04:45:29 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-88dcec94-f3ce-470f-8b64-ad3269b051d8 tempest-VolumesGetTest-423200778 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097" returned: 0 in 0.708s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:45:29 devstack cinder-volume[87444]: DEBUG cinder.manager [None req-88dcec94-f3ce-470f-8b64-ad3269b051d8 tempest-VolumesGetTest-423200778 None] Notifying Schedulers of capabilities ... {{(pid=87444) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 04:45:29 devstack cinder-volume[87444]: INFO cinder.volume.manager [None req-88dcec94-f3ce-470f-8b64-ad3269b051d8 tempest-VolumesGetTest-423200778 None] Deleted volume successfully. Jul 10 04:45:29 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-88dcec94-f3ce-470f-8b64-ad3269b051d8 tempest-VolumesGetTest-423200778 None] Lock "cinder-cb786c8c-c46d-4fa0-8fbe-7e87ce1ee7d7-delete_volume" released by "delete_volume" :: held 3.196s {{(pid=87444) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 04:45:30 devstack cinder-volume[87444]: DEBUG cinder.volume.flows.manager.create_volume [None req-f4342d46-d348-4355-a22f-e14f30fad23b tempest-VolumesNegativeTest-1562591450 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87444) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 04:45:30 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-f4342d46-d348-4355-a22f-e14f30fad23b tempest-VolumesNegativeTest-1562591450 None] Flow 'volume_create_manager' (d7cdaa67-51ce-41f5-aab8-e2afaa05ddf1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 04:45:30 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-f4342d46-d348-4355-a22f-e14f30fad23b tempest-VolumesNegativeTest-1562591450 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6a530e84-8713-4b3f-afa3-61e6b76d5ab8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:45:30 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-64e0e57a-6b13-41c8-a089-f73fb4b56411 tempest-VolumesGetTest-423200778 None] Acquiring lock "cinder-addeab11-568e-44aa-bdea-b21abc4e570d-delete_volume" by "delete_volume" {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 04:45:30 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-f4342d46-d348-4355-a22f-e14f30fad23b tempest-VolumesNegativeTest-1562591450 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6a530e84-8713-4b3f-afa3-61e6b76d5ab8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T02:45:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-2128911510',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8ef0d246-886f-4d49-89f4-ab67433748d2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1782df7609ee44198d0c9d5515a53c60',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T02:45:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T02:45:30Z,use_quota=True,user_id='a6aa8bcb138543ce8795691db4caff51',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(317e369e-1e06-434d-ae95-a335f0e6c903),volume_type_id=317e369e-1e06-434d-ae95-a335f0e6c903)' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:45:30 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-f4342d46-d348-4355-a22f-e14f30fad23b tempest-VolumesNegativeTest-1562591450 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c141a9af-6938-4f97-a755-428e738e5e2d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:45:30 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-f4342d46-d348-4355-a22f-e14f30fad23b tempest-VolumesNegativeTest-1562591450 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c141a9af-6938-4f97-a755-428e738e5e2d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:45:30 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-f4342d46-d348-4355-a22f-e14f30fad23b tempest-VolumesNegativeTest-1562591450 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6db942e1-c643-4c80-9db2-4b6bf80dec4c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:45:30 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-f4342d46-d348-4355-a22f-e14f30fad23b tempest-VolumesNegativeTest-1562591450 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6db942e1-c643-4c80-9db2-4b6bf80dec4c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8ef0d246-886f-4d49-89f4-ab67433748d2', 'volume_name': 'volume-8ef0d246-886f-4d49-89f4-ab67433748d2', 'volume_size': 1}' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:45:30 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-f4342d46-d348-4355-a22f-e14f30fad23b tempest-VolumesNegativeTest-1562591450 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4bf17ab6-43e2-4880-b10f-5f503e5f53e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:45:30 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-f4342d46-d348-4355-a22f-e14f30fad23b tempest-VolumesNegativeTest-1562591450 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4bf17ab6-43e2-4880-b10f-5f503e5f53e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:45:30 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-f4342d46-d348-4355-a22f-e14f30fad23b tempest-VolumesNegativeTest-1562591450 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (29fcc442-7027-4bd9-a58c-186df11f9d40) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:45:30 devstack cinder-volume[87444]: INFO cinder.volume.flows.manager.create_volume [None req-f4342d46-d348-4355-a22f-e14f30fad23b tempest-VolumesNegativeTest-1562591450 None] Volume 8ef0d246-886f-4d49-89f4-ab67433748d2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8ef0d246-886f-4d49-89f4-ab67433748d2', 'volume_size': 1} Jul 10 04:45:30 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-f4342d46-d348-4355-a22f-e14f30fad23b tempest-VolumesNegativeTest-1562591450 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 04:45:30 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-f4342d46-d348-4355-a22f-e14f30fad23b tempest-VolumesNegativeTest-1562591450 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 04:45:30 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-f4342d46-d348-4355-a22f-e14f30fad23b tempest-VolumesNegativeTest-1562591450 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T02:45:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-2128911510',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8ef0d246-886f-4d49-89f4-ab67433748d2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1782df7609ee44198d0c9d5515a53c60',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T02:45:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T02:45:30Z,use_quota=True,user_id='a6aa8bcb138543ce8795691db4caff51',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(317e369e-1e06-434d-ae95-a335f0e6c903),volume_type_id=317e369e-1e06-434d-ae95-a335f0e6c903)}" {{(pid=87444) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 04:45:30 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.remotefs [None req-f4342d46-d348-4355-a22f-e14f30fad23b tempest-VolumesNegativeTest-1562591450 None] Creating volume 8ef0d246-886f-4d49-89f4-ab67433748d2 {{(pid=87444) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 04:45:30 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-f4342d46-d348-4355-a22f-e14f30fad23b tempest-VolumesNegativeTest-1562591450 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 04:45:30 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-f4342d46-d348-4355-a22f-e14f30fad23b tempest-VolumesNegativeTest-1562591450 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 04:45:30 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-f4342d46-d348-4355-a22f-e14f30fad23b tempest-VolumesNegativeTest-1562591450 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922': None} {{(pid=87444) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 04:45:30 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-f4342d46-d348-4355-a22f-e14f30fad23b tempest-VolumesNegativeTest-1562591450 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922'] {{(pid=87444) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 04:45:30 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-f4342d46-d348-4355-a22f-e14f30fad23b tempest-VolumesNegativeTest-1562591450 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 04:45:30 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-f4342d46-d348-4355-a22f-e14f30fad23b tempest-VolumesNegativeTest-1562591450 None] Selected osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922 as target Quobyte volume. {{(pid=87444) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 04:45:30 devstack cinder-volume[87444]: INFO cinder.volume.drivers.remotefs [None req-f4342d46-d348-4355-a22f-e14f30fad23b tempest-VolumesNegativeTest-1562591450 None] casted to osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922 Jul 10 04:45:30 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-f4342d46-d348-4355-a22f-e14f30fad23b tempest-VolumesNegativeTest-1562591450 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-8ef0d246-886f-4d49-89f4-ab67433748d2 1073741824 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:45:30 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-64e0e57a-6b13-41c8-a089-f73fb4b56411 tempest-VolumesGetTest-423200778 None] Lock "cinder-addeab11-568e-44aa-bdea-b21abc4e570d-delete_volume" acquired by "delete_volume" :: waited 0.091s {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 04:45:30 devstack sudo[98912]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-8ef0d246-886f-4d49-89f4-ab67433748d2 1073741824 Jul 10 04:45:30 devstack sudo[98912]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:45:30 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-64e0e57a-6b13-41c8-a089-f73fb4b56411 tempest-VolumesGetTest-423200778 None] Acquiring lock "cinder-quobyte-addeab11-568e-44aa-bdea-b21abc4e570d" by "delete_volume" {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 04:45:30 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-64e0e57a-6b13-41c8-a089-f73fb4b56411 tempest-VolumesGetTest-423200778 None] Lock "cinder-quobyte-addeab11-568e-44aa-bdea-b21abc4e570d" acquired by "delete_volume" :: waited 0.022s {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 04:45:30 devstack cinder-volume[87444]: DEBUG oslo.privsep.daemon [-] privsep: reply[52ff0ce9-4e67-4a29-a374-496756722f4a]: (4, 'qcow2') {{(pid=88499) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 04:45:30 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-64e0e57a-6b13-41c8-a089-f73fb4b56411 tempest-VolumesGetTest-423200778 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-addeab11-568e-44aa-bdea-b21abc4e570d {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:45:30 devstack sudo[98914]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-addeab11-568e-44aa-bdea-b21abc4e570d Jul 10 04:45:30 devstack sudo[98914]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:45:31 devstack sudo[98914]: pam_unix(sudo:session): session closed for user root Jul 10 04:45:31 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-64e0e57a-6b13-41c8-a089-f73fb4b56411 tempest-VolumesGetTest-423200778 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-addeab11-568e-44aa-bdea-b21abc4e570d" returned: 0 in 0.856s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:45:31 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-64e0e57a-6b13-41c8-a089-f73fb4b56411 tempest-VolumesGetTest-423200778 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-addeab11-568e-44aa-bdea-b21abc4e570d {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:45:31 devstack sudo[98924]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-addeab11-568e-44aa-bdea-b21abc4e570d Jul 10 04:45:31 devstack sudo[98924]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:45:31 devstack sudo[98912]: pam_unix(sudo:session): session closed for user root Jul 10 04:45:31 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-f4342d46-d348-4355-a22f-e14f30fad23b tempest-VolumesNegativeTest-1562591450 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-8ef0d246-886f-4d49-89f4-ab67433748d2 1073741824" returned: 0 in 1.075s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:45:31 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-f4342d46-d348-4355-a22f-e14f30fad23b tempest-VolumesNegativeTest-1562591450 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-8ef0d246-886f-4d49-89f4-ab67433748d2 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:45:31 devstack sudo[98926]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-8ef0d246-886f-4d49-89f4-ab67433748d2 Jul 10 04:45:31 devstack sudo[98926]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:45:32 devstack sudo[98924]: pam_unix(sudo:session): session closed for user root Jul 10 04:45:32 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-64e0e57a-6b13-41c8-a089-f73fb4b56411 tempest-VolumesGetTest-423200778 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-addeab11-568e-44aa-bdea-b21abc4e570d" returned: 0 in 0.785s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:45:32 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-64e0e57a-6b13-41c8-a089-f73fb4b56411 tempest-VolumesGetTest-423200778 None] Lock "cinder-quobyte-addeab11-568e-44aa-bdea-b21abc4e570d" released by "delete_volume" :: held 1.696s {{(pid=87444) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 04:45:32 devstack sudo[98926]: pam_unix(sudo:session): session closed for user root Jul 10 04:45:32 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-f4342d46-d348-4355-a22f-e14f30fad23b tempest-VolumesNegativeTest-1562591450 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-8ef0d246-886f-4d49-89f4-ab67433748d2" returned: 0 in 0.716s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:45:32 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-f4342d46-d348-4355-a22f-e14f30fad23b tempest-VolumesNegativeTest-1562591450 None] <== create_volume: return (1860ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922'} {{(pid=87444) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 04:45:32 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-f4342d46-d348-4355-a22f-e14f30fad23b tempest-VolumesNegativeTest-1562591450 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.862s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 04:45:32 devstack cinder-volume[87444]: DEBUG cinder.quota [None req-64e0e57a-6b13-41c8-a089-f73fb4b56411 tempest-VolumesGetTest-423200778 None] Created reservations ['38c98b86-4e7b-40a9-bf8d-3b3d46263e95', '9911772c-5f53-4b8e-9e17-4d880eb7e702', 'c661a4b1-9005-49c6-9ab3-3ff2f000316d', 'aad87dfd-48fa-43df-9b41-2849b137132c'] {{(pid=87444) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 04:45:32 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-f4342d46-d348-4355-a22f-e14f30fad23b tempest-VolumesNegativeTest-1562591450 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (29fcc442-7027-4bd9-a58c-186df11f9d40) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8ef0d246-886f-4d49-89f4-ab67433748d2', 'volume_size': 1}' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:45:32 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-f4342d46-d348-4355-a22f-e14f30fad23b tempest-VolumesNegativeTest-1562591450 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6454379c-c763-4a75-a99b-7f0c87d01e32) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:45:32 devstack cinder-volume[87444]: INFO cinder.volume.flows.manager.create_volume [None req-f4342d46-d348-4355-a22f-e14f30fad23b tempest-VolumesNegativeTest-1562591450 None] Volume volume-8ef0d246-886f-4d49-89f4-ab67433748d2 (8ef0d246-886f-4d49-89f4-ab67433748d2): created successfully Jul 10 04:45:32 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-f4342d46-d348-4355-a22f-e14f30fad23b tempest-VolumesNegativeTest-1562591450 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6454379c-c763-4a75-a99b-7f0c87d01e32) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:45:32 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-f4342d46-d348-4355-a22f-e14f30fad23b tempest-VolumesNegativeTest-1562591450 None] Flow 'volume_create_manager' (d7cdaa67-51ce-41f5-aab8-e2afaa05ddf1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87444) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 04:45:32 devstack cinder-volume[87444]: INFO cinder.volume.manager [None req-f4342d46-d348-4355-a22f-e14f30fad23b tempest-VolumesNegativeTest-1562591450 None] Created volume successfully. Jul 10 04:45:32 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-64e0e57a-6b13-41c8-a089-f73fb4b56411 tempest-VolumesGetTest-423200778 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 04:45:32 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-64e0e57a-6b13-41c8-a089-f73fb4b56411 tempest-VolumesGetTest-423200778 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 04:45:32 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-64e0e57a-6b13-41c8-a089-f73fb4b56411 tempest-VolumesGetTest-423200778 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922': None} {{(pid=87444) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 04:45:32 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-64e0e57a-6b13-41c8-a089-f73fb4b56411 tempest-VolumesGetTest-423200778 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922'] {{(pid=87444) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 04:45:32 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-64e0e57a-6b13-41c8-a089-f73fb4b56411 tempest-VolumesGetTest-423200778 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 04:45:32 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-64e0e57a-6b13-41c8-a089-f73fb4b56411 tempest-VolumesGetTest-423200778 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:45:32 devstack sudo[98930]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097 Jul 10 04:45:32 devstack sudo[98930]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:45:32 devstack cinder-volume[87444]: DEBUG cinder.volume.flows.manager.create_volume [None req-de5886ee-87a8-4f69-a4ba-d0b1a22c5109 tempest-TestInstancesWithCinderVolumes-1741196733 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87444) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 04:45:32 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-de5886ee-87a8-4f69-a4ba-d0b1a22c5109 tempest-TestInstancesWithCinderVolumes-1741196733 None] Flow 'volume_create_manager' (c795db52-0a8c-4baf-95f8-3f5b119d72d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 04:45:32 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-de5886ee-87a8-4f69-a4ba-d0b1a22c5109 tempest-TestInstancesWithCinderVolumes-1741196733 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a1f304ff-adfc-40f6-add2-0e1adb3f6dc3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:45:32 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-de5886ee-87a8-4f69-a4ba-d0b1a22c5109 tempest-TestInstancesWithCinderVolumes-1741196733 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a1f304ff-adfc-40f6-add2-0e1adb3f6dc3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T02:45:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-2022786066',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a9b21329-62c2-4cd4-8a67-34eb1efdc714,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e98650f7bf93499fad9ed367fab18dff',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T02:45:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T02:45:32Z,use_quota=True,user_id='ceb6d26439444df79a23079d4c62132b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(05047119-ddac-4960-bd73-0f5aaa07c6aa),volume_type_id=05047119-ddac-4960-bd73-0f5aaa07c6aa)' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:45:32 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-de5886ee-87a8-4f69-a4ba-d0b1a22c5109 tempest-TestInstancesWithCinderVolumes-1741196733 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e59db45b-56b9-434e-a697-8e9f31695126) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:45:32 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-de5886ee-87a8-4f69-a4ba-d0b1a22c5109 tempest-TestInstancesWithCinderVolumes-1741196733 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e59db45b-56b9-434e-a697-8e9f31695126) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:45:32 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-de5886ee-87a8-4f69-a4ba-d0b1a22c5109 tempest-TestInstancesWithCinderVolumes-1741196733 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c6ce2348-5741-43cd-8f01-83faca659dd3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:45:32 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-de5886ee-87a8-4f69-a4ba-d0b1a22c5109 tempest-TestInstancesWithCinderVolumes-1741196733 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c6ce2348-5741-43cd-8f01-83faca659dd3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a9b21329-62c2-4cd4-8a67-34eb1efdc714', 'volume_name': 'volume-a9b21329-62c2-4cd4-8a67-34eb1efdc714', 'volume_size': 1}' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:45:32 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-de5886ee-87a8-4f69-a4ba-d0b1a22c5109 tempest-TestInstancesWithCinderVolumes-1741196733 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f10d7e74-1c52-4cb6-bf5d-436ff78780ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:45:32 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-de5886ee-87a8-4f69-a4ba-d0b1a22c5109 tempest-TestInstancesWithCinderVolumes-1741196733 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f10d7e74-1c52-4cb6-bf5d-436ff78780ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:45:32 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-de5886ee-87a8-4f69-a4ba-d0b1a22c5109 tempest-TestInstancesWithCinderVolumes-1741196733 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d19c8ca1-c0ba-48e0-8ead-107562939163) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:45:32 devstack cinder-volume[87444]: INFO cinder.volume.flows.manager.create_volume [None req-de5886ee-87a8-4f69-a4ba-d0b1a22c5109 tempest-TestInstancesWithCinderVolumes-1741196733 None] Volume a9b21329-62c2-4cd4-8a67-34eb1efdc714: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a9b21329-62c2-4cd4-8a67-34eb1efdc714', 'volume_size': 1} Jul 10 04:45:32 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-de5886ee-87a8-4f69-a4ba-d0b1a22c5109 tempest-TestInstancesWithCinderVolumes-1741196733 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 04:45:32 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-de5886ee-87a8-4f69-a4ba-d0b1a22c5109 tempest-TestInstancesWithCinderVolumes-1741196733 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 04:45:32 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-de5886ee-87a8-4f69-a4ba-d0b1a22c5109 tempest-TestInstancesWithCinderVolumes-1741196733 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T02:45:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-2022786066',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a9b21329-62c2-4cd4-8a67-34eb1efdc714,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e98650f7bf93499fad9ed367fab18dff',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T02:45:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T02:45:32Z,use_quota=True,user_id='ceb6d26439444df79a23079d4c62132b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(05047119-ddac-4960-bd73-0f5aaa07c6aa),volume_type_id=05047119-ddac-4960-bd73-0f5aaa07c6aa)}" {{(pid=87444) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 04:45:32 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.remotefs [None req-de5886ee-87a8-4f69-a4ba-d0b1a22c5109 tempest-TestInstancesWithCinderVolumes-1741196733 None] Creating volume a9b21329-62c2-4cd4-8a67-34eb1efdc714 {{(pid=87444) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 04:45:32 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-de5886ee-87a8-4f69-a4ba-d0b1a22c5109 tempest-TestInstancesWithCinderVolumes-1741196733 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 04:45:32 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-de5886ee-87a8-4f69-a4ba-d0b1a22c5109 tempest-TestInstancesWithCinderVolumes-1741196733 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 04:45:32 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-de5886ee-87a8-4f69-a4ba-d0b1a22c5109 tempest-TestInstancesWithCinderVolumes-1741196733 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922': None} {{(pid=87444) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 04:45:32 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-de5886ee-87a8-4f69-a4ba-d0b1a22c5109 tempest-TestInstancesWithCinderVolumes-1741196733 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922'] {{(pid=87444) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 04:45:32 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-de5886ee-87a8-4f69-a4ba-d0b1a22c5109 tempest-TestInstancesWithCinderVolumes-1741196733 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 04:45:32 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-de5886ee-87a8-4f69-a4ba-d0b1a22c5109 tempest-TestInstancesWithCinderVolumes-1741196733 None] Selected osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922 as target Quobyte volume. {{(pid=87444) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 04:45:32 devstack cinder-volume[87444]: INFO cinder.volume.drivers.remotefs [None req-de5886ee-87a8-4f69-a4ba-d0b1a22c5109 tempest-TestInstancesWithCinderVolumes-1741196733 None] casted to osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922 Jul 10 04:45:32 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-de5886ee-87a8-4f69-a4ba-d0b1a22c5109 tempest-TestInstancesWithCinderVolumes-1741196733 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-a9b21329-62c2-4cd4-8a67-34eb1efdc714 1073741824 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:45:32 devstack sudo[98932]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-a9b21329-62c2-4cd4-8a67-34eb1efdc714 1073741824 Jul 10 04:45:32 devstack sudo[98932]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:45:33 devstack cinder-volume[87444]: DEBUG oslo_service.periodic_task [None req-01f0ce3e-6850-4e14-881d-e40d3c4ad6e5 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87444) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 10 04:45:33 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-01f0ce3e-6850-4e14-881d-e40d3c4ad6e5 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 04:45:33 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-01f0ce3e-6850-4e14-881d-e40d3c4ad6e5 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 04:45:33 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-01f0ce3e-6850-4e14-881d-e40d3c4ad6e5 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922': None} {{(pid=87444) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 04:45:33 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-01f0ce3e-6850-4e14-881d-e40d3c4ad6e5 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922'] {{(pid=87444) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 04:45:33 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-01f0ce3e-6850-4e14-881d-e40d3c4ad6e5 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 04:45:33 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-01f0ce3e-6850-4e14-881d-e40d3c4ad6e5 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:45:33 devstack sudo[98968]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097 Jul 10 04:45:33 devstack sudo[98968]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:45:33 devstack cinder-volume[87444]: DEBUG cinder.volume.flows.manager.create_volume [None req-3798a0fa-c1b5-4afd-8f1a-c7938a68f8c3 tempest-TestInstancesWithCinderVolumes-1741196733 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87444) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 04:45:33 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-3798a0fa-c1b5-4afd-8f1a-c7938a68f8c3 tempest-TestInstancesWithCinderVolumes-1741196733 None] Flow 'volume_create_manager' (3ae85e06-685c-4b34-af6a-293dc3884dc5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 04:45:33 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-3798a0fa-c1b5-4afd-8f1a-c7938a68f8c3 tempest-TestInstancesWithCinderVolumes-1741196733 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c7a82038-b474-4ec8-95c3-932f1d6d1947) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:45:33 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-3798a0fa-c1b5-4afd-8f1a-c7938a68f8c3 tempest-TestInstancesWithCinderVolumes-1741196733 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c7a82038-b474-4ec8-95c3-932f1d6d1947) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T02:45:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-231980061',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7d23f8f0-4475-43cb-b423-8aeb7a87c98d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e98650f7bf93499fad9ed367fab18dff',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T02:45:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T02:45:33Z,use_quota=True,user_id='ceb6d26439444df79a23079d4c62132b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8f199c45-0626-462c-b71f-f2fb3034b105),volume_type_id=8f199c45-0626-462c-b71f-f2fb3034b105)' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:45:33 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-3798a0fa-c1b5-4afd-8f1a-c7938a68f8c3 tempest-TestInstancesWithCinderVolumes-1741196733 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1e5045fe-50d4-426f-b0dd-526120ed0bf4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:45:33 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-3798a0fa-c1b5-4afd-8f1a-c7938a68f8c3 tempest-TestInstancesWithCinderVolumes-1741196733 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1e5045fe-50d4-426f-b0dd-526120ed0bf4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:45:33 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-3798a0fa-c1b5-4afd-8f1a-c7938a68f8c3 tempest-TestInstancesWithCinderVolumes-1741196733 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d9003625-8d72-4ea9-9014-6a9b26c8ce26) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:45:33 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-3798a0fa-c1b5-4afd-8f1a-c7938a68f8c3 tempest-TestInstancesWithCinderVolumes-1741196733 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d9003625-8d72-4ea9-9014-6a9b26c8ce26) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7d23f8f0-4475-43cb-b423-8aeb7a87c98d', 'volume_name': 'volume-7d23f8f0-4475-43cb-b423-8aeb7a87c98d', 'volume_size': 1}' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:45:33 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-3798a0fa-c1b5-4afd-8f1a-c7938a68f8c3 tempest-TestInstancesWithCinderVolumes-1741196733 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6cb6a61e-5e73-4ae7-9c72-96e2df31def9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:45:33 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-3798a0fa-c1b5-4afd-8f1a-c7938a68f8c3 tempest-TestInstancesWithCinderVolumes-1741196733 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6cb6a61e-5e73-4ae7-9c72-96e2df31def9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:45:33 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-3798a0fa-c1b5-4afd-8f1a-c7938a68f8c3 tempest-TestInstancesWithCinderVolumes-1741196733 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (026e45b0-2302-40d8-895d-2fa5bd21be58) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:45:33 devstack cinder-volume[87444]: INFO cinder.volume.flows.manager.create_volume [None req-3798a0fa-c1b5-4afd-8f1a-c7938a68f8c3 tempest-TestInstancesWithCinderVolumes-1741196733 None] Volume 7d23f8f0-4475-43cb-b423-8aeb7a87c98d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7d23f8f0-4475-43cb-b423-8aeb7a87c98d', 'volume_size': 1} Jul 10 04:45:33 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-3798a0fa-c1b5-4afd-8f1a-c7938a68f8c3 tempest-TestInstancesWithCinderVolumes-1741196733 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 04:45:33 devstack sudo[98930]: pam_unix(sudo:session): session closed for user root Jul 10 04:45:33 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-64e0e57a-6b13-41c8-a089-f73fb4b56411 tempest-VolumesGetTest-423200778 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097" returned: 0 in 1.213s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:45:33 devstack cinder-volume[87444]: DEBUG cinder.manager [None req-64e0e57a-6b13-41c8-a089-f73fb4b56411 tempest-VolumesGetTest-423200778 None] Notifying Schedulers of capabilities ... {{(pid=87444) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 04:45:33 devstack cinder-volume[87444]: INFO cinder.volume.manager [None req-64e0e57a-6b13-41c8-a089-f73fb4b56411 tempest-VolumesGetTest-423200778 None] Deleted volume successfully. Jul 10 04:45:33 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-64e0e57a-6b13-41c8-a089-f73fb4b56411 tempest-VolumesGetTest-423200778 None] Lock "cinder-addeab11-568e-44aa-bdea-b21abc4e570d-delete_volume" released by "delete_volume" :: held 3.219s {{(pid=87444) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 04:45:33 devstack cinder-volume[87444]: DEBUG cinder.volume.flows.manager.create_volume [None req-499b3fbf-12a5-4a07-9c97-e8d12d5c6784 tempest-VolumesGetTest-423200778 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87444) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 04:45:33 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-499b3fbf-12a5-4a07-9c97-e8d12d5c6784 tempest-VolumesGetTest-423200778 None] Flow 'volume_create_manager' (d9e8b528-0e98-4d23-8069-2c08703fd5e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 04:45:33 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-499b3fbf-12a5-4a07-9c97-e8d12d5c6784 tempest-VolumesGetTest-423200778 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f94e316e-7aff-4f84-a0fd-40beabd3539e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:45:33 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-499b3fbf-12a5-4a07-9c97-e8d12d5c6784 tempest-VolumesGetTest-423200778 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f94e316e-7aff-4f84-a0fd-40beabd3539e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T02:45:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-545432530',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=05be954a-4a47-4dd9-ac7f-15be06ddf426,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='761a9e430aba4ae18bd6ef42f16015f4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T02:45:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T02:45:34Z,use_quota=True,user_id='ae02b9a0cfaa4f7d8fd6393dfd0bb7b6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(317e369e-1e06-434d-ae95-a335f0e6c903),volume_type_id=317e369e-1e06-434d-ae95-a335f0e6c903)' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:45:33 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-499b3fbf-12a5-4a07-9c97-e8d12d5c6784 tempest-VolumesGetTest-423200778 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (985b47c4-5ce9-49a9-950b-9a9918b0ce6a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:45:33 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-499b3fbf-12a5-4a07-9c97-e8d12d5c6784 tempest-VolumesGetTest-423200778 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (985b47c4-5ce9-49a9-950b-9a9918b0ce6a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:45:33 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-499b3fbf-12a5-4a07-9c97-e8d12d5c6784 tempest-VolumesGetTest-423200778 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f11bb8f3-e83a-4e0b-a38d-00ee2b38955d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:45:33 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-499b3fbf-12a5-4a07-9c97-e8d12d5c6784 tempest-VolumesGetTest-423200778 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f11bb8f3-e83a-4e0b-a38d-00ee2b38955d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '05be954a-4a47-4dd9-ac7f-15be06ddf426', 'volume_name': 'volume-05be954a-4a47-4dd9-ac7f-15be06ddf426', 'volume_size': 1}' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:45:33 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-499b3fbf-12a5-4a07-9c97-e8d12d5c6784 tempest-VolumesGetTest-423200778 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (474eaae0-8a8e-4e26-a868-b65fb1927119) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:45:33 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-499b3fbf-12a5-4a07-9c97-e8d12d5c6784 tempest-VolumesGetTest-423200778 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (474eaae0-8a8e-4e26-a868-b65fb1927119) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:45:33 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-499b3fbf-12a5-4a07-9c97-e8d12d5c6784 tempest-VolumesGetTest-423200778 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d27b1741-d1ac-4530-b7c5-45add0e11191) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:45:33 devstack cinder-volume[87444]: INFO cinder.volume.flows.manager.create_volume [None req-499b3fbf-12a5-4a07-9c97-e8d12d5c6784 tempest-VolumesGetTest-423200778 None] Volume 05be954a-4a47-4dd9-ac7f-15be06ddf426: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-05be954a-4a47-4dd9-ac7f-15be06ddf426', 'volume_size': 1} Jul 10 04:45:33 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-499b3fbf-12a5-4a07-9c97-e8d12d5c6784 tempest-VolumesGetTest-423200778 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 04:45:34 devstack sudo[98968]: pam_unix(sudo:session): session closed for user root Jul 10 04:45:34 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-01f0ce3e-6850-4e14-881d-e40d3c4ad6e5 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097" returned: 0 in 1.112s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:45:34 devstack cinder-volume[87444]: DEBUG cinder.manager [None req-01f0ce3e-6850-4e14-881d-e40d3c4ad6e5 None None] Notifying Schedulers of capabilities ... {{(pid=87444) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 04:45:34 devstack cinder-volume[87444]: DEBUG oslo_service.periodic_task [None req-01f0ce3e-6850-4e14-881d-e40d3c4ad6e5 None None] Running periodic task VolumeManager._thread_info {{(pid=87444) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 10 04:45:34 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-01f0ce3e-6850-4e14-881d-e40d3c4ad6e5 None None] thread count: 28 {{(pid=87444) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 10 04:45:34 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-01f0ce3e-6850-4e14-881d-e40d3c4ad6e5 None None] thread info: [<_MainThread(MainThread, started 126839257915520)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87444) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 10 04:45:34 devstack cinder-volume[87444]: DEBUG cinder.volume.flows.manager.create_volume [None req-59766116-d923-41dd-96d2-bb1972203832 tempest-TestInstancesWithCinderVolumes-1741196733 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87444) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 04:45:34 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-59766116-d923-41dd-96d2-bb1972203832 tempest-TestInstancesWithCinderVolumes-1741196733 None] Flow 'volume_create_manager' (9a4708b0-733b-46c2-ac76-af8accc64b4d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 04:45:34 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-59766116-d923-41dd-96d2-bb1972203832 tempest-TestInstancesWithCinderVolumes-1741196733 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7850e7a3-e463-4257-b6cd-72f64209522d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:45:34 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-59766116-d923-41dd-96d2-bb1972203832 tempest-TestInstancesWithCinderVolumes-1741196733 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7850e7a3-e463-4257-b6cd-72f64209522d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T02:45:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-2006124423',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=51f17d86-5d8b-4a30-b599-e679ed47dd26,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e98650f7bf93499fad9ed367fab18dff',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T02:45:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T02:45:34Z,use_quota=True,user_id='ceb6d26439444df79a23079d4c62132b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(11bd8f0f-16b1-4c9b-8929-c1776dfe0914),volume_type_id=11bd8f0f-16b1-4c9b-8929-c1776dfe0914)' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:45:34 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-59766116-d923-41dd-96d2-bb1972203832 tempest-TestInstancesWithCinderVolumes-1741196733 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b7150ba5-f81a-49d3-8283-8b84ae9f481e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:45:34 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-59766116-d923-41dd-96d2-bb1972203832 tempest-TestInstancesWithCinderVolumes-1741196733 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b7150ba5-f81a-49d3-8283-8b84ae9f481e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:45:34 devstack sudo[98932]: pam_unix(sudo:session): session closed for user root Jul 10 04:45:34 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-59766116-d923-41dd-96d2-bb1972203832 tempest-TestInstancesWithCinderVolumes-1741196733 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d29bedc2-13e7-4162-b7c1-2ebd6d563c4b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:45:34 devstack cinder-volume[87444]: DEBUG cinder.image.glance [None req-59766116-d923-41dd-96d2-bb1972203832 tempest-TestInstancesWithCinderVolumes-1741196733 None] Creating Keystone auth plugin from conf {{(pid=87444) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jul 10 04:45:34 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-de5886ee-87a8-4f69-a4ba-d0b1a22c5109 tempest-TestInstancesWithCinderVolumes-1741196733 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-a9b21329-62c2-4cd4-8a67-34eb1efdc714 1073741824" returned: 0 in 1.846s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:45:34 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-de5886ee-87a8-4f69-a4ba-d0b1a22c5109 tempest-TestInstancesWithCinderVolumes-1741196733 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-a9b21329-62c2-4cd4-8a67-34eb1efdc714 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:45:34 devstack sudo[98978]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-a9b21329-62c2-4cd4-8a67-34eb1efdc714 Jul 10 04:45:34 devstack sudo[98978]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:45:34 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-59766116-d923-41dd-96d2-bb1972203832 tempest-TestInstancesWithCinderVolumes-1741196733 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d29bedc2-13e7-4162-b7c1-2ebd6d563c4b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '51f17d86-5d8b-4a30-b599-e679ed47dd26', 'volume_name': 'volume-51f17d86-5d8b-4a30-b599-e679ed47dd26', 'volume_size': 1, 'image_id': 'e43721af-c8fa-44d2-8f43-d1ee90b7fb4a', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/e43721af-c8fa-44d2-8f43-d1ee90b7fb4a', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--1950598215', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'e98650f7bf93499fad9ed367fab18dff', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'e43721af-c8fa-44d2-8f43-d1ee90b7fb4a', 'created_at': datetime.datetime(2026, 7, 10, 2, 45, 29, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 10, 2, 45, 31, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/e43721af-c8fa-44d2-8f43-d1ee90b7fb4a/file', 'properties': {}}, 'image_service': }' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:45:34 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-59766116-d923-41dd-96d2-bb1972203832 tempest-TestInstancesWithCinderVolumes-1741196733 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8a6c66af-9562-4100-b1f6-fa9890e37304) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:45:34 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-59766116-d923-41dd-96d2-bb1972203832 tempest-TestInstancesWithCinderVolumes-1741196733 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8a6c66af-9562-4100-b1f6-fa9890e37304) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:45:34 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-59766116-d923-41dd-96d2-bb1972203832 tempest-TestInstancesWithCinderVolumes-1741196733 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (688d5aa6-281c-435b-84ad-3b7d813efda4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:45:34 devstack cinder-volume[87444]: INFO cinder.volume.flows.manager.create_volume [None req-59766116-d923-41dd-96d2-bb1972203832 tempest-TestInstancesWithCinderVolumes-1741196733 None] Volume 51f17d86-5d8b-4a30-b599-e679ed47dd26: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-51f17d86-5d8b-4a30-b599-e679ed47dd26', 'volume_size': 1, 'image_id': 'e43721af-c8fa-44d2-8f43-d1ee90b7fb4a', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/e43721af-c8fa-44d2-8f43-d1ee90b7fb4a', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--1950598215', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'e98650f7bf93499fad9ed367fab18dff', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'e43721af-c8fa-44d2-8f43-d1ee90b7fb4a', 'created_at': datetime.datetime(2026, 7, 10, 2, 45, 29, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 10, 2, 45, 31, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/e43721af-c8fa-44d2-8f43-d1ee90b7fb4a/file', 'properties': {}}, 'image_service': } Jul 10 04:45:34 devstack cinder-volume[87444]: DEBUG cinder.volume.flows.manager.create_volume [None req-59766116-d923-41dd-96d2-bb1972203832 tempest-TestInstancesWithCinderVolumes-1741196733 None] Trying to clone 51f17d86-5d8b-4a30-b599-e679ed47dd26 from image e43721af-c8fa-44d2-8f43-d1ee90b7fb4a at location (None, [{'url': 'file:///opt/stack/data/glance/images/e43721af-c8fa-44d2-8f43-d1ee90b7fb4a', 'metadata': {}}]). {{(pid=87444) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jul 10 04:45:35 devstack sudo[98978]: pam_unix(sudo:session): session closed for user root Jul 10 04:45:35 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-de5886ee-87a8-4f69-a4ba-d0b1a22c5109 tempest-TestInstancesWithCinderVolumes-1741196733 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-a9b21329-62c2-4cd4-8a67-34eb1efdc714" returned: 0 in 1.041s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:45:35 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-de5886ee-87a8-4f69-a4ba-d0b1a22c5109 tempest-TestInstancesWithCinderVolumes-1741196733 None] <== create_volume: return (2940ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922'} {{(pid=87444) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 04:45:35 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-de5886ee-87a8-4f69-a4ba-d0b1a22c5109 tempest-TestInstancesWithCinderVolumes-1741196733 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.943s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 04:45:35 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-3798a0fa-c1b5-4afd-8f1a-c7938a68f8c3 tempest-TestInstancesWithCinderVolumes-1741196733 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.033s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 04:45:35 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-3798a0fa-c1b5-4afd-8f1a-c7938a68f8c3 tempest-TestInstancesWithCinderVolumes-1741196733 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T02:45:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-231980061',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7d23f8f0-4475-43cb-b423-8aeb7a87c98d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e98650f7bf93499fad9ed367fab18dff',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T02:45:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T02:45:33Z,use_quota=True,user_id='ceb6d26439444df79a23079d4c62132b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8f199c45-0626-462c-b71f-f2fb3034b105),volume_type_id=8f199c45-0626-462c-b71f-f2fb3034b105)}" {{(pid=87444) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 04:45:35 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.remotefs [None req-3798a0fa-c1b5-4afd-8f1a-c7938a68f8c3 tempest-TestInstancesWithCinderVolumes-1741196733 None] Creating volume 7d23f8f0-4475-43cb-b423-8aeb7a87c98d {{(pid=87444) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 04:45:35 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-3798a0fa-c1b5-4afd-8f1a-c7938a68f8c3 tempest-TestInstancesWithCinderVolumes-1741196733 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 04:45:35 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-3798a0fa-c1b5-4afd-8f1a-c7938a68f8c3 tempest-TestInstancesWithCinderVolumes-1741196733 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 04:45:35 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-3798a0fa-c1b5-4afd-8f1a-c7938a68f8c3 tempest-TestInstancesWithCinderVolumes-1741196733 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922': None} {{(pid=87444) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 04:45:35 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-3798a0fa-c1b5-4afd-8f1a-c7938a68f8c3 tempest-TestInstancesWithCinderVolumes-1741196733 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922'] {{(pid=87444) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 04:45:35 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-3798a0fa-c1b5-4afd-8f1a-c7938a68f8c3 tempest-TestInstancesWithCinderVolumes-1741196733 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 04:45:35 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-3798a0fa-c1b5-4afd-8f1a-c7938a68f8c3 tempest-TestInstancesWithCinderVolumes-1741196733 None] Selected osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922 as target Quobyte volume. {{(pid=87444) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 04:45:35 devstack cinder-volume[87444]: INFO cinder.volume.drivers.remotefs [None req-3798a0fa-c1b5-4afd-8f1a-c7938a68f8c3 tempest-TestInstancesWithCinderVolumes-1741196733 None] casted to osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922 Jul 10 04:45:35 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-3798a0fa-c1b5-4afd-8f1a-c7938a68f8c3 tempest-TestInstancesWithCinderVolumes-1741196733 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-7d23f8f0-4475-43cb-b423-8aeb7a87c98d 1073741824 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:45:35 devstack sudo[98986]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-7d23f8f0-4475-43cb-b423-8aeb7a87c98d 1073741824 Jul 10 04:45:35 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-de5886ee-87a8-4f69-a4ba-d0b1a22c5109 tempest-TestInstancesWithCinderVolumes-1741196733 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d19c8ca1-c0ba-48e0-8ead-107562939163) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a9b21329-62c2-4cd4-8a67-34eb1efdc714', 'volume_size': 1}' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:45:35 devstack sudo[98986]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:45:35 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-de5886ee-87a8-4f69-a4ba-d0b1a22c5109 tempest-TestInstancesWithCinderVolumes-1741196733 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fa889397-4423-4a41-8869-e4d203fa3e31) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:45:35 devstack cinder-volume[87444]: INFO cinder.volume.flows.manager.create_volume [None req-de5886ee-87a8-4f69-a4ba-d0b1a22c5109 tempest-TestInstancesWithCinderVolumes-1741196733 None] Volume volume-a9b21329-62c2-4cd4-8a67-34eb1efdc714 (a9b21329-62c2-4cd4-8a67-34eb1efdc714): created successfully Jul 10 04:45:35 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-de5886ee-87a8-4f69-a4ba-d0b1a22c5109 tempest-TestInstancesWithCinderVolumes-1741196733 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fa889397-4423-4a41-8869-e4d203fa3e31) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:45:35 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-de5886ee-87a8-4f69-a4ba-d0b1a22c5109 tempest-TestInstancesWithCinderVolumes-1741196733 None] Flow 'volume_create_manager' (c795db52-0a8c-4baf-95f8-3f5b119d72d0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87444) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 04:45:35 devstack cinder-volume[87444]: INFO cinder.volume.manager [None req-de5886ee-87a8-4f69-a4ba-d0b1a22c5109 tempest-TestInstancesWithCinderVolumes-1741196733 None] Created volume successfully. Jul 10 04:45:36 devstack sudo[98986]: pam_unix(sudo:session): session closed for user root Jul 10 04:45:36 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-3798a0fa-c1b5-4afd-8f1a-c7938a68f8c3 tempest-TestInstancesWithCinderVolumes-1741196733 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-7d23f8f0-4475-43cb-b423-8aeb7a87c98d 1073741824" returned: 0 in 1.076s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:45:36 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-3798a0fa-c1b5-4afd-8f1a-c7938a68f8c3 tempest-TestInstancesWithCinderVolumes-1741196733 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-7d23f8f0-4475-43cb-b423-8aeb7a87c98d {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:45:36 devstack sudo[98993]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-7d23f8f0-4475-43cb-b423-8aeb7a87c98d Jul 10 04:45:36 devstack sudo[98993]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:45:37 devstack sudo[98993]: pam_unix(sudo:session): session closed for user root Jul 10 04:45:37 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-3798a0fa-c1b5-4afd-8f1a-c7938a68f8c3 tempest-TestInstancesWithCinderVolumes-1741196733 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-7d23f8f0-4475-43cb-b423-8aeb7a87c98d" returned: 0 in 0.864s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:45:37 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-3798a0fa-c1b5-4afd-8f1a-c7938a68f8c3 tempest-TestInstancesWithCinderVolumes-1741196733 None] <== create_volume: return (1992ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922'} {{(pid=87444) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 04:45:37 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-3798a0fa-c1b5-4afd-8f1a-c7938a68f8c3 tempest-TestInstancesWithCinderVolumes-1741196733 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.995s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 04:45:37 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-499b3fbf-12a5-4a07-9c97-e8d12d5c6784 tempest-VolumesGetTest-423200778 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.707s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 04:45:37 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-499b3fbf-12a5-4a07-9c97-e8d12d5c6784 tempest-VolumesGetTest-423200778 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T02:45:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-545432530',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=05be954a-4a47-4dd9-ac7f-15be06ddf426,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='761a9e430aba4ae18bd6ef42f16015f4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T02:45:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T02:45:34Z,use_quota=True,user_id='ae02b9a0cfaa4f7d8fd6393dfd0bb7b6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(317e369e-1e06-434d-ae95-a335f0e6c903),volume_type_id=317e369e-1e06-434d-ae95-a335f0e6c903)}" {{(pid=87444) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 04:45:37 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.remotefs [None req-499b3fbf-12a5-4a07-9c97-e8d12d5c6784 tempest-VolumesGetTest-423200778 None] Creating volume 05be954a-4a47-4dd9-ac7f-15be06ddf426 {{(pid=87444) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 04:45:37 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-499b3fbf-12a5-4a07-9c97-e8d12d5c6784 tempest-VolumesGetTest-423200778 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 04:45:37 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-499b3fbf-12a5-4a07-9c97-e8d12d5c6784 tempest-VolumesGetTest-423200778 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 04:45:37 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-499b3fbf-12a5-4a07-9c97-e8d12d5c6784 tempest-VolumesGetTest-423200778 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922': None} {{(pid=87444) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 04:45:37 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-499b3fbf-12a5-4a07-9c97-e8d12d5c6784 tempest-VolumesGetTest-423200778 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922'] {{(pid=87444) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 04:45:37 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-499b3fbf-12a5-4a07-9c97-e8d12d5c6784 tempest-VolumesGetTest-423200778 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 04:45:37 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-499b3fbf-12a5-4a07-9c97-e8d12d5c6784 tempest-VolumesGetTest-423200778 None] Selected osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922 as target Quobyte volume. {{(pid=87444) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 04:45:37 devstack cinder-volume[87444]: INFO cinder.volume.drivers.remotefs [None req-499b3fbf-12a5-4a07-9c97-e8d12d5c6784 tempest-VolumesGetTest-423200778 None] casted to osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922 Jul 10 04:45:37 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-499b3fbf-12a5-4a07-9c97-e8d12d5c6784 tempest-VolumesGetTest-423200778 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-05be954a-4a47-4dd9-ac7f-15be06ddf426 1073741824 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:45:37 devstack sudo[98996]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-05be954a-4a47-4dd9-ac7f-15be06ddf426 1073741824 Jul 10 04:45:37 devstack sudo[98996]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:45:37 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-3798a0fa-c1b5-4afd-8f1a-c7938a68f8c3 tempest-TestInstancesWithCinderVolumes-1741196733 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (026e45b0-2302-40d8-895d-2fa5bd21be58) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7d23f8f0-4475-43cb-b423-8aeb7a87c98d', 'volume_size': 1}' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:45:37 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-3798a0fa-c1b5-4afd-8f1a-c7938a68f8c3 tempest-TestInstancesWithCinderVolumes-1741196733 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (965cfffe-07a0-495c-8277-7d4a805380c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:45:37 devstack cinder-volume[87444]: INFO cinder.volume.flows.manager.create_volume [None req-3798a0fa-c1b5-4afd-8f1a-c7938a68f8c3 tempest-TestInstancesWithCinderVolumes-1741196733 None] Volume volume-7d23f8f0-4475-43cb-b423-8aeb7a87c98d (7d23f8f0-4475-43cb-b423-8aeb7a87c98d): created successfully Jul 10 04:45:37 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-3798a0fa-c1b5-4afd-8f1a-c7938a68f8c3 tempest-TestInstancesWithCinderVolumes-1741196733 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (965cfffe-07a0-495c-8277-7d4a805380c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:45:37 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-3798a0fa-c1b5-4afd-8f1a-c7938a68f8c3 tempest-TestInstancesWithCinderVolumes-1741196733 None] Flow 'volume_create_manager' (3ae85e06-685c-4b34-af6a-293dc3884dc5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87444) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 04:45:37 devstack cinder-volume[87444]: INFO cinder.volume.manager [None req-3798a0fa-c1b5-4afd-8f1a-c7938a68f8c3 tempest-TestInstancesWithCinderVolumes-1741196733 None] Created volume successfully. Jul 10 04:45:38 devstack sudo[98996]: pam_unix(sudo:session): session closed for user root Jul 10 04:45:38 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-499b3fbf-12a5-4a07-9c97-e8d12d5c6784 tempest-VolumesGetTest-423200778 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-05be954a-4a47-4dd9-ac7f-15be06ddf426 1073741824" returned: 0 in 1.024s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:45:38 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-499b3fbf-12a5-4a07-9c97-e8d12d5c6784 tempest-VolumesGetTest-423200778 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-05be954a-4a47-4dd9-ac7f-15be06ddf426 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:45:38 devstack sudo[99003]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-05be954a-4a47-4dd9-ac7f-15be06ddf426 Jul 10 04:45:38 devstack sudo[99003]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:45:39 devstack cinder-volume[87444]: DEBUG cinder.image.image_utils [None req-59766116-d923-41dd-96d2-bb1972203832 tempest-TestInstancesWithCinderVolumes-1741196733 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_e43721af-c8fa-44d2-8f43-d1ee90b7fb4a_qfbvjubndevstack@QuobyteHD, size 20.69 MB, duration 4.12 sec {{(pid=87444) fetch /opt/stack/cinder/cinder/image/image_utils.py:765}} Jul 10 04:45:39 devstack cinder-volume[87444]: INFO cinder.image.image_utils [None req-59766116-d923-41dd-96d2-bb1972203832 tempest-TestInstancesWithCinderVolumes-1741196733 None] Image download 20.69 MB at 5.02 MB/s Jul 10 04:45:39 devstack cinder-volume[87444]: DEBUG oslo.privsep.daemon [-] privsep: reply[6644ca4f-516c-4974-95b4-1d3bd3ac576e]: (4, 'qcow2') {{(pid=88499) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 04:45:39 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-59766116-d923-41dd-96d2-bb1972203832 tempest-TestInstancesWithCinderVolumes-1741196733 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_e43721af-c8fa-44d2-8f43-d1ee90b7fb4a_qfbvjubndevstack@QuobyteHD {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:45:39 devstack sudo[99005]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_e43721af-c8fa-44d2-8f43-d1ee90b7fb4a_qfbvjubndevstack@QuobyteHD Jul 10 04:45:39 devstack sudo[99005]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:45:39 devstack sudo[99003]: pam_unix(sudo:session): session closed for user root Jul 10 04:45:39 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-499b3fbf-12a5-4a07-9c97-e8d12d5c6784 tempest-VolumesGetTest-423200778 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-05be954a-4a47-4dd9-ac7f-15be06ddf426" returned: 0 in 0.716s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:45:39 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-499b3fbf-12a5-4a07-9c97-e8d12d5c6784 tempest-VolumesGetTest-423200778 None] <== create_volume: return (1794ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922'} {{(pid=87444) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 04:45:39 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-499b3fbf-12a5-4a07-9c97-e8d12d5c6784 tempest-VolumesGetTest-423200778 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.798s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 04:45:39 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-499b3fbf-12a5-4a07-9c97-e8d12d5c6784 tempest-VolumesGetTest-423200778 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d27b1741-d1ac-4530-b7c5-45add0e11191) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-05be954a-4a47-4dd9-ac7f-15be06ddf426', 'volume_size': 1}' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:45:39 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-499b3fbf-12a5-4a07-9c97-e8d12d5c6784 tempest-VolumesGetTest-423200778 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7656a6fb-7cfd-4a43-bcde-c525a06f27e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:45:39 devstack cinder-volume[87444]: INFO cinder.volume.flows.manager.create_volume [None req-499b3fbf-12a5-4a07-9c97-e8d12d5c6784 tempest-VolumesGetTest-423200778 None] Volume volume-05be954a-4a47-4dd9-ac7f-15be06ddf426 (05be954a-4a47-4dd9-ac7f-15be06ddf426): created successfully Jul 10 04:45:39 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-499b3fbf-12a5-4a07-9c97-e8d12d5c6784 tempest-VolumesGetTest-423200778 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7656a6fb-7cfd-4a43-bcde-c525a06f27e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:45:39 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-499b3fbf-12a5-4a07-9c97-e8d12d5c6784 tempest-VolumesGetTest-423200778 None] Flow 'volume_create_manager' (d9e8b528-0e98-4d23-8069-2c08703fd5e0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87444) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 04:45:39 devstack cinder-volume[87444]: INFO cinder.volume.manager [None req-499b3fbf-12a5-4a07-9c97-e8d12d5c6784 tempest-VolumesGetTest-423200778 None] Created volume successfully. Jul 10 04:45:39 devstack sudo[99005]: pam_unix(sudo:session): session closed for user root Jul 10 04:45:39 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-59766116-d923-41dd-96d2-bb1972203832 tempest-TestInstancesWithCinderVolumes-1741196733 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_e43721af-c8fa-44d2-8f43-d1ee90b7fb4a_qfbvjubndevstack@QuobyteHD" returned: 0 in 0.777s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:45:39 devstack cinder-volume[87444]: DEBUG cinder.image.image_utils [None req-59766116-d923-41dd-96d2-bb1972203832 tempest-TestInstancesWithCinderVolumes-1741196733 None] Temporary image e43721af-c8fa-44d2-8f43-d1ee90b7fb4a is fetched for user ceb6d26439444df79a23079d4c62132b. {{(pid=87444) fetch /opt/stack/cinder/cinder/image/image_utils.py:1464}} Jul 10 04:45:39 devstack cinder-volume[87444]: DEBUG oslo.privsep.daemon [-] privsep: reply[eafe79cc-f027-4ecd-acd4-86fbae5289d5]: (4, 'qcow2') {{(pid=88499) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 04:45:39 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-59766116-d923-41dd-96d2-bb1972203832 tempest-TestInstancesWithCinderVolumes-1741196733 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_e43721af-c8fa-44d2-8f43-d1ee90b7fb4a_qfbvjubndevstack@QuobyteHD {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:45:40 devstack sudo[99011]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_e43721af-c8fa-44d2-8f43-d1ee90b7fb4a_qfbvjubndevstack@QuobyteHD Jul 10 04:45:40 devstack sudo[99011]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:45:40 devstack cinder-volume[87444]: DEBUG cinder.volume.flows.manager.create_volume [None req-c9701de1-866e-46ce-91be-53bbea93664c tempest-VolumesGetTest-423200778 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87444) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 04:45:40 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-c9701de1-866e-46ce-91be-53bbea93664c tempest-VolumesGetTest-423200778 None] Flow 'volume_create_manager' (21f188ea-8e9f-48dd-8cf5-e0ad26ec2f50) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 04:45:40 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-c9701de1-866e-46ce-91be-53bbea93664c tempest-VolumesGetTest-423200778 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ce6183a3-06c8-46c9-92be-7996e8ae59f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:45:40 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-c9701de1-866e-46ce-91be-53bbea93664c tempest-VolumesGetTest-423200778 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ce6183a3-06c8-46c9-92be-7996e8ae59f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T02:45:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-742693154',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c1550a73-bf63-478c-bb51-2ddbb87cb4e9,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='761a9e430aba4ae18bd6ef42f16015f4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T02:45:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=05be954a-4a47-4dd9-ac7f-15be06ddf426,status='creating',terminated_at=None,updated_at=2026-07-10T02:45:40Z,use_quota=True,user_id='ae02b9a0cfaa4f7d8fd6393dfd0bb7b6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(317e369e-1e06-434d-ae95-a335f0e6c903),volume_type_id=317e369e-1e06-434d-ae95-a335f0e6c903)' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:45:40 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-c9701de1-866e-46ce-91be-53bbea93664c tempest-VolumesGetTest-423200778 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1633ad53-9dbf-4dba-a14a-e2f6e805cd5c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:45:40 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-c9701de1-866e-46ce-91be-53bbea93664c tempest-VolumesGetTest-423200778 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1633ad53-9dbf-4dba-a14a-e2f6e805cd5c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:45:40 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-c9701de1-866e-46ce-91be-53bbea93664c tempest-VolumesGetTest-423200778 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ccf00d6e-2d5b-4e9d-a938-79a5fe8ce9d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:45:40 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-c9701de1-866e-46ce-91be-53bbea93664c tempest-VolumesGetTest-423200778 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ccf00d6e-2d5b-4e9d-a938-79a5fe8ce9d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': 'c1550a73-bf63-478c-bb51-2ddbb87cb4e9', 'volume_name': 'volume-c1550a73-bf63-478c-bb51-2ddbb87cb4e9', 'volume_size': 1, 'source_volid': '05be954a-4a47-4dd9-ac7f-15be06ddf426', 'source_volstatus': 'available'}' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:45:40 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-c9701de1-866e-46ce-91be-53bbea93664c tempest-VolumesGetTest-423200778 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1e3acf88-88dd-41b3-8f10-bcee07edc7cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:45:40 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-c9701de1-866e-46ce-91be-53bbea93664c tempest-VolumesGetTest-423200778 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1e3acf88-88dd-41b3-8f10-bcee07edc7cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:45:40 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-c9701de1-866e-46ce-91be-53bbea93664c tempest-VolumesGetTest-423200778 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a9cedd3e-f1a3-4a90-9a86-95a8b66b2e8d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:45:40 devstack cinder-volume[87444]: INFO cinder.volume.flows.manager.create_volume [None req-c9701de1-866e-46ce-91be-53bbea93664c tempest-VolumesGetTest-423200778 None] Volume c1550a73-bf63-478c-bb51-2ddbb87cb4e9: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-c1550a73-bf63-478c-bb51-2ddbb87cb4e9', 'volume_size': 1, 'source_volid': '05be954a-4a47-4dd9-ac7f-15be06ddf426', 'source_volstatus': 'available'} Jul 10 04:45:40 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-c9701de1-866e-46ce-91be-53bbea93664c tempest-VolumesGetTest-423200778 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 04:45:40 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-c9701de1-866e-46ce-91be-53bbea93664c tempest-VolumesGetTest-423200778 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 04:45:40 devstack cinder-volume[87444]: INFO cinder.volume.drivers.remotefs [None req-c9701de1-866e-46ce-91be-53bbea93664c tempest-VolumesGetTest-423200778 None] Cloning volume 05be954a-4a47-4dd9-ac7f-15be06ddf426 to volume c1550a73-bf63-478c-bb51-2ddbb87cb4e9 Jul 10 04:45:40 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.remotefs [None req-c9701de1-866e-46ce-91be-53bbea93664c tempest-VolumesGetTest-423200778 None] Creating offline snapshot ab5096a6-6d45-43f9-aefe-c631a11469ba of volume 05be954a-4a47-4dd9-ac7f-15be06ddf426 {{(pid=87444) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 10 04:45:40 devstack cinder-volume[87444]: DEBUG oslo.privsep.daemon [-] privsep: reply[48b6cd11-629f-4e8e-96b5-1b472eb2b798]: (4, 'qcow2') {{(pid=88499) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 04:45:40 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-c9701de1-866e-46ce-91be-53bbea93664c tempest-VolumesGetTest-423200778 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-05be954a-4a47-4dd9-ac7f-15be06ddf426 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:45:40 devstack sudo[99014]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-05be954a-4a47-4dd9-ac7f-15be06ddf426 Jul 10 04:45:40 devstack sudo[99014]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:45:40 devstack sudo[99011]: pam_unix(sudo:session): session closed for user root Jul 10 04:45:40 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-59766116-d923-41dd-96d2-bb1972203832 tempest-TestInstancesWithCinderVolumes-1741196733 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_e43721af-c8fa-44d2-8f43-d1ee90b7fb4a_qfbvjubndevstack@QuobyteHD" returned: 0 in 0.891s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:45:40 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-59766116-d923-41dd-96d2-bb1972203832 tempest-TestInstancesWithCinderVolumes-1741196733 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 04:45:41 devstack sudo[99014]: pam_unix(sudo:session): session closed for user root Jul 10 04:45:41 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-c9701de1-866e-46ce-91be-53bbea93664c tempest-VolumesGetTest-423200778 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-05be954a-4a47-4dd9-ac7f-15be06ddf426" returned: 0 in 0.961s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:45:41 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-c9701de1-866e-46ce-91be-53bbea93664c tempest-VolumesGetTest-423200778 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-05be954a-4a47-4dd9-ac7f-15be06ddf426,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-05be954a-4a47-4dd9-ac7f-15be06ddf426.ab5096a6-6d45-43f9-aefe-c631a11469ba 1G {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:45:41 devstack sudo[99023]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-05be954a-4a47-4dd9-ac7f-15be06ddf426,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-05be954a-4a47-4dd9-ac7f-15be06ddf426.ab5096a6-6d45-43f9-aefe-c631a11469ba 1G Jul 10 04:45:41 devstack sudo[99023]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:45:42 devstack sudo[99023]: pam_unix(sudo:session): session closed for user root Jul 10 04:45:42 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-c9701de1-866e-46ce-91be-53bbea93664c tempest-VolumesGetTest-423200778 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-05be954a-4a47-4dd9-ac7f-15be06ddf426,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-05be954a-4a47-4dd9-ac7f-15be06ddf426.ab5096a6-6d45-43f9-aefe-c631a11469ba 1G" returned: 0 in 1.065s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:45:42 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-c9701de1-866e-46ce-91be-53bbea93664c tempest-VolumesGetTest-423200778 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-05be954a-4a47-4dd9-ac7f-15be06ddf426 -F qcow2 /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-05be954a-4a47-4dd9-ac7f-15be06ddf426.ab5096a6-6d45-43f9-aefe-c631a11469ba {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:45:42 devstack sudo[99031]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-05be954a-4a47-4dd9-ac7f-15be06ddf426 -F qcow2 /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-05be954a-4a47-4dd9-ac7f-15be06ddf426.ab5096a6-6d45-43f9-aefe-c631a11469ba Jul 10 04:45:42 devstack sudo[99031]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:45:43 devstack sudo[99031]: pam_unix(sudo:session): session closed for user root Jul 10 04:45:43 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-c9701de1-866e-46ce-91be-53bbea93664c tempest-VolumesGetTest-423200778 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-05be954a-4a47-4dd9-ac7f-15be06ddf426 -F qcow2 /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-05be954a-4a47-4dd9-ac7f-15be06ddf426.ab5096a6-6d45-43f9-aefe-c631a11469ba" returned: 0 in 1.015s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:45:43 devstack cinder-volume[87444]: WARNING cinder.volume.drivers.remotefs [None req-c9701de1-866e-46ce-91be-53bbea93664c tempest-VolumesGetTest-423200778 None] /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-05be954a-4a47-4dd9-ac7f-15be06ddf426.ab5096a6-6d45-43f9-aefe-c631a11469ba is being set with open permissions: ugo+rw Jul 10 04:45:43 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-c9701de1-866e-46ce-91be-53bbea93664c tempest-VolumesGetTest-423200778 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-05be954a-4a47-4dd9-ac7f-15be06ddf426.ab5096a6-6d45-43f9-aefe-c631a11469ba {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:45:43 devstack sudo[99052]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-05be954a-4a47-4dd9-ac7f-15be06ddf426.ab5096a6-6d45-43f9-aefe-c631a11469ba Jul 10 04:45:43 devstack sudo[99052]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:45:44 devstack sudo[99052]: pam_unix(sudo:session): session closed for user root Jul 10 04:45:44 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-c9701de1-866e-46ce-91be-53bbea93664c tempest-VolumesGetTest-423200778 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-05be954a-4a47-4dd9-ac7f-15be06ddf426.ab5096a6-6d45-43f9-aefe-c631a11469ba" returned: 0 in 0.749s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:45:44 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-c9701de1-866e-46ce-91be-53bbea93664c tempest-VolumesGetTest-423200778 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-05be954a-4a47-4dd9-ac7f-15be06ddf426.info {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:45:44 devstack sudo[99055]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-05be954a-4a47-4dd9-ac7f-15be06ddf426.info Jul 10 04:45:44 devstack sudo[99055]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:45:45 devstack sudo[99055]: pam_unix(sudo:session): session closed for user root Jul 10 04:45:45 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-c9701de1-866e-46ce-91be-53bbea93664c tempest-VolumesGetTest-423200778 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-05be954a-4a47-4dd9-ac7f-15be06ddf426.info" returned: 0 in 0.747s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:45:45 devstack cinder-volume[87444]: WARNING cinder.volume.drivers.remotefs [None req-c9701de1-866e-46ce-91be-53bbea93664c tempest-VolumesGetTest-423200778 None] /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-05be954a-4a47-4dd9-ac7f-15be06ddf426.info is being set with open permissions: ugo+rw Jul 10 04:45:45 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-c9701de1-866e-46ce-91be-53bbea93664c tempest-VolumesGetTest-423200778 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-05be954a-4a47-4dd9-ac7f-15be06ddf426.info {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:45:45 devstack sudo[99059]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-05be954a-4a47-4dd9-ac7f-15be06ddf426.info Jul 10 04:45:45 devstack sudo[99059]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:45:45 devstack sudo[99059]: pam_unix(sudo:session): session closed for user root Jul 10 04:45:45 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-c9701de1-866e-46ce-91be-53bbea93664c tempest-VolumesGetTest-423200778 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-05be954a-4a47-4dd9-ac7f-15be06ddf426.info" returned: 0 in 0.707s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:45:45 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-c9701de1-866e-46ce-91be-53bbea93664c tempest-VolumesGetTest-423200778 None] Acquiring lock "cinder-quobyte-c1550a73-bf63-478c-bb51-2ddbb87cb4e9" by "_copy_volume_from_snapshot" {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 04:45:45 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-c9701de1-866e-46ce-91be-53bbea93664c tempest-VolumesGetTest-423200778 None] Lock "cinder-quobyte-c1550a73-bf63-478c-bb51-2ddbb87cb4e9" acquired by "_copy_volume_from_snapshot" :: waited 0.020s {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 04:45:45 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-c9701de1-866e-46ce-91be-53bbea93664c tempest-VolumesGetTest-423200778 None] snapshot: ab5096a6-6d45-43f9-aefe-c631a11469ba, volume: c1550a73-bf63-478c-bb51-2ddbb87cb4e9, {{(pid=87444) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jul 10 04:45:45 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-c9701de1-866e-46ce-91be-53bbea93664c tempest-VolumesGetTest-423200778 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 04:45:45 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-c9701de1-866e-46ce-91be-53bbea93664c tempest-VolumesGetTest-423200778 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 04:45:45 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-c9701de1-866e-46ce-91be-53bbea93664c tempest-VolumesGetTest-423200778 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922': None} {{(pid=87444) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 04:45:45 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-c9701de1-866e-46ce-91be-53bbea93664c tempest-VolumesGetTest-423200778 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922'] {{(pid=87444) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 04:45:45 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-c9701de1-866e-46ce-91be-53bbea93664c tempest-VolumesGetTest-423200778 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 04:45:45 devstack cinder-volume[87444]: DEBUG oslo.privsep.daemon [-] privsep: reply[5da9c666-c097-442a-aedb-829133d5fddc]: (4, 'qcow2') {{(pid=88499) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 04:45:45 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-c9701de1-866e-46ce-91be-53bbea93664c tempest-VolumesGetTest-423200778 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-05be954a-4a47-4dd9-ac7f-15be06ddf426.ab5096a6-6d45-43f9-aefe-c631a11469ba {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:45:45 devstack sudo[99068]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-05be954a-4a47-4dd9-ac7f-15be06ddf426.ab5096a6-6d45-43f9-aefe-c631a11469ba Jul 10 04:45:45 devstack sudo[99068]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:45:46 devstack sudo[99068]: pam_unix(sudo:session): session closed for user root Jul 10 04:45:46 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-c9701de1-866e-46ce-91be-53bbea93664c tempest-VolumesGetTest-423200778 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-05be954a-4a47-4dd9-ac7f-15be06ddf426.ab5096a6-6d45-43f9-aefe-c631a11469ba" returned: 0 in 0.836s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:45:46 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.remotefs [None req-c9701de1-866e-46ce-91be-53bbea93664c tempest-VolumesGetTest-423200778 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-05be954a-4a47-4dd9-ac7f-15be06ddf426(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87444) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 10 04:45:46 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-c9701de1-866e-46ce-91be-53bbea93664c tempest-VolumesGetTest-423200778 None] will copy from snapshot at /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-05be954a-4a47-4dd9-ac7f-15be06ddf426 {{(pid=87444) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jul 10 04:45:46 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-c9701de1-866e-46ce-91be-53bbea93664c tempest-VolumesGetTest-423200778 None] Creating direct copy from snapshot {{(pid=87444) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jul 10 04:45:46 devstack cinder-volume[87444]: DEBUG oslo.privsep.daemon [-] privsep: reply[6da02d57-a23c-40da-a8f4-7bd5e1e9d669]: (4, 'qcow2') {{(pid=88499) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 04:45:46 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-c9701de1-866e-46ce-91be-53bbea93664c tempest-VolumesGetTest-423200778 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-05be954a-4a47-4dd9-ac7f-15be06ddf426 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:45:46 devstack sudo[99074]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-05be954a-4a47-4dd9-ac7f-15be06ddf426 Jul 10 04:45:46 devstack sudo[99074]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:45:47 devstack sudo[99074]: pam_unix(sudo:session): session closed for user root Jul 10 04:45:47 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-c9701de1-866e-46ce-91be-53bbea93664c tempest-VolumesGetTest-423200778 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-05be954a-4a47-4dd9-ac7f-15be06ddf426" returned: 0 in 0.852s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:45:47 devstack cinder-volume[87444]: DEBUG cinder.utils [None req-c9701de1-866e-46ce-91be-53bbea93664c tempest-VolumesGetTest-423200778 None] Path /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-c1550a73-bf63-478c-bb51-2ddbb87cb4e9 not found in is_blk_device check {{(pid=87444) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 10 04:45:47 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-c9701de1-866e-46ce-91be-53bbea93664c tempest-VolumesGetTest-423200778 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-05be954a-4a47-4dd9-ac7f-15be06ddf426 /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-c1550a73-bf63-478c-bb51-2ddbb87cb4e9 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:45:47 devstack sudo[99080]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-05be954a-4a47-4dd9-ac7f-15be06ddf426 /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-c1550a73-bf63-478c-bb51-2ddbb87cb4e9 Jul 10 04:45:47 devstack sudo[99080]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:45:54 devstack cinder-volume[87444]: DEBUG dbcounter [-] [87444] Writing DB stats cinder:SELECT=99,cinder:INSERT=45,cinder:UPDATE=122,cinder:DELETE=8 {{(pid=87444) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 10 04:45:54 devstack cinder-volume[87444]: DEBUG dbcounter [-] [87444] Writing DB stats cinder:UPDATE=101,cinder:SELECT=79,cinder:DELETE=11,cinder:INSERT=20 {{(pid=87444) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 10 04:45:54 devstack sudo[99080]: pam_unix(sudo:session): session closed for user root Jul 10 04:45:54 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-c9701de1-866e-46ce-91be-53bbea93664c tempest-VolumesGetTest-423200778 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-05be954a-4a47-4dd9-ac7f-15be06ddf426 /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-c1550a73-bf63-478c-bb51-2ddbb87cb4e9" returned: 0 in 7.336s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:45:54 devstack cinder-volume[87444]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf20229c-fd5f-491f-b1ab-3527fc85455b]: (4, 'qcow2') {{(pid=88499) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 04:45:54 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-c9701de1-866e-46ce-91be-53bbea93664c tempest-VolumesGetTest-423200778 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-05be954a-4a47-4dd9-ac7f-15be06ddf426 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:45:55 devstack sudo[99161]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-05be954a-4a47-4dd9-ac7f-15be06ddf426 Jul 10 04:45:55 devstack sudo[99161]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:45:56 devstack sudo[99161]: pam_unix(sudo:session): session closed for user root Jul 10 04:45:56 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-c9701de1-866e-46ce-91be-53bbea93664c tempest-VolumesGetTest-423200778 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-05be954a-4a47-4dd9-ac7f-15be06ddf426" returned: 0 in 1.351s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:45:56 devstack cinder-volume[87444]: DEBUG cinder.image.image_utils [None req-c9701de1-866e-46ce-91be-53bbea93664c tempest-VolumesGetTest-423200778 None] Image conversion details: src /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-05be954a-4a47-4dd9-ac7f-15be06ddf426, size 1024.00 MB, duration 7.34 sec, destination /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-c1550a73-bf63-478c-bb51-2ddbb87cb4e9 {{(pid=87444) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:561}} Jul 10 04:45:56 devstack cinder-volume[87444]: INFO cinder.image.image_utils [None req-c9701de1-866e-46ce-91be-53bbea93664c tempest-VolumesGetTest-423200778 None] Converted 1024.00 MB image at 139.57 MB/s Jul 10 04:45:56 devstack cinder-volume[87444]: WARNING cinder.volume.drivers.remotefs [None req-c9701de1-866e-46ce-91be-53bbea93664c tempest-VolumesGetTest-423200778 None] /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-c1550a73-bf63-478c-bb51-2ddbb87cb4e9 is being set with open permissions: ugo+rw Jul 10 04:45:56 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-c9701de1-866e-46ce-91be-53bbea93664c tempest-VolumesGetTest-423200778 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-c1550a73-bf63-478c-bb51-2ddbb87cb4e9 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:45:56 devstack sudo[99171]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-c1550a73-bf63-478c-bb51-2ddbb87cb4e9 Jul 10 04:45:56 devstack sudo[99171]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:45:57 devstack sudo[99171]: pam_unix(sudo:session): session closed for user root Jul 10 04:45:57 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-c9701de1-866e-46ce-91be-53bbea93664c tempest-VolumesGetTest-423200778 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-c1550a73-bf63-478c-bb51-2ddbb87cb4e9" returned: 0 in 0.825s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:45:57 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-c9701de1-866e-46ce-91be-53bbea93664c tempest-VolumesGetTest-423200778 None] Lock "cinder-quobyte-c1550a73-bf63-478c-bb51-2ddbb87cb4e9" released by "_copy_volume_from_snapshot" :: held 11.292s {{(pid=87444) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 04:45:57 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-c9701de1-866e-46ce-91be-53bbea93664c tempest-VolumesGetTest-423200778 None] Acquiring lock "cinder-quobyte-ab5096a6-6d45-43f9-aefe-c631a11469ba" by "_delete_snapshot" {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 04:45:57 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-c9701de1-866e-46ce-91be-53bbea93664c tempest-VolumesGetTest-423200778 None] Lock "cinder-quobyte-ab5096a6-6d45-43f9-aefe-c631a11469ba" acquired by "_delete_snapshot" :: waited 0.022s {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 04:45:57 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.remotefs [None req-c9701de1-866e-46ce-91be-53bbea93664c tempest-VolumesGetTest-423200778 None] Deleting offline snapshot ab5096a6-6d45-43f9-aefe-c631a11469ba of volume 05be954a-4a47-4dd9-ac7f-15be06ddf426 {{(pid=87444) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 10 04:45:57 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.remotefs [None req-c9701de1-866e-46ce-91be-53bbea93664c tempest-VolumesGetTest-423200778 None] snapshot_file for this snap is: volume-05be954a-4a47-4dd9-ac7f-15be06ddf426.ab5096a6-6d45-43f9-aefe-c631a11469ba {{(pid=87444) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 10 04:45:57 devstack cinder-volume[87444]: DEBUG oslo.privsep.daemon [-] privsep: reply[1419f40a-3b97-4fd7-8c13-0a75646a723e]: (4, 'qcow2') {{(pid=88499) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 04:45:57 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-c9701de1-866e-46ce-91be-53bbea93664c tempest-VolumesGetTest-423200778 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-05be954a-4a47-4dd9-ac7f-15be06ddf426.ab5096a6-6d45-43f9-aefe-c631a11469ba {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:45:57 devstack sudo[99190]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-05be954a-4a47-4dd9-ac7f-15be06ddf426.ab5096a6-6d45-43f9-aefe-c631a11469ba Jul 10 04:45:57 devstack sudo[99190]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:45:58 devstack sudo[99190]: pam_unix(sudo:session): session closed for user root Jul 10 04:45:58 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-c9701de1-866e-46ce-91be-53bbea93664c tempest-VolumesGetTest-423200778 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-05be954a-4a47-4dd9-ac7f-15be06ddf426.ab5096a6-6d45-43f9-aefe-c631a11469ba" returned: 0 in 0.988s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:45:58 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.remotefs [None req-c9701de1-866e-46ce-91be-53bbea93664c tempest-VolumesGetTest-423200778 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-05be954a-4a47-4dd9-ac7f-15be06ddf426(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87444) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 10 04:45:58 devstack cinder-volume[87444]: DEBUG oslo.privsep.daemon [-] privsep: reply[40d6bec0-1a32-4cd0-a3ee-cb524061be45]: (4, 'qcow2') {{(pid=88499) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 04:45:58 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-c9701de1-866e-46ce-91be-53bbea93664c tempest-VolumesGetTest-423200778 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-05be954a-4a47-4dd9-ac7f-15be06ddf426 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:45:58 devstack sudo[99198]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-05be954a-4a47-4dd9-ac7f-15be06ddf426 Jul 10 04:45:58 devstack sudo[99198]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:45:59 devstack sudo[99198]: pam_unix(sudo:session): session closed for user root Jul 10 04:45:59 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-c9701de1-866e-46ce-91be-53bbea93664c tempest-VolumesGetTest-423200778 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-05be954a-4a47-4dd9-ac7f-15be06ddf426" returned: 0 in 0.828s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:45:59 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-c9701de1-866e-46ce-91be-53bbea93664c tempest-VolumesGetTest-423200778 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-05be954a-4a47-4dd9-ac7f-15be06ddf426.ab5096a6-6d45-43f9-aefe-c631a11469ba {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:45:59 devstack sudo[99204]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-05be954a-4a47-4dd9-ac7f-15be06ddf426.ab5096a6-6d45-43f9-aefe-c631a11469ba Jul 10 04:45:59 devstack sudo[99204]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:45:59 devstack sudo[99204]: pam_unix(sudo:session): session closed for user root Jul 10 04:45:59 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-c9701de1-866e-46ce-91be-53bbea93664c tempest-VolumesGetTest-423200778 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-05be954a-4a47-4dd9-ac7f-15be06ddf426.ab5096a6-6d45-43f9-aefe-c631a11469ba" returned: 0 in 0.850s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:45:59 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-c9701de1-866e-46ce-91be-53bbea93664c tempest-VolumesGetTest-423200778 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-05be954a-4a47-4dd9-ac7f-15be06ddf426.ab5096a6-6d45-43f9-aefe-c631a11469ba {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:45:59 devstack sudo[99210]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-05be954a-4a47-4dd9-ac7f-15be06ddf426.ab5096a6-6d45-43f9-aefe-c631a11469ba Jul 10 04:45:59 devstack sudo[99210]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:46:00 devstack sudo[99210]: pam_unix(sudo:session): session closed for user root Jul 10 04:46:00 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-c9701de1-866e-46ce-91be-53bbea93664c tempest-VolumesGetTest-423200778 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-05be954a-4a47-4dd9-ac7f-15be06ddf426.ab5096a6-6d45-43f9-aefe-c631a11469ba" returned: 0 in 0.695s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:46:00 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-c9701de1-866e-46ce-91be-53bbea93664c tempest-VolumesGetTest-423200778 None] Lock "cinder-quobyte-ab5096a6-6d45-43f9-aefe-c631a11469ba" released by "_delete_snapshot" :: held 3.488s {{(pid=87444) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 04:46:00 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-c9701de1-866e-46ce-91be-53bbea93664c tempest-VolumesGetTest-423200778 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 20.270s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 04:46:00 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-59766116-d923-41dd-96d2-bb1972203832 tempest-TestInstancesWithCinderVolumes-1741196733 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 19.850s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 04:46:00 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-59766116-d923-41dd-96d2-bb1972203832 tempest-TestInstancesWithCinderVolumes-1741196733 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T02:45:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-2006124423',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=51f17d86-5d8b-4a30-b599-e679ed47dd26,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e98650f7bf93499fad9ed367fab18dff',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T02:45:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T02:45:34Z,use_quota=True,user_id='ceb6d26439444df79a23079d4c62132b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(11bd8f0f-16b1-4c9b-8929-c1776dfe0914),volume_type_id=11bd8f0f-16b1-4c9b-8929-c1776dfe0914)}" {{(pid=87444) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 04:46:00 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.remotefs [None req-59766116-d923-41dd-96d2-bb1972203832 tempest-TestInstancesWithCinderVolumes-1741196733 None] Creating volume 51f17d86-5d8b-4a30-b599-e679ed47dd26 {{(pid=87444) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 04:46:00 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-59766116-d923-41dd-96d2-bb1972203832 tempest-TestInstancesWithCinderVolumes-1741196733 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 04:46:00 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-59766116-d923-41dd-96d2-bb1972203832 tempest-TestInstancesWithCinderVolumes-1741196733 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 04:46:00 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-59766116-d923-41dd-96d2-bb1972203832 tempest-TestInstancesWithCinderVolumes-1741196733 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922': None} {{(pid=87444) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 04:46:00 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-59766116-d923-41dd-96d2-bb1972203832 tempest-TestInstancesWithCinderVolumes-1741196733 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922'] {{(pid=87444) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 04:46:00 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-59766116-d923-41dd-96d2-bb1972203832 tempest-TestInstancesWithCinderVolumes-1741196733 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 04:46:00 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-59766116-d923-41dd-96d2-bb1972203832 tempest-TestInstancesWithCinderVolumes-1741196733 None] Selected osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922 as target Quobyte volume. {{(pid=87444) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 04:46:00 devstack cinder-volume[87444]: INFO cinder.volume.drivers.remotefs [None req-59766116-d923-41dd-96d2-bb1972203832 tempest-TestInstancesWithCinderVolumes-1741196733 None] casted to osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922 Jul 10 04:46:00 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-59766116-d923-41dd-96d2-bb1972203832 tempest-TestInstancesWithCinderVolumes-1741196733 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-51f17d86-5d8b-4a30-b599-e679ed47dd26 1073741824 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:46:00 devstack sudo[99213]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-51f17d86-5d8b-4a30-b599-e679ed47dd26 1073741824 Jul 10 04:46:00 devstack sudo[99213]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:46:00 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-c9701de1-866e-46ce-91be-53bbea93664c tempest-VolumesGetTest-423200778 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a9cedd3e-f1a3-4a90-9a86-95a8b66b2e8d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c1550a73-bf63-478c-bb51-2ddbb87cb4e9', 'volume_size': 1, 'source_volid': '05be954a-4a47-4dd9-ac7f-15be06ddf426', 'source_volstatus': 'available'}' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:46:00 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-c9701de1-866e-46ce-91be-53bbea93664c tempest-VolumesGetTest-423200778 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cd5348c6-8f02-4ecb-bf63-1b9215ee56df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:46:00 devstack cinder-volume[87444]: INFO cinder.volume.flows.manager.create_volume [None req-c9701de1-866e-46ce-91be-53bbea93664c tempest-VolumesGetTest-423200778 None] Volume volume-c1550a73-bf63-478c-bb51-2ddbb87cb4e9 (c1550a73-bf63-478c-bb51-2ddbb87cb4e9): created successfully Jul 10 04:46:00 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-c9701de1-866e-46ce-91be-53bbea93664c tempest-VolumesGetTest-423200778 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cd5348c6-8f02-4ecb-bf63-1b9215ee56df) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:46:00 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-c9701de1-866e-46ce-91be-53bbea93664c tempest-VolumesGetTest-423200778 None] Flow 'volume_create_manager' (21f188ea-8e9f-48dd-8cf5-e0ad26ec2f50) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87444) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 04:46:00 devstack cinder-volume[87444]: INFO cinder.volume.manager [None req-c9701de1-866e-46ce-91be-53bbea93664c tempest-VolumesGetTest-423200778 None] Created volume successfully. Jul 10 04:46:01 devstack sudo[99213]: pam_unix(sudo:session): session closed for user root Jul 10 04:46:01 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-59766116-d923-41dd-96d2-bb1972203832 tempest-TestInstancesWithCinderVolumes-1741196733 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-51f17d86-5d8b-4a30-b599-e679ed47dd26 1073741824" returned: 0 in 1.102s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:46:01 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-59766116-d923-41dd-96d2-bb1972203832 tempest-TestInstancesWithCinderVolumes-1741196733 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-51f17d86-5d8b-4a30-b599-e679ed47dd26 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:46:01 devstack sudo[99219]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-51f17d86-5d8b-4a30-b599-e679ed47dd26 Jul 10 04:46:01 devstack sudo[99219]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:46:02 devstack cinder-volume[87444]: DEBUG cinder.volume.flows.manager.create_volume [None req-09c77661-6c92-442f-8c22-c830647fb79d tempest-VolumesGetTest-423200778 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87444) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 04:46:02 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-09c77661-6c92-442f-8c22-c830647fb79d tempest-VolumesGetTest-423200778 None] Flow 'volume_create_manager' (68787872-9828-439f-b783-3262b284f141) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 04:46:02 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-09c77661-6c92-442f-8c22-c830647fb79d tempest-VolumesGetTest-423200778 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (713070ae-92ed-4df9-a37d-c3eb02047228) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:46:02 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-09c77661-6c92-442f-8c22-c830647fb79d tempest-VolumesGetTest-423200778 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (713070ae-92ed-4df9-a37d-c3eb02047228) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T02:46:02Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-970077280',display_name='tempest-VolumesGetTest-Volume-188187964',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6b956cc8-bdf0-48e2-8448-46a6e6b3268e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='761a9e430aba4ae18bd6ef42f16015f4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T02:46:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T02:46:03Z,use_quota=True,user_id='ae02b9a0cfaa4f7d8fd6393dfd0bb7b6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(317e369e-1e06-434d-ae95-a335f0e6c903),volume_type_id=317e369e-1e06-434d-ae95-a335f0e6c903)' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:46:02 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-09c77661-6c92-442f-8c22-c830647fb79d tempest-VolumesGetTest-423200778 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (888eddca-585d-4a69-af48-7a37a2dd2e06) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:46:02 devstack sudo[99219]: pam_unix(sudo:session): session closed for user root Jul 10 04:46:02 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-09c77661-6c92-442f-8c22-c830647fb79d tempest-VolumesGetTest-423200778 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (888eddca-585d-4a69-af48-7a37a2dd2e06) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:46:02 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-09c77661-6c92-442f-8c22-c830647fb79d tempest-VolumesGetTest-423200778 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2c0148e2-a5c5-48d6-bd07-fec4bae8f854) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:46:02 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-09c77661-6c92-442f-8c22-c830647fb79d tempest-VolumesGetTest-423200778 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2c0148e2-a5c5-48d6-bd07-fec4bae8f854) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6b956cc8-bdf0-48e2-8448-46a6e6b3268e', 'volume_name': 'volume-6b956cc8-bdf0-48e2-8448-46a6e6b3268e', 'volume_size': 1}' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:46:02 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-09c77661-6c92-442f-8c22-c830647fb79d tempest-VolumesGetTest-423200778 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (154374d3-0284-4681-8c2b-8251eaea0f33) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:46:02 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-09c77661-6c92-442f-8c22-c830647fb79d tempest-VolumesGetTest-423200778 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (154374d3-0284-4681-8c2b-8251eaea0f33) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:46:02 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-09c77661-6c92-442f-8c22-c830647fb79d tempest-VolumesGetTest-423200778 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dd5e6b96-a72d-4b48-b2fd-d37347348aea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:46:02 devstack cinder-volume[87444]: INFO cinder.volume.flows.manager.create_volume [None req-09c77661-6c92-442f-8c22-c830647fb79d tempest-VolumesGetTest-423200778 None] Volume 6b956cc8-bdf0-48e2-8448-46a6e6b3268e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6b956cc8-bdf0-48e2-8448-46a6e6b3268e', 'volume_size': 1} Jul 10 04:46:02 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-09c77661-6c92-442f-8c22-c830647fb79d tempest-VolumesGetTest-423200778 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 04:46:02 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-59766116-d923-41dd-96d2-bb1972203832 tempest-TestInstancesWithCinderVolumes-1741196733 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-51f17d86-5d8b-4a30-b599-e679ed47dd26" returned: 0 in 1.055s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:46:02 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-59766116-d923-41dd-96d2-bb1972203832 tempest-TestInstancesWithCinderVolumes-1741196733 None] <== create_volume: return (2215ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922'} {{(pid=87444) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 04:46:02 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-59766116-d923-41dd-96d2-bb1972203832 tempest-TestInstancesWithCinderVolumes-1741196733 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.219s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 04:46:02 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-09c77661-6c92-442f-8c22-c830647fb79d tempest-VolumesGetTest-423200778 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.009s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 04:46:02 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-09c77661-6c92-442f-8c22-c830647fb79d tempest-VolumesGetTest-423200778 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T02:46:02Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-970077280',display_name='tempest-VolumesGetTest-Volume-188187964',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6b956cc8-bdf0-48e2-8448-46a6e6b3268e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='761a9e430aba4ae18bd6ef42f16015f4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T02:46:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T02:46:03Z,use_quota=True,user_id='ae02b9a0cfaa4f7d8fd6393dfd0bb7b6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(317e369e-1e06-434d-ae95-a335f0e6c903),volume_type_id=317e369e-1e06-434d-ae95-a335f0e6c903)}" {{(pid=87444) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 04:46:02 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.remotefs [None req-09c77661-6c92-442f-8c22-c830647fb79d tempest-VolumesGetTest-423200778 None] Creating volume 6b956cc8-bdf0-48e2-8448-46a6e6b3268e {{(pid=87444) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 04:46:02 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-09c77661-6c92-442f-8c22-c830647fb79d tempest-VolumesGetTest-423200778 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 04:46:02 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-09c77661-6c92-442f-8c22-c830647fb79d tempest-VolumesGetTest-423200778 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 04:46:02 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-09c77661-6c92-442f-8c22-c830647fb79d tempest-VolumesGetTest-423200778 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922': None} {{(pid=87444) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 04:46:02 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-09c77661-6c92-442f-8c22-c830647fb79d tempest-VolumesGetTest-423200778 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922'] {{(pid=87444) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 04:46:02 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-09c77661-6c92-442f-8c22-c830647fb79d tempest-VolumesGetTest-423200778 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 04:46:02 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-09c77661-6c92-442f-8c22-c830647fb79d tempest-VolumesGetTest-423200778 None] Selected osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922 as target Quobyte volume. {{(pid=87444) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 04:46:02 devstack cinder-volume[87444]: INFO cinder.volume.drivers.remotefs [None req-09c77661-6c92-442f-8c22-c830647fb79d tempest-VolumesGetTest-423200778 None] casted to osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922 Jul 10 04:46:02 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-09c77661-6c92-442f-8c22-c830647fb79d tempest-VolumesGetTest-423200778 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-6b956cc8-bdf0-48e2-8448-46a6e6b3268e 1073741824 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:46:02 devstack sudo[99224]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-6b956cc8-bdf0-48e2-8448-46a6e6b3268e 1073741824 Jul 10 04:46:02 devstack sudo[99224]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:46:02 devstack cinder-volume[87444]: DEBUG cinder.volume.volume_utils [None req-59766116-d923-41dd-96d2-bb1972203832 tempest-TestInstancesWithCinderVolumes-1741196733 None] Attempting download of e43721af-c8fa-44d2-8f43-d1ee90b7fb4a ((None, [{'url': 'file:///opt/stack/data/glance/images/e43721af-c8fa-44d2-8f43-d1ee90b7fb4a', 'metadata': {}}])) to volume 51f17d86-5d8b-4a30-b599-e679ed47dd26. {{(pid=87444) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jul 10 04:46:03 devstack cinder-volume[87444]: DEBUG oslo.privsep.daemon [-] privsep: reply[24b34ecd-26e0-4a98-befc-3f20d9031402]: (4, 'raw') {{(pid=88499) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 04:46:03 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-59766116-d923-41dd-96d2-bb1972203832 tempest-TestInstancesWithCinderVolumes-1741196733 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_e43721af-c8fa-44d2-8f43-d1ee90b7fb4a_y4l_ttcj {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:46:03 devstack sudo[99226]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_e43721af-c8fa-44d2-8f43-d1ee90b7fb4a_y4l_ttcj Jul 10 04:46:03 devstack sudo[99226]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:46:03 devstack sudo[99224]: pam_unix(sudo:session): session closed for user root Jul 10 04:46:03 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-09c77661-6c92-442f-8c22-c830647fb79d tempest-VolumesGetTest-423200778 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-6b956cc8-bdf0-48e2-8448-46a6e6b3268e 1073741824" returned: 0 in 1.036s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:46:04 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-09c77661-6c92-442f-8c22-c830647fb79d tempest-VolumesGetTest-423200778 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-6b956cc8-bdf0-48e2-8448-46a6e6b3268e {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:46:04 devstack sudo[99226]: pam_unix(sudo:session): session closed for user root Jul 10 04:46:04 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-59766116-d923-41dd-96d2-bb1972203832 tempest-TestInstancesWithCinderVolumes-1741196733 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_e43721af-c8fa-44d2-8f43-d1ee90b7fb4a_y4l_ttcj" returned: 0 in 0.980s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:46:04 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-59766116-d923-41dd-96d2-bb1972203832 tempest-TestInstancesWithCinderVolumes-1741196733 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_e43721af-c8fa-44d2-8f43-d1ee90b7fb4a_y4l_ttcj {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:46:04 devstack sudo[99235]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-6b956cc8-bdf0-48e2-8448-46a6e6b3268e Jul 10 04:46:04 devstack sudo[99235]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:46:04 devstack sudo[99237]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_e43721af-c8fa-44d2-8f43-d1ee90b7fb4a_y4l_ttcj Jul 10 04:46:04 devstack sudo[99237]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:46:04 devstack sudo[99235]: pam_unix(sudo:session): session closed for user root Jul 10 04:46:04 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-09c77661-6c92-442f-8c22-c830647fb79d tempest-VolumesGetTest-423200778 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-6b956cc8-bdf0-48e2-8448-46a6e6b3268e" returned: 0 in 0.846s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:46:04 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-09c77661-6c92-442f-8c22-c830647fb79d tempest-VolumesGetTest-423200778 None] <== create_volume: return (1942ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922'} {{(pid=87444) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 04:46:04 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-09c77661-6c92-442f-8c22-c830647fb79d tempest-VolumesGetTest-423200778 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.945s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 04:46:04 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-09c77661-6c92-442f-8c22-c830647fb79d tempest-VolumesGetTest-423200778 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dd5e6b96-a72d-4b48-b2fd-d37347348aea) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6b956cc8-bdf0-48e2-8448-46a6e6b3268e', 'volume_size': 1}' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:46:04 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-09c77661-6c92-442f-8c22-c830647fb79d tempest-VolumesGetTest-423200778 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (01b67bdf-8799-4894-8ec0-b6b069e3cc69) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:46:04 devstack cinder-volume[87444]: INFO cinder.volume.flows.manager.create_volume [None req-09c77661-6c92-442f-8c22-c830647fb79d tempest-VolumesGetTest-423200778 None] Volume volume-6b956cc8-bdf0-48e2-8448-46a6e6b3268e (6b956cc8-bdf0-48e2-8448-46a6e6b3268e): created successfully Jul 10 04:46:04 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-09c77661-6c92-442f-8c22-c830647fb79d tempest-VolumesGetTest-423200778 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (01b67bdf-8799-4894-8ec0-b6b069e3cc69) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:46:04 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-09c77661-6c92-442f-8c22-c830647fb79d tempest-VolumesGetTest-423200778 None] Flow 'volume_create_manager' (68787872-9828-439f-b783-3262b284f141) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87444) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 04:46:04 devstack cinder-volume[87444]: INFO cinder.volume.manager [None req-09c77661-6c92-442f-8c22-c830647fb79d tempest-VolumesGetTest-423200778 None] Created volume successfully. Jul 10 04:46:05 devstack sudo[99237]: pam_unix(sudo:session): session closed for user root Jul 10 04:46:05 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-59766116-d923-41dd-96d2-bb1972203832 tempest-TestInstancesWithCinderVolumes-1741196733 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_e43721af-c8fa-44d2-8f43-d1ee90b7fb4a_y4l_ttcj" returned: 1 in 1.127s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:46:05 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-59766116-d923-41dd-96d2-bb1972203832 tempest-TestInstancesWithCinderVolumes-1741196733 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_e43721af-c8fa-44d2-8f43-d1ee90b7fb4a_y4l_ttcj' failed. Not Retrying. {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 10 04:46:05 devstack cinder-volume[87444]: DEBUG oslo.privsep.daemon [-] privsep: reply[0fe5bd37-bb4b-4387-84b4-7edad838b4ec]: (4, 'qcow2') {{(pid=88499) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 04:46:05 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-59766116-d923-41dd-96d2-bb1972203832 tempest-TestInstancesWithCinderVolumes-1741196733 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_e43721af-c8fa-44d2-8f43-d1ee90b7fb4a_qfbvjubndevstack@QuobyteHD {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:46:05 devstack sudo[99243]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_e43721af-c8fa-44d2-8f43-d1ee90b7fb4a_qfbvjubndevstack@QuobyteHD Jul 10 04:46:05 devstack sudo[99243]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:46:05 devstack sudo[99243]: pam_unix(sudo:session): session closed for user root Jul 10 04:46:05 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-59766116-d923-41dd-96d2-bb1972203832 tempest-TestInstancesWithCinderVolumes-1741196733 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_e43721af-c8fa-44d2-8f43-d1ee90b7fb4a_qfbvjubndevstack@QuobyteHD" returned: 0 in 0.791s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:46:05 devstack cinder-volume[87444]: DEBUG cinder.image.image_utils [None req-59766116-d923-41dd-96d2-bb1972203832 tempest-TestInstancesWithCinderVolumes-1741196733 None] e43721af-c8fa-44d2-8f43-d1ee90b7fb4a was qcow2, converting to raw {{(pid=87444) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1153}} Jul 10 04:46:05 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-59766116-d923-41dd-96d2-bb1972203832 tempest-TestInstancesWithCinderVolumes-1741196733 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_e43721af-c8fa-44d2-8f43-d1ee90b7fb4a_qfbvjubndevstack@QuobyteHD /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-51f17d86-5d8b-4a30-b599-e679ed47dd26 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:46:06 devstack sudo[99250]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_e43721af-c8fa-44d2-8f43-d1ee90b7fb4a_qfbvjubndevstack@QuobyteHD /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-51f17d86-5d8b-4a30-b599-e679ed47dd26 Jul 10 04:46:06 devstack sudo[99250]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:46:06 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-835f2821-19ff-4631-80b0-4d38273ef22b tempest-VolumesGetTest-423200778 None] Acquiring lock "cinder-6b956cc8-bdf0-48e2-8448-46a6e6b3268e-delete_volume" by "delete_volume" {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 04:46:06 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-835f2821-19ff-4631-80b0-4d38273ef22b tempest-VolumesGetTest-423200778 None] Lock "cinder-6b956cc8-bdf0-48e2-8448-46a6e6b3268e-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 04:46:06 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-835f2821-19ff-4631-80b0-4d38273ef22b tempest-VolumesGetTest-423200778 None] Acquiring lock "cinder-quobyte-6b956cc8-bdf0-48e2-8448-46a6e6b3268e" by "delete_volume" {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 04:46:06 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-835f2821-19ff-4631-80b0-4d38273ef22b tempest-VolumesGetTest-423200778 None] Lock "cinder-quobyte-6b956cc8-bdf0-48e2-8448-46a6e6b3268e" acquired by "delete_volume" :: waited 0.025s {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 04:46:06 devstack cinder-volume[87444]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d589a14-dd7c-4d35-9f82-e0415d0ec3ab]: (4, 'qcow2') {{(pid=88499) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 04:46:06 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-835f2821-19ff-4631-80b0-4d38273ef22b tempest-VolumesGetTest-423200778 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-6b956cc8-bdf0-48e2-8448-46a6e6b3268e {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:46:06 devstack sudo[99252]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-6b956cc8-bdf0-48e2-8448-46a6e6b3268e Jul 10 04:46:06 devstack sudo[99252]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:46:07 devstack sudo[99252]: pam_unix(sudo:session): session closed for user root Jul 10 04:46:07 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-835f2821-19ff-4631-80b0-4d38273ef22b tempest-VolumesGetTest-423200778 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-6b956cc8-bdf0-48e2-8448-46a6e6b3268e" returned: 0 in 1.099s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:46:07 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-835f2821-19ff-4631-80b0-4d38273ef22b tempest-VolumesGetTest-423200778 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-6b956cc8-bdf0-48e2-8448-46a6e6b3268e {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:46:07 devstack sudo[99265]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-6b956cc8-bdf0-48e2-8448-46a6e6b3268e Jul 10 04:46:07 devstack sudo[99265]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:46:08 devstack sudo[99265]: pam_unix(sudo:session): session closed for user root Jul 10 04:46:08 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-835f2821-19ff-4631-80b0-4d38273ef22b tempest-VolumesGetTest-423200778 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-6b956cc8-bdf0-48e2-8448-46a6e6b3268e" returned: 0 in 0.743s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:46:08 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-835f2821-19ff-4631-80b0-4d38273ef22b tempest-VolumesGetTest-423200778 None] Lock "cinder-quobyte-6b956cc8-bdf0-48e2-8448-46a6e6b3268e" released by "delete_volume" :: held 1.899s {{(pid=87444) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 04:46:08 devstack cinder-volume[87444]: DEBUG cinder.quota [None req-835f2821-19ff-4631-80b0-4d38273ef22b tempest-VolumesGetTest-423200778 None] Created reservations ['5491f7ec-5495-423d-8aeb-40028844b0cf', '0cae8399-7080-480f-90cd-8eb84fa76728', '6a880d3b-864f-45fb-9cf9-036d47b7b3b2', '9c8cf38c-f42c-40e2-8abb-a506664b78e3'] {{(pid=87444) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 04:46:08 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-835f2821-19ff-4631-80b0-4d38273ef22b tempest-VolumesGetTest-423200778 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 04:46:08 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-835f2821-19ff-4631-80b0-4d38273ef22b tempest-VolumesGetTest-423200778 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 04:46:08 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-835f2821-19ff-4631-80b0-4d38273ef22b tempest-VolumesGetTest-423200778 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922': None} {{(pid=87444) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 04:46:08 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-835f2821-19ff-4631-80b0-4d38273ef22b tempest-VolumesGetTest-423200778 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922'] {{(pid=87444) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 04:46:08 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-835f2821-19ff-4631-80b0-4d38273ef22b tempest-VolumesGetTest-423200778 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 04:46:08 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-835f2821-19ff-4631-80b0-4d38273ef22b tempest-VolumesGetTest-423200778 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:46:08 devstack sudo[99268]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097 Jul 10 04:46:08 devstack sudo[99268]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:46:08 devstack sudo[99250]: pam_unix(sudo:session): session closed for user root Jul 10 04:46:08 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-59766116-d923-41dd-96d2-bb1972203832 tempest-TestInstancesWithCinderVolumes-1741196733 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_e43721af-c8fa-44d2-8f43-d1ee90b7fb4a_qfbvjubndevstack@QuobyteHD /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-51f17d86-5d8b-4a30-b599-e679ed47dd26" returned: 0 in 2.605s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:46:08 devstack cinder-volume[87444]: DEBUG cinder.image.image_utils [None req-59766116-d923-41dd-96d2-bb1972203832 tempest-TestInstancesWithCinderVolumes-1741196733 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_e43721af-c8fa-44d2-8f43-d1ee90b7fb4a_qfbvjubndevstack@QuobyteHD, size 112.00 MB, duration 2.61 sec, destination /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-51f17d86-5d8b-4a30-b599-e679ed47dd26 {{(pid=87444) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:561}} Jul 10 04:46:08 devstack cinder-volume[87444]: INFO cinder.image.image_utils [None req-59766116-d923-41dd-96d2-bb1972203832 tempest-TestInstancesWithCinderVolumes-1741196733 None] Converted 112.00 MB image at 42.97 MB/s Jul 10 04:46:08 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-59766116-d923-41dd-96d2-bb1972203832 tempest-TestInstancesWithCinderVolumes-1741196733 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-51f17d86-5d8b-4a30-b599-e679ed47dd26 1G {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:46:08 devstack sudo[99270]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-51f17d86-5d8b-4a30-b599-e679ed47dd26 1G Jul 10 04:46:08 devstack sudo[99270]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:46:08 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-c0ee1d57-34bb-4603-a640-347ba79d2c2d tempest-VolumesGetTest-423200778 None] Acquiring lock "cinder-c1550a73-bf63-478c-bb51-2ddbb87cb4e9-delete_volume" by "delete_volume" {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 04:46:08 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-c0ee1d57-34bb-4603-a640-347ba79d2c2d tempest-VolumesGetTest-423200778 None] Lock "cinder-c1550a73-bf63-478c-bb51-2ddbb87cb4e9-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 04:46:08 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-c0ee1d57-34bb-4603-a640-347ba79d2c2d tempest-VolumesGetTest-423200778 None] Acquiring lock "cinder-quobyte-c1550a73-bf63-478c-bb51-2ddbb87cb4e9" by "delete_volume" {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 04:46:08 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-c0ee1d57-34bb-4603-a640-347ba79d2c2d tempest-VolumesGetTest-423200778 None] Lock "cinder-quobyte-c1550a73-bf63-478c-bb51-2ddbb87cb4e9" acquired by "delete_volume" :: waited 0.077s {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 04:46:08 devstack cinder-volume[87444]: DEBUG oslo.privsep.daemon [-] privsep: reply[af73489c-a8f2-49d9-ae08-15b172082b5d]: (4, 'qcow2') {{(pid=88499) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 04:46:08 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-c0ee1d57-34bb-4603-a640-347ba79d2c2d tempest-VolumesGetTest-423200778 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-c1550a73-bf63-478c-bb51-2ddbb87cb4e9 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:46:09 devstack sudo[99272]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-c1550a73-bf63-478c-bb51-2ddbb87cb4e9 Jul 10 04:46:09 devstack sudo[99272]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:46:09 devstack sudo[99268]: pam_unix(sudo:session): session closed for user root Jul 10 04:46:09 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-835f2821-19ff-4631-80b0-4d38273ef22b tempest-VolumesGetTest-423200778 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097" returned: 0 in 1.238s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:46:09 devstack cinder-volume[87444]: DEBUG cinder.manager [None req-835f2821-19ff-4631-80b0-4d38273ef22b tempest-VolumesGetTest-423200778 None] Notifying Schedulers of capabilities ... {{(pid=87444) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 04:46:09 devstack cinder-volume[87444]: INFO cinder.volume.manager [None req-835f2821-19ff-4631-80b0-4d38273ef22b tempest-VolumesGetTest-423200778 None] Deleted volume successfully. Jul 10 04:46:09 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-835f2821-19ff-4631-80b0-4d38273ef22b tempest-VolumesGetTest-423200778 None] Lock "cinder-6b956cc8-bdf0-48e2-8448-46a6e6b3268e-delete_volume" released by "delete_volume" :: held 3.434s {{(pid=87444) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 04:46:09 devstack sudo[99270]: pam_unix(sudo:session): session closed for user root Jul 10 04:46:09 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-59766116-d923-41dd-96d2-bb1972203832 tempest-TestInstancesWithCinderVolumes-1741196733 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-51f17d86-5d8b-4a30-b599-e679ed47dd26 1G" returned: 0 in 1.171s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:46:09 devstack cinder-volume[87444]: DEBUG oslo.privsep.daemon [-] privsep: reply[c29e8626-0a92-4bfc-9766-1c2d2be59637]: (4, 'raw') {{(pid=88499) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 04:46:09 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-59766116-d923-41dd-96d2-bb1972203832 tempest-TestInstancesWithCinderVolumes-1741196733 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-51f17d86-5d8b-4a30-b599-e679ed47dd26 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:46:10 devstack sudo[99278]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-51f17d86-5d8b-4a30-b599-e679ed47dd26 Jul 10 04:46:10 devstack sudo[99278]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:46:10 devstack sudo[99272]: pam_unix(sudo:session): session closed for user root Jul 10 04:46:10 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-c0ee1d57-34bb-4603-a640-347ba79d2c2d tempest-VolumesGetTest-423200778 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-c1550a73-bf63-478c-bb51-2ddbb87cb4e9" returned: 0 in 1.273s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:46:10 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-c0ee1d57-34bb-4603-a640-347ba79d2c2d tempest-VolumesGetTest-423200778 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-c1550a73-bf63-478c-bb51-2ddbb87cb4e9 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:46:10 devstack sudo[99283]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-c1550a73-bf63-478c-bb51-2ddbb87cb4e9 Jul 10 04:46:10 devstack sudo[99283]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:46:10 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-f8addad5-7068-43ef-8e5d-2236023234d2 tempest-VolumesNegativeTest-1562591450 None] Acquiring lock "cinder-8ef0d246-886f-4d49-89f4-ab67433748d2-delete_volume" by "delete_volume" {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 04:46:10 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-f8addad5-7068-43ef-8e5d-2236023234d2 tempest-VolumesNegativeTest-1562591450 None] Lock "cinder-8ef0d246-886f-4d49-89f4-ab67433748d2-delete_volume" acquired by "delete_volume" :: waited 0.049s {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 04:46:10 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-f8addad5-7068-43ef-8e5d-2236023234d2 tempest-VolumesNegativeTest-1562591450 None] Acquiring lock "cinder-quobyte-8ef0d246-886f-4d49-89f4-ab67433748d2" by "delete_volume" {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 04:46:10 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-f8addad5-7068-43ef-8e5d-2236023234d2 tempest-VolumesNegativeTest-1562591450 None] Lock "cinder-quobyte-8ef0d246-886f-4d49-89f4-ab67433748d2" acquired by "delete_volume" :: waited 0.036s {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 04:46:10 devstack cinder-volume[87444]: DEBUG oslo.privsep.daemon [-] privsep: reply[7561027e-0fa1-48ce-9c40-62be53c2f107]: (4, 'qcow2') {{(pid=88499) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 04:46:10 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-f8addad5-7068-43ef-8e5d-2236023234d2 tempest-VolumesNegativeTest-1562591450 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-8ef0d246-886f-4d49-89f4-ab67433748d2 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:46:10 devstack sudo[99286]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-8ef0d246-886f-4d49-89f4-ab67433748d2 Jul 10 04:46:10 devstack sudo[99286]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:46:10 devstack sudo[99278]: pam_unix(sudo:session): session closed for user root Jul 10 04:46:10 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-59766116-d923-41dd-96d2-bb1972203832 tempest-TestInstancesWithCinderVolumes-1741196733 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-51f17d86-5d8b-4a30-b599-e679ed47dd26" returned: 0 in 1.137s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:46:10 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-59766116-d923-41dd-96d2-bb1972203832 tempest-TestInstancesWithCinderVolumes-1741196733 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-51f17d86-5d8b-4a30-b599-e679ed47dd26 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:46:11 devstack sudo[99289]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-51f17d86-5d8b-4a30-b599-e679ed47dd26 Jul 10 04:46:11 devstack sudo[99289]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:46:11 devstack sudo[99283]: pam_unix(sudo:session): session closed for user root Jul 10 04:46:11 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-c0ee1d57-34bb-4603-a640-347ba79d2c2d tempest-VolumesGetTest-423200778 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-c1550a73-bf63-478c-bb51-2ddbb87cb4e9" returned: 0 in 1.018s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:46:11 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-c0ee1d57-34bb-4603-a640-347ba79d2c2d tempest-VolumesGetTest-423200778 None] Lock "cinder-quobyte-c1550a73-bf63-478c-bb51-2ddbb87cb4e9" released by "delete_volume" :: held 2.382s {{(pid=87444) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 04:46:11 devstack cinder-volume[87444]: DEBUG cinder.quota [None req-c0ee1d57-34bb-4603-a640-347ba79d2c2d tempest-VolumesGetTest-423200778 None] Created reservations ['65033d8d-2e21-42f9-b048-839d12749f3a', '0075f020-4a70-49f2-99e2-80322bc7bb80', '7a8222b4-90cd-4ff0-9413-2418dfc28d8a', 'c735b578-d01a-4ccc-934e-9424751ac4c9'] {{(pid=87444) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 04:46:11 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-c0ee1d57-34bb-4603-a640-347ba79d2c2d tempest-VolumesGetTest-423200778 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 04:46:11 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-c0ee1d57-34bb-4603-a640-347ba79d2c2d tempest-VolumesGetTest-423200778 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 04:46:11 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-c0ee1d57-34bb-4603-a640-347ba79d2c2d tempest-VolumesGetTest-423200778 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922': None} {{(pid=87444) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 04:46:11 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-c0ee1d57-34bb-4603-a640-347ba79d2c2d tempest-VolumesGetTest-423200778 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922'] {{(pid=87444) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 04:46:11 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-c0ee1d57-34bb-4603-a640-347ba79d2c2d tempest-VolumesGetTest-423200778 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 04:46:11 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-c0ee1d57-34bb-4603-a640-347ba79d2c2d tempest-VolumesGetTest-423200778 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:46:11 devstack sudo[99292]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097 Jul 10 04:46:11 devstack sudo[99292]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:46:12 devstack sudo[99289]: pam_unix(sudo:session): session closed for user root Jul 10 04:46:12 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-59766116-d923-41dd-96d2-bb1972203832 tempest-TestInstancesWithCinderVolumes-1741196733 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-51f17d86-5d8b-4a30-b599-e679ed47dd26" returned: 1 in 1.072s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:46:12 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-59766116-d923-41dd-96d2-bb1972203832 tempest-TestInstancesWithCinderVolumes-1741196733 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-51f17d86-5d8b-4a30-b599-e679ed47dd26' failed. Not Retrying. {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 10 04:46:12 devstack cinder-volume[87444]: DEBUG cinder.volume.volume_utils [None req-59766116-d923-41dd-96d2-bb1972203832 tempest-TestInstancesWithCinderVolumes-1741196733 None] Downloaded image e43721af-c8fa-44d2-8f43-d1ee90b7fb4a ((None, [{'url': 'file:///opt/stack/data/glance/images/e43721af-c8fa-44d2-8f43-d1ee90b7fb4a', 'metadata': {}}])) to volume 51f17d86-5d8b-4a30-b599-e679ed47dd26 successfully. {{(pid=87444) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jul 10 04:46:12 devstack cinder-volume[87444]: DEBUG cinder.image.image_utils [None req-59766116-d923-41dd-96d2-bb1972203832 tempest-TestInstancesWithCinderVolumes-1741196733 None] Temporary image e43721af-c8fa-44d2-8f43-d1ee90b7fb4a for user ceb6d26439444df79a23079d4c62132b is deleted. {{(pid=87444) fetch /opt/stack/cinder/cinder/image/image_utils.py:1468}} Jul 10 04:46:12 devstack cinder-volume[87444]: DEBUG cinder.volume.volume_utils [None req-59766116-d923-41dd-96d2-bb1972203832 tempest-TestInstancesWithCinderVolumes-1741196733 None] Marking volume 51f17d86-5d8b-4a30-b599-e679ed47dd26 as bootable. {{(pid=87444) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jul 10 04:46:12 devstack cinder-volume[87444]: DEBUG cinder.volume.flows.manager.create_volume [None req-59766116-d923-41dd-96d2-bb1972203832 tempest-TestInstancesWithCinderVolumes-1741196733 None] Copying metadata from image e43721af-c8fa-44d2-8f43-d1ee90b7fb4a to 51f17d86-5d8b-4a30-b599-e679ed47dd26. {{(pid=87444) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jul 10 04:46:12 devstack cinder-volume[87444]: DEBUG cinder.volume.flows.manager.create_volume [None req-59766116-d923-41dd-96d2-bb1972203832 tempest-TestInstancesWithCinderVolumes-1741196733 None] Creating volume glance metadata for volume 51f17d86-5d8b-4a30-b599-e679ed47dd26 backed by image e43721af-c8fa-44d2-8f43-d1ee90b7fb4a with: {'image_id': 'e43721af-c8fa-44d2-8f43-d1ee90b7fb4a', 'image_name': 'tempest-scenario-img--1950598215', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=87444) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jul 10 04:46:12 devstack sudo[99286]: pam_unix(sudo:session): session closed for user root Jul 10 04:46:12 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-f8addad5-7068-43ef-8e5d-2236023234d2 tempest-VolumesNegativeTest-1562591450 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-8ef0d246-886f-4d49-89f4-ab67433748d2" returned: 0 in 1.356s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:46:12 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-f8addad5-7068-43ef-8e5d-2236023234d2 tempest-VolumesNegativeTest-1562591450 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-8ef0d246-886f-4d49-89f4-ab67433748d2 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:46:12 devstack sudo[99301]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-8ef0d246-886f-4d49-89f4-ab67433748d2 Jul 10 04:46:12 devstack sudo[99301]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:46:12 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-59766116-d923-41dd-96d2-bb1972203832 tempest-TestInstancesWithCinderVolumes-1741196733 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (688d5aa6-281c-435b-84ad-3b7d813efda4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-51f17d86-5d8b-4a30-b599-e679ed47dd26', 'volume_size': 1, 'image_id': 'e43721af-c8fa-44d2-8f43-d1ee90b7fb4a', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/e43721af-c8fa-44d2-8f43-d1ee90b7fb4a', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--1950598215', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'e98650f7bf93499fad9ed367fab18dff', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'e43721af-c8fa-44d2-8f43-d1ee90b7fb4a', 'created_at': datetime.datetime(2026, 7, 10, 2, 45, 29, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 10, 2, 45, 31, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/e43721af-c8fa-44d2-8f43-d1ee90b7fb4a/file', 'properties': {}}, 'image_service': }' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:46:12 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-59766116-d923-41dd-96d2-bb1972203832 tempest-TestInstancesWithCinderVolumes-1741196733 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1794541c-83cd-4195-8373-5e503aa22c22) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:46:12 devstack cinder-volume[87444]: INFO cinder.volume.flows.manager.create_volume [None req-59766116-d923-41dd-96d2-bb1972203832 tempest-TestInstancesWithCinderVolumes-1741196733 None] Volume volume-51f17d86-5d8b-4a30-b599-e679ed47dd26 (51f17d86-5d8b-4a30-b599-e679ed47dd26): created successfully Jul 10 04:46:12 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-59766116-d923-41dd-96d2-bb1972203832 tempest-TestInstancesWithCinderVolumes-1741196733 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1794541c-83cd-4195-8373-5e503aa22c22) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:46:12 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-59766116-d923-41dd-96d2-bb1972203832 tempest-TestInstancesWithCinderVolumes-1741196733 None] Flow 'volume_create_manager' (9a4708b0-733b-46c2-ac76-af8accc64b4d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87444) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 04:46:12 devstack cinder-volume[87444]: INFO cinder.volume.manager [None req-59766116-d923-41dd-96d2-bb1972203832 tempest-TestInstancesWithCinderVolumes-1741196733 None] Created volume successfully. Jul 10 04:46:12 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-9173c4b7-9627-4f96-8754-a3084a4f84f8 tempest-VolumesGetTest-423200778 None] Acquiring lock "cinder-05be954a-4a47-4dd9-ac7f-15be06ddf426-delete_volume" by "delete_volume" {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 04:46:12 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-9173c4b7-9627-4f96-8754-a3084a4f84f8 tempest-VolumesGetTest-423200778 None] Lock "cinder-05be954a-4a47-4dd9-ac7f-15be06ddf426-delete_volume" acquired by "delete_volume" :: waited 0.045s {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 04:46:12 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-9173c4b7-9627-4f96-8754-a3084a4f84f8 tempest-VolumesGetTest-423200778 None] Acquiring lock "cinder-quobyte-05be954a-4a47-4dd9-ac7f-15be06ddf426" by "delete_volume" {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 04:46:12 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-9173c4b7-9627-4f96-8754-a3084a4f84f8 tempest-VolumesGetTest-423200778 None] Lock "cinder-quobyte-05be954a-4a47-4dd9-ac7f-15be06ddf426" acquired by "delete_volume" :: waited 0.036s {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 04:46:12 devstack cinder-volume[87444]: DEBUG oslo.privsep.daemon [-] privsep: reply[b26a64f5-b5c4-4a2d-949f-efd4550de380]: (4, 'qcow2') {{(pid=88499) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 04:46:12 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-9173c4b7-9627-4f96-8754-a3084a4f84f8 tempest-VolumesGetTest-423200778 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-05be954a-4a47-4dd9-ac7f-15be06ddf426 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:46:12 devstack sudo[99292]: pam_unix(sudo:session): session closed for user root Jul 10 04:46:12 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-c0ee1d57-34bb-4603-a640-347ba79d2c2d tempest-VolumesGetTest-423200778 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097" returned: 0 in 1.134s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:46:12 devstack cinder-volume[87444]: DEBUG cinder.manager [None req-c0ee1d57-34bb-4603-a640-347ba79d2c2d tempest-VolumesGetTest-423200778 None] Notifying Schedulers of capabilities ... {{(pid=87444) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 04:46:12 devstack cinder-volume[87444]: INFO cinder.volume.manager [None req-c0ee1d57-34bb-4603-a640-347ba79d2c2d tempest-VolumesGetTest-423200778 None] Deleted volume successfully. Jul 10 04:46:12 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-c0ee1d57-34bb-4603-a640-347ba79d2c2d tempest-VolumesGetTest-423200778 None] Lock "cinder-c1550a73-bf63-478c-bb51-2ddbb87cb4e9-delete_volume" released by "delete_volume" :: held 4.008s {{(pid=87444) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 04:46:12 devstack sudo[99304]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-05be954a-4a47-4dd9-ac7f-15be06ddf426 Jul 10 04:46:12 devstack sudo[99304]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:46:13 devstack sudo[99301]: pam_unix(sudo:session): session closed for user root Jul 10 04:46:13 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-f8addad5-7068-43ef-8e5d-2236023234d2 tempest-VolumesNegativeTest-1562591450 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-8ef0d246-886f-4d49-89f4-ab67433748d2" returned: 0 in 1.010s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:46:13 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-f8addad5-7068-43ef-8e5d-2236023234d2 tempest-VolumesNegativeTest-1562591450 None] Lock "cinder-quobyte-8ef0d246-886f-4d49-89f4-ab67433748d2" released by "delete_volume" :: held 2.434s {{(pid=87444) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 04:46:13 devstack cinder-volume[87444]: DEBUG cinder.quota [None req-f8addad5-7068-43ef-8e5d-2236023234d2 tempest-VolumesNegativeTest-1562591450 None] Created reservations ['d72c76d0-af17-420c-a649-3d9b9bd00f68', 'f974a4a1-9875-414b-85f8-5d935bfca264', '72f148ce-cd20-49b7-be76-2f8f7e19fab5', '8a4b4572-aa02-4811-a885-b3bc84e70634'] {{(pid=87444) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 04:46:13 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-f8addad5-7068-43ef-8e5d-2236023234d2 tempest-VolumesNegativeTest-1562591450 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 04:46:13 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-f8addad5-7068-43ef-8e5d-2236023234d2 tempest-VolumesNegativeTest-1562591450 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 04:46:13 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-f8addad5-7068-43ef-8e5d-2236023234d2 tempest-VolumesNegativeTest-1562591450 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922': None} {{(pid=87444) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 04:46:13 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-f8addad5-7068-43ef-8e5d-2236023234d2 tempest-VolumesNegativeTest-1562591450 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922'] {{(pid=87444) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 04:46:13 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-f8addad5-7068-43ef-8e5d-2236023234d2 tempest-VolumesNegativeTest-1562591450 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 04:46:13 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-f8addad5-7068-43ef-8e5d-2236023234d2 tempest-VolumesNegativeTest-1562591450 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:46:13 devstack sudo[99308]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097 Jul 10 04:46:13 devstack sudo[99308]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:46:13 devstack sudo[99304]: pam_unix(sudo:session): session closed for user root Jul 10 04:46:13 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-9173c4b7-9627-4f96-8754-a3084a4f84f8 tempest-VolumesGetTest-423200778 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-05be954a-4a47-4dd9-ac7f-15be06ddf426" returned: 0 in 0.945s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:46:13 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-9173c4b7-9627-4f96-8754-a3084a4f84f8 tempest-VolumesGetTest-423200778 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-05be954a-4a47-4dd9-ac7f-15be06ddf426 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:46:13 devstack sudo[99316]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-05be954a-4a47-4dd9-ac7f-15be06ddf426 Jul 10 04:46:13 devstack sudo[99316]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:46:14 devstack sudo[99316]: pam_unix(sudo:session): session closed for user root Jul 10 04:46:14 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-9173c4b7-9627-4f96-8754-a3084a4f84f8 tempest-VolumesGetTest-423200778 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-05be954a-4a47-4dd9-ac7f-15be06ddf426" returned: 0 in 0.834s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:46:14 devstack sudo[99308]: pam_unix(sudo:session): session closed for user root Jul 10 04:46:14 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-f8addad5-7068-43ef-8e5d-2236023234d2 tempest-VolumesNegativeTest-1562591450 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097" returned: 0 in 1.115s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:46:14 devstack cinder-volume[87444]: DEBUG cinder.manager [None req-f8addad5-7068-43ef-8e5d-2236023234d2 tempest-VolumesNegativeTest-1562591450 None] Notifying Schedulers of capabilities ... {{(pid=87444) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 04:46:14 devstack cinder-volume[87444]: INFO cinder.volume.manager [None req-f8addad5-7068-43ef-8e5d-2236023234d2 tempest-VolumesNegativeTest-1562591450 None] Deleted volume successfully. Jul 10 04:46:14 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-9173c4b7-9627-4f96-8754-a3084a4f84f8 tempest-VolumesGetTest-423200778 None] Lock "cinder-quobyte-05be954a-4a47-4dd9-ac7f-15be06ddf426" released by "delete_volume" :: held 1.913s {{(pid=87444) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 04:46:14 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-f8addad5-7068-43ef-8e5d-2236023234d2 tempest-VolumesNegativeTest-1562591450 None] Lock "cinder-8ef0d246-886f-4d49-89f4-ab67433748d2-delete_volume" released by "delete_volume" :: held 3.949s {{(pid=87444) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 04:46:14 devstack cinder-volume[87444]: DEBUG cinder.quota [None req-9173c4b7-9627-4f96-8754-a3084a4f84f8 tempest-VolumesGetTest-423200778 None] Created reservations ['ff01d304-7640-43dd-80d9-e1f86e657f66', '4af55f63-f39e-4454-bc69-2cbe06514fd2', 'af7f91e9-1704-40d8-b7fe-b8cc21917867', 'd150429c-7afd-4ce3-834c-12ff222fa0c9'] {{(pid=87444) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 04:46:14 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-9173c4b7-9627-4f96-8754-a3084a4f84f8 tempest-VolumesGetTest-423200778 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 04:46:14 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-9173c4b7-9627-4f96-8754-a3084a4f84f8 tempest-VolumesGetTest-423200778 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 04:46:14 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-9173c4b7-9627-4f96-8754-a3084a4f84f8 tempest-VolumesGetTest-423200778 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922': None} {{(pid=87444) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 04:46:14 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-9173c4b7-9627-4f96-8754-a3084a4f84f8 tempest-VolumesGetTest-423200778 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922'] {{(pid=87444) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 04:46:14 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-9173c4b7-9627-4f96-8754-a3084a4f84f8 tempest-VolumesGetTest-423200778 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 04:46:14 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-9173c4b7-9627-4f96-8754-a3084a4f84f8 tempest-VolumesGetTest-423200778 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:46:14 devstack sudo[99323]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097 Jul 10 04:46:14 devstack sudo[99323]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:46:15 devstack cinder-volume[87444]: DEBUG cinder.volume.flows.manager.create_volume [None req-701af10e-fe27-463a-8cdf-963867660a5a tempest-VolumesGetTest-423200778 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87444) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 04:46:15 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-701af10e-fe27-463a-8cdf-963867660a5a tempest-VolumesGetTest-423200778 None] Flow 'volume_create_manager' (42ac2b01-dc06-4046-98ac-86be0b1c412c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 04:46:15 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-701af10e-fe27-463a-8cdf-963867660a5a tempest-VolumesGetTest-423200778 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (73e50e47-9233-4d57-b4da-8ff4b8210eb4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:46:15 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-701af10e-fe27-463a-8cdf-963867660a5a tempest-VolumesGetTest-423200778 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (73e50e47-9233-4d57-b4da-8ff4b8210eb4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T02:46:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1159741764',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=328eb4c5-f16d-446a-8d0a-db719a5d5f49,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='761a9e430aba4ae18bd6ef42f16015f4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T02:46:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T02:46:16Z,use_quota=True,user_id='ae02b9a0cfaa4f7d8fd6393dfd0bb7b6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(317e369e-1e06-434d-ae95-a335f0e6c903),volume_type_id=317e369e-1e06-434d-ae95-a335f0e6c903)' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:46:15 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-701af10e-fe27-463a-8cdf-963867660a5a tempest-VolumesGetTest-423200778 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6862a503-9867-4d4f-bb69-ead006f8204e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:46:15 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-701af10e-fe27-463a-8cdf-963867660a5a tempest-VolumesGetTest-423200778 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6862a503-9867-4d4f-bb69-ead006f8204e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:46:15 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-701af10e-fe27-463a-8cdf-963867660a5a tempest-VolumesGetTest-423200778 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (69754e08-cea0-48dc-b7e6-09678cfaa11a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:46:15 devstack cinder-volume[87444]: DEBUG cinder.image.glance [None req-701af10e-fe27-463a-8cdf-963867660a5a tempest-VolumesGetTest-423200778 None] Creating Keystone auth plugin from conf {{(pid=87444) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jul 10 04:46:15 devstack sudo[99323]: pam_unix(sudo:session): session closed for user root Jul 10 04:46:15 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-9173c4b7-9627-4f96-8754-a3084a4f84f8 tempest-VolumesGetTest-423200778 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097" returned: 0 in 1.130s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:46:15 devstack cinder-volume[87444]: DEBUG cinder.manager [None req-9173c4b7-9627-4f96-8754-a3084a4f84f8 tempest-VolumesGetTest-423200778 None] Notifying Schedulers of capabilities ... {{(pid=87444) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 04:46:15 devstack cinder-volume[87444]: INFO cinder.volume.manager [None req-9173c4b7-9627-4f96-8754-a3084a4f84f8 tempest-VolumesGetTest-423200778 None] Deleted volume successfully. Jul 10 04:46:15 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-9173c4b7-9627-4f96-8754-a3084a4f84f8 tempest-VolumesGetTest-423200778 None] Lock "cinder-05be954a-4a47-4dd9-ac7f-15be06ddf426-delete_volume" released by "delete_volume" :: held 3.524s {{(pid=87444) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 04:46:16 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-701af10e-fe27-463a-8cdf-963867660a5a tempest-VolumesGetTest-423200778 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (69754e08-cea0-48dc-b7e6-09678cfaa11a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '328eb4c5-f16d-446a-8d0a-db719a5d5f49', 'volume_name': 'volume-328eb4c5-f16d-446a-8d0a-db719a5d5f49', 'volume_size': 1, 'image_id': '5ac2ee4b-64bc-499a-b553-ae96ba343fc0', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/5ac2ee4b-64bc-499a-b553-ae96ba343fc0', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'ca4bb946b593473194351a84617cf92e', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '5ac2ee4b-64bc-499a-b553-ae96ba343fc0', 'created_at': datetime.datetime(2026, 7, 10, 2, 26, 36, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 10, 2, 26, 38, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/5ac2ee4b-64bc-499a-b553-ae96ba343fc0/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:46:16 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-701af10e-fe27-463a-8cdf-963867660a5a tempest-VolumesGetTest-423200778 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (82b7d75d-0dad-4ddd-aec5-a3acf7f324b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:46:16 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-701af10e-fe27-463a-8cdf-963867660a5a tempest-VolumesGetTest-423200778 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (82b7d75d-0dad-4ddd-aec5-a3acf7f324b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:46:16 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-701af10e-fe27-463a-8cdf-963867660a5a tempest-VolumesGetTest-423200778 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c8a2e6b0-c91e-4b4a-9525-8d79f8becfb2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:46:16 devstack cinder-volume[87444]: INFO cinder.volume.flows.manager.create_volume [None req-701af10e-fe27-463a-8cdf-963867660a5a tempest-VolumesGetTest-423200778 None] Volume 328eb4c5-f16d-446a-8d0a-db719a5d5f49: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-328eb4c5-f16d-446a-8d0a-db719a5d5f49', 'volume_size': 1, 'image_id': '5ac2ee4b-64bc-499a-b553-ae96ba343fc0', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/5ac2ee4b-64bc-499a-b553-ae96ba343fc0', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'ca4bb946b593473194351a84617cf92e', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '5ac2ee4b-64bc-499a-b553-ae96ba343fc0', 'created_at': datetime.datetime(2026, 7, 10, 2, 26, 36, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 10, 2, 26, 38, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/5ac2ee4b-64bc-499a-b553-ae96ba343fc0/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Jul 10 04:46:16 devstack cinder-volume[87444]: DEBUG cinder.volume.flows.manager.create_volume [None req-701af10e-fe27-463a-8cdf-963867660a5a tempest-VolumesGetTest-423200778 None] Trying to clone 328eb4c5-f16d-446a-8d0a-db719a5d5f49 from image 5ac2ee4b-64bc-499a-b553-ae96ba343fc0 at location (None, [{'url': 'file:///opt/stack/data/glance/images/5ac2ee4b-64bc-499a-b553-ae96ba343fc0', 'metadata': {}}]). {{(pid=87444) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jul 10 04:46:16 devstack cinder-volume[87444]: DEBUG cinder.image.image_utils [None req-701af10e-fe27-463a-8cdf-963867660a5a tempest-VolumesGetTest-423200778 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_5ac2ee4b-64bc-499a-b553-ae96ba343fc0_qpz4z94rdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=87444) fetch /opt/stack/cinder/cinder/image/image_utils.py:765}} Jul 10 04:46:16 devstack cinder-volume[87444]: INFO cinder.image.image_utils [None req-701af10e-fe27-463a-8cdf-963867660a5a tempest-VolumesGetTest-423200778 None] Image download 20.69 MB at 20.69 MB/s Jul 10 04:46:16 devstack cinder-volume[87444]: DEBUG oslo.privsep.daemon [-] privsep: reply[217cb8f7-c4af-46dc-9b84-e48be5d1283a]: (4, 'qcow2') {{(pid=88499) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 04:46:16 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-701af10e-fe27-463a-8cdf-963867660a5a tempest-VolumesGetTest-423200778 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_5ac2ee4b-64bc-499a-b553-ae96ba343fc0_qpz4z94rdevstack@QuobyteHD {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:46:17 devstack sudo[99327]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_5ac2ee4b-64bc-499a-b553-ae96ba343fc0_qpz4z94rdevstack@QuobyteHD Jul 10 04:46:17 devstack sudo[99327]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:46:17 devstack sudo[99327]: pam_unix(sudo:session): session closed for user root Jul 10 04:46:17 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-701af10e-fe27-463a-8cdf-963867660a5a tempest-VolumesGetTest-423200778 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_5ac2ee4b-64bc-499a-b553-ae96ba343fc0_qpz4z94rdevstack@QuobyteHD" returned: 0 in 0.881s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:46:17 devstack cinder-volume[87444]: DEBUG cinder.image.image_utils [None req-701af10e-fe27-463a-8cdf-963867660a5a tempest-VolumesGetTest-423200778 None] Temporary image 5ac2ee4b-64bc-499a-b553-ae96ba343fc0 is fetched for user ae02b9a0cfaa4f7d8fd6393dfd0bb7b6. {{(pid=87444) fetch /opt/stack/cinder/cinder/image/image_utils.py:1464}} Jul 10 04:46:17 devstack cinder-volume[87444]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9016290-b9f6-42ef-88b1-c4d6a45cabd7]: (4, 'qcow2') {{(pid=88499) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 04:46:17 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-701af10e-fe27-463a-8cdf-963867660a5a tempest-VolumesGetTest-423200778 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_5ac2ee4b-64bc-499a-b553-ae96ba343fc0_qpz4z94rdevstack@QuobyteHD {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:46:18 devstack sudo[99333]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_5ac2ee4b-64bc-499a-b553-ae96ba343fc0_qpz4z94rdevstack@QuobyteHD Jul 10 04:46:18 devstack sudo[99333]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:46:18 devstack cinder-volume[87444]: DEBUG cinder.volume.flows.manager.create_volume [None req-5175f99a-9989-43f8-9fb7-f30eb7da4e86 tempest-VolumesSnapshotNegativeTestJSON-594286395 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87444) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 04:46:18 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-5175f99a-9989-43f8-9fb7-f30eb7da4e86 tempest-VolumesSnapshotNegativeTestJSON-594286395 None] Flow 'volume_create_manager' (d6060b46-ff8c-416b-b44b-86d25298c496) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 04:46:18 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-5175f99a-9989-43f8-9fb7-f30eb7da4e86 tempest-VolumesSnapshotNegativeTestJSON-594286395 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2a422c6f-17b5-4c4a-89fd-9d1356ef0dc2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:46:18 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-5175f99a-9989-43f8-9fb7-f30eb7da4e86 tempest-VolumesSnapshotNegativeTestJSON-594286395 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2a422c6f-17b5-4c4a-89fd-9d1356ef0dc2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T02:46:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-1738718939',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a749a086-f508-45de-a8f7-fa00452e799d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6d4434ce127c4fd6bdc3839b0b45f70f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T02:46:18Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T02:46:18Z,use_quota=True,user_id='7c1a3cc5415c4e5eb7f445041bfb62fb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(317e369e-1e06-434d-ae95-a335f0e6c903),volume_type_id=317e369e-1e06-434d-ae95-a335f0e6c903)' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:46:18 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-5175f99a-9989-43f8-9fb7-f30eb7da4e86 tempest-VolumesSnapshotNegativeTestJSON-594286395 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (648baeae-d574-4e4d-b9ea-8abf98ef9533) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:46:18 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-5175f99a-9989-43f8-9fb7-f30eb7da4e86 tempest-VolumesSnapshotNegativeTestJSON-594286395 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (648baeae-d574-4e4d-b9ea-8abf98ef9533) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:46:18 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-5175f99a-9989-43f8-9fb7-f30eb7da4e86 tempest-VolumesSnapshotNegativeTestJSON-594286395 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d44c2ef5-be91-4e08-8484-fc59686083b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:46:18 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-5175f99a-9989-43f8-9fb7-f30eb7da4e86 tempest-VolumesSnapshotNegativeTestJSON-594286395 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d44c2ef5-be91-4e08-8484-fc59686083b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a749a086-f508-45de-a8f7-fa00452e799d', 'volume_name': 'volume-a749a086-f508-45de-a8f7-fa00452e799d', 'volume_size': 2}' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:46:18 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-5175f99a-9989-43f8-9fb7-f30eb7da4e86 tempest-VolumesSnapshotNegativeTestJSON-594286395 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (76153667-1e53-42dc-a977-5f039dab0fca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:46:18 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-5175f99a-9989-43f8-9fb7-f30eb7da4e86 tempest-VolumesSnapshotNegativeTestJSON-594286395 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (76153667-1e53-42dc-a977-5f039dab0fca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:46:18 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-5175f99a-9989-43f8-9fb7-f30eb7da4e86 tempest-VolumesSnapshotNegativeTestJSON-594286395 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c39f91b4-a4d7-4be9-add4-e52836595398) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:46:18 devstack cinder-volume[87444]: INFO cinder.volume.flows.manager.create_volume [None req-5175f99a-9989-43f8-9fb7-f30eb7da4e86 tempest-VolumesSnapshotNegativeTestJSON-594286395 None] Volume a749a086-f508-45de-a8f7-fa00452e799d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a749a086-f508-45de-a8f7-fa00452e799d', 'volume_size': 2} Jul 10 04:46:18 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-5175f99a-9989-43f8-9fb7-f30eb7da4e86 tempest-VolumesSnapshotNegativeTestJSON-594286395 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 04:46:18 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-5175f99a-9989-43f8-9fb7-f30eb7da4e86 tempest-VolumesSnapshotNegativeTestJSON-594286395 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 04:46:18 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-5175f99a-9989-43f8-9fb7-f30eb7da4e86 tempest-VolumesSnapshotNegativeTestJSON-594286395 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T02:46:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-1738718939',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a749a086-f508-45de-a8f7-fa00452e799d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6d4434ce127c4fd6bdc3839b0b45f70f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T02:46:18Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T02:46:18Z,use_quota=True,user_id='7c1a3cc5415c4e5eb7f445041bfb62fb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(317e369e-1e06-434d-ae95-a335f0e6c903),volume_type_id=317e369e-1e06-434d-ae95-a335f0e6c903)}" {{(pid=87444) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 04:46:18 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.remotefs [None req-5175f99a-9989-43f8-9fb7-f30eb7da4e86 tempest-VolumesSnapshotNegativeTestJSON-594286395 None] Creating volume a749a086-f508-45de-a8f7-fa00452e799d {{(pid=87444) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 04:46:18 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-5175f99a-9989-43f8-9fb7-f30eb7da4e86 tempest-VolumesSnapshotNegativeTestJSON-594286395 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 04:46:18 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-5175f99a-9989-43f8-9fb7-f30eb7da4e86 tempest-VolumesSnapshotNegativeTestJSON-594286395 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 04:46:18 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-5175f99a-9989-43f8-9fb7-f30eb7da4e86 tempest-VolumesSnapshotNegativeTestJSON-594286395 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922': None} {{(pid=87444) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 04:46:18 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-5175f99a-9989-43f8-9fb7-f30eb7da4e86 tempest-VolumesSnapshotNegativeTestJSON-594286395 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922'] {{(pid=87444) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 04:46:18 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-5175f99a-9989-43f8-9fb7-f30eb7da4e86 tempest-VolumesSnapshotNegativeTestJSON-594286395 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 04:46:18 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-5175f99a-9989-43f8-9fb7-f30eb7da4e86 tempest-VolumesSnapshotNegativeTestJSON-594286395 None] Selected osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922 as target Quobyte volume. {{(pid=87444) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 04:46:18 devstack cinder-volume[87444]: INFO cinder.volume.drivers.remotefs [None req-5175f99a-9989-43f8-9fb7-f30eb7da4e86 tempest-VolumesSnapshotNegativeTestJSON-594286395 None] casted to osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922 Jul 10 04:46:18 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-5175f99a-9989-43f8-9fb7-f30eb7da4e86 tempest-VolumesSnapshotNegativeTestJSON-594286395 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-a749a086-f508-45de-a8f7-fa00452e799d 2147483648 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:46:18 devstack sudo[99335]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-a749a086-f508-45de-a8f7-fa00452e799d 2147483648 Jul 10 04:46:18 devstack sudo[99335]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:46:18 devstack sudo[99333]: pam_unix(sudo:session): session closed for user root Jul 10 04:46:18 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-701af10e-fe27-463a-8cdf-963867660a5a tempest-VolumesGetTest-423200778 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_5ac2ee4b-64bc-499a-b553-ae96ba343fc0_qpz4z94rdevstack@QuobyteHD" returned: 0 in 0.889s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:46:18 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-701af10e-fe27-463a-8cdf-963867660a5a tempest-VolumesGetTest-423200778 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 04:46:19 devstack cinder-volume[87444]: DEBUG cinder.volume.flows.manager.create_volume [None req-c8f3d998-29a9-4eb1-91b1-8601f3bab061 tempest-TestStampPattern-1378957900 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87444) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 04:46:19 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-c8f3d998-29a9-4eb1-91b1-8601f3bab061 tempest-TestStampPattern-1378957900 None] Flow 'volume_create_manager' (d7cd8420-493f-4944-9f6f-8454e8a541ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 04:46:19 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-c8f3d998-29a9-4eb1-91b1-8601f3bab061 tempest-TestStampPattern-1378957900 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dd38a206-905b-4fb2-b641-3fc6aca124f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:46:19 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-c8f3d998-29a9-4eb1-91b1-8601f3bab061 tempest-TestStampPattern-1378957900 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dd38a206-905b-4fb2-b641-3fc6aca124f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T02:46:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-946778140',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=420cd972-7ecb-4fdb-abf1-d859698bbb94,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='97695cee493e44c8b788d712728bc23f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T02:46:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T02:46:19Z,use_quota=True,user_id='15e772be8620466c96f211a214493a88',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(317e369e-1e06-434d-ae95-a335f0e6c903),volume_type_id=317e369e-1e06-434d-ae95-a335f0e6c903)' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:46:19 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-c8f3d998-29a9-4eb1-91b1-8601f3bab061 tempest-TestStampPattern-1378957900 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bc354c7c-2013-4259-814a-c392821fff0c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:46:19 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-c8f3d998-29a9-4eb1-91b1-8601f3bab061 tempest-TestStampPattern-1378957900 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bc354c7c-2013-4259-814a-c392821fff0c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:46:19 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-c8f3d998-29a9-4eb1-91b1-8601f3bab061 tempest-TestStampPattern-1378957900 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7be59e4a-ce96-42ba-a86b-1140c0f0843c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:46:19 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-c8f3d998-29a9-4eb1-91b1-8601f3bab061 tempest-TestStampPattern-1378957900 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7be59e4a-ce96-42ba-a86b-1140c0f0843c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '420cd972-7ecb-4fdb-abf1-d859698bbb94', 'volume_name': 'volume-420cd972-7ecb-4fdb-abf1-d859698bbb94', 'volume_size': 1}' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:46:19 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-c8f3d998-29a9-4eb1-91b1-8601f3bab061 tempest-TestStampPattern-1378957900 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2652e985-6ab4-42f7-953e-ff6490210926) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:46:19 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-c8f3d998-29a9-4eb1-91b1-8601f3bab061 tempest-TestStampPattern-1378957900 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2652e985-6ab4-42f7-953e-ff6490210926) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:46:19 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-c8f3d998-29a9-4eb1-91b1-8601f3bab061 tempest-TestStampPattern-1378957900 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3cdd1042-8b38-4942-9645-0113d5b8adc3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:46:19 devstack cinder-volume[87444]: INFO cinder.volume.flows.manager.create_volume [None req-c8f3d998-29a9-4eb1-91b1-8601f3bab061 tempest-TestStampPattern-1378957900 None] Volume 420cd972-7ecb-4fdb-abf1-d859698bbb94: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-420cd972-7ecb-4fdb-abf1-d859698bbb94', 'volume_size': 1} Jul 10 04:46:19 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-c8f3d998-29a9-4eb1-91b1-8601f3bab061 tempest-TestStampPattern-1378957900 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 04:46:19 devstack sudo[99335]: pam_unix(sudo:session): session closed for user root Jul 10 04:46:19 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-5175f99a-9989-43f8-9fb7-f30eb7da4e86 tempest-VolumesSnapshotNegativeTestJSON-594286395 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-a749a086-f508-45de-a8f7-fa00452e799d 2147483648" returned: 0 in 1.051s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:46:19 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-5175f99a-9989-43f8-9fb7-f30eb7da4e86 tempest-VolumesSnapshotNegativeTestJSON-594286395 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-a749a086-f508-45de-a8f7-fa00452e799d {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:46:19 devstack sudo[99344]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-a749a086-f508-45de-a8f7-fa00452e799d Jul 10 04:46:19 devstack sudo[99344]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:46:20 devstack sudo[99344]: pam_unix(sudo:session): session closed for user root Jul 10 04:46:20 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-5175f99a-9989-43f8-9fb7-f30eb7da4e86 tempest-VolumesSnapshotNegativeTestJSON-594286395 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-a749a086-f508-45de-a8f7-fa00452e799d" returned: 0 in 0.790s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:46:20 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-5175f99a-9989-43f8-9fb7-f30eb7da4e86 tempest-VolumesSnapshotNegativeTestJSON-594286395 None] <== create_volume: return (1887ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922'} {{(pid=87444) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 04:46:20 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-5175f99a-9989-43f8-9fb7-f30eb7da4e86 tempest-VolumesSnapshotNegativeTestJSON-594286395 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.891s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 04:46:20 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-701af10e-fe27-463a-8cdf-963867660a5a tempest-VolumesGetTest-423200778 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.454s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 04:46:20 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-701af10e-fe27-463a-8cdf-963867660a5a tempest-VolumesGetTest-423200778 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T02:46:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1159741764',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=328eb4c5-f16d-446a-8d0a-db719a5d5f49,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='761a9e430aba4ae18bd6ef42f16015f4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T02:46:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T02:46:16Z,use_quota=True,user_id='ae02b9a0cfaa4f7d8fd6393dfd0bb7b6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(317e369e-1e06-434d-ae95-a335f0e6c903),volume_type_id=317e369e-1e06-434d-ae95-a335f0e6c903)}" {{(pid=87444) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 04:46:20 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.remotefs [None req-701af10e-fe27-463a-8cdf-963867660a5a tempest-VolumesGetTest-423200778 None] Creating volume 328eb4c5-f16d-446a-8d0a-db719a5d5f49 {{(pid=87444) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 04:46:20 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-701af10e-fe27-463a-8cdf-963867660a5a tempest-VolumesGetTest-423200778 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 04:46:20 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-701af10e-fe27-463a-8cdf-963867660a5a tempest-VolumesGetTest-423200778 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 04:46:20 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-701af10e-fe27-463a-8cdf-963867660a5a tempest-VolumesGetTest-423200778 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922': None} {{(pid=87444) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 04:46:20 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-701af10e-fe27-463a-8cdf-963867660a5a tempest-VolumesGetTest-423200778 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922'] {{(pid=87444) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 04:46:20 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-701af10e-fe27-463a-8cdf-963867660a5a tempest-VolumesGetTest-423200778 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 04:46:20 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-701af10e-fe27-463a-8cdf-963867660a5a tempest-VolumesGetTest-423200778 None] Selected osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922 as target Quobyte volume. {{(pid=87444) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 04:46:20 devstack cinder-volume[87444]: INFO cinder.volume.drivers.remotefs [None req-701af10e-fe27-463a-8cdf-963867660a5a tempest-VolumesGetTest-423200778 None] casted to osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922 Jul 10 04:46:20 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-701af10e-fe27-463a-8cdf-963867660a5a tempest-VolumesGetTest-423200778 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-328eb4c5-f16d-446a-8d0a-db719a5d5f49 1073741824 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:46:20 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-5175f99a-9989-43f8-9fb7-f30eb7da4e86 tempest-VolumesSnapshotNegativeTestJSON-594286395 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c39f91b4-a4d7-4be9-add4-e52836595398) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a749a086-f508-45de-a8f7-fa00452e799d', 'volume_size': 2}' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:46:20 devstack sudo[99350]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-328eb4c5-f16d-446a-8d0a-db719a5d5f49 1073741824 Jul 10 04:46:20 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-5175f99a-9989-43f8-9fb7-f30eb7da4e86 tempest-VolumesSnapshotNegativeTestJSON-594286395 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (624654b0-2bcb-488c-9717-47ecf5299809) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:46:20 devstack sudo[99350]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:46:20 devstack cinder-volume[87444]: INFO cinder.volume.flows.manager.create_volume [None req-5175f99a-9989-43f8-9fb7-f30eb7da4e86 tempest-VolumesSnapshotNegativeTestJSON-594286395 None] Volume volume-a749a086-f508-45de-a8f7-fa00452e799d (a749a086-f508-45de-a8f7-fa00452e799d): created successfully Jul 10 04:46:20 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-5175f99a-9989-43f8-9fb7-f30eb7da4e86 tempest-VolumesSnapshotNegativeTestJSON-594286395 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (624654b0-2bcb-488c-9717-47ecf5299809) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:46:20 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-5175f99a-9989-43f8-9fb7-f30eb7da4e86 tempest-VolumesSnapshotNegativeTestJSON-594286395 None] Flow 'volume_create_manager' (d6060b46-ff8c-416b-b44b-86d25298c496) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87444) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 04:46:20 devstack cinder-volume[87444]: INFO cinder.volume.manager [None req-5175f99a-9989-43f8-9fb7-f30eb7da4e86 tempest-VolumesSnapshotNegativeTestJSON-594286395 None] Created volume successfully. Jul 10 04:46:21 devstack sudo[99350]: pam_unix(sudo:session): session closed for user root Jul 10 04:46:21 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-701af10e-fe27-463a-8cdf-963867660a5a tempest-VolumesGetTest-423200778 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-328eb4c5-f16d-446a-8d0a-db719a5d5f49 1073741824" returned: 0 in 1.173s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:46:21 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [req-a57303fb-bcb5-4680-aaa7-5dfb667fccfe req-f9e0991e-5465-4650-8ac7-93f98b6ac5bb tempest-TestInstancesWithCinderVolumes-1741196733 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 04:46:21 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-701af10e-fe27-463a-8cdf-963867660a5a tempest-VolumesGetTest-423200778 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-328eb4c5-f16d-446a-8d0a-db719a5d5f49 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:46:21 devstack sudo[99365]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-328eb4c5-f16d-446a-8d0a-db719a5d5f49 Jul 10 04:46:21 devstack sudo[99365]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:46:21 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-a7b30570-d3a9-46a8-8dea-fe5335e95d71 tempest-VolumesSnapshotNegativeTestJSON-594286395 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 04:46:22 devstack sudo[99365]: pam_unix(sudo:session): session closed for user root Jul 10 04:46:22 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-701af10e-fe27-463a-8cdf-963867660a5a tempest-VolumesGetTest-423200778 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-328eb4c5-f16d-446a-8d0a-db719a5d5f49" returned: 0 in 0.730s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:46:22 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-701af10e-fe27-463a-8cdf-963867660a5a tempest-VolumesGetTest-423200778 None] <== create_volume: return (1981ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922'} {{(pid=87444) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 04:46:22 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-701af10e-fe27-463a-8cdf-963867660a5a tempest-VolumesGetTest-423200778 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.984s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 04:46:22 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-c8f3d998-29a9-4eb1-91b1-8601f3bab061 tempest-TestStampPattern-1378957900 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.969s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 04:46:22 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-c8f3d998-29a9-4eb1-91b1-8601f3bab061 tempest-TestStampPattern-1378957900 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T02:46:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-946778140',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=420cd972-7ecb-4fdb-abf1-d859698bbb94,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='97695cee493e44c8b788d712728bc23f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T02:46:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T02:46:19Z,use_quota=True,user_id='15e772be8620466c96f211a214493a88',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(317e369e-1e06-434d-ae95-a335f0e6c903),volume_type_id=317e369e-1e06-434d-ae95-a335f0e6c903)}" {{(pid=87444) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 04:46:22 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.remotefs [None req-c8f3d998-29a9-4eb1-91b1-8601f3bab061 tempest-TestStampPattern-1378957900 None] Creating volume 420cd972-7ecb-4fdb-abf1-d859698bbb94 {{(pid=87444) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 04:46:22 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-c8f3d998-29a9-4eb1-91b1-8601f3bab061 tempest-TestStampPattern-1378957900 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 04:46:22 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-c8f3d998-29a9-4eb1-91b1-8601f3bab061 tempest-TestStampPattern-1378957900 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 04:46:22 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-c8f3d998-29a9-4eb1-91b1-8601f3bab061 tempest-TestStampPattern-1378957900 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922': None} {{(pid=87444) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 04:46:22 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-c8f3d998-29a9-4eb1-91b1-8601f3bab061 tempest-TestStampPattern-1378957900 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922'] {{(pid=87444) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 04:46:22 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-c8f3d998-29a9-4eb1-91b1-8601f3bab061 tempest-TestStampPattern-1378957900 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 04:46:22 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-c8f3d998-29a9-4eb1-91b1-8601f3bab061 tempest-TestStampPattern-1378957900 None] Selected osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922 as target Quobyte volume. {{(pid=87444) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 04:46:22 devstack cinder-volume[87444]: INFO cinder.volume.drivers.remotefs [None req-c8f3d998-29a9-4eb1-91b1-8601f3bab061 tempest-TestStampPattern-1378957900 None] casted to osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922 Jul 10 04:46:22 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-c8f3d998-29a9-4eb1-91b1-8601f3bab061 tempest-TestStampPattern-1378957900 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-420cd972-7ecb-4fdb-abf1-d859698bbb94 1073741824 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:46:22 devstack sudo[99369]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-420cd972-7ecb-4fdb-abf1-d859698bbb94 1073741824 Jul 10 04:46:22 devstack sudo[99369]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:46:22 devstack cinder-volume[87444]: DEBUG cinder.volume.volume_utils [None req-701af10e-fe27-463a-8cdf-963867660a5a tempest-VolumesGetTest-423200778 None] Attempting download of 5ac2ee4b-64bc-499a-b553-ae96ba343fc0 ((None, [{'url': 'file:///opt/stack/data/glance/images/5ac2ee4b-64bc-499a-b553-ae96ba343fc0', 'metadata': {}}])) to volume 328eb4c5-f16d-446a-8d0a-db719a5d5f49. {{(pid=87444) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jul 10 04:46:22 devstack cinder-volume[87444]: DEBUG oslo.privsep.daemon [-] privsep: reply[1847f805-0cdc-4dfd-b2c6-d5426a9c364d]: (4, 'raw') {{(pid=88499) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 04:46:22 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-701af10e-fe27-463a-8cdf-963867660a5a tempest-VolumesGetTest-423200778 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_5ac2ee4b-64bc-499a-b553-ae96ba343fc0_90os6xi7 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:46:22 devstack sudo[99371]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_5ac2ee4b-64bc-499a-b553-ae96ba343fc0_90os6xi7 Jul 10 04:46:22 devstack sudo[99371]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:46:23 devstack sudo[99371]: pam_unix(sudo:session): session closed for user root Jul 10 04:46:23 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-701af10e-fe27-463a-8cdf-963867660a5a tempest-VolumesGetTest-423200778 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_5ac2ee4b-64bc-499a-b553-ae96ba343fc0_90os6xi7" returned: 0 in 0.780s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:46:23 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-701af10e-fe27-463a-8cdf-963867660a5a tempest-VolumesGetTest-423200778 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_5ac2ee4b-64bc-499a-b553-ae96ba343fc0_90os6xi7 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:46:23 devstack sudo[99369]: pam_unix(sudo:session): session closed for user root Jul 10 04:46:23 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-c8f3d998-29a9-4eb1-91b1-8601f3bab061 tempest-TestStampPattern-1378957900 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-420cd972-7ecb-4fdb-abf1-d859698bbb94 1073741824" returned: 0 in 0.909s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:46:23 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-c8f3d998-29a9-4eb1-91b1-8601f3bab061 tempest-TestStampPattern-1378957900 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-420cd972-7ecb-4fdb-abf1-d859698bbb94 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:46:23 devstack sudo[99380]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-420cd972-7ecb-4fdb-abf1-d859698bbb94 Jul 10 04:46:23 devstack sudo[99380]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:46:23 devstack sudo[99378]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_5ac2ee4b-64bc-499a-b553-ae96ba343fc0_90os6xi7 Jul 10 04:46:23 devstack sudo[99378]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:46:23 devstack sudo[99380]: pam_unix(sudo:session): session closed for user root Jul 10 04:46:23 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-c8f3d998-29a9-4eb1-91b1-8601f3bab061 tempest-TestStampPattern-1378957900 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-420cd972-7ecb-4fdb-abf1-d859698bbb94" returned: 0 in 0.674s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:46:23 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-c8f3d998-29a9-4eb1-91b1-8601f3bab061 tempest-TestStampPattern-1378957900 None] <== create_volume: return (1631ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922'} {{(pid=87444) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 04:46:23 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-c8f3d998-29a9-4eb1-91b1-8601f3bab061 tempest-TestStampPattern-1378957900 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.634s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 04:46:23 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [req-a57303fb-bcb5-4680-aaa7-5dfb667fccfe req-f9e0991e-5465-4650-8ac7-93f98b6ac5bb tempest-TestInstancesWithCinderVolumes-1741196733 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 2.378s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 04:46:23 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-c8f3d998-29a9-4eb1-91b1-8601f3bab061 tempest-TestStampPattern-1378957900 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3cdd1042-8b38-4942-9645-0113d5b8adc3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-420cd972-7ecb-4fdb-abf1-d859698bbb94', 'volume_size': 1}' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:46:23 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-c8f3d998-29a9-4eb1-91b1-8601f3bab061 tempest-TestStampPattern-1378957900 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (76c3304e-1d17-42ea-be4f-184d4c524c61) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:46:23 devstack sudo[99378]: pam_unix(sudo:session): session closed for user root Jul 10 04:46:23 devstack cinder-volume[87444]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ab61113-5fe9-44d8-8025-b05cee05bdc2]: (4, 'raw') {{(pid=88499) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 04:46:23 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [req-a57303fb-bcb5-4680-aaa7-5dfb667fccfe req-f9e0991e-5465-4650-8ac7-93f98b6ac5bb tempest-TestInstancesWithCinderVolumes-1741196733 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-51f17d86-5d8b-4a30-b599-e679ed47dd26 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:46:23 devstack cinder-volume[87444]: INFO cinder.volume.flows.manager.create_volume [None req-c8f3d998-29a9-4eb1-91b1-8601f3bab061 tempest-TestStampPattern-1378957900 None] Volume volume-420cd972-7ecb-4fdb-abf1-d859698bbb94 (420cd972-7ecb-4fdb-abf1-d859698bbb94): created successfully Jul 10 04:46:23 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-c8f3d998-29a9-4eb1-91b1-8601f3bab061 tempest-TestStampPattern-1378957900 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (76c3304e-1d17-42ea-be4f-184d4c524c61) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:46:23 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-c8f3d998-29a9-4eb1-91b1-8601f3bab061 tempest-TestStampPattern-1378957900 None] Flow 'volume_create_manager' (d7cd8420-493f-4944-9f6f-8454e8a541ee) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87444) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 04:46:23 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-701af10e-fe27-463a-8cdf-963867660a5a tempest-VolumesGetTest-423200778 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_5ac2ee4b-64bc-499a-b553-ae96ba343fc0_90os6xi7" returned: 1 in 0.829s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:46:23 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-701af10e-fe27-463a-8cdf-963867660a5a tempest-VolumesGetTest-423200778 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_5ac2ee4b-64bc-499a-b553-ae96ba343fc0_90os6xi7' failed. Not Retrying. {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 10 04:46:23 devstack cinder-volume[87444]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b89bbdf-da32-4dc4-aeac-ea4cb4f75c0a]: (4, 'qcow2') {{(pid=88499) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 04:46:23 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-701af10e-fe27-463a-8cdf-963867660a5a tempest-VolumesGetTest-423200778 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_5ac2ee4b-64bc-499a-b553-ae96ba343fc0_qpz4z94rdevstack@QuobyteHD {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:46:23 devstack cinder-volume[87444]: INFO cinder.volume.manager [None req-c8f3d998-29a9-4eb1-91b1-8601f3bab061 tempest-TestStampPattern-1378957900 None] Created volume successfully. Jul 10 04:46:23 devstack sudo[99386]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-51f17d86-5d8b-4a30-b599-e679ed47dd26 Jul 10 04:46:23 devstack sudo[99386]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:46:24 devstack sudo[99387]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_5ac2ee4b-64bc-499a-b553-ae96ba343fc0_qpz4z94rdevstack@QuobyteHD Jul 10 04:46:24 devstack sudo[99387]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:46:24 devstack sudo[99386]: pam_unix(sudo:session): session closed for user root Jul 10 04:46:24 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [req-a57303fb-bcb5-4680-aaa7-5dfb667fccfe req-f9e0991e-5465-4650-8ac7-93f98b6ac5bb tempest-TestInstancesWithCinderVolumes-1741196733 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-51f17d86-5d8b-4a30-b599-e679ed47dd26" returned: 0 in 0.826s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:46:24 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [req-a57303fb-bcb5-4680-aaa7-5dfb667fccfe req-f9e0991e-5465-4650-8ac7-93f98b6ac5bb tempest-TestInstancesWithCinderVolumes-1741196733 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-51f17d86-5d8b-4a30-b599-e679ed47dd26 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:46:24 devstack sudo[99387]: pam_unix(sudo:session): session closed for user root Jul 10 04:46:24 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-701af10e-fe27-463a-8cdf-963867660a5a tempest-VolumesGetTest-423200778 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_5ac2ee4b-64bc-499a-b553-ae96ba343fc0_qpz4z94rdevstack@QuobyteHD" returned: 0 in 0.808s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:46:24 devstack cinder-volume[87444]: DEBUG cinder.image.image_utils [None req-701af10e-fe27-463a-8cdf-963867660a5a tempest-VolumesGetTest-423200778 None] 5ac2ee4b-64bc-499a-b553-ae96ba343fc0 was qcow2, converting to raw {{(pid=87444) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1153}} Jul 10 04:46:24 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-701af10e-fe27-463a-8cdf-963867660a5a tempest-VolumesGetTest-423200778 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_5ac2ee4b-64bc-499a-b553-ae96ba343fc0_qpz4z94rdevstack@QuobyteHD /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-328eb4c5-f16d-446a-8d0a-db719a5d5f49 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:46:24 devstack sudo[99396]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_5ac2ee4b-64bc-499a-b553-ae96ba343fc0_qpz4z94rdevstack@QuobyteHD /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-328eb4c5-f16d-446a-8d0a-db719a5d5f49 Jul 10 04:46:24 devstack sudo[99396]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:46:24 devstack sudo[99395]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-51f17d86-5d8b-4a30-b599-e679ed47dd26 Jul 10 04:46:24 devstack sudo[99395]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:46:25 devstack sudo[99395]: pam_unix(sudo:session): session closed for user root Jul 10 04:46:25 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [req-a57303fb-bcb5-4680-aaa7-5dfb667fccfe req-f9e0991e-5465-4650-8ac7-93f98b6ac5bb tempest-TestInstancesWithCinderVolumes-1741196733 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-51f17d86-5d8b-4a30-b599-e679ed47dd26" returned: 1 in 0.915s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:46:25 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [req-a57303fb-bcb5-4680-aaa7-5dfb667fccfe req-f9e0991e-5465-4650-8ac7-93f98b6ac5bb tempest-TestInstancesWithCinderVolumes-1741196733 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-51f17d86-5d8b-4a30-b599-e679ed47dd26' failed. Not Retrying. {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 10 04:46:25 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [req-a57303fb-bcb5-4680-aaa7-5dfb667fccfe req-f9e0991e-5465-4650-8ac7-93f98b6ac5bb tempest-TestInstancesWithCinderVolumes-1741196733 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.796s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 04:46:25 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-a7b30570-d3a9-46a8-8dea-fe5335e95d71 tempest-VolumesSnapshotNegativeTestJSON-594286395 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 3.987s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 04:46:25 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.remotefs [None req-a7b30570-d3a9-46a8-8dea-fe5335e95d71 tempest-VolumesSnapshotNegativeTestJSON-594286395 None] Creating offline snapshot 021b8f15-9b7a-4d37-9542-3c13267301d9 of volume a749a086-f508-45de-a8f7-fa00452e799d {{(pid=87444) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 10 04:46:25 devstack cinder-volume[87444]: DEBUG oslo.privsep.daemon [-] privsep: reply[f912b0d6-1fc9-4eda-9ef8-a6d12f40e39d]: (4, 'qcow2') {{(pid=88499) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 04:46:25 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-a7b30570-d3a9-46a8-8dea-fe5335e95d71 tempest-VolumesSnapshotNegativeTestJSON-594286395 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-a749a086-f508-45de-a8f7-fa00452e799d {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:46:25 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [req-a57303fb-bcb5-4680-aaa7-5dfb667fccfe req-f9e0991e-5465-4650-8ac7-93f98b6ac5bb tempest-TestInstancesWithCinderVolumes-1741196733 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922', 'name': 'volume-51f17d86-5d8b-4a30-b599-e679ed47dd26', 'options': None, 'format': 'raw', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'c8df2f00-e038-4e4c-962c-59e4c61a37d2', 'enforce_multipath': True} {{(pid=87444) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 10 04:46:25 devstack sudo[99408]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-a749a086-f508-45de-a8f7-fa00452e799d Jul 10 04:46:25 devstack sudo[99408]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:46:25 devstack cinder-volume[87444]: INFO cinder.volume.manager [req-a57303fb-bcb5-4680-aaa7-5dfb667fccfe req-f9e0991e-5465-4650-8ac7-93f98b6ac5bb tempest-TestInstancesWithCinderVolumes-1741196733 None] attachment_update completed successfully. Jul 10 04:46:26 devstack sudo[99408]: pam_unix(sudo:session): session closed for user root Jul 10 04:46:26 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-a7b30570-d3a9-46a8-8dea-fe5335e95d71 tempest-VolumesSnapshotNegativeTestJSON-594286395 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-a749a086-f508-45de-a8f7-fa00452e799d" returned: 0 in 0.947s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:46:26 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-a7b30570-d3a9-46a8-8dea-fe5335e95d71 tempest-VolumesSnapshotNegativeTestJSON-594286395 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-a749a086-f508-45de-a8f7-fa00452e799d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-a749a086-f508-45de-a8f7-fa00452e799d.021b8f15-9b7a-4d37-9542-3c13267301d9 2G {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:46:26 devstack sudo[99414]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-a749a086-f508-45de-a8f7-fa00452e799d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-a749a086-f508-45de-a8f7-fa00452e799d.021b8f15-9b7a-4d37-9542-3c13267301d9 2G Jul 10 04:46:26 devstack sudo[99414]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:46:27 devstack sudo[99396]: pam_unix(sudo:session): session closed for user root Jul 10 04:46:27 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-701af10e-fe27-463a-8cdf-963867660a5a tempest-VolumesGetTest-423200778 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_5ac2ee4b-64bc-499a-b553-ae96ba343fc0_qpz4z94rdevstack@QuobyteHD /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-328eb4c5-f16d-446a-8d0a-db719a5d5f49" returned: 0 in 2.442s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:46:27 devstack cinder-volume[87444]: DEBUG cinder.image.image_utils [None req-701af10e-fe27-463a-8cdf-963867660a5a tempest-VolumesGetTest-423200778 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_5ac2ee4b-64bc-499a-b553-ae96ba343fc0_qpz4z94rdevstack@QuobyteHD, size 112.00 MB, duration 2.44 sec, destination /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-328eb4c5-f16d-446a-8d0a-db719a5d5f49 {{(pid=87444) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:561}} Jul 10 04:46:27 devstack cinder-volume[87444]: INFO cinder.image.image_utils [None req-701af10e-fe27-463a-8cdf-963867660a5a tempest-VolumesGetTest-423200778 None] Converted 112.00 MB image at 45.84 MB/s Jul 10 04:46:27 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-701af10e-fe27-463a-8cdf-963867660a5a tempest-VolumesGetTest-423200778 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-328eb4c5-f16d-446a-8d0a-db719a5d5f49 1G {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:46:27 devstack sudo[99426]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-328eb4c5-f16d-446a-8d0a-db719a5d5f49 1G Jul 10 04:46:27 devstack sudo[99426]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:46:27 devstack sudo[99414]: pam_unix(sudo:session): session closed for user root Jul 10 04:46:27 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-a7b30570-d3a9-46a8-8dea-fe5335e95d71 tempest-VolumesSnapshotNegativeTestJSON-594286395 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-a749a086-f508-45de-a8f7-fa00452e799d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-a749a086-f508-45de-a8f7-fa00452e799d.021b8f15-9b7a-4d37-9542-3c13267301d9 2G" returned: 0 in 1.033s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:46:27 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-a7b30570-d3a9-46a8-8dea-fe5335e95d71 tempest-VolumesSnapshotNegativeTestJSON-594286395 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a749a086-f508-45de-a8f7-fa00452e799d -F qcow2 /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-a749a086-f508-45de-a8f7-fa00452e799d.021b8f15-9b7a-4d37-9542-3c13267301d9 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:46:27 devstack sudo[99437]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a749a086-f508-45de-a8f7-fa00452e799d -F qcow2 /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-a749a086-f508-45de-a8f7-fa00452e799d.021b8f15-9b7a-4d37-9542-3c13267301d9 Jul 10 04:46:27 devstack sudo[99437]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:46:27 devstack sudo[99426]: pam_unix(sudo:session): session closed for user root Jul 10 04:46:27 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-701af10e-fe27-463a-8cdf-963867660a5a tempest-VolumesGetTest-423200778 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-328eb4c5-f16d-446a-8d0a-db719a5d5f49 1G" returned: 0 in 0.761s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:46:27 devstack cinder-volume[87444]: DEBUG oslo.privsep.daemon [-] privsep: reply[dcb8ecd9-9417-452a-8cf7-ac3fc68432d6]: (4, 'raw') {{(pid=88499) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 04:46:27 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-701af10e-fe27-463a-8cdf-963867660a5a tempest-VolumesGetTest-423200778 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-328eb4c5-f16d-446a-8d0a-db719a5d5f49 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:46:28 devstack sudo[99442]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-328eb4c5-f16d-446a-8d0a-db719a5d5f49 Jul 10 04:46:28 devstack sudo[99442]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:46:28 devstack sudo[99437]: pam_unix(sudo:session): session closed for user root Jul 10 04:46:28 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-a7b30570-d3a9-46a8-8dea-fe5335e95d71 tempest-VolumesSnapshotNegativeTestJSON-594286395 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a749a086-f508-45de-a8f7-fa00452e799d -F qcow2 /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-a749a086-f508-45de-a8f7-fa00452e799d.021b8f15-9b7a-4d37-9542-3c13267301d9" returned: 0 in 0.745s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:46:28 devstack cinder-volume[87444]: WARNING cinder.volume.drivers.remotefs [None req-a7b30570-d3a9-46a8-8dea-fe5335e95d71 tempest-VolumesSnapshotNegativeTestJSON-594286395 None] /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-a749a086-f508-45de-a8f7-fa00452e799d.021b8f15-9b7a-4d37-9542-3c13267301d9 is being set with open permissions: ugo+rw Jul 10 04:46:28 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-a7b30570-d3a9-46a8-8dea-fe5335e95d71 tempest-VolumesSnapshotNegativeTestJSON-594286395 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-a749a086-f508-45de-a8f7-fa00452e799d.021b8f15-9b7a-4d37-9542-3c13267301d9 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:46:28 devstack sudo[99514]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-a749a086-f508-45de-a8f7-fa00452e799d.021b8f15-9b7a-4d37-9542-3c13267301d9 Jul 10 04:46:28 devstack sudo[99514]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:46:28 devstack sudo[99442]: pam_unix(sudo:session): session closed for user root Jul 10 04:46:28 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-701af10e-fe27-463a-8cdf-963867660a5a tempest-VolumesGetTest-423200778 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-328eb4c5-f16d-446a-8d0a-db719a5d5f49" returned: 0 in 0.844s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:46:28 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-701af10e-fe27-463a-8cdf-963867660a5a tempest-VolumesGetTest-423200778 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-328eb4c5-f16d-446a-8d0a-db719a5d5f49 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:46:28 devstack sudo[99518]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-328eb4c5-f16d-446a-8d0a-db719a5d5f49 Jul 10 04:46:28 devstack sudo[99518]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:46:29 devstack sudo[99514]: pam_unix(sudo:session): session closed for user root Jul 10 04:46:29 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-a7b30570-d3a9-46a8-8dea-fe5335e95d71 tempest-VolumesSnapshotNegativeTestJSON-594286395 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-a749a086-f508-45de-a8f7-fa00452e799d.021b8f15-9b7a-4d37-9542-3c13267301d9" returned: 0 in 0.717s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:46:29 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-a7b30570-d3a9-46a8-8dea-fe5335e95d71 tempest-VolumesSnapshotNegativeTestJSON-594286395 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-a749a086-f508-45de-a8f7-fa00452e799d.info {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:46:29 devstack sudo[99521]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-a749a086-f508-45de-a8f7-fa00452e799d.info Jul 10 04:46:29 devstack sudo[99521]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:46:29 devstack sudo[99518]: pam_unix(sudo:session): session closed for user root Jul 10 04:46:29 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-701af10e-fe27-463a-8cdf-963867660a5a tempest-VolumesGetTest-423200778 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-328eb4c5-f16d-446a-8d0a-db719a5d5f49" returned: 1 in 1.039s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:46:29 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-701af10e-fe27-463a-8cdf-963867660a5a tempest-VolumesGetTest-423200778 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-328eb4c5-f16d-446a-8d0a-db719a5d5f49' failed. Not Retrying. {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 10 04:46:29 devstack cinder-volume[87444]: DEBUG cinder.volume.volume_utils [None req-701af10e-fe27-463a-8cdf-963867660a5a tempest-VolumesGetTest-423200778 None] Downloaded image 5ac2ee4b-64bc-499a-b553-ae96ba343fc0 ((None, [{'url': 'file:///opt/stack/data/glance/images/5ac2ee4b-64bc-499a-b553-ae96ba343fc0', 'metadata': {}}])) to volume 328eb4c5-f16d-446a-8d0a-db719a5d5f49 successfully. {{(pid=87444) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jul 10 04:46:29 devstack cinder-volume[87444]: DEBUG cinder.image.image_utils [None req-701af10e-fe27-463a-8cdf-963867660a5a tempest-VolumesGetTest-423200778 None] Temporary image 5ac2ee4b-64bc-499a-b553-ae96ba343fc0 for user ae02b9a0cfaa4f7d8fd6393dfd0bb7b6 is deleted. {{(pid=87444) fetch /opt/stack/cinder/cinder/image/image_utils.py:1468}} Jul 10 04:46:29 devstack cinder-volume[87444]: DEBUG cinder.volume.volume_utils [None req-701af10e-fe27-463a-8cdf-963867660a5a tempest-VolumesGetTest-423200778 None] Marking volume 328eb4c5-f16d-446a-8d0a-db719a5d5f49 as bootable. {{(pid=87444) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jul 10 04:46:29 devstack cinder-volume[87444]: DEBUG cinder.volume.flows.manager.create_volume [None req-701af10e-fe27-463a-8cdf-963867660a5a tempest-VolumesGetTest-423200778 None] Copying metadata from image 5ac2ee4b-64bc-499a-b553-ae96ba343fc0 to 328eb4c5-f16d-446a-8d0a-db719a5d5f49. {{(pid=87444) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jul 10 04:46:29 devstack cinder-volume[87444]: DEBUG cinder.volume.flows.manager.create_volume [None req-701af10e-fe27-463a-8cdf-963867660a5a tempest-VolumesGetTest-423200778 None] Creating volume glance metadata for volume 328eb4c5-f16d-446a-8d0a-db719a5d5f49 backed by image 5ac2ee4b-64bc-499a-b553-ae96ba343fc0 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '5ac2ee4b-64bc-499a-b553-ae96ba343fc0', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=87444) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jul 10 04:46:30 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-701af10e-fe27-463a-8cdf-963867660a5a tempest-VolumesGetTest-423200778 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c8a2e6b0-c91e-4b4a-9525-8d79f8becfb2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-328eb4c5-f16d-446a-8d0a-db719a5d5f49', 'volume_size': 1, 'image_id': '5ac2ee4b-64bc-499a-b553-ae96ba343fc0', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/5ac2ee4b-64bc-499a-b553-ae96ba343fc0', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'ca4bb946b593473194351a84617cf92e', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '5ac2ee4b-64bc-499a-b553-ae96ba343fc0', 'created_at': datetime.datetime(2026, 7, 10, 2, 26, 36, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 10, 2, 26, 38, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/5ac2ee4b-64bc-499a-b553-ae96ba343fc0/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:46:30 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-701af10e-fe27-463a-8cdf-963867660a5a tempest-VolumesGetTest-423200778 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (409a9f20-c21b-4162-a1b9-c1a539ae885d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:46:30 devstack cinder-volume[87444]: INFO cinder.volume.flows.manager.create_volume [None req-701af10e-fe27-463a-8cdf-963867660a5a tempest-VolumesGetTest-423200778 None] Volume volume-328eb4c5-f16d-446a-8d0a-db719a5d5f49 (328eb4c5-f16d-446a-8d0a-db719a5d5f49): created successfully Jul 10 04:46:30 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-701af10e-fe27-463a-8cdf-963867660a5a tempest-VolumesGetTest-423200778 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (409a9f20-c21b-4162-a1b9-c1a539ae885d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:46:30 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-701af10e-fe27-463a-8cdf-963867660a5a tempest-VolumesGetTest-423200778 None] Flow 'volume_create_manager' (42ac2b01-dc06-4046-98ac-86be0b1c412c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87444) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 04:46:30 devstack cinder-volume[87444]: INFO cinder.volume.manager [None req-701af10e-fe27-463a-8cdf-963867660a5a tempest-VolumesGetTest-423200778 None] Created volume successfully. Jul 10 04:46:30 devstack sudo[99521]: pam_unix(sudo:session): session closed for user root Jul 10 04:46:30 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-a7b30570-d3a9-46a8-8dea-fe5335e95d71 tempest-VolumesSnapshotNegativeTestJSON-594286395 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-a749a086-f508-45de-a8f7-fa00452e799d.info" returned: 0 in 0.985s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:46:30 devstack cinder-volume[87444]: WARNING cinder.volume.drivers.remotefs [None req-a7b30570-d3a9-46a8-8dea-fe5335e95d71 tempest-VolumesSnapshotNegativeTestJSON-594286395 None] /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-a749a086-f508-45de-a8f7-fa00452e799d.info is being set with open permissions: ugo+rw Jul 10 04:46:30 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-a7b30570-d3a9-46a8-8dea-fe5335e95d71 tempest-VolumesSnapshotNegativeTestJSON-594286395 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-a749a086-f508-45de-a8f7-fa00452e799d.info {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:46:30 devstack sudo[99568]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-a749a086-f508-45de-a8f7-fa00452e799d.info Jul 10 04:46:30 devstack sudo[99568]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:46:31 devstack sudo[99568]: pam_unix(sudo:session): session closed for user root Jul 10 04:46:31 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-a7b30570-d3a9-46a8-8dea-fe5335e95d71 tempest-VolumesSnapshotNegativeTestJSON-594286395 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-a749a086-f508-45de-a8f7-fa00452e799d.info" returned: 0 in 1.044s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:46:31 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-a7b30570-d3a9-46a8-8dea-fe5335e95d71 tempest-VolumesSnapshotNegativeTestJSON-594286395 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.640s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 04:46:31 devstack cinder-volume[87444]: INFO cinder.volume.manager [None req-a7b30570-d3a9-46a8-8dea-fe5335e95d71 tempest-VolumesSnapshotNegativeTestJSON-594286395 None] Create snapshot completed successfully Jul 10 04:46:31 devstack cinder-volume[87444]: DEBUG cinder.volume.flows.manager.create_volume [None req-3a66604c-334e-4be5-a98f-b1ff7e1e73a5 tempest-VolumesGetTest-423200778 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87444) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 04:46:31 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-3a66604c-334e-4be5-a98f-b1ff7e1e73a5 tempest-VolumesGetTest-423200778 None] Flow 'volume_create_manager' (64038a48-ec00-4d6c-8517-98bd1e1c91ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 04:46:31 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-3a66604c-334e-4be5-a98f-b1ff7e1e73a5 tempest-VolumesGetTest-423200778 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f8a1b95a-1519-4c5d-a568-94859362a0e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:46:31 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-3a66604c-334e-4be5-a98f-b1ff7e1e73a5 tempest-VolumesGetTest-423200778 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f8a1b95a-1519-4c5d-a568-94859362a0e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T02:46:32Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-382704318',display_name='tempest-VolumesGetTest-Volume-1111470856',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5105ed4a-1e2b-4175-9140-51247988aa20,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='761a9e430aba4ae18bd6ef42f16015f4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T02:46:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T02:46:32Z,use_quota=True,user_id='ae02b9a0cfaa4f7d8fd6393dfd0bb7b6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(317e369e-1e06-434d-ae95-a335f0e6c903),volume_type_id=317e369e-1e06-434d-ae95-a335f0e6c903)' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:46:31 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-3a66604c-334e-4be5-a98f-b1ff7e1e73a5 tempest-VolumesGetTest-423200778 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8d4dc09a-bb33-4d0f-a808-74153da98a43) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:46:31 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-3a66604c-334e-4be5-a98f-b1ff7e1e73a5 tempest-VolumesGetTest-423200778 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8d4dc09a-bb33-4d0f-a808-74153da98a43) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:46:31 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-3a66604c-334e-4be5-a98f-b1ff7e1e73a5 tempest-VolumesGetTest-423200778 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d0896e14-b60e-435f-989f-1543109a0e52) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:46:31 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-3a66604c-334e-4be5-a98f-b1ff7e1e73a5 tempest-VolumesGetTest-423200778 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d0896e14-b60e-435f-989f-1543109a0e52) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5105ed4a-1e2b-4175-9140-51247988aa20', 'volume_name': 'volume-5105ed4a-1e2b-4175-9140-51247988aa20', 'volume_size': 1}' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:46:32 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-3a66604c-334e-4be5-a98f-b1ff7e1e73a5 tempest-VolumesGetTest-423200778 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (80823da9-c8bf-418d-a3a5-aaa41b51f28a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:46:32 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-3a66604c-334e-4be5-a98f-b1ff7e1e73a5 tempest-VolumesGetTest-423200778 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (80823da9-c8bf-418d-a3a5-aaa41b51f28a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:46:32 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-3a66604c-334e-4be5-a98f-b1ff7e1e73a5 tempest-VolumesGetTest-423200778 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (49b41487-020f-47c1-94bd-363f5ae2ef19) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:46:32 devstack cinder-volume[87444]: INFO cinder.volume.flows.manager.create_volume [None req-3a66604c-334e-4be5-a98f-b1ff7e1e73a5 tempest-VolumesGetTest-423200778 None] Volume 5105ed4a-1e2b-4175-9140-51247988aa20: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5105ed4a-1e2b-4175-9140-51247988aa20', 'volume_size': 1} Jul 10 04:46:32 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-3a66604c-334e-4be5-a98f-b1ff7e1e73a5 tempest-VolumesGetTest-423200778 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 04:46:32 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-3a66604c-334e-4be5-a98f-b1ff7e1e73a5 tempest-VolumesGetTest-423200778 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 04:46:32 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-3a66604c-334e-4be5-a98f-b1ff7e1e73a5 tempest-VolumesGetTest-423200778 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T02:46:32Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-382704318',display_name='tempest-VolumesGetTest-Volume-1111470856',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5105ed4a-1e2b-4175-9140-51247988aa20,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='761a9e430aba4ae18bd6ef42f16015f4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T02:46:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T02:46:32Z,use_quota=True,user_id='ae02b9a0cfaa4f7d8fd6393dfd0bb7b6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(317e369e-1e06-434d-ae95-a335f0e6c903),volume_type_id=317e369e-1e06-434d-ae95-a335f0e6c903)}" {{(pid=87444) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 04:46:32 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.remotefs [None req-3a66604c-334e-4be5-a98f-b1ff7e1e73a5 tempest-VolumesGetTest-423200778 None] Creating volume 5105ed4a-1e2b-4175-9140-51247988aa20 {{(pid=87444) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 04:46:32 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-3a66604c-334e-4be5-a98f-b1ff7e1e73a5 tempest-VolumesGetTest-423200778 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 04:46:32 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-3a66604c-334e-4be5-a98f-b1ff7e1e73a5 tempest-VolumesGetTest-423200778 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 04:46:32 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-3a66604c-334e-4be5-a98f-b1ff7e1e73a5 tempest-VolumesGetTest-423200778 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922': None} {{(pid=87444) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 04:46:32 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-3a66604c-334e-4be5-a98f-b1ff7e1e73a5 tempest-VolumesGetTest-423200778 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922'] {{(pid=87444) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 04:46:32 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-3a66604c-334e-4be5-a98f-b1ff7e1e73a5 tempest-VolumesGetTest-423200778 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 04:46:32 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-3a66604c-334e-4be5-a98f-b1ff7e1e73a5 tempest-VolumesGetTest-423200778 None] Selected osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922 as target Quobyte volume. {{(pid=87444) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 04:46:32 devstack cinder-volume[87444]: INFO cinder.volume.drivers.remotefs [None req-3a66604c-334e-4be5-a98f-b1ff7e1e73a5 tempest-VolumesGetTest-423200778 None] casted to osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922 Jul 10 04:46:32 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-3a66604c-334e-4be5-a98f-b1ff7e1e73a5 tempest-VolumesGetTest-423200778 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-5105ed4a-1e2b-4175-9140-51247988aa20 1073741824 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:46:32 devstack sudo[99953]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-5105ed4a-1e2b-4175-9140-51247988aa20 1073741824 Jul 10 04:46:32 devstack sudo[99953]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:46:32 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-b007135c-d80e-48cb-b859-ce5926ff394d tempest-VolumesSnapshotNegativeTestJSON-594286395 None] Acquiring lock "cinder-021b8f15-9b7a-4d37-9542-3c13267301d9-delete_snapshot" by "delete_snapshot" {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 04:46:32 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-b007135c-d80e-48cb-b859-ce5926ff394d tempest-VolumesSnapshotNegativeTestJSON-594286395 None] Lock "cinder-021b8f15-9b7a-4d37-9542-3c13267301d9-delete_snapshot" acquired by "delete_snapshot" :: waited 0.032s {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 04:46:32 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-b007135c-d80e-48cb-b859-ce5926ff394d tempest-VolumesSnapshotNegativeTestJSON-594286395 None] Acquiring lock "cinder-quobyte-a749a086-f508-45de-a8f7-fa00452e799d" by "delete_snapshot" {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 04:46:32 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-b007135c-d80e-48cb-b859-ce5926ff394d tempest-VolumesSnapshotNegativeTestJSON-594286395 None] Lock "cinder-quobyte-a749a086-f508-45de-a8f7-fa00452e799d" acquired by "delete_snapshot" :: waited 0.024s {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 04:46:32 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-b007135c-d80e-48cb-b859-ce5926ff394d tempest-VolumesSnapshotNegativeTestJSON-594286395 None] Acquiring lock "cinder-quobyte-021b8f15-9b7a-4d37-9542-3c13267301d9" by "_delete_snapshot" {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 04:46:32 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-b007135c-d80e-48cb-b859-ce5926ff394d tempest-VolumesSnapshotNegativeTestJSON-594286395 None] Lock "cinder-quobyte-021b8f15-9b7a-4d37-9542-3c13267301d9" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 04:46:32 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.remotefs [None req-b007135c-d80e-48cb-b859-ce5926ff394d tempest-VolumesSnapshotNegativeTestJSON-594286395 None] Deleting offline snapshot 021b8f15-9b7a-4d37-9542-3c13267301d9 of volume a749a086-f508-45de-a8f7-fa00452e799d {{(pid=87444) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 10 04:46:32 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.remotefs [None req-b007135c-d80e-48cb-b859-ce5926ff394d tempest-VolumesSnapshotNegativeTestJSON-594286395 None] snapshot_file for this snap is: volume-a749a086-f508-45de-a8f7-fa00452e799d.021b8f15-9b7a-4d37-9542-3c13267301d9 {{(pid=87444) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 10 04:46:32 devstack cinder-volume[87444]: DEBUG oslo.privsep.daemon [-] privsep: reply[57fd2420-755c-45cd-ad1a-b0945cb04300]: (4, 'qcow2') {{(pid=88499) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 04:46:32 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-b007135c-d80e-48cb-b859-ce5926ff394d tempest-VolumesSnapshotNegativeTestJSON-594286395 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-a749a086-f508-45de-a8f7-fa00452e799d.021b8f15-9b7a-4d37-9542-3c13267301d9 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:46:32 devstack sudo[99965]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-a749a086-f508-45de-a8f7-fa00452e799d.021b8f15-9b7a-4d37-9542-3c13267301d9 Jul 10 04:46:32 devstack sudo[99965]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:46:33 devstack cinder-volume[87444]: DEBUG oslo_service.periodic_task [None req-01f0ce3e-6850-4e14-881d-e40d3c4ad6e5 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87444) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 10 04:46:33 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-01f0ce3e-6850-4e14-881d-e40d3c4ad6e5 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 04:46:33 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-01f0ce3e-6850-4e14-881d-e40d3c4ad6e5 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 04:46:33 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-01f0ce3e-6850-4e14-881d-e40d3c4ad6e5 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922': None} {{(pid=87444) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 04:46:33 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-01f0ce3e-6850-4e14-881d-e40d3c4ad6e5 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922'] {{(pid=87444) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 04:46:33 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-01f0ce3e-6850-4e14-881d-e40d3c4ad6e5 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 04:46:33 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-01f0ce3e-6850-4e14-881d-e40d3c4ad6e5 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:46:33 devstack sudo[99973]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097 Jul 10 04:46:33 devstack sudo[99973]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:46:33 devstack sudo[99953]: pam_unix(sudo:session): session closed for user root Jul 10 04:46:33 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-3a66604c-334e-4be5-a98f-b1ff7e1e73a5 tempest-VolumesGetTest-423200778 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-5105ed4a-1e2b-4175-9140-51247988aa20 1073741824" returned: 0 in 1.323s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:46:33 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-3a66604c-334e-4be5-a98f-b1ff7e1e73a5 tempest-VolumesGetTest-423200778 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-5105ed4a-1e2b-4175-9140-51247988aa20 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:46:33 devstack sudo[99978]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-5105ed4a-1e2b-4175-9140-51247988aa20 Jul 10 04:46:33 devstack sudo[99978]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:46:34 devstack sudo[99965]: pam_unix(sudo:session): session closed for user root Jul 10 04:46:34 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-b007135c-d80e-48cb-b859-ce5926ff394d tempest-VolumesSnapshotNegativeTestJSON-594286395 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-a749a086-f508-45de-a8f7-fa00452e799d.021b8f15-9b7a-4d37-9542-3c13267301d9" returned: 0 in 1.598s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:46:34 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.remotefs [None req-b007135c-d80e-48cb-b859-ce5926ff394d tempest-VolumesSnapshotNegativeTestJSON-594286395 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a749a086-f508-45de-a8f7-fa00452e799d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87444) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 10 04:46:34 devstack cinder-volume[87444]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ca4cb63-4745-4d52-8a4a-ebcc396684b0]: (4, 'qcow2') {{(pid=88499) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 04:46:34 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-b007135c-d80e-48cb-b859-ce5926ff394d tempest-VolumesSnapshotNegativeTestJSON-594286395 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-a749a086-f508-45de-a8f7-fa00452e799d {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:46:34 devstack sudo[99983]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-a749a086-f508-45de-a8f7-fa00452e799d Jul 10 04:46:34 devstack sudo[99983]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:46:34 devstack sudo[99973]: pam_unix(sudo:session): session closed for user root Jul 10 04:46:34 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-01f0ce3e-6850-4e14-881d-e40d3c4ad6e5 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097" returned: 0 in 1.773s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:46:34 devstack cinder-volume[87444]: DEBUG cinder.manager [None req-01f0ce3e-6850-4e14-881d-e40d3c4ad6e5 None None] Notifying Schedulers of capabilities ... {{(pid=87444) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 04:46:34 devstack cinder-volume[87444]: DEBUG oslo_service.periodic_task [None req-01f0ce3e-6850-4e14-881d-e40d3c4ad6e5 None None] Running periodic task VolumeManager._thread_info {{(pid=87444) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 10 04:46:34 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-01f0ce3e-6850-4e14-881d-e40d3c4ad6e5 None None] thread count: 28 {{(pid=87444) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 10 04:46:34 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-01f0ce3e-6850-4e14-881d-e40d3c4ad6e5 None None] thread info: [<_MainThread(MainThread, started 126839257915520)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87444) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 10 04:46:34 devstack sudo[99978]: pam_unix(sudo:session): session closed for user root Jul 10 04:46:34 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-3a66604c-334e-4be5-a98f-b1ff7e1e73a5 tempest-VolumesGetTest-423200778 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-5105ed4a-1e2b-4175-9140-51247988aa20" returned: 0 in 1.407s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:46:34 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-3a66604c-334e-4be5-a98f-b1ff7e1e73a5 tempest-VolumesGetTest-423200778 None] <== create_volume: return (2829ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922'} {{(pid=87444) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 04:46:34 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-3a66604c-334e-4be5-a98f-b1ff7e1e73a5 tempest-VolumesGetTest-423200778 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.833s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 04:46:34 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-3a66604c-334e-4be5-a98f-b1ff7e1e73a5 tempest-VolumesGetTest-423200778 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (49b41487-020f-47c1-94bd-363f5ae2ef19) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5105ed4a-1e2b-4175-9140-51247988aa20', 'volume_size': 1}' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:46:34 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-3a66604c-334e-4be5-a98f-b1ff7e1e73a5 tempest-VolumesGetTest-423200778 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1c604a56-052d-471b-8bcc-91d651c01c20) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:46:34 devstack cinder-volume[87444]: INFO cinder.volume.flows.manager.create_volume [None req-3a66604c-334e-4be5-a98f-b1ff7e1e73a5 tempest-VolumesGetTest-423200778 None] Volume volume-5105ed4a-1e2b-4175-9140-51247988aa20 (5105ed4a-1e2b-4175-9140-51247988aa20): created successfully Jul 10 04:46:34 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-3a66604c-334e-4be5-a98f-b1ff7e1e73a5 tempest-VolumesGetTest-423200778 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1c604a56-052d-471b-8bcc-91d651c01c20) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:46:34 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-3a66604c-334e-4be5-a98f-b1ff7e1e73a5 tempest-VolumesGetTest-423200778 None] Flow 'volume_create_manager' (64038a48-ec00-4d6c-8517-98bd1e1c91ec) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87444) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 04:46:34 devstack cinder-volume[87444]: INFO cinder.volume.manager [None req-3a66604c-334e-4be5-a98f-b1ff7e1e73a5 tempest-VolumesGetTest-423200778 None] Created volume successfully. Jul 10 04:46:36 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-8b27d10a-40ff-49e0-878f-639322f35ed7 tempest-VolumesGetTest-423200778 None] Acquiring lock "cinder-5105ed4a-1e2b-4175-9140-51247988aa20-delete_volume" by "delete_volume" {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 04:46:36 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-8b27d10a-40ff-49e0-878f-639322f35ed7 tempest-VolumesGetTest-423200778 None] Lock "cinder-5105ed4a-1e2b-4175-9140-51247988aa20-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 04:46:36 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-8b27d10a-40ff-49e0-878f-639322f35ed7 tempest-VolumesGetTest-423200778 None] Acquiring lock "cinder-quobyte-5105ed4a-1e2b-4175-9140-51247988aa20" by "delete_volume" {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 04:46:36 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-8b27d10a-40ff-49e0-878f-639322f35ed7 tempest-VolumesGetTest-423200778 None] Lock "cinder-quobyte-5105ed4a-1e2b-4175-9140-51247988aa20" acquired by "delete_volume" :: waited 0.047s {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 04:46:36 devstack cinder-volume[87444]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e771712-721c-442a-8a0d-48b05d108acf]: (4, 'qcow2') {{(pid=88499) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 04:46:36 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-8b27d10a-40ff-49e0-878f-639322f35ed7 tempest-VolumesGetTest-423200778 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-5105ed4a-1e2b-4175-9140-51247988aa20 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:46:36 devstack sudo[100026]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-5105ed4a-1e2b-4175-9140-51247988aa20 Jul 10 04:46:36 devstack sudo[100026]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:46:36 devstack sudo[99983]: pam_unix(sudo:session): session closed for user root Jul 10 04:46:36 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-b007135c-d80e-48cb-b859-ce5926ff394d tempest-VolumesSnapshotNegativeTestJSON-594286395 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-a749a086-f508-45de-a8f7-fa00452e799d" returned: 0 in 2.434s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:46:36 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-b007135c-d80e-48cb-b859-ce5926ff394d tempest-VolumesSnapshotNegativeTestJSON-594286395 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-a749a086-f508-45de-a8f7-fa00452e799d.021b8f15-9b7a-4d37-9542-3c13267301d9 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:46:36 devstack sudo[100030]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-a749a086-f508-45de-a8f7-fa00452e799d.021b8f15-9b7a-4d37-9542-3c13267301d9 Jul 10 04:46:36 devstack sudo[100030]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:46:38 devstack sudo[100026]: pam_unix(sudo:session): session closed for user root Jul 10 04:46:38 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-8b27d10a-40ff-49e0-878f-639322f35ed7 tempest-VolumesGetTest-423200778 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-5105ed4a-1e2b-4175-9140-51247988aa20" returned: 0 in 1.997s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:46:38 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-8b27d10a-40ff-49e0-878f-639322f35ed7 tempest-VolumesGetTest-423200778 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-5105ed4a-1e2b-4175-9140-51247988aa20 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:46:38 devstack sudo[100045]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-5105ed4a-1e2b-4175-9140-51247988aa20 Jul 10 04:46:38 devstack sudo[100045]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:46:38 devstack sudo[100030]: pam_unix(sudo:session): session closed for user root Jul 10 04:46:38 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-b007135c-d80e-48cb-b859-ce5926ff394d tempest-VolumesSnapshotNegativeTestJSON-594286395 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-a749a086-f508-45de-a8f7-fa00452e799d.021b8f15-9b7a-4d37-9542-3c13267301d9" returned: 0 in 2.070s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:46:38 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-b007135c-d80e-48cb-b859-ce5926ff394d tempest-VolumesSnapshotNegativeTestJSON-594286395 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-a749a086-f508-45de-a8f7-fa00452e799d.021b8f15-9b7a-4d37-9542-3c13267301d9 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:46:38 devstack sudo[100047]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-a749a086-f508-45de-a8f7-fa00452e799d.021b8f15-9b7a-4d37-9542-3c13267301d9 Jul 10 04:46:38 devstack sudo[100047]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:46:40 devstack sudo[100045]: pam_unix(sudo:session): session closed for user root Jul 10 04:46:40 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-8b27d10a-40ff-49e0-878f-639322f35ed7 tempest-VolumesGetTest-423200778 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-5105ed4a-1e2b-4175-9140-51247988aa20" returned: 0 in 1.758s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:46:40 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-8b27d10a-40ff-49e0-878f-639322f35ed7 tempest-VolumesGetTest-423200778 None] Lock "cinder-quobyte-5105ed4a-1e2b-4175-9140-51247988aa20" released by "delete_volume" :: held 3.872s {{(pid=87444) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 04:46:40 devstack cinder-volume[87444]: DEBUG cinder.quota [None req-8b27d10a-40ff-49e0-878f-639322f35ed7 tempest-VolumesGetTest-423200778 None] Created reservations ['130e33cc-c0c6-45ac-b805-6d7011679c01', 'd8d6046c-3f9c-4308-a88a-83f682706ddc', '6039e210-897a-41f0-9b63-bbd552c129da', 'b10a0135-5a8e-4cd4-bee1-0d89cee109bd'] {{(pid=87444) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 04:46:40 devstack sudo[100047]: pam_unix(sudo:session): session closed for user root Jul 10 04:46:40 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-b007135c-d80e-48cb-b859-ce5926ff394d tempest-VolumesSnapshotNegativeTestJSON-594286395 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-a749a086-f508-45de-a8f7-fa00452e799d.021b8f15-9b7a-4d37-9542-3c13267301d9" returned: 0 in 1.741s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:46:40 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-8b27d10a-40ff-49e0-878f-639322f35ed7 tempest-VolumesGetTest-423200778 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 04:46:40 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-8b27d10a-40ff-49e0-878f-639322f35ed7 tempest-VolumesGetTest-423200778 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 04:46:40 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-8b27d10a-40ff-49e0-878f-639322f35ed7 tempest-VolumesGetTest-423200778 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922': None} {{(pid=87444) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 04:46:40 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-8b27d10a-40ff-49e0-878f-639322f35ed7 tempest-VolumesGetTest-423200778 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922'] {{(pid=87444) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 04:46:40 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-8b27d10a-40ff-49e0-878f-639322f35ed7 tempest-VolumesGetTest-423200778 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 04:46:40 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-8b27d10a-40ff-49e0-878f-639322f35ed7 tempest-VolumesGetTest-423200778 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:46:40 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-b007135c-d80e-48cb-b859-ce5926ff394d tempest-VolumesSnapshotNegativeTestJSON-594286395 None] Lock "cinder-quobyte-021b8f15-9b7a-4d37-9542-3c13267301d9" released by "_delete_snapshot" :: held 8.188s {{(pid=87444) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 04:46:40 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-b007135c-d80e-48cb-b859-ce5926ff394d tempest-VolumesSnapshotNegativeTestJSON-594286395 None] Lock "cinder-quobyte-a749a086-f508-45de-a8f7-fa00452e799d" released by "delete_snapshot" :: held 8.243s {{(pid=87444) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 04:46:40 devstack sudo[100052]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097 Jul 10 04:46:40 devstack sudo[100052]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:46:41 devstack cinder-volume[87444]: DEBUG cinder.quota [None req-b007135c-d80e-48cb-b859-ce5926ff394d tempest-VolumesSnapshotNegativeTestJSON-594286395 None] Created reservations ['9d8e71c1-e85d-4a9d-925b-e90b3268b320', '0399987f-566f-4160-bd42-6a6c8837f930', 'b8ea3988-2bd0-4f1a-b0c2-8616806c4af1', '9a5b2914-5da9-478b-b062-a4aca87ba306'] {{(pid=87444) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 04:46:41 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-1972d8e9-3ce5-445e-827d-e660d467921c tempest-VolumesGetTest-423200778 None] Acquiring lock "cinder-328eb4c5-f16d-446a-8d0a-db719a5d5f49-delete_volume" by "delete_volume" {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 04:46:41 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-1972d8e9-3ce5-445e-827d-e660d467921c tempest-VolumesGetTest-423200778 None] Lock "cinder-328eb4c5-f16d-446a-8d0a-db719a5d5f49-delete_volume" acquired by "delete_volume" :: waited 0.090s {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 04:46:41 devstack cinder-volume[87444]: INFO cinder.volume.manager [None req-b007135c-d80e-48cb-b859-ce5926ff394d tempest-VolumesSnapshotNegativeTestJSON-594286395 None] Delete snapshot completed successfully. Jul 10 04:46:41 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-1972d8e9-3ce5-445e-827d-e660d467921c tempest-VolumesGetTest-423200778 None] Acquiring lock "cinder-quobyte-328eb4c5-f16d-446a-8d0a-db719a5d5f49" by "delete_volume" {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 04:46:41 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-b007135c-d80e-48cb-b859-ce5926ff394d tempest-VolumesSnapshotNegativeTestJSON-594286395 None] Lock "cinder-021b8f15-9b7a-4d37-9542-3c13267301d9-delete_snapshot" released by "delete_snapshot" :: held 9.032s {{(pid=87444) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 04:46:41 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-1972d8e9-3ce5-445e-827d-e660d467921c tempest-VolumesGetTest-423200778 None] Lock "cinder-quobyte-328eb4c5-f16d-446a-8d0a-db719a5d5f49" acquired by "delete_volume" :: waited 0.039s {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 04:46:41 devstack cinder-volume[87444]: DEBUG oslo.privsep.daemon [-] privsep: reply[af8d9bfb-baf3-4539-aeb4-05138c3b3c8c]: (4, 'raw') {{(pid=88499) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 04:46:41 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-1972d8e9-3ce5-445e-827d-e660d467921c tempest-VolumesGetTest-423200778 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-328eb4c5-f16d-446a-8d0a-db719a5d5f49 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:46:41 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-12f4f05b-7792-4e06-8bc6-72dbd7706865 tempest-VolumesSnapshotNegativeTestJSON-594286395 None] Acquiring lock "cinder-a749a086-f508-45de-a8f7-fa00452e799d-delete_volume" by "delete_volume" {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 04:46:41 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-12f4f05b-7792-4e06-8bc6-72dbd7706865 tempest-VolumesSnapshotNegativeTestJSON-594286395 None] Lock "cinder-a749a086-f508-45de-a8f7-fa00452e799d-delete_volume" acquired by "delete_volume" :: waited 0.075s {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 04:46:41 devstack sudo[100055]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-328eb4c5-f16d-446a-8d0a-db719a5d5f49 Jul 10 04:46:41 devstack sudo[100055]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:46:41 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-12f4f05b-7792-4e06-8bc6-72dbd7706865 tempest-VolumesSnapshotNegativeTestJSON-594286395 None] Acquiring lock "cinder-quobyte-a749a086-f508-45de-a8f7-fa00452e799d" by "delete_volume" {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 04:46:42 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-12f4f05b-7792-4e06-8bc6-72dbd7706865 tempest-VolumesSnapshotNegativeTestJSON-594286395 None] Lock "cinder-quobyte-a749a086-f508-45de-a8f7-fa00452e799d" acquired by "delete_volume" :: waited 0.030s {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 04:46:42 devstack cinder-volume[87444]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c9ad039-170d-4072-8d65-295c411b8415]: (4, 'qcow2') {{(pid=88499) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 04:46:42 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-12f4f05b-7792-4e06-8bc6-72dbd7706865 tempest-VolumesSnapshotNegativeTestJSON-594286395 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-a749a086-f508-45de-a8f7-fa00452e799d {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:46:42 devstack sudo[100057]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-a749a086-f508-45de-a8f7-fa00452e799d Jul 10 04:46:42 devstack sudo[100057]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:46:42 devstack sudo[100052]: pam_unix(sudo:session): session closed for user root Jul 10 04:46:42 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-8b27d10a-40ff-49e0-878f-639322f35ed7 tempest-VolumesGetTest-423200778 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097" returned: 0 in 2.248s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:46:42 devstack cinder-volume[87444]: DEBUG cinder.manager [None req-8b27d10a-40ff-49e0-878f-639322f35ed7 tempest-VolumesGetTest-423200778 None] Notifying Schedulers of capabilities ... {{(pid=87444) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 04:46:42 devstack cinder-volume[87444]: INFO cinder.volume.manager [None req-8b27d10a-40ff-49e0-878f-639322f35ed7 tempest-VolumesGetTest-423200778 None] Deleted volume successfully. Jul 10 04:46:42 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-8b27d10a-40ff-49e0-878f-639322f35ed7 tempest-VolumesGetTest-423200778 None] Lock "cinder-5105ed4a-1e2b-4175-9140-51247988aa20-delete_volume" released by "delete_volume" :: held 6.860s {{(pid=87444) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 04:46:43 devstack sudo[100055]: pam_unix(sudo:session): session closed for user root Jul 10 04:46:43 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-1972d8e9-3ce5-445e-827d-e660d467921c tempest-VolumesGetTest-423200778 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-328eb4c5-f16d-446a-8d0a-db719a5d5f49" returned: 0 in 2.090s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:46:43 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-1972d8e9-3ce5-445e-827d-e660d467921c tempest-VolumesGetTest-423200778 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-328eb4c5-f16d-446a-8d0a-db719a5d5f49 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:46:43 devstack sudo[100063]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-328eb4c5-f16d-446a-8d0a-db719a5d5f49 Jul 10 04:46:43 devstack sudo[100063]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:46:44 devstack sudo[100057]: pam_unix(sudo:session): session closed for user root Jul 10 04:46:44 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-12f4f05b-7792-4e06-8bc6-72dbd7706865 tempest-VolumesSnapshotNegativeTestJSON-594286395 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-a749a086-f508-45de-a8f7-fa00452e799d" returned: 0 in 2.273s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:46:44 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-12f4f05b-7792-4e06-8bc6-72dbd7706865 tempest-VolumesSnapshotNegativeTestJSON-594286395 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-a749a086-f508-45de-a8f7-fa00452e799d {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:46:44 devstack sudo[100068]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-a749a086-f508-45de-a8f7-fa00452e799d Jul 10 04:46:44 devstack sudo[100068]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:46:46 devstack sudo[100063]: pam_unix(sudo:session): session closed for user root Jul 10 04:46:46 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-1972d8e9-3ce5-445e-827d-e660d467921c tempest-VolumesGetTest-423200778 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-328eb4c5-f16d-446a-8d0a-db719a5d5f49" returned: 1 in 2.367s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:46:46 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-1972d8e9-3ce5-445e-827d-e660d467921c tempest-VolumesGetTest-423200778 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-328eb4c5-f16d-446a-8d0a-db719a5d5f49' failed. Not Retrying. {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 10 04:46:46 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-1972d8e9-3ce5-445e-827d-e660d467921c tempest-VolumesGetTest-423200778 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-328eb4c5-f16d-446a-8d0a-db719a5d5f49 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:46:46 devstack sudo[100082]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-328eb4c5-f16d-446a-8d0a-db719a5d5f49 Jul 10 04:46:46 devstack sudo[100082]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:46:46 devstack sudo[100068]: pam_unix(sudo:session): session closed for user root Jul 10 04:46:46 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-12f4f05b-7792-4e06-8bc6-72dbd7706865 tempest-VolumesSnapshotNegativeTestJSON-594286395 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-a749a086-f508-45de-a8f7-fa00452e799d" returned: 0 in 2.073s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:46:46 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-12f4f05b-7792-4e06-8bc6-72dbd7706865 tempest-VolumesSnapshotNegativeTestJSON-594286395 None] Lock "cinder-quobyte-a749a086-f508-45de-a8f7-fa00452e799d" released by "delete_volume" :: held 4.498s {{(pid=87444) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 04:46:46 devstack cinder-volume[87444]: DEBUG cinder.quota [None req-12f4f05b-7792-4e06-8bc6-72dbd7706865 tempest-VolumesSnapshotNegativeTestJSON-594286395 None] Created reservations ['c48229a5-c61f-4a85-9cee-00cb85fb426a', 'b25bac60-b225-422b-b32b-7fd9548576ef', '706135be-40fe-44f3-841f-16130d3ce782', 'c7849c1c-daec-4314-8c09-39e63f09fdab'] {{(pid=87444) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 04:46:46 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-12f4f05b-7792-4e06-8bc6-72dbd7706865 tempest-VolumesSnapshotNegativeTestJSON-594286395 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 04:46:46 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-12f4f05b-7792-4e06-8bc6-72dbd7706865 tempest-VolumesSnapshotNegativeTestJSON-594286395 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 04:46:46 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-12f4f05b-7792-4e06-8bc6-72dbd7706865 tempest-VolumesSnapshotNegativeTestJSON-594286395 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922': None} {{(pid=87444) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 04:46:46 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-12f4f05b-7792-4e06-8bc6-72dbd7706865 tempest-VolumesSnapshotNegativeTestJSON-594286395 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922'] {{(pid=87444) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 04:46:46 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-12f4f05b-7792-4e06-8bc6-72dbd7706865 tempest-VolumesSnapshotNegativeTestJSON-594286395 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 04:46:46 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-12f4f05b-7792-4e06-8bc6-72dbd7706865 tempest-VolumesSnapshotNegativeTestJSON-594286395 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:46:46 devstack sudo[100084]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097 Jul 10 04:46:46 devstack sudo[100084]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:46:47 devstack sudo[100082]: pam_unix(sudo:session): session closed for user root Jul 10 04:46:47 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-1972d8e9-3ce5-445e-827d-e660d467921c tempest-VolumesGetTest-423200778 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-328eb4c5-f16d-446a-8d0a-db719a5d5f49" returned: 0 in 1.339s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:46:47 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-1972d8e9-3ce5-445e-827d-e660d467921c tempest-VolumesGetTest-423200778 None] Lock "cinder-quobyte-328eb4c5-f16d-446a-8d0a-db719a5d5f49" released by "delete_volume" :: held 5.918s {{(pid=87444) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 04:46:47 devstack cinder-volume[87444]: DEBUG cinder.quota [None req-1972d8e9-3ce5-445e-827d-e660d467921c tempest-VolumesGetTest-423200778 None] Created reservations ['ca0bab34-a144-4d82-a9e3-0a5635573142', 'f04b9004-6e2a-4d42-b239-3e5713e3097e', '5ab734e2-dbb5-46da-8aab-04b39d84e7da', '42ee0c00-11af-4a1f-a975-b1f9e832cbf6'] {{(pid=87444) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 04:46:47 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-1972d8e9-3ce5-445e-827d-e660d467921c tempest-VolumesGetTest-423200778 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 04:46:47 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-1972d8e9-3ce5-445e-827d-e660d467921c tempest-VolumesGetTest-423200778 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 04:46:47 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-1972d8e9-3ce5-445e-827d-e660d467921c tempest-VolumesGetTest-423200778 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922': None} {{(pid=87444) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 04:46:47 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-1972d8e9-3ce5-445e-827d-e660d467921c tempest-VolumesGetTest-423200778 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922'] {{(pid=87444) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 04:46:47 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-1972d8e9-3ce5-445e-827d-e660d467921c tempest-VolumesGetTest-423200778 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.028s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 04:46:47 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-1972d8e9-3ce5-445e-827d-e660d467921c tempest-VolumesGetTest-423200778 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:46:47 devstack sudo[100087]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097 Jul 10 04:46:47 devstack sudo[100087]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:46:48 devstack sudo[100084]: pam_unix(sudo:session): session closed for user root Jul 10 04:46:48 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-12f4f05b-7792-4e06-8bc6-72dbd7706865 tempest-VolumesSnapshotNegativeTestJSON-594286395 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097" returned: 0 in 1.395s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:46:48 devstack cinder-volume[87444]: DEBUG cinder.manager [None req-12f4f05b-7792-4e06-8bc6-72dbd7706865 tempest-VolumesSnapshotNegativeTestJSON-594286395 None] Notifying Schedulers of capabilities ... {{(pid=87444) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 04:46:48 devstack cinder-volume[87444]: INFO cinder.volume.manager [None req-12f4f05b-7792-4e06-8bc6-72dbd7706865 tempest-VolumesSnapshotNegativeTestJSON-594286395 None] Deleted volume successfully. Jul 10 04:46:48 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-12f4f05b-7792-4e06-8bc6-72dbd7706865 tempest-VolumesSnapshotNegativeTestJSON-594286395 None] Lock "cinder-a749a086-f508-45de-a8f7-fa00452e799d-delete_volume" released by "delete_volume" :: held 6.448s {{(pid=87444) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 04:46:49 devstack sudo[100087]: pam_unix(sudo:session): session closed for user root Jul 10 04:46:49 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-1972d8e9-3ce5-445e-827d-e660d467921c tempest-VolumesGetTest-423200778 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097" returned: 0 in 1.495s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:46:49 devstack cinder-volume[87444]: DEBUG cinder.manager [None req-1972d8e9-3ce5-445e-827d-e660d467921c tempest-VolumesGetTest-423200778 None] Notifying Schedulers of capabilities ... {{(pid=87444) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 04:46:49 devstack cinder-volume[87444]: INFO cinder.volume.manager [None req-1972d8e9-3ce5-445e-827d-e660d467921c tempest-VolumesGetTest-423200778 None] Deleted volume successfully. Jul 10 04:46:49 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-1972d8e9-3ce5-445e-827d-e660d467921c tempest-VolumesGetTest-423200778 None] Lock "cinder-328eb4c5-f16d-446a-8d0a-db719a5d5f49-delete_volume" released by "delete_volume" :: held 7.845s {{(pid=87444) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 04:46:52 devstack cinder-volume[87444]: DEBUG cinder.volume.flows.manager.create_volume [None req-fc6e1121-d4c2-4f15-ac4d-6fab965a93f0 tempest-VolumesListTestJSON-1134650599 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87444) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 04:46:52 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-fc6e1121-d4c2-4f15-ac4d-6fab965a93f0 tempest-VolumesListTestJSON-1134650599 None] Flow 'volume_create_manager' (215d2887-70fe-49a6-8c81-2b45915ce6d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 04:46:53 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-fc6e1121-d4c2-4f15-ac4d-6fab965a93f0 tempest-VolumesListTestJSON-1134650599 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7d21b5ec-bae2-4dae-b456-60d2ff5ffecb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:46:53 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-fc6e1121-d4c2-4f15-ac4d-6fab965a93f0 tempest-VolumesListTestJSON-1134650599 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7d21b5ec-bae2-4dae-b456-60d2ff5ffecb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T02:46:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1319337703',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d4c9dca3-dc4c-47eb-8525-96c0d7fdc536,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='cb26e61de05a46e0889334626c33ba43',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T02:46:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T02:46:53Z,use_quota=True,user_id='77038d59a8d9404c8ee01aa17409e156',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(317e369e-1e06-434d-ae95-a335f0e6c903),volume_type_id=317e369e-1e06-434d-ae95-a335f0e6c903)' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:46:53 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-fc6e1121-d4c2-4f15-ac4d-6fab965a93f0 tempest-VolumesListTestJSON-1134650599 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f44367cf-f0d6-4d03-911b-1e12eadc936c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:46:53 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-fc6e1121-d4c2-4f15-ac4d-6fab965a93f0 tempest-VolumesListTestJSON-1134650599 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f44367cf-f0d6-4d03-911b-1e12eadc936c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:46:53 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-fc6e1121-d4c2-4f15-ac4d-6fab965a93f0 tempest-VolumesListTestJSON-1134650599 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c3f3a9d4-befa-4ffc-803d-6df936fd3171) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:46:53 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-fc6e1121-d4c2-4f15-ac4d-6fab965a93f0 tempest-VolumesListTestJSON-1134650599 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c3f3a9d4-befa-4ffc-803d-6df936fd3171) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd4c9dca3-dc4c-47eb-8525-96c0d7fdc536', 'volume_name': 'volume-d4c9dca3-dc4c-47eb-8525-96c0d7fdc536', 'volume_size': 1}' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:46:53 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-fc6e1121-d4c2-4f15-ac4d-6fab965a93f0 tempest-VolumesListTestJSON-1134650599 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1b5969cb-aefb-44a3-8694-35f0e1ed3ad8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:46:53 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-fc6e1121-d4c2-4f15-ac4d-6fab965a93f0 tempest-VolumesListTestJSON-1134650599 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1b5969cb-aefb-44a3-8694-35f0e1ed3ad8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:46:53 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-fc6e1121-d4c2-4f15-ac4d-6fab965a93f0 tempest-VolumesListTestJSON-1134650599 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9adf01e5-5bd2-4426-84a7-18cb67268a68) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:46:53 devstack cinder-volume[87444]: INFO cinder.volume.flows.manager.create_volume [None req-fc6e1121-d4c2-4f15-ac4d-6fab965a93f0 tempest-VolumesListTestJSON-1134650599 None] Volume d4c9dca3-dc4c-47eb-8525-96c0d7fdc536: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d4c9dca3-dc4c-47eb-8525-96c0d7fdc536', 'volume_size': 1} Jul 10 04:46:53 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-fc6e1121-d4c2-4f15-ac4d-6fab965a93f0 tempest-VolumesListTestJSON-1134650599 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 04:46:53 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-fc6e1121-d4c2-4f15-ac4d-6fab965a93f0 tempest-VolumesListTestJSON-1134650599 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 04:46:53 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-fc6e1121-d4c2-4f15-ac4d-6fab965a93f0 tempest-VolumesListTestJSON-1134650599 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T02:46:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1319337703',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d4c9dca3-dc4c-47eb-8525-96c0d7fdc536,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='cb26e61de05a46e0889334626c33ba43',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T02:46:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T02:46:53Z,use_quota=True,user_id='77038d59a8d9404c8ee01aa17409e156',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(317e369e-1e06-434d-ae95-a335f0e6c903),volume_type_id=317e369e-1e06-434d-ae95-a335f0e6c903)}" {{(pid=87444) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 04:46:53 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.remotefs [None req-fc6e1121-d4c2-4f15-ac4d-6fab965a93f0 tempest-VolumesListTestJSON-1134650599 None] Creating volume d4c9dca3-dc4c-47eb-8525-96c0d7fdc536 {{(pid=87444) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 04:46:53 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-fc6e1121-d4c2-4f15-ac4d-6fab965a93f0 tempest-VolumesListTestJSON-1134650599 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 04:46:53 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-fc6e1121-d4c2-4f15-ac4d-6fab965a93f0 tempest-VolumesListTestJSON-1134650599 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 04:46:53 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-fc6e1121-d4c2-4f15-ac4d-6fab965a93f0 tempest-VolumesListTestJSON-1134650599 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922': None} {{(pid=87444) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 04:46:53 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-fc6e1121-d4c2-4f15-ac4d-6fab965a93f0 tempest-VolumesListTestJSON-1134650599 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922'] {{(pid=87444) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 04:46:53 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-fc6e1121-d4c2-4f15-ac4d-6fab965a93f0 tempest-VolumesListTestJSON-1134650599 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 04:46:53 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-fc6e1121-d4c2-4f15-ac4d-6fab965a93f0 tempest-VolumesListTestJSON-1134650599 None] Selected osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922 as target Quobyte volume. {{(pid=87444) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 04:46:53 devstack cinder-volume[87444]: INFO cinder.volume.drivers.remotefs [None req-fc6e1121-d4c2-4f15-ac4d-6fab965a93f0 tempest-VolumesListTestJSON-1134650599 None] casted to osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922 Jul 10 04:46:53 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-fc6e1121-d4c2-4f15-ac4d-6fab965a93f0 tempest-VolumesListTestJSON-1134650599 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-d4c9dca3-dc4c-47eb-8525-96c0d7fdc536 1073741824 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:46:53 devstack sudo[100210]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-d4c9dca3-dc4c-47eb-8525-96c0d7fdc536 1073741824 Jul 10 04:46:53 devstack sudo[100210]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:46:54 devstack sudo[100210]: pam_unix(sudo:session): session closed for user root Jul 10 04:46:54 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-fc6e1121-d4c2-4f15-ac4d-6fab965a93f0 tempest-VolumesListTestJSON-1134650599 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-d4c9dca3-dc4c-47eb-8525-96c0d7fdc536 1073741824" returned: 0 in 0.960s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:46:54 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-fc6e1121-d4c2-4f15-ac4d-6fab965a93f0 tempest-VolumesListTestJSON-1134650599 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-d4c9dca3-dc4c-47eb-8525-96c0d7fdc536 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:46:54 devstack sudo[100218]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-d4c9dca3-dc4c-47eb-8525-96c0d7fdc536 Jul 10 04:46:54 devstack sudo[100218]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:46:54 devstack sudo[100218]: pam_unix(sudo:session): session closed for user root Jul 10 04:46:54 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-fc6e1121-d4c2-4f15-ac4d-6fab965a93f0 tempest-VolumesListTestJSON-1134650599 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-d4c9dca3-dc4c-47eb-8525-96c0d7fdc536" returned: 0 in 0.642s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:46:54 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-fc6e1121-d4c2-4f15-ac4d-6fab965a93f0 tempest-VolumesListTestJSON-1134650599 None] <== create_volume: return (1651ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922'} {{(pid=87444) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 04:46:54 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-fc6e1121-d4c2-4f15-ac4d-6fab965a93f0 tempest-VolumesListTestJSON-1134650599 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.654s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 04:46:54 devstack cinder-volume[87444]: DEBUG dbcounter [-] [87444] Writing DB stats cinder:UPDATE=81,cinder:SELECT=72,cinder:INSERT=32,cinder:DELETE=7 {{(pid=87444) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 10 04:46:54 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-fc6e1121-d4c2-4f15-ac4d-6fab965a93f0 tempest-VolumesListTestJSON-1134650599 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9adf01e5-5bd2-4426-84a7-18cb67268a68) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d4c9dca3-dc4c-47eb-8525-96c0d7fdc536', 'volume_size': 1}' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:46:54 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-fc6e1121-d4c2-4f15-ac4d-6fab965a93f0 tempest-VolumesListTestJSON-1134650599 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d88587f1-4a3c-4be4-a5a6-66fdbb9564b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:46:54 devstack cinder-volume[87444]: DEBUG dbcounter [-] [87444] Writing DB stats cinder:UPDATE=101,cinder:INSERT=30,cinder:DELETE=8,cinder:SELECT=79 {{(pid=87444) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 10 04:46:54 devstack cinder-volume[87444]: INFO cinder.volume.flows.manager.create_volume [None req-fc6e1121-d4c2-4f15-ac4d-6fab965a93f0 tempest-VolumesListTestJSON-1134650599 None] Volume volume-d4c9dca3-dc4c-47eb-8525-96c0d7fdc536 (d4c9dca3-dc4c-47eb-8525-96c0d7fdc536): created successfully Jul 10 04:46:54 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-fc6e1121-d4c2-4f15-ac4d-6fab965a93f0 tempest-VolumesListTestJSON-1134650599 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d88587f1-4a3c-4be4-a5a6-66fdbb9564b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:46:54 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-fc6e1121-d4c2-4f15-ac4d-6fab965a93f0 tempest-VolumesListTestJSON-1134650599 None] Flow 'volume_create_manager' (215d2887-70fe-49a6-8c81-2b45915ce6d2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87444) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 04:46:54 devstack cinder-volume[87444]: INFO cinder.volume.manager [None req-fc6e1121-d4c2-4f15-ac4d-6fab965a93f0 tempest-VolumesListTestJSON-1134650599 None] Created volume successfully. Jul 10 04:46:55 devstack cinder-volume[87444]: DEBUG cinder.volume.flows.manager.create_volume [None req-eb51521d-897f-4e27-b5bf-c725e1e54ac9 tempest-VolumesListTestJSON-1134650599 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87444) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 04:46:55 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-eb51521d-897f-4e27-b5bf-c725e1e54ac9 tempest-VolumesListTestJSON-1134650599 None] Flow 'volume_create_manager' (fffbf820-8ca9-41d2-a287-7744eb8e49cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 04:46:55 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-eb51521d-897f-4e27-b5bf-c725e1e54ac9 tempest-VolumesListTestJSON-1134650599 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d1eda675-78c0-4533-bdaf-ad83b900f811) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:46:55 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-eb51521d-897f-4e27-b5bf-c725e1e54ac9 tempest-VolumesListTestJSON-1134650599 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d1eda675-78c0-4533-bdaf-ad83b900f811) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T02:46:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-949517631',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1f80783a-19a6-47a1-9429-f94caddb2e16,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='cb26e61de05a46e0889334626c33ba43',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T02:46:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T02:46:55Z,use_quota=True,user_id='77038d59a8d9404c8ee01aa17409e156',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(317e369e-1e06-434d-ae95-a335f0e6c903),volume_type_id=317e369e-1e06-434d-ae95-a335f0e6c903)' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:46:55 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-eb51521d-897f-4e27-b5bf-c725e1e54ac9 tempest-VolumesListTestJSON-1134650599 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c0a411a1-0d60-406d-b453-51377346aa16) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:46:55 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-eb51521d-897f-4e27-b5bf-c725e1e54ac9 tempest-VolumesListTestJSON-1134650599 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c0a411a1-0d60-406d-b453-51377346aa16) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:46:55 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-eb51521d-897f-4e27-b5bf-c725e1e54ac9 tempest-VolumesListTestJSON-1134650599 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b6ea7c07-f070-4ed5-8607-f5a4dbd3753f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:46:55 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-eb51521d-897f-4e27-b5bf-c725e1e54ac9 tempest-VolumesListTestJSON-1134650599 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b6ea7c07-f070-4ed5-8607-f5a4dbd3753f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1f80783a-19a6-47a1-9429-f94caddb2e16', 'volume_name': 'volume-1f80783a-19a6-47a1-9429-f94caddb2e16', 'volume_size': 1}' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:46:55 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-eb51521d-897f-4e27-b5bf-c725e1e54ac9 tempest-VolumesListTestJSON-1134650599 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (425baff5-00b8-4846-8721-dbf2356543c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:46:55 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-eb51521d-897f-4e27-b5bf-c725e1e54ac9 tempest-VolumesListTestJSON-1134650599 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (425baff5-00b8-4846-8721-dbf2356543c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:46:55 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-eb51521d-897f-4e27-b5bf-c725e1e54ac9 tempest-VolumesListTestJSON-1134650599 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b7bb1c64-8460-4b57-8abc-9c13e20b737d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:46:55 devstack cinder-volume[87444]: INFO cinder.volume.flows.manager.create_volume [None req-eb51521d-897f-4e27-b5bf-c725e1e54ac9 tempest-VolumesListTestJSON-1134650599 None] Volume 1f80783a-19a6-47a1-9429-f94caddb2e16: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1f80783a-19a6-47a1-9429-f94caddb2e16', 'volume_size': 1} Jul 10 04:46:55 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-eb51521d-897f-4e27-b5bf-c725e1e54ac9 tempest-VolumesListTestJSON-1134650599 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 04:46:55 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-eb51521d-897f-4e27-b5bf-c725e1e54ac9 tempest-VolumesListTestJSON-1134650599 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 04:46:55 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-eb51521d-897f-4e27-b5bf-c725e1e54ac9 tempest-VolumesListTestJSON-1134650599 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T02:46:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-949517631',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1f80783a-19a6-47a1-9429-f94caddb2e16,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='cb26e61de05a46e0889334626c33ba43',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T02:46:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T02:46:55Z,use_quota=True,user_id='77038d59a8d9404c8ee01aa17409e156',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(317e369e-1e06-434d-ae95-a335f0e6c903),volume_type_id=317e369e-1e06-434d-ae95-a335f0e6c903)}" {{(pid=87444) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 04:46:55 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.remotefs [None req-eb51521d-897f-4e27-b5bf-c725e1e54ac9 tempest-VolumesListTestJSON-1134650599 None] Creating volume 1f80783a-19a6-47a1-9429-f94caddb2e16 {{(pid=87444) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 04:46:55 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-eb51521d-897f-4e27-b5bf-c725e1e54ac9 tempest-VolumesListTestJSON-1134650599 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 04:46:55 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-eb51521d-897f-4e27-b5bf-c725e1e54ac9 tempest-VolumesListTestJSON-1134650599 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 04:46:55 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-eb51521d-897f-4e27-b5bf-c725e1e54ac9 tempest-VolumesListTestJSON-1134650599 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922': None} {{(pid=87444) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 04:46:55 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-eb51521d-897f-4e27-b5bf-c725e1e54ac9 tempest-VolumesListTestJSON-1134650599 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922'] {{(pid=87444) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 04:46:55 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-eb51521d-897f-4e27-b5bf-c725e1e54ac9 tempest-VolumesListTestJSON-1134650599 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 04:46:55 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-eb51521d-897f-4e27-b5bf-c725e1e54ac9 tempest-VolumesListTestJSON-1134650599 None] Selected osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922 as target Quobyte volume. {{(pid=87444) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 04:46:55 devstack cinder-volume[87444]: INFO cinder.volume.drivers.remotefs [None req-eb51521d-897f-4e27-b5bf-c725e1e54ac9 tempest-VolumesListTestJSON-1134650599 None] casted to osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922 Jul 10 04:46:55 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-eb51521d-897f-4e27-b5bf-c725e1e54ac9 tempest-VolumesListTestJSON-1134650599 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-1f80783a-19a6-47a1-9429-f94caddb2e16 1073741824 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:46:55 devstack sudo[100221]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-1f80783a-19a6-47a1-9429-f94caddb2e16 1073741824 Jul 10 04:46:55 devstack sudo[100221]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:46:56 devstack sudo[100221]: pam_unix(sudo:session): session closed for user root Jul 10 04:46:56 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-eb51521d-897f-4e27-b5bf-c725e1e54ac9 tempest-VolumesListTestJSON-1134650599 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-1f80783a-19a6-47a1-9429-f94caddb2e16 1073741824" returned: 0 in 1.077s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:46:56 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-eb51521d-897f-4e27-b5bf-c725e1e54ac9 tempest-VolumesListTestJSON-1134650599 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-1f80783a-19a6-47a1-9429-f94caddb2e16 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:46:56 devstack sudo[100226]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-1f80783a-19a6-47a1-9429-f94caddb2e16 Jul 10 04:46:56 devstack sudo[100226]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:46:57 devstack sudo[100226]: pam_unix(sudo:session): session closed for user root Jul 10 04:46:57 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-eb51521d-897f-4e27-b5bf-c725e1e54ac9 tempest-VolumesListTestJSON-1134650599 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-1f80783a-19a6-47a1-9429-f94caddb2e16" returned: 0 in 0.707s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:46:57 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-eb51521d-897f-4e27-b5bf-c725e1e54ac9 tempest-VolumesListTestJSON-1134650599 None] <== create_volume: return (1834ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922'} {{(pid=87444) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 04:46:57 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-eb51521d-897f-4e27-b5bf-c725e1e54ac9 tempest-VolumesListTestJSON-1134650599 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.837s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 04:46:57 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-eb51521d-897f-4e27-b5bf-c725e1e54ac9 tempest-VolumesListTestJSON-1134650599 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b7bb1c64-8460-4b57-8abc-9c13e20b737d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1f80783a-19a6-47a1-9429-f94caddb2e16', 'volume_size': 1}' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:46:57 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-eb51521d-897f-4e27-b5bf-c725e1e54ac9 tempest-VolumesListTestJSON-1134650599 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fa1aab41-f999-43a7-9ed3-fa3b4147ae5c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:46:57 devstack cinder-volume[87444]: INFO cinder.volume.flows.manager.create_volume [None req-eb51521d-897f-4e27-b5bf-c725e1e54ac9 tempest-VolumesListTestJSON-1134650599 None] Volume volume-1f80783a-19a6-47a1-9429-f94caddb2e16 (1f80783a-19a6-47a1-9429-f94caddb2e16): created successfully Jul 10 04:46:57 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-eb51521d-897f-4e27-b5bf-c725e1e54ac9 tempest-VolumesListTestJSON-1134650599 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fa1aab41-f999-43a7-9ed3-fa3b4147ae5c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:46:57 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-eb51521d-897f-4e27-b5bf-c725e1e54ac9 tempest-VolumesListTestJSON-1134650599 None] Flow 'volume_create_manager' (fffbf820-8ca9-41d2-a287-7744eb8e49cf) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87444) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 04:46:57 devstack cinder-volume[87444]: INFO cinder.volume.manager [None req-eb51521d-897f-4e27-b5bf-c725e1e54ac9 tempest-VolumesListTestJSON-1134650599 None] Created volume successfully. Jul 10 04:46:58 devstack cinder-volume[87444]: DEBUG cinder.volume.flows.manager.create_volume [None req-cccb4af4-4eab-4475-8600-5ac754a8c76d tempest-VolumesListTestJSON-1134650599 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87444) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 04:46:58 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-cccb4af4-4eab-4475-8600-5ac754a8c76d tempest-VolumesListTestJSON-1134650599 None] Flow 'volume_create_manager' (4bbfc270-ba9c-4129-8bd3-5a765ea53eff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 04:46:58 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-cccb4af4-4eab-4475-8600-5ac754a8c76d tempest-VolumesListTestJSON-1134650599 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (47a57328-9def-42a2-ba5c-66bafe429ab9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:46:58 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-cccb4af4-4eab-4475-8600-5ac754a8c76d tempest-VolumesListTestJSON-1134650599 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (47a57328-9def-42a2-ba5c-66bafe429ab9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T02:46:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-173190181',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=90316071-8189-4d1d-bbe0-98e6dd9f49f1,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='cb26e61de05a46e0889334626c33ba43',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T02:46:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T02:46:58Z,use_quota=True,user_id='77038d59a8d9404c8ee01aa17409e156',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(317e369e-1e06-434d-ae95-a335f0e6c903),volume_type_id=317e369e-1e06-434d-ae95-a335f0e6c903)' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:46:58 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-cccb4af4-4eab-4475-8600-5ac754a8c76d tempest-VolumesListTestJSON-1134650599 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ab07ca4f-7c00-4760-8c30-652d747e671b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:46:58 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-cccb4af4-4eab-4475-8600-5ac754a8c76d tempest-VolumesListTestJSON-1134650599 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ab07ca4f-7c00-4760-8c30-652d747e671b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:46:58 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-cccb4af4-4eab-4475-8600-5ac754a8c76d tempest-VolumesListTestJSON-1134650599 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (28bb2b29-9bec-4d9e-a34c-535cd5c58798) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:46:58 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-cccb4af4-4eab-4475-8600-5ac754a8c76d tempest-VolumesListTestJSON-1134650599 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (28bb2b29-9bec-4d9e-a34c-535cd5c58798) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '90316071-8189-4d1d-bbe0-98e6dd9f49f1', 'volume_name': 'volume-90316071-8189-4d1d-bbe0-98e6dd9f49f1', 'volume_size': 1}' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:46:58 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-cccb4af4-4eab-4475-8600-5ac754a8c76d tempest-VolumesListTestJSON-1134650599 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9fb0cc16-8700-45ed-8a7e-2ab9d83d883b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:46:58 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-cccb4af4-4eab-4475-8600-5ac754a8c76d tempest-VolumesListTestJSON-1134650599 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9fb0cc16-8700-45ed-8a7e-2ab9d83d883b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:46:58 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-cccb4af4-4eab-4475-8600-5ac754a8c76d tempest-VolumesListTestJSON-1134650599 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (72c21636-de9e-49ea-9f00-9132026235e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:46:58 devstack cinder-volume[87444]: INFO cinder.volume.flows.manager.create_volume [None req-cccb4af4-4eab-4475-8600-5ac754a8c76d tempest-VolumesListTestJSON-1134650599 None] Volume 90316071-8189-4d1d-bbe0-98e6dd9f49f1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-90316071-8189-4d1d-bbe0-98e6dd9f49f1', 'volume_size': 1} Jul 10 04:46:58 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-cccb4af4-4eab-4475-8600-5ac754a8c76d tempest-VolumesListTestJSON-1134650599 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 04:46:58 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-cccb4af4-4eab-4475-8600-5ac754a8c76d tempest-VolumesListTestJSON-1134650599 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 04:46:58 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-cccb4af4-4eab-4475-8600-5ac754a8c76d tempest-VolumesListTestJSON-1134650599 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T02:46:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-173190181',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=90316071-8189-4d1d-bbe0-98e6dd9f49f1,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='cb26e61de05a46e0889334626c33ba43',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T02:46:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T02:46:58Z,use_quota=True,user_id='77038d59a8d9404c8ee01aa17409e156',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(317e369e-1e06-434d-ae95-a335f0e6c903),volume_type_id=317e369e-1e06-434d-ae95-a335f0e6c903)}" {{(pid=87444) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 04:46:58 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.remotefs [None req-cccb4af4-4eab-4475-8600-5ac754a8c76d tempest-VolumesListTestJSON-1134650599 None] Creating volume 90316071-8189-4d1d-bbe0-98e6dd9f49f1 {{(pid=87444) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 04:46:58 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-cccb4af4-4eab-4475-8600-5ac754a8c76d tempest-VolumesListTestJSON-1134650599 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 04:46:58 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-cccb4af4-4eab-4475-8600-5ac754a8c76d tempest-VolumesListTestJSON-1134650599 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 04:46:58 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-cccb4af4-4eab-4475-8600-5ac754a8c76d tempest-VolumesListTestJSON-1134650599 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922': None} {{(pid=87444) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 04:46:58 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-cccb4af4-4eab-4475-8600-5ac754a8c76d tempest-VolumesListTestJSON-1134650599 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922'] {{(pid=87444) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 04:46:58 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-cccb4af4-4eab-4475-8600-5ac754a8c76d tempest-VolumesListTestJSON-1134650599 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 04:46:58 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-cccb4af4-4eab-4475-8600-5ac754a8c76d tempest-VolumesListTestJSON-1134650599 None] Selected osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922 as target Quobyte volume. {{(pid=87444) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 04:46:58 devstack cinder-volume[87444]: INFO cinder.volume.drivers.remotefs [None req-cccb4af4-4eab-4475-8600-5ac754a8c76d tempest-VolumesListTestJSON-1134650599 None] casted to osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922 Jul 10 04:46:58 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-cccb4af4-4eab-4475-8600-5ac754a8c76d tempest-VolumesListTestJSON-1134650599 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-90316071-8189-4d1d-bbe0-98e6dd9f49f1 1073741824 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:46:58 devstack sudo[100229]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-90316071-8189-4d1d-bbe0-98e6dd9f49f1 1073741824 Jul 10 04:46:58 devstack sudo[100229]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:46:59 devstack sudo[100229]: pam_unix(sudo:session): session closed for user root Jul 10 04:46:59 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-cccb4af4-4eab-4475-8600-5ac754a8c76d tempest-VolumesListTestJSON-1134650599 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-90316071-8189-4d1d-bbe0-98e6dd9f49f1 1073741824" returned: 0 in 1.213s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:46:59 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-cccb4af4-4eab-4475-8600-5ac754a8c76d tempest-VolumesListTestJSON-1134650599 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-90316071-8189-4d1d-bbe0-98e6dd9f49f1 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:46:59 devstack sudo[100242]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-90316071-8189-4d1d-bbe0-98e6dd9f49f1 Jul 10 04:46:59 devstack sudo[100242]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:47:00 devstack sudo[100242]: pam_unix(sudo:session): session closed for user root Jul 10 04:47:00 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-cccb4af4-4eab-4475-8600-5ac754a8c76d tempest-VolumesListTestJSON-1134650599 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-90316071-8189-4d1d-bbe0-98e6dd9f49f1" returned: 0 in 0.732s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:47:00 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-cccb4af4-4eab-4475-8600-5ac754a8c76d tempest-VolumesListTestJSON-1134650599 None] <== create_volume: return (2003ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922'} {{(pid=87444) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 04:47:00 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-cccb4af4-4eab-4475-8600-5ac754a8c76d tempest-VolumesListTestJSON-1134650599 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.007s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 04:47:00 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-cccb4af4-4eab-4475-8600-5ac754a8c76d tempest-VolumesListTestJSON-1134650599 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (72c21636-de9e-49ea-9f00-9132026235e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-90316071-8189-4d1d-bbe0-98e6dd9f49f1', 'volume_size': 1}' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:47:00 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-cccb4af4-4eab-4475-8600-5ac754a8c76d tempest-VolumesListTestJSON-1134650599 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (350e88cb-6ed4-4631-a479-d3d7cdcb8bdc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:47:00 devstack cinder-volume[87444]: INFO cinder.volume.flows.manager.create_volume [None req-cccb4af4-4eab-4475-8600-5ac754a8c76d tempest-VolumesListTestJSON-1134650599 None] Volume volume-90316071-8189-4d1d-bbe0-98e6dd9f49f1 (90316071-8189-4d1d-bbe0-98e6dd9f49f1): created successfully Jul 10 04:47:00 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-cccb4af4-4eab-4475-8600-5ac754a8c76d tempest-VolumesListTestJSON-1134650599 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (350e88cb-6ed4-4631-a479-d3d7cdcb8bdc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:47:00 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-cccb4af4-4eab-4475-8600-5ac754a8c76d tempest-VolumesListTestJSON-1134650599 None] Flow 'volume_create_manager' (4bbfc270-ba9c-4129-8bd3-5a765ea53eff) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87444) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 04:47:00 devstack cinder-volume[87444]: INFO cinder.volume.manager [None req-cccb4af4-4eab-4475-8600-5ac754a8c76d tempest-VolumesListTestJSON-1134650599 None] Created volume successfully. Jul 10 04:47:02 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [req-1ece989c-2e9c-46bb-b220-8b552cfe1689 req-d3d67f33-9fe0-481b-941d-8b438976e31e tempest-TestStampPattern-1378957900 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 04:47:02 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [req-1ece989c-2e9c-46bb-b220-8b552cfe1689 req-d3d67f33-9fe0-481b-941d-8b438976e31e tempest-TestStampPattern-1378957900 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 04:47:02 devstack cinder-volume[87444]: DEBUG oslo.privsep.daemon [-] privsep: reply[a169dafa-19ed-43ae-ab27-61278134ec2f]: (4, 'qcow2') {{(pid=88499) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 04:47:02 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [req-1ece989c-2e9c-46bb-b220-8b552cfe1689 req-d3d67f33-9fe0-481b-941d-8b438976e31e tempest-TestStampPattern-1378957900 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-420cd972-7ecb-4fdb-abf1-d859698bbb94 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:47:02 devstack sudo[100262]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-420cd972-7ecb-4fdb-abf1-d859698bbb94 Jul 10 04:47:02 devstack sudo[100262]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:47:03 devstack sudo[100262]: pam_unix(sudo:session): session closed for user root Jul 10 04:47:03 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [req-1ece989c-2e9c-46bb-b220-8b552cfe1689 req-d3d67f33-9fe0-481b-941d-8b438976e31e tempest-TestStampPattern-1378957900 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-420cd972-7ecb-4fdb-abf1-d859698bbb94" returned: 0 in 0.936s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:47:03 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [req-1ece989c-2e9c-46bb-b220-8b552cfe1689 req-d3d67f33-9fe0-481b-941d-8b438976e31e tempest-TestStampPattern-1378957900 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.963s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 04:47:03 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [req-1ece989c-2e9c-46bb-b220-8b552cfe1689 req-d3d67f33-9fe0-481b-941d-8b438976e31e tempest-TestStampPattern-1378957900 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922', 'name': 'volume-420cd972-7ecb-4fdb-abf1-d859698bbb94', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'bbe1e65b-237e-40b4-aec8-5a0d96987175', 'enforce_multipath': True} {{(pid=87444) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 10 04:47:03 devstack cinder-volume[87444]: INFO cinder.volume.manager [req-1ece989c-2e9c-46bb-b220-8b552cfe1689 req-d3d67f33-9fe0-481b-941d-8b438976e31e tempest-TestStampPattern-1378957900 None] attachment_update completed successfully. Jul 10 04:47:04 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-d489aee7-e441-461b-9c3f-ed6ca5766a21 tempest-VolumesListTestJSON-1134650599 None] Acquiring lock "cinder-90316071-8189-4d1d-bbe0-98e6dd9f49f1-delete_volume" by "delete_volume" {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 04:47:04 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-d489aee7-e441-461b-9c3f-ed6ca5766a21 tempest-VolumesListTestJSON-1134650599 None] Lock "cinder-90316071-8189-4d1d-bbe0-98e6dd9f49f1-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 04:47:04 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-d489aee7-e441-461b-9c3f-ed6ca5766a21 tempest-VolumesListTestJSON-1134650599 None] Acquiring lock "cinder-quobyte-90316071-8189-4d1d-bbe0-98e6dd9f49f1" by "delete_volume" {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 04:47:04 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-d489aee7-e441-461b-9c3f-ed6ca5766a21 tempest-VolumesListTestJSON-1134650599 None] Lock "cinder-quobyte-90316071-8189-4d1d-bbe0-98e6dd9f49f1" acquired by "delete_volume" :: waited 0.015s {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 04:47:04 devstack cinder-volume[87444]: DEBUG oslo.privsep.daemon [-] privsep: reply[966fa31d-3a53-4379-ad0e-f2b0a2b50dec]: (4, 'qcow2') {{(pid=88499) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 04:47:04 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-d489aee7-e441-461b-9c3f-ed6ca5766a21 tempest-VolumesListTestJSON-1134650599 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-90316071-8189-4d1d-bbe0-98e6dd9f49f1 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:47:04 devstack sudo[100268]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-90316071-8189-4d1d-bbe0-98e6dd9f49f1 Jul 10 04:47:04 devstack sudo[100268]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:47:05 devstack sudo[100268]: pam_unix(sudo:session): session closed for user root Jul 10 04:47:05 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-d489aee7-e441-461b-9c3f-ed6ca5766a21 tempest-VolumesListTestJSON-1134650599 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-90316071-8189-4d1d-bbe0-98e6dd9f49f1" returned: 0 in 0.860s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:47:05 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-d489aee7-e441-461b-9c3f-ed6ca5766a21 tempest-VolumesListTestJSON-1134650599 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-90316071-8189-4d1d-bbe0-98e6dd9f49f1 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:47:05 devstack sudo[100275]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-90316071-8189-4d1d-bbe0-98e6dd9f49f1 Jul 10 04:47:05 devstack sudo[100275]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:47:05 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [req-6465d81a-e338-435b-8f3a-c3b9b565a471 req-e77e375d-e07a-4848-a7c0-72258737b462 tempest-TestInstancesWithCinderVolumes-1741196733 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 04:47:05 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [req-6465d81a-e338-435b-8f3a-c3b9b565a471 req-e77e375d-e07a-4848-a7c0-72258737b462 tempest-TestInstancesWithCinderVolumes-1741196733 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 04:47:05 devstack cinder-volume[87444]: DEBUG oslo.privsep.daemon [-] privsep: reply[aff65558-5810-4f3f-96a7-f5cba119393b]: (4, 'qcow2') {{(pid=88499) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 04:47:05 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [req-6465d81a-e338-435b-8f3a-c3b9b565a471 req-e77e375d-e07a-4848-a7c0-72258737b462 tempest-TestInstancesWithCinderVolumes-1741196733 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-a9b21329-62c2-4cd4-8a67-34eb1efdc714 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:47:05 devstack sudo[100285]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-a9b21329-62c2-4cd4-8a67-34eb1efdc714 Jul 10 04:47:05 devstack sudo[100285]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:47:05 devstack sudo[100275]: pam_unix(sudo:session): session closed for user root Jul 10 04:47:05 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-d489aee7-e441-461b-9c3f-ed6ca5766a21 tempest-VolumesListTestJSON-1134650599 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-90316071-8189-4d1d-bbe0-98e6dd9f49f1" returned: 0 in 0.776s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:47:05 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-d489aee7-e441-461b-9c3f-ed6ca5766a21 tempest-VolumesListTestJSON-1134650599 None] Lock "cinder-quobyte-90316071-8189-4d1d-bbe0-98e6dd9f49f1" released by "delete_volume" :: held 1.690s {{(pid=87444) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 04:47:05 devstack cinder-volume[87444]: DEBUG cinder.quota [None req-d489aee7-e441-461b-9c3f-ed6ca5766a21 tempest-VolumesListTestJSON-1134650599 None] Created reservations ['3a1eb9d6-ed39-4862-89e2-445572eb614a', 'e791b01d-d6ef-4079-9ef9-3698b8ac3f18', 'c01f80df-ad35-4121-a729-f0e1a34d354d', '5a508c10-7c01-445c-a1a9-36bb4a759521'] {{(pid=87444) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 04:47:06 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-d489aee7-e441-461b-9c3f-ed6ca5766a21 tempest-VolumesListTestJSON-1134650599 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 04:47:06 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-d489aee7-e441-461b-9c3f-ed6ca5766a21 tempest-VolumesListTestJSON-1134650599 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 04:47:06 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-d489aee7-e441-461b-9c3f-ed6ca5766a21 tempest-VolumesListTestJSON-1134650599 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922': None} {{(pid=87444) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 04:47:06 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-d489aee7-e441-461b-9c3f-ed6ca5766a21 tempest-VolumesListTestJSON-1134650599 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922'] {{(pid=87444) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 04:47:06 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-d489aee7-e441-461b-9c3f-ed6ca5766a21 tempest-VolumesListTestJSON-1134650599 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 04:47:06 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-d489aee7-e441-461b-9c3f-ed6ca5766a21 tempest-VolumesListTestJSON-1134650599 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:47:06 devstack sudo[100288]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097 Jul 10 04:47:06 devstack sudo[100288]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:47:06 devstack sudo[100285]: pam_unix(sudo:session): session closed for user root Jul 10 04:47:06 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-7c9062e6-89e2-44ec-8e26-6896bdde2122 tempest-VolumesListTestJSON-1134650599 None] Acquiring lock "cinder-1f80783a-19a6-47a1-9429-f94caddb2e16-delete_volume" by "delete_volume" {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 04:47:06 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [req-6465d81a-e338-435b-8f3a-c3b9b565a471 req-e77e375d-e07a-4848-a7c0-72258737b462 tempest-TestInstancesWithCinderVolumes-1741196733 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-a9b21329-62c2-4cd4-8a67-34eb1efdc714" returned: 0 in 0.974s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:47:06 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [req-6465d81a-e338-435b-8f3a-c3b9b565a471 req-e77e375d-e07a-4848-a7c0-72258737b462 tempest-TestInstancesWithCinderVolumes-1741196733 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.001s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 04:47:06 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-7c9062e6-89e2-44ec-8e26-6896bdde2122 tempest-VolumesListTestJSON-1134650599 None] Lock "cinder-1f80783a-19a6-47a1-9429-f94caddb2e16-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 04:47:06 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [req-6465d81a-e338-435b-8f3a-c3b9b565a471 req-e77e375d-e07a-4848-a7c0-72258737b462 tempest-TestInstancesWithCinderVolumes-1741196733 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922', 'name': 'volume-a9b21329-62c2-4cd4-8a67-34eb1efdc714', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '7e4c6d98-9be1-47a9-9251-49f86d36b2b9', 'enforce_multipath': True} {{(pid=87444) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 10 04:47:06 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-7c9062e6-89e2-44ec-8e26-6896bdde2122 tempest-VolumesListTestJSON-1134650599 None] Acquiring lock "cinder-quobyte-1f80783a-19a6-47a1-9429-f94caddb2e16" by "delete_volume" {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 04:47:06 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-7c9062e6-89e2-44ec-8e26-6896bdde2122 tempest-VolumesListTestJSON-1134650599 None] Lock "cinder-quobyte-1f80783a-19a6-47a1-9429-f94caddb2e16" acquired by "delete_volume" :: waited 0.034s {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 04:47:06 devstack cinder-volume[87444]: DEBUG oslo.privsep.daemon [-] privsep: reply[4af36a7d-ce3a-4a03-9155-649e0987ea5f]: (4, 'qcow2') {{(pid=88499) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 04:47:06 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-7c9062e6-89e2-44ec-8e26-6896bdde2122 tempest-VolumesListTestJSON-1134650599 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-1f80783a-19a6-47a1-9429-f94caddb2e16 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:47:06 devstack cinder-volume[87444]: INFO cinder.volume.manager [req-6465d81a-e338-435b-8f3a-c3b9b565a471 req-e77e375d-e07a-4848-a7c0-72258737b462 tempest-TestInstancesWithCinderVolumes-1741196733 None] attachment_update completed successfully. Jul 10 04:47:06 devstack sudo[100294]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-1f80783a-19a6-47a1-9429-f94caddb2e16 Jul 10 04:47:06 devstack sudo[100294]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:47:07 devstack sudo[100288]: pam_unix(sudo:session): session closed for user root Jul 10 04:47:07 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-d489aee7-e441-461b-9c3f-ed6ca5766a21 tempest-VolumesListTestJSON-1134650599 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097" returned: 0 in 0.945s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:47:07 devstack cinder-volume[87444]: DEBUG cinder.manager [None req-d489aee7-e441-461b-9c3f-ed6ca5766a21 tempest-VolumesListTestJSON-1134650599 None] Notifying Schedulers of capabilities ... {{(pid=87444) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 04:47:07 devstack cinder-volume[87444]: INFO cinder.volume.manager [None req-d489aee7-e441-461b-9c3f-ed6ca5766a21 tempest-VolumesListTestJSON-1134650599 None] Deleted volume successfully. Jul 10 04:47:07 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-d489aee7-e441-461b-9c3f-ed6ca5766a21 tempest-VolumesListTestJSON-1134650599 None] Lock "cinder-90316071-8189-4d1d-bbe0-98e6dd9f49f1-delete_volume" released by "delete_volume" :: held 2.959s {{(pid=87444) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 04:47:07 devstack sudo[100294]: pam_unix(sudo:session): session closed for user root Jul 10 04:47:07 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-7c9062e6-89e2-44ec-8e26-6896bdde2122 tempest-VolumesListTestJSON-1134650599 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-1f80783a-19a6-47a1-9429-f94caddb2e16" returned: 0 in 0.860s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:47:07 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-7c9062e6-89e2-44ec-8e26-6896bdde2122 tempest-VolumesListTestJSON-1134650599 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-1f80783a-19a6-47a1-9429-f94caddb2e16 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:47:07 devstack sudo[100300]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-1f80783a-19a6-47a1-9429-f94caddb2e16 Jul 10 04:47:07 devstack sudo[100300]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:47:08 devstack sudo[100300]: pam_unix(sudo:session): session closed for user root Jul 10 04:47:08 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-7c9062e6-89e2-44ec-8e26-6896bdde2122 tempest-VolumesListTestJSON-1134650599 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-1f80783a-19a6-47a1-9429-f94caddb2e16" returned: 0 in 0.749s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:47:08 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-7c9062e6-89e2-44ec-8e26-6896bdde2122 tempest-VolumesListTestJSON-1134650599 None] Lock "cinder-quobyte-1f80783a-19a6-47a1-9429-f94caddb2e16" released by "delete_volume" :: held 1.699s {{(pid=87444) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 04:47:08 devstack cinder-volume[87444]: DEBUG cinder.quota [None req-7c9062e6-89e2-44ec-8e26-6896bdde2122 tempest-VolumesListTestJSON-1134650599 None] Created reservations ['ec380f0c-3a63-4fcf-b497-e20cd710f54f', '9209e562-40a6-4175-8ece-ae5eafd29ebf', '7dfa0a89-b3ae-46a3-bccb-c26e1f926cf2', '42c7e055-4b32-47ff-9407-7d1f25246e2d'] {{(pid=87444) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 04:47:08 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-7c9062e6-89e2-44ec-8e26-6896bdde2122 tempest-VolumesListTestJSON-1134650599 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 04:47:08 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-7c9062e6-89e2-44ec-8e26-6896bdde2122 tempest-VolumesListTestJSON-1134650599 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 04:47:08 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-7c9062e6-89e2-44ec-8e26-6896bdde2122 tempest-VolumesListTestJSON-1134650599 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922': None} {{(pid=87444) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 04:47:08 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-7c9062e6-89e2-44ec-8e26-6896bdde2122 tempest-VolumesListTestJSON-1134650599 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922'] {{(pid=87444) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 04:47:08 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-7c9062e6-89e2-44ec-8e26-6896bdde2122 tempest-VolumesListTestJSON-1134650599 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 04:47:08 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-7c9062e6-89e2-44ec-8e26-6896bdde2122 tempest-VolumesListTestJSON-1134650599 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:47:08 devstack sudo[100305]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097 Jul 10 04:47:08 devstack sudo[100305]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:47:08 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-0b322828-b51d-4d2c-a3b5-03dc600cf38d tempest-VolumesListTestJSON-1134650599 None] Acquiring lock "cinder-d4c9dca3-dc4c-47eb-8525-96c0d7fdc536-delete_volume" by "delete_volume" {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 04:47:08 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-0b322828-b51d-4d2c-a3b5-03dc600cf38d tempest-VolumesListTestJSON-1134650599 None] Lock "cinder-d4c9dca3-dc4c-47eb-8525-96c0d7fdc536-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 04:47:09 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-0b322828-b51d-4d2c-a3b5-03dc600cf38d tempest-VolumesListTestJSON-1134650599 None] Acquiring lock "cinder-quobyte-d4c9dca3-dc4c-47eb-8525-96c0d7fdc536" by "delete_volume" {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 04:47:09 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-0b322828-b51d-4d2c-a3b5-03dc600cf38d tempest-VolumesListTestJSON-1134650599 None] Lock "cinder-quobyte-d4c9dca3-dc4c-47eb-8525-96c0d7fdc536" acquired by "delete_volume" :: waited 0.025s {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 04:47:09 devstack cinder-volume[87444]: DEBUG oslo.privsep.daemon [-] privsep: reply[63f2d696-c633-473f-b320-36c0c5f52967]: (4, 'qcow2') {{(pid=88499) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 04:47:09 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-0b322828-b51d-4d2c-a3b5-03dc600cf38d tempest-VolumesListTestJSON-1134650599 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-d4c9dca3-dc4c-47eb-8525-96c0d7fdc536 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:47:09 devstack sudo[100317]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-d4c9dca3-dc4c-47eb-8525-96c0d7fdc536 Jul 10 04:47:09 devstack sudo[100317]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:47:09 devstack sudo[100305]: pam_unix(sudo:session): session closed for user root Jul 10 04:47:09 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-7c9062e6-89e2-44ec-8e26-6896bdde2122 tempest-VolumesListTestJSON-1134650599 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097" returned: 0 in 0.768s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:47:09 devstack cinder-volume[87444]: DEBUG cinder.manager [None req-7c9062e6-89e2-44ec-8e26-6896bdde2122 tempest-VolumesListTestJSON-1134650599 None] Notifying Schedulers of capabilities ... {{(pid=87444) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 04:47:09 devstack cinder-volume[87444]: INFO cinder.volume.manager [None req-7c9062e6-89e2-44ec-8e26-6896bdde2122 tempest-VolumesListTestJSON-1134650599 None] Deleted volume successfully. Jul 10 04:47:09 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-7c9062e6-89e2-44ec-8e26-6896bdde2122 tempest-VolumesListTestJSON-1134650599 None] Lock "cinder-1f80783a-19a6-47a1-9429-f94caddb2e16-delete_volume" released by "delete_volume" :: held 2.789s {{(pid=87444) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 04:47:09 devstack sudo[100317]: pam_unix(sudo:session): session closed for user root Jul 10 04:47:09 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-0b322828-b51d-4d2c-a3b5-03dc600cf38d tempest-VolumesListTestJSON-1134650599 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-d4c9dca3-dc4c-47eb-8525-96c0d7fdc536" returned: 0 in 0.892s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:47:09 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-0b322828-b51d-4d2c-a3b5-03dc600cf38d tempest-VolumesListTestJSON-1134650599 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-d4c9dca3-dc4c-47eb-8525-96c0d7fdc536 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:47:10 devstack sudo[100324]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-d4c9dca3-dc4c-47eb-8525-96c0d7fdc536 Jul 10 04:47:10 devstack sudo[100324]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:47:10 devstack sudo[100324]: pam_unix(sudo:session): session closed for user root Jul 10 04:47:10 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-0b322828-b51d-4d2c-a3b5-03dc600cf38d tempest-VolumesListTestJSON-1134650599 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-d4c9dca3-dc4c-47eb-8525-96c0d7fdc536" returned: 0 in 0.846s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:47:10 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-0b322828-b51d-4d2c-a3b5-03dc600cf38d tempest-VolumesListTestJSON-1134650599 None] Lock "cinder-quobyte-d4c9dca3-dc4c-47eb-8525-96c0d7fdc536" released by "delete_volume" :: held 1.816s {{(pid=87444) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 04:47:10 devstack cinder-volume[87444]: DEBUG cinder.quota [None req-0b322828-b51d-4d2c-a3b5-03dc600cf38d tempest-VolumesListTestJSON-1134650599 None] Created reservations ['36cc1817-fb4c-4d5e-bdca-491844650c8a', '5458a486-2e31-47e0-816c-47fbb84b092f', '89ac41e9-82bc-49b1-a6a0-480cd175d3fb', '25131a16-0024-4163-a701-7ff1f58ecc46'] {{(pid=87444) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 04:47:11 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-0b322828-b51d-4d2c-a3b5-03dc600cf38d tempest-VolumesListTestJSON-1134650599 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 04:47:11 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-0b322828-b51d-4d2c-a3b5-03dc600cf38d tempest-VolumesListTestJSON-1134650599 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 04:47:11 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-0b322828-b51d-4d2c-a3b5-03dc600cf38d tempest-VolumesListTestJSON-1134650599 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922': None} {{(pid=87444) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 04:47:11 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-0b322828-b51d-4d2c-a3b5-03dc600cf38d tempest-VolumesListTestJSON-1134650599 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922'] {{(pid=87444) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 04:47:11 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-0b322828-b51d-4d2c-a3b5-03dc600cf38d tempest-VolumesListTestJSON-1134650599 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.037s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 04:47:11 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-0b322828-b51d-4d2c-a3b5-03dc600cf38d tempest-VolumesListTestJSON-1134650599 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:47:11 devstack sudo[100333]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097 Jul 10 04:47:11 devstack sudo[100333]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:47:12 devstack sudo[100333]: pam_unix(sudo:session): session closed for user root Jul 10 04:47:12 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-0b322828-b51d-4d2c-a3b5-03dc600cf38d tempest-VolumesListTestJSON-1134650599 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097" returned: 0 in 1.055s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:47:12 devstack cinder-volume[87444]: DEBUG cinder.manager [None req-0b322828-b51d-4d2c-a3b5-03dc600cf38d tempest-VolumesListTestJSON-1134650599 None] Notifying Schedulers of capabilities ... {{(pid=87444) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 04:47:12 devstack cinder-volume[87444]: INFO cinder.volume.manager [None req-0b322828-b51d-4d2c-a3b5-03dc600cf38d tempest-VolumesListTestJSON-1134650599 None] Deleted volume successfully. Jul 10 04:47:12 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-0b322828-b51d-4d2c-a3b5-03dc600cf38d tempest-VolumesListTestJSON-1134650599 None] Lock "cinder-d4c9dca3-dc4c-47eb-8525-96c0d7fdc536-delete_volume" released by "delete_volume" :: held 3.249s {{(pid=87444) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 04:47:13 devstack cinder-volume[87444]: INFO cinder.volume.manager [req-2e3aa459-0f21-4651-81b3-a1de465f8cd0 req-50eb13df-ca52-4d2a-bdc6-961bc7e558dd tempest-TestStampPattern-1378957900 None] Terminate volume connection completed successfully. Jul 10 04:47:13 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [req-2e3aa459-0f21-4651-81b3-a1de465f8cd0 req-50eb13df-ca52-4d2a-bdc6-961bc7e558dd tempest-TestStampPattern-1378957900 None] Deleting attachment bbe1e65b-237e-40b4-aec8-5a0d96987175. {{(pid=87444) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 10 04:47:14 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [req-1107c434-f5a7-449f-b94f-e6bc1ea108d6 req-e13e91a3-e709-4cc3-b776-31a5de4a000f tempest-TestInstancesWithCinderVolumes-1741196733 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 04:47:14 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [req-1107c434-f5a7-449f-b94f-e6bc1ea108d6 req-e13e91a3-e709-4cc3-b776-31a5de4a000f tempest-TestInstancesWithCinderVolumes-1741196733 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 04:47:14 devstack cinder-volume[87444]: DEBUG oslo.privsep.daemon [-] privsep: reply[d234126b-325a-4b3f-895c-94e0095e5025]: (4, 'qcow2') {{(pid=88499) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 04:47:14 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [req-1107c434-f5a7-449f-b94f-e6bc1ea108d6 req-e13e91a3-e709-4cc3-b776-31a5de4a000f tempest-TestInstancesWithCinderVolumes-1741196733 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-7d23f8f0-4475-43cb-b423-8aeb7a87c98d {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:47:14 devstack sudo[100360]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-7d23f8f0-4475-43cb-b423-8aeb7a87c98d Jul 10 04:47:14 devstack sudo[100360]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:47:15 devstack sudo[100360]: pam_unix(sudo:session): session closed for user root Jul 10 04:47:15 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [req-1107c434-f5a7-449f-b94f-e6bc1ea108d6 req-e13e91a3-e709-4cc3-b776-31a5de4a000f tempest-TestInstancesWithCinderVolumes-1741196733 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-7d23f8f0-4475-43cb-b423-8aeb7a87c98d" returned: 0 in 1.058s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:47:15 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [req-1107c434-f5a7-449f-b94f-e6bc1ea108d6 req-e13e91a3-e709-4cc3-b776-31a5de4a000f tempest-TestInstancesWithCinderVolumes-1741196733 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.094s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 04:47:15 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [req-1107c434-f5a7-449f-b94f-e6bc1ea108d6 req-e13e91a3-e709-4cc3-b776-31a5de4a000f tempest-TestInstancesWithCinderVolumes-1741196733 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922', 'name': 'volume-7d23f8f0-4475-43cb-b423-8aeb7a87c98d', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '1fca0f09-6d4f-4812-afe8-1c78ea25e176', 'enforce_multipath': True} {{(pid=87444) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 10 04:47:15 devstack cinder-volume[87444]: INFO cinder.volume.manager [req-1107c434-f5a7-449f-b94f-e6bc1ea108d6 req-e13e91a3-e709-4cc3-b776-31a5de4a000f tempest-TestInstancesWithCinderVolumes-1741196733 None] attachment_update completed successfully. Jul 10 04:47:16 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-5eb539f5-88df-46c1-b0cc-745fc1989cfd tempest-TestStampPattern-1378957900 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 04:47:16 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-5eb539f5-88df-46c1-b0cc-745fc1989cfd tempest-TestStampPattern-1378957900 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.003s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 04:47:16 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.remotefs [None req-5eb539f5-88df-46c1-b0cc-745fc1989cfd tempest-TestStampPattern-1378957900 None] Creating offline snapshot 377c9456-51f8-4392-818b-e5e1f7eb7f99 of volume 420cd972-7ecb-4fdb-abf1-d859698bbb94 {{(pid=87444) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 10 04:47:16 devstack cinder-volume[87444]: DEBUG oslo.privsep.daemon [-] privsep: reply[933d6f1c-1690-424b-a7aa-3b3787a57c1c]: (4, 'qcow2') {{(pid=88499) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 04:47:16 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-5eb539f5-88df-46c1-b0cc-745fc1989cfd tempest-TestStampPattern-1378957900 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-420cd972-7ecb-4fdb-abf1-d859698bbb94 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:47:16 devstack sudo[100366]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-420cd972-7ecb-4fdb-abf1-d859698bbb94 Jul 10 04:47:16 devstack sudo[100366]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:47:16 devstack cinder-volume[87444]: DEBUG cinder.volume.flows.manager.create_volume [None req-b012f8ba-0838-4645-92a3-804694049fff tempest-TestServerVolumeAttachmentScenario-922014933 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87444) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 04:47:16 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-b012f8ba-0838-4645-92a3-804694049fff tempest-TestServerVolumeAttachmentScenario-922014933 None] Flow 'volume_create_manager' (2974fdd6-42e5-41a7-87e6-185dc165b565) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 04:47:16 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-b012f8ba-0838-4645-92a3-804694049fff tempest-TestServerVolumeAttachmentScenario-922014933 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6c5bca19-8f29-4ec2-b3b8-e313e95cc7a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:47:16 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-b012f8ba-0838-4645-92a3-804694049fff tempest-TestServerVolumeAttachmentScenario-922014933 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6c5bca19-8f29-4ec2-b3b8-e313e95cc7a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T02:47:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-1710993121',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6b52b010-e7a2-4354-8dc9-fb362998af6e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='27edf0fa2ce34d27878bf9005d9b5c94',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T02:47:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T02:47:17Z,use_quota=True,user_id='51e53e21d7cd442ca86bfeb582de407c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(317e369e-1e06-434d-ae95-a335f0e6c903),volume_type_id=317e369e-1e06-434d-ae95-a335f0e6c903)' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:47:16 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-b012f8ba-0838-4645-92a3-804694049fff tempest-TestServerVolumeAttachmentScenario-922014933 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d7362e22-d450-405c-8435-2ce4c2b3441a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:47:16 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-b012f8ba-0838-4645-92a3-804694049fff tempest-TestServerVolumeAttachmentScenario-922014933 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d7362e22-d450-405c-8435-2ce4c2b3441a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:47:16 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-b012f8ba-0838-4645-92a3-804694049fff tempest-TestServerVolumeAttachmentScenario-922014933 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (acbd7bfe-267f-47e6-8d9f-7a3e9b85de3d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:47:16 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-b012f8ba-0838-4645-92a3-804694049fff tempest-TestServerVolumeAttachmentScenario-922014933 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (acbd7bfe-267f-47e6-8d9f-7a3e9b85de3d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6b52b010-e7a2-4354-8dc9-fb362998af6e', 'volume_name': 'volume-6b52b010-e7a2-4354-8dc9-fb362998af6e', 'volume_size': 1}' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:47:16 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-b012f8ba-0838-4645-92a3-804694049fff tempest-TestServerVolumeAttachmentScenario-922014933 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cdf7d40c-ea53-46e8-983f-6c523edab674) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:47:16 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-b012f8ba-0838-4645-92a3-804694049fff tempest-TestServerVolumeAttachmentScenario-922014933 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cdf7d40c-ea53-46e8-983f-6c523edab674) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:47:16 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-b012f8ba-0838-4645-92a3-804694049fff tempest-TestServerVolumeAttachmentScenario-922014933 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b0e3934d-dc2d-4947-9742-12721ab7f2a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:47:16 devstack cinder-volume[87444]: INFO cinder.volume.flows.manager.create_volume [None req-b012f8ba-0838-4645-92a3-804694049fff tempest-TestServerVolumeAttachmentScenario-922014933 None] Volume 6b52b010-e7a2-4354-8dc9-fb362998af6e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6b52b010-e7a2-4354-8dc9-fb362998af6e', 'volume_size': 1} Jul 10 04:47:16 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-b012f8ba-0838-4645-92a3-804694049fff tempest-TestServerVolumeAttachmentScenario-922014933 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 04:47:17 devstack cinder-volume[87444]: DEBUG cinder.volume.flows.manager.create_volume [None req-fc56bd72-7e51-4fb6-a1db-5981933b247b tempest-TestServerVolumeAttachmentScenario-922014933 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87444) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 04:47:17 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-fc56bd72-7e51-4fb6-a1db-5981933b247b tempest-TestServerVolumeAttachmentScenario-922014933 None] Flow 'volume_create_manager' (911de590-2354-4c5f-bb77-7fcd507533e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 04:47:17 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-fc56bd72-7e51-4fb6-a1db-5981933b247b tempest-TestServerVolumeAttachmentScenario-922014933 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (95b22bd0-fc32-4a50-96a2-53af6ce25bdd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:47:17 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-fc56bd72-7e51-4fb6-a1db-5981933b247b tempest-TestServerVolumeAttachmentScenario-922014933 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (95b22bd0-fc32-4a50-96a2-53af6ce25bdd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T02:47:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-1819682026',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3ba472a0-8c20-4406-b602-b04311be740e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='27edf0fa2ce34d27878bf9005d9b5c94',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T02:47:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T02:47:17Z,use_quota=True,user_id='51e53e21d7cd442ca86bfeb582de407c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(317e369e-1e06-434d-ae95-a335f0e6c903),volume_type_id=317e369e-1e06-434d-ae95-a335f0e6c903)' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:47:17 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-fc56bd72-7e51-4fb6-a1db-5981933b247b tempest-TestServerVolumeAttachmentScenario-922014933 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c70dc997-2be6-400f-89a4-0f835484984b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:47:17 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-fc56bd72-7e51-4fb6-a1db-5981933b247b tempest-TestServerVolumeAttachmentScenario-922014933 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c70dc997-2be6-400f-89a4-0f835484984b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:47:17 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-fc56bd72-7e51-4fb6-a1db-5981933b247b tempest-TestServerVolumeAttachmentScenario-922014933 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1b1d4f5d-5c20-4de5-be52-3bee1f67c166) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:47:17 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-fc56bd72-7e51-4fb6-a1db-5981933b247b tempest-TestServerVolumeAttachmentScenario-922014933 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1b1d4f5d-5c20-4de5-be52-3bee1f67c166) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3ba472a0-8c20-4406-b602-b04311be740e', 'volume_name': 'volume-3ba472a0-8c20-4406-b602-b04311be740e', 'volume_size': 1}' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:47:17 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-fc56bd72-7e51-4fb6-a1db-5981933b247b tempest-TestServerVolumeAttachmentScenario-922014933 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6bd0c79a-7136-46ce-b586-13ec136b4f1f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:47:17 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-fc56bd72-7e51-4fb6-a1db-5981933b247b tempest-TestServerVolumeAttachmentScenario-922014933 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6bd0c79a-7136-46ce-b586-13ec136b4f1f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:47:17 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-fc56bd72-7e51-4fb6-a1db-5981933b247b tempest-TestServerVolumeAttachmentScenario-922014933 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2ecf4c1c-9dd5-4ede-9415-2542f87c5fc5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:47:17 devstack cinder-volume[87444]: INFO cinder.volume.flows.manager.create_volume [None req-fc56bd72-7e51-4fb6-a1db-5981933b247b tempest-TestServerVolumeAttachmentScenario-922014933 None] Volume 3ba472a0-8c20-4406-b602-b04311be740e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3ba472a0-8c20-4406-b602-b04311be740e', 'volume_size': 1} Jul 10 04:47:17 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-fc56bd72-7e51-4fb6-a1db-5981933b247b tempest-TestServerVolumeAttachmentScenario-922014933 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 04:47:17 devstack sudo[100366]: pam_unix(sudo:session): session closed for user root Jul 10 04:47:17 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-5eb539f5-88df-46c1-b0cc-745fc1989cfd tempest-TestStampPattern-1378957900 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-420cd972-7ecb-4fdb-abf1-d859698bbb94" returned: 0 in 1.088s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:47:17 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-5eb539f5-88df-46c1-b0cc-745fc1989cfd tempest-TestStampPattern-1378957900 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-420cd972-7ecb-4fdb-abf1-d859698bbb94,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-420cd972-7ecb-4fdb-abf1-d859698bbb94.377c9456-51f8-4392-818b-e5e1f7eb7f99 1G {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:47:17 devstack sudo[100374]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-420cd972-7ecb-4fdb-abf1-d859698bbb94,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-420cd972-7ecb-4fdb-abf1-d859698bbb94.377c9456-51f8-4392-818b-e5e1f7eb7f99 1G Jul 10 04:47:17 devstack sudo[100374]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:47:18 devstack sudo[100374]: pam_unix(sudo:session): session closed for user root Jul 10 04:47:18 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-5eb539f5-88df-46c1-b0cc-745fc1989cfd tempest-TestStampPattern-1378957900 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-420cd972-7ecb-4fdb-abf1-d859698bbb94,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-420cd972-7ecb-4fdb-abf1-d859698bbb94.377c9456-51f8-4392-818b-e5e1f7eb7f99 1G" returned: 0 in 1.039s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:47:18 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-5eb539f5-88df-46c1-b0cc-745fc1989cfd tempest-TestStampPattern-1378957900 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-420cd972-7ecb-4fdb-abf1-d859698bbb94 -F qcow2 /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-420cd972-7ecb-4fdb-abf1-d859698bbb94.377c9456-51f8-4392-818b-e5e1f7eb7f99 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:47:18 devstack sudo[100381]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-420cd972-7ecb-4fdb-abf1-d859698bbb94 -F qcow2 /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-420cd972-7ecb-4fdb-abf1-d859698bbb94.377c9456-51f8-4392-818b-e5e1f7eb7f99 Jul 10 04:47:18 devstack sudo[100381]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:47:19 devstack sudo[100381]: pam_unix(sudo:session): session closed for user root Jul 10 04:47:19 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-5eb539f5-88df-46c1-b0cc-745fc1989cfd tempest-TestStampPattern-1378957900 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-420cd972-7ecb-4fdb-abf1-d859698bbb94 -F qcow2 /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-420cd972-7ecb-4fdb-abf1-d859698bbb94.377c9456-51f8-4392-818b-e5e1f7eb7f99" returned: 0 in 0.871s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:47:19 devstack cinder-volume[87444]: WARNING cinder.volume.drivers.remotefs [None req-5eb539f5-88df-46c1-b0cc-745fc1989cfd tempest-TestStampPattern-1378957900 None] /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-420cd972-7ecb-4fdb-abf1-d859698bbb94.377c9456-51f8-4392-818b-e5e1f7eb7f99 is being set with open permissions: ugo+rw Jul 10 04:47:19 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-5eb539f5-88df-46c1-b0cc-745fc1989cfd tempest-TestStampPattern-1378957900 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-420cd972-7ecb-4fdb-abf1-d859698bbb94.377c9456-51f8-4392-818b-e5e1f7eb7f99 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:47:19 devstack sudo[100386]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-420cd972-7ecb-4fdb-abf1-d859698bbb94.377c9456-51f8-4392-818b-e5e1f7eb7f99 Jul 10 04:47:19 devstack sudo[100386]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:47:20 devstack sudo[100386]: pam_unix(sudo:session): session closed for user root Jul 10 04:47:20 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-5eb539f5-88df-46c1-b0cc-745fc1989cfd tempest-TestStampPattern-1378957900 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-420cd972-7ecb-4fdb-abf1-d859698bbb94.377c9456-51f8-4392-818b-e5e1f7eb7f99" returned: 0 in 0.919s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:47:20 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-5eb539f5-88df-46c1-b0cc-745fc1989cfd tempest-TestStampPattern-1378957900 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-420cd972-7ecb-4fdb-abf1-d859698bbb94.info {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:47:20 devstack sudo[100397]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-420cd972-7ecb-4fdb-abf1-d859698bbb94.info Jul 10 04:47:20 devstack sudo[100397]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:47:21 devstack sudo[100397]: pam_unix(sudo:session): session closed for user root Jul 10 04:47:21 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-5eb539f5-88df-46c1-b0cc-745fc1989cfd tempest-TestStampPattern-1378957900 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-420cd972-7ecb-4fdb-abf1-d859698bbb94.info" returned: 0 in 1.221s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:47:21 devstack cinder-volume[87444]: WARNING cinder.volume.drivers.remotefs [None req-5eb539f5-88df-46c1-b0cc-745fc1989cfd tempest-TestStampPattern-1378957900 None] /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-420cd972-7ecb-4fdb-abf1-d859698bbb94.info is being set with open permissions: ugo+rw Jul 10 04:47:21 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-5eb539f5-88df-46c1-b0cc-745fc1989cfd tempest-TestStampPattern-1378957900 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-420cd972-7ecb-4fdb-abf1-d859698bbb94.info {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:47:21 devstack sudo[100403]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-420cd972-7ecb-4fdb-abf1-d859698bbb94.info Jul 10 04:47:21 devstack sudo[100403]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:47:22 devstack sudo[100403]: pam_unix(sudo:session): session closed for user root Jul 10 04:47:22 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-5eb539f5-88df-46c1-b0cc-745fc1989cfd tempest-TestStampPattern-1378957900 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-420cd972-7ecb-4fdb-abf1-d859698bbb94.info" returned: 0 in 0.893s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:47:22 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-5eb539f5-88df-46c1-b0cc-745fc1989cfd tempest-TestStampPattern-1378957900 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 6.167s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 04:47:22 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-b012f8ba-0838-4645-92a3-804694049fff tempest-TestServerVolumeAttachmentScenario-922014933 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.767s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 04:47:22 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-b012f8ba-0838-4645-92a3-804694049fff tempest-TestServerVolumeAttachmentScenario-922014933 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T02:47:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-1710993121',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6b52b010-e7a2-4354-8dc9-fb362998af6e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='27edf0fa2ce34d27878bf9005d9b5c94',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T02:47:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T02:47:17Z,use_quota=True,user_id='51e53e21d7cd442ca86bfeb582de407c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(317e369e-1e06-434d-ae95-a335f0e6c903),volume_type_id=317e369e-1e06-434d-ae95-a335f0e6c903)}" {{(pid=87444) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 04:47:22 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.remotefs [None req-b012f8ba-0838-4645-92a3-804694049fff tempest-TestServerVolumeAttachmentScenario-922014933 None] Creating volume 6b52b010-e7a2-4354-8dc9-fb362998af6e {{(pid=87444) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 04:47:22 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-b012f8ba-0838-4645-92a3-804694049fff tempest-TestServerVolumeAttachmentScenario-922014933 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 04:47:22 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-b012f8ba-0838-4645-92a3-804694049fff tempest-TestServerVolumeAttachmentScenario-922014933 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 04:47:22 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-b012f8ba-0838-4645-92a3-804694049fff tempest-TestServerVolumeAttachmentScenario-922014933 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922': None} {{(pid=87444) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 04:47:22 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-b012f8ba-0838-4645-92a3-804694049fff tempest-TestServerVolumeAttachmentScenario-922014933 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922'] {{(pid=87444) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 04:47:22 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-b012f8ba-0838-4645-92a3-804694049fff tempest-TestServerVolumeAttachmentScenario-922014933 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 04:47:22 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-b012f8ba-0838-4645-92a3-804694049fff tempest-TestServerVolumeAttachmentScenario-922014933 None] Selected osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922 as target Quobyte volume. {{(pid=87444) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 04:47:22 devstack cinder-volume[87444]: INFO cinder.volume.drivers.remotefs [None req-b012f8ba-0838-4645-92a3-804694049fff tempest-TestServerVolumeAttachmentScenario-922014933 None] casted to osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922 Jul 10 04:47:22 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-b012f8ba-0838-4645-92a3-804694049fff tempest-TestServerVolumeAttachmentScenario-922014933 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-6b52b010-e7a2-4354-8dc9-fb362998af6e 1073741824 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:47:22 devstack sudo[100408]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-6b52b010-e7a2-4354-8dc9-fb362998af6e 1073741824 Jul 10 04:47:22 devstack sudo[100408]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:47:22 devstack cinder-volume[87444]: INFO cinder.volume.manager [None req-5eb539f5-88df-46c1-b0cc-745fc1989cfd tempest-TestStampPattern-1378957900 None] Create snapshot completed successfully Jul 10 04:47:23 devstack sudo[100408]: pam_unix(sudo:session): session closed for user root Jul 10 04:47:23 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-b012f8ba-0838-4645-92a3-804694049fff tempest-TestServerVolumeAttachmentScenario-922014933 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-6b52b010-e7a2-4354-8dc9-fb362998af6e 1073741824" returned: 0 in 1.377s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:47:23 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-b012f8ba-0838-4645-92a3-804694049fff tempest-TestServerVolumeAttachmentScenario-922014933 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-6b52b010-e7a2-4354-8dc9-fb362998af6e {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:47:23 devstack sudo[100436]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-6b52b010-e7a2-4354-8dc9-fb362998af6e Jul 10 04:47:23 devstack sudo[100436]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:47:24 devstack sudo[100436]: pam_unix(sudo:session): session closed for user root Jul 10 04:47:24 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-b012f8ba-0838-4645-92a3-804694049fff tempest-TestServerVolumeAttachmentScenario-922014933 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-6b52b010-e7a2-4354-8dc9-fb362998af6e" returned: 0 in 0.949s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:47:24 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-b012f8ba-0838-4645-92a3-804694049fff tempest-TestServerVolumeAttachmentScenario-922014933 None] <== create_volume: return (2411ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922'} {{(pid=87444) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 04:47:24 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-b012f8ba-0838-4645-92a3-804694049fff tempest-TestServerVolumeAttachmentScenario-922014933 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.415s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 04:47:24 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-fc56bd72-7e51-4fb6-a1db-5981933b247b tempest-TestServerVolumeAttachmentScenario-922014933 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.566s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 04:47:24 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-fc56bd72-7e51-4fb6-a1db-5981933b247b tempest-TestServerVolumeAttachmentScenario-922014933 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T02:47:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-1819682026',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3ba472a0-8c20-4406-b602-b04311be740e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='27edf0fa2ce34d27878bf9005d9b5c94',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T02:47:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T02:47:17Z,use_quota=True,user_id='51e53e21d7cd442ca86bfeb582de407c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(317e369e-1e06-434d-ae95-a335f0e6c903),volume_type_id=317e369e-1e06-434d-ae95-a335f0e6c903)}" {{(pid=87444) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 04:47:24 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.remotefs [None req-fc56bd72-7e51-4fb6-a1db-5981933b247b tempest-TestServerVolumeAttachmentScenario-922014933 None] Creating volume 3ba472a0-8c20-4406-b602-b04311be740e {{(pid=87444) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 04:47:24 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-fc56bd72-7e51-4fb6-a1db-5981933b247b tempest-TestServerVolumeAttachmentScenario-922014933 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 04:47:24 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-fc56bd72-7e51-4fb6-a1db-5981933b247b tempest-TestServerVolumeAttachmentScenario-922014933 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 04:47:24 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-fc56bd72-7e51-4fb6-a1db-5981933b247b tempest-TestServerVolumeAttachmentScenario-922014933 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922': None} {{(pid=87444) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 04:47:24 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-fc56bd72-7e51-4fb6-a1db-5981933b247b tempest-TestServerVolumeAttachmentScenario-922014933 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922'] {{(pid=87444) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 04:47:24 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-fc56bd72-7e51-4fb6-a1db-5981933b247b tempest-TestServerVolumeAttachmentScenario-922014933 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 04:47:24 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-fc56bd72-7e51-4fb6-a1db-5981933b247b tempest-TestServerVolumeAttachmentScenario-922014933 None] Selected osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922 as target Quobyte volume. {{(pid=87444) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 04:47:24 devstack cinder-volume[87444]: INFO cinder.volume.drivers.remotefs [None req-fc56bd72-7e51-4fb6-a1db-5981933b247b tempest-TestServerVolumeAttachmentScenario-922014933 None] casted to osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922 Jul 10 04:47:24 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-fc56bd72-7e51-4fb6-a1db-5981933b247b tempest-TestServerVolumeAttachmentScenario-922014933 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-3ba472a0-8c20-4406-b602-b04311be740e 1073741824 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:47:24 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-b012f8ba-0838-4645-92a3-804694049fff tempest-TestServerVolumeAttachmentScenario-922014933 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b0e3934d-dc2d-4947-9742-12721ab7f2a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6b52b010-e7a2-4354-8dc9-fb362998af6e', 'volume_size': 1}' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:47:24 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-b012f8ba-0838-4645-92a3-804694049fff tempest-TestServerVolumeAttachmentScenario-922014933 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (725cd70f-9de3-495c-a81a-7c02676cbb52) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:47:24 devstack sudo[100439]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-3ba472a0-8c20-4406-b602-b04311be740e 1073741824 Jul 10 04:47:24 devstack sudo[100439]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:47:24 devstack cinder-volume[87444]: INFO cinder.volume.flows.manager.create_volume [None req-b012f8ba-0838-4645-92a3-804694049fff tempest-TestServerVolumeAttachmentScenario-922014933 None] Volume volume-6b52b010-e7a2-4354-8dc9-fb362998af6e (6b52b010-e7a2-4354-8dc9-fb362998af6e): created successfully Jul 10 04:47:24 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-b012f8ba-0838-4645-92a3-804694049fff tempest-TestServerVolumeAttachmentScenario-922014933 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (725cd70f-9de3-495c-a81a-7c02676cbb52) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:47:24 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-b012f8ba-0838-4645-92a3-804694049fff tempest-TestServerVolumeAttachmentScenario-922014933 None] Flow 'volume_create_manager' (2974fdd6-42e5-41a7-87e6-185dc165b565) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87444) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 04:47:24 devstack cinder-volume[87444]: INFO cinder.volume.manager [None req-b012f8ba-0838-4645-92a3-804694049fff tempest-TestServerVolumeAttachmentScenario-922014933 None] Created volume successfully. Jul 10 04:47:25 devstack cinder-volume[87444]: INFO cinder.volume.manager [req-a0726cc3-716c-41de-a242-7a9bb76cb23d req-5fb0606f-f393-4115-8f17-aa23dffb788a tempest-TestInstancesWithCinderVolumes-1741196733 None] Terminate volume connection completed successfully. Jul 10 04:47:25 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [req-a0726cc3-716c-41de-a242-7a9bb76cb23d req-5fb0606f-f393-4115-8f17-aa23dffb788a tempest-TestInstancesWithCinderVolumes-1741196733 None] Deleting attachment 7e4c6d98-9be1-47a9-9251-49f86d36b2b9. {{(pid=87444) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 10 04:47:26 devstack sudo[100439]: pam_unix(sudo:session): session closed for user root Jul 10 04:47:26 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-fc56bd72-7e51-4fb6-a1db-5981933b247b tempest-TestServerVolumeAttachmentScenario-922014933 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-3ba472a0-8c20-4406-b602-b04311be740e 1073741824" returned: 0 in 1.361s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:47:26 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-fc56bd72-7e51-4fb6-a1db-5981933b247b tempest-TestServerVolumeAttachmentScenario-922014933 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-3ba472a0-8c20-4406-b602-b04311be740e {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:47:26 devstack sudo[100446]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-3ba472a0-8c20-4406-b602-b04311be740e Jul 10 04:47:26 devstack sudo[100446]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:47:27 devstack sudo[100446]: pam_unix(sudo:session): session closed for user root Jul 10 04:47:27 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-fc56bd72-7e51-4fb6-a1db-5981933b247b tempest-TestServerVolumeAttachmentScenario-922014933 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-3ba472a0-8c20-4406-b602-b04311be740e" returned: 0 in 0.931s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:47:27 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-fc56bd72-7e51-4fb6-a1db-5981933b247b tempest-TestServerVolumeAttachmentScenario-922014933 None] <== create_volume: return (2348ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922'} {{(pid=87444) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 04:47:27 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-fc56bd72-7e51-4fb6-a1db-5981933b247b tempest-TestServerVolumeAttachmentScenario-922014933 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.351s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 04:47:27 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-fc56bd72-7e51-4fb6-a1db-5981933b247b tempest-TestServerVolumeAttachmentScenario-922014933 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2ecf4c1c-9dd5-4ede-9415-2542f87c5fc5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3ba472a0-8c20-4406-b602-b04311be740e', 'volume_size': 1}' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:47:27 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-fc56bd72-7e51-4fb6-a1db-5981933b247b tempest-TestServerVolumeAttachmentScenario-922014933 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9dfd3b60-8e85-4e81-9656-239462b29e97) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:47:27 devstack cinder-volume[87444]: INFO cinder.volume.flows.manager.create_volume [None req-fc56bd72-7e51-4fb6-a1db-5981933b247b tempest-TestServerVolumeAttachmentScenario-922014933 None] Volume volume-3ba472a0-8c20-4406-b602-b04311be740e (3ba472a0-8c20-4406-b602-b04311be740e): created successfully Jul 10 04:47:27 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-fc56bd72-7e51-4fb6-a1db-5981933b247b tempest-TestServerVolumeAttachmentScenario-922014933 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9dfd3b60-8e85-4e81-9656-239462b29e97) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:47:27 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-fc56bd72-7e51-4fb6-a1db-5981933b247b tempest-TestServerVolumeAttachmentScenario-922014933 None] Flow 'volume_create_manager' (911de590-2354-4c5f-bb77-7fcd507533e3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87444) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 04:47:27 devstack cinder-volume[87444]: INFO cinder.volume.manager [None req-fc56bd72-7e51-4fb6-a1db-5981933b247b tempest-TestServerVolumeAttachmentScenario-922014933 None] Created volume successfully. Jul 10 04:47:27 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-90e0c06d-113e-4133-abb6-81084b991f65 tempest-TestInstancesWithCinderVolumes-1741196733 None] Acquiring lock "cinder-a9b21329-62c2-4cd4-8a67-34eb1efdc714-delete_volume" by "delete_volume" {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 04:47:27 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-90e0c06d-113e-4133-abb6-81084b991f65 tempest-TestInstancesWithCinderVolumes-1741196733 None] Lock "cinder-a9b21329-62c2-4cd4-8a67-34eb1efdc714-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 04:47:27 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-90e0c06d-113e-4133-abb6-81084b991f65 tempest-TestInstancesWithCinderVolumes-1741196733 None] Acquiring lock "cinder-quobyte-a9b21329-62c2-4cd4-8a67-34eb1efdc714" by "delete_volume" {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 04:47:27 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-90e0c06d-113e-4133-abb6-81084b991f65 tempest-TestInstancesWithCinderVolumes-1741196733 None] Lock "cinder-quobyte-a9b21329-62c2-4cd4-8a67-34eb1efdc714" acquired by "delete_volume" :: waited 0.026s {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 04:47:27 devstack cinder-volume[87444]: DEBUG oslo.privsep.daemon [-] privsep: reply[940ed323-d531-46d1-a88f-5afa9b30e125]: (4, 'qcow2') {{(pid=88499) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 04:47:27 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-90e0c06d-113e-4133-abb6-81084b991f65 tempest-TestInstancesWithCinderVolumes-1741196733 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-a9b21329-62c2-4cd4-8a67-34eb1efdc714 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:47:28 devstack sudo[100466]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-a9b21329-62c2-4cd4-8a67-34eb1efdc714 Jul 10 04:47:28 devstack sudo[100466]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:47:29 devstack sudo[100466]: pam_unix(sudo:session): session closed for user root Jul 10 04:47:29 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-90e0c06d-113e-4133-abb6-81084b991f65 tempest-TestInstancesWithCinderVolumes-1741196733 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-a9b21329-62c2-4cd4-8a67-34eb1efdc714" returned: 0 in 1.298s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:47:29 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-90e0c06d-113e-4133-abb6-81084b991f65 tempest-TestInstancesWithCinderVolumes-1741196733 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-a9b21329-62c2-4cd4-8a67-34eb1efdc714 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:47:29 devstack sudo[100512]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-a9b21329-62c2-4cd4-8a67-34eb1efdc714 Jul 10 04:47:29 devstack sudo[100512]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:47:30 devstack sudo[100512]: pam_unix(sudo:session): session closed for user root Jul 10 04:47:30 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-90e0c06d-113e-4133-abb6-81084b991f65 tempest-TestInstancesWithCinderVolumes-1741196733 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-a9b21329-62c2-4cd4-8a67-34eb1efdc714" returned: 0 in 0.798s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:47:30 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-90e0c06d-113e-4133-abb6-81084b991f65 tempest-TestInstancesWithCinderVolumes-1741196733 None] Lock "cinder-quobyte-a9b21329-62c2-4cd4-8a67-34eb1efdc714" released by "delete_volume" :: held 2.177s {{(pid=87444) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 04:47:30 devstack cinder-volume[87444]: WARNING cinder.quota [None req-90e0c06d-113e-4133-abb6-81084b991f65 tempest-TestInstancesWithCinderVolumes-1741196733 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1761409748-1853224033 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1761409748-1853224033, it is now deprecated. Please use the default quota class for default quota. Jul 10 04:47:30 devstack cinder-volume[87444]: WARNING cinder.quota [None req-90e0c06d-113e-4133-abb6-81084b991f65 tempest-TestInstancesWithCinderVolumes-1741196733 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1761409748-1853224033 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1761409748-1853224033, it is now deprecated. Please use the default quota class for default quota. Jul 10 04:47:30 devstack cinder-volume[87444]: DEBUG cinder.quota [None req-90e0c06d-113e-4133-abb6-81084b991f65 tempest-TestInstancesWithCinderVolumes-1741196733 None] Created reservations ['398c1dcf-c57b-4dae-a139-a91899a25eb4', '8efa717b-f87c-43e3-8724-df73bfed3522', 'c527b32f-4a76-44e4-ba2a-27909580e98f', '816907bf-3663-4079-95b2-23513b0fa46a'] {{(pid=87444) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 04:47:30 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-90e0c06d-113e-4133-abb6-81084b991f65 tempest-TestInstancesWithCinderVolumes-1741196733 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 04:47:30 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-90e0c06d-113e-4133-abb6-81084b991f65 tempest-TestInstancesWithCinderVolumes-1741196733 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 04:47:30 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-90e0c06d-113e-4133-abb6-81084b991f65 tempest-TestInstancesWithCinderVolumes-1741196733 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922': None} {{(pid=87444) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 04:47:30 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-90e0c06d-113e-4133-abb6-81084b991f65 tempest-TestInstancesWithCinderVolumes-1741196733 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922'] {{(pid=87444) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 04:47:30 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-90e0c06d-113e-4133-abb6-81084b991f65 tempest-TestInstancesWithCinderVolumes-1741196733 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 04:47:30 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-90e0c06d-113e-4133-abb6-81084b991f65 tempest-TestInstancesWithCinderVolumes-1741196733 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:47:30 devstack sudo[100515]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097 Jul 10 04:47:30 devstack sudo[100515]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:47:31 devstack sudo[100515]: pam_unix(sudo:session): session closed for user root Jul 10 04:47:31 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-90e0c06d-113e-4133-abb6-81084b991f65 tempest-TestInstancesWithCinderVolumes-1741196733 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097" returned: 0 in 0.876s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:47:31 devstack cinder-volume[87444]: DEBUG cinder.manager [None req-90e0c06d-113e-4133-abb6-81084b991f65 tempest-TestInstancesWithCinderVolumes-1741196733 None] Notifying Schedulers of capabilities ... {{(pid=87444) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 04:47:31 devstack cinder-volume[87444]: INFO cinder.volume.manager [None req-90e0c06d-113e-4133-abb6-81084b991f65 tempest-TestInstancesWithCinderVolumes-1741196733 None] Deleted volume successfully. Jul 10 04:47:31 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-90e0c06d-113e-4133-abb6-81084b991f65 tempest-TestInstancesWithCinderVolumes-1741196733 None] Lock "cinder-a9b21329-62c2-4cd4-8a67-34eb1efdc714-delete_volume" released by "delete_volume" :: held 3.394s {{(pid=87444) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 04:47:33 devstack cinder-volume[87444]: DEBUG oslo_service.periodic_task [None req-01f0ce3e-6850-4e14-881d-e40d3c4ad6e5 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87444) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 10 04:47:33 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-01f0ce3e-6850-4e14-881d-e40d3c4ad6e5 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 04:47:33 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-01f0ce3e-6850-4e14-881d-e40d3c4ad6e5 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 04:47:33 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-01f0ce3e-6850-4e14-881d-e40d3c4ad6e5 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922': None} {{(pid=87444) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 04:47:33 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-01f0ce3e-6850-4e14-881d-e40d3c4ad6e5 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922'] {{(pid=87444) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 04:47:33 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-01f0ce3e-6850-4e14-881d-e40d3c4ad6e5 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 04:47:33 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-01f0ce3e-6850-4e14-881d-e40d3c4ad6e5 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:47:33 devstack sudo[100569]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097 Jul 10 04:47:33 devstack sudo[100569]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:47:33 devstack cinder-volume[87444]: INFO cinder.volume.manager [req-656d83d2-3c42-4196-95ce-9c643c8022de req-7729a5bb-6f51-4a75-8cca-e43f54758d32 tempest-TestInstancesWithCinderVolumes-1741196733 None] Terminate volume connection completed successfully. Jul 10 04:47:33 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [req-656d83d2-3c42-4196-95ce-9c643c8022de req-7729a5bb-6f51-4a75-8cca-e43f54758d32 tempest-TestInstancesWithCinderVolumes-1741196733 None] Deleting attachment 1fca0f09-6d4f-4812-afe8-1c78ea25e176. {{(pid=87444) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 10 04:47:34 devstack sudo[100569]: pam_unix(sudo:session): session closed for user root Jul 10 04:47:34 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-01f0ce3e-6850-4e14-881d-e40d3c4ad6e5 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097" returned: 0 in 1.066s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:47:34 devstack cinder-volume[87444]: DEBUG cinder.manager [None req-01f0ce3e-6850-4e14-881d-e40d3c4ad6e5 None None] Notifying Schedulers of capabilities ... {{(pid=87444) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 04:47:34 devstack cinder-volume[87444]: DEBUG oslo_service.periodic_task [None req-01f0ce3e-6850-4e14-881d-e40d3c4ad6e5 None None] Running periodic task VolumeManager._thread_info {{(pid=87444) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 10 04:47:34 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-01f0ce3e-6850-4e14-881d-e40d3c4ad6e5 None None] thread count: 28 {{(pid=87444) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 10 04:47:34 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-01f0ce3e-6850-4e14-881d-e40d3c4ad6e5 None None] thread info: [<_MainThread(MainThread, started 126839257915520)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87444) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 10 04:47:35 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-8f7b1fc5-e818-4870-b15e-15adea61d38d tempest-TestInstancesWithCinderVolumes-1741196733 None] Acquiring lock "cinder-7d23f8f0-4475-43cb-b423-8aeb7a87c98d-delete_volume" by "delete_volume" {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 04:47:35 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-8f7b1fc5-e818-4870-b15e-15adea61d38d tempest-TestInstancesWithCinderVolumes-1741196733 None] Lock "cinder-7d23f8f0-4475-43cb-b423-8aeb7a87c98d-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 04:47:35 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-8f7b1fc5-e818-4870-b15e-15adea61d38d tempest-TestInstancesWithCinderVolumes-1741196733 None] Acquiring lock "cinder-quobyte-7d23f8f0-4475-43cb-b423-8aeb7a87c98d" by "delete_volume" {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 04:47:35 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-8f7b1fc5-e818-4870-b15e-15adea61d38d tempest-TestInstancesWithCinderVolumes-1741196733 None] Lock "cinder-quobyte-7d23f8f0-4475-43cb-b423-8aeb7a87c98d" acquired by "delete_volume" :: waited 0.015s {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 04:47:35 devstack cinder-volume[87444]: DEBUG oslo.privsep.daemon [-] privsep: reply[29d28a20-9ce8-4e02-bae2-1c98f122182b]: (4, 'qcow2') {{(pid=88499) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 04:47:35 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-8f7b1fc5-e818-4870-b15e-15adea61d38d tempest-TestInstancesWithCinderVolumes-1741196733 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-7d23f8f0-4475-43cb-b423-8aeb7a87c98d {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:47:35 devstack cinder-volume[87444]: DEBUG cinder.volume.flows.manager.create_volume [None req-a635b04b-9d70-4a5e-8e27-9c2118794dcc tempest-TestStampPattern-1378957900 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87444) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 04:47:35 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-a635b04b-9d70-4a5e-8e27-9c2118794dcc tempest-TestStampPattern-1378957900 None] Flow 'volume_create_manager' (368a0504-2e22-475f-a666-bebeb2d133ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 04:47:35 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-a635b04b-9d70-4a5e-8e27-9c2118794dcc tempest-TestStampPattern-1378957900 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6cf45256-c1f4-4413-9900-7efe9f92dd92) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:47:35 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-a635b04b-9d70-4a5e-8e27-9c2118794dcc tempest-TestStampPattern-1378957900 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6cf45256-c1f4-4413-9900-7efe9f92dd92) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T02:47:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-673154389',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1619d28f-d75b-43c4-9227-e309e35ee077,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='97695cee493e44c8b788d712728bc23f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T02:47:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=377c9456-51f8-4392-818b-e5e1f7eb7f99,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T02:47:36Z,use_quota=True,user_id='15e772be8620466c96f211a214493a88',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(317e369e-1e06-434d-ae95-a335f0e6c903),volume_type_id=317e369e-1e06-434d-ae95-a335f0e6c903)' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:47:35 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-a635b04b-9d70-4a5e-8e27-9c2118794dcc tempest-TestStampPattern-1378957900 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bd337ce7-f7d3-493c-ac62-8007a671393a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:47:35 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-a635b04b-9d70-4a5e-8e27-9c2118794dcc tempest-TestStampPattern-1378957900 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bd337ce7-f7d3-493c-ac62-8007a671393a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:47:35 devstack sudo[100608]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-7d23f8f0-4475-43cb-b423-8aeb7a87c98d Jul 10 04:47:35 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-a635b04b-9d70-4a5e-8e27-9c2118794dcc tempest-TestStampPattern-1378957900 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e73d2e47-4beb-4eea-9e48-fb97f087d24e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:47:35 devstack sudo[100608]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:47:35 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-a635b04b-9d70-4a5e-8e27-9c2118794dcc tempest-TestStampPattern-1378957900 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e73d2e47-4beb-4eea-9e48-fb97f087d24e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '1619d28f-d75b-43c4-9227-e309e35ee077', 'volume_name': 'volume-1619d28f-d75b-43c4-9227-e309e35ee077', 'volume_size': 1, 'snapshot_id': '377c9456-51f8-4392-818b-e5e1f7eb7f99'}' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:47:35 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-a635b04b-9d70-4a5e-8e27-9c2118794dcc tempest-TestStampPattern-1378957900 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d0e7492a-85d4-4867-abb0-b710d6e5c980) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:47:35 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-a635b04b-9d70-4a5e-8e27-9c2118794dcc tempest-TestStampPattern-1378957900 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d0e7492a-85d4-4867-abb0-b710d6e5c980) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:47:35 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-a635b04b-9d70-4a5e-8e27-9c2118794dcc tempest-TestStampPattern-1378957900 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (27fdf2c9-b94e-4131-b25e-0c4137aeea3d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:47:35 devstack cinder-volume[87444]: INFO cinder.volume.flows.manager.create_volume [None req-a635b04b-9d70-4a5e-8e27-9c2118794dcc tempest-TestStampPattern-1378957900 None] Volume 1619d28f-d75b-43c4-9227-e309e35ee077: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-1619d28f-d75b-43c4-9227-e309e35ee077', 'volume_size': 1, 'snapshot_id': '377c9456-51f8-4392-818b-e5e1f7eb7f99'} Jul 10 04:47:36 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-a635b04b-9d70-4a5e-8e27-9c2118794dcc tempest-TestStampPattern-1378957900 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 04:47:36 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-a635b04b-9d70-4a5e-8e27-9c2118794dcc tempest-TestStampPattern-1378957900 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 04:47:36 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-a635b04b-9d70-4a5e-8e27-9c2118794dcc tempest-TestStampPattern-1378957900 None] Acquiring lock "cinder-quobyte-377c9456-51f8-4392-818b-e5e1f7eb7f99-1619d28f-d75b-43c4-9227-e309e35ee077" by "_create_volume_from_snapshot" {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 04:47:36 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-a635b04b-9d70-4a5e-8e27-9c2118794dcc tempest-TestStampPattern-1378957900 None] Lock "cinder-quobyte-377c9456-51f8-4392-818b-e5e1f7eb7f99-1619d28f-d75b-43c4-9227-e309e35ee077" acquired by "_create_volume_from_snapshot" :: waited 0.027s {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 04:47:36 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-a635b04b-9d70-4a5e-8e27-9c2118794dcc tempest-TestStampPattern-1378957900 None] Creating volume 1619d28f-d75b-43c4-9227-e309e35ee077 from snapshot 377c9456-51f8-4392-818b-e5e1f7eb7f99 {{(pid=87444) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Jul 10 04:47:36 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-a635b04b-9d70-4a5e-8e27-9c2118794dcc tempest-TestStampPattern-1378957900 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 04:47:36 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-a635b04b-9d70-4a5e-8e27-9c2118794dcc tempest-TestStampPattern-1378957900 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 04:47:36 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-a635b04b-9d70-4a5e-8e27-9c2118794dcc tempest-TestStampPattern-1378957900 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922': None} {{(pid=87444) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 04:47:36 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-a635b04b-9d70-4a5e-8e27-9c2118794dcc tempest-TestStampPattern-1378957900 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922'] {{(pid=87444) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 04:47:36 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-a635b04b-9d70-4a5e-8e27-9c2118794dcc tempest-TestStampPattern-1378957900 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 04:47:36 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-a635b04b-9d70-4a5e-8e27-9c2118794dcc tempest-TestStampPattern-1378957900 None] Selected osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922 as target Quobyte volume. {{(pid=87444) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 04:47:36 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-a635b04b-9d70-4a5e-8e27-9c2118794dcc tempest-TestStampPattern-1378957900 None] Acquiring lock "cinder-quobyte-1619d28f-d75b-43c4-9227-e309e35ee077" by "_copy_volume_from_snapshot" {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 04:47:36 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-a635b04b-9d70-4a5e-8e27-9c2118794dcc tempest-TestStampPattern-1378957900 None] Lock "cinder-quobyte-1619d28f-d75b-43c4-9227-e309e35ee077" acquired by "_copy_volume_from_snapshot" :: waited 0.031s {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 04:47:36 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-a635b04b-9d70-4a5e-8e27-9c2118794dcc tempest-TestStampPattern-1378957900 None] snapshot: 377c9456-51f8-4392-818b-e5e1f7eb7f99, volume: 1619d28f-d75b-43c4-9227-e309e35ee077, {{(pid=87444) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jul 10 04:47:36 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-a635b04b-9d70-4a5e-8e27-9c2118794dcc tempest-TestStampPattern-1378957900 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 04:47:36 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-a635b04b-9d70-4a5e-8e27-9c2118794dcc tempest-TestStampPattern-1378957900 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 04:47:36 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-a635b04b-9d70-4a5e-8e27-9c2118794dcc tempest-TestStampPattern-1378957900 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922': None} {{(pid=87444) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 04:47:36 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-a635b04b-9d70-4a5e-8e27-9c2118794dcc tempest-TestStampPattern-1378957900 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922'] {{(pid=87444) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 04:47:36 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-a635b04b-9d70-4a5e-8e27-9c2118794dcc tempest-TestStampPattern-1378957900 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 04:47:36 devstack cinder-volume[87444]: DEBUG oslo.privsep.daemon [-] privsep: reply[b373d6dc-9f39-4d49-a4e1-205582add86b]: (4, 'qcow2') {{(pid=88499) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 04:47:36 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-a635b04b-9d70-4a5e-8e27-9c2118794dcc tempest-TestStampPattern-1378957900 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-420cd972-7ecb-4fdb-abf1-d859698bbb94.377c9456-51f8-4392-818b-e5e1f7eb7f99 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:47:36 devstack sudo[100624]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-420cd972-7ecb-4fdb-abf1-d859698bbb94.377c9456-51f8-4392-818b-e5e1f7eb7f99 Jul 10 04:47:36 devstack sudo[100624]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:47:37 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-8f7b1fc5-e818-4870-b15e-15adea61d38d tempest-TestInstancesWithCinderVolumes-1741196733 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-7d23f8f0-4475-43cb-b423-8aeb7a87c98d" returned: 0 in 1.505s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:47:37 devstack sudo[100608]: pam_unix(sudo:session): session closed for user root Jul 10 04:47:37 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-8f7b1fc5-e818-4870-b15e-15adea61d38d tempest-TestInstancesWithCinderVolumes-1741196733 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-7d23f8f0-4475-43cb-b423-8aeb7a87c98d {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:47:37 devstack sudo[100656]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-7d23f8f0-4475-43cb-b423-8aeb7a87c98d Jul 10 04:47:37 devstack sudo[100656]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:47:37 devstack sudo[100624]: pam_unix(sudo:session): session closed for user root Jul 10 04:47:37 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-a635b04b-9d70-4a5e-8e27-9c2118794dcc tempest-TestStampPattern-1378957900 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-420cd972-7ecb-4fdb-abf1-d859698bbb94.377c9456-51f8-4392-818b-e5e1f7eb7f99" returned: 0 in 1.439s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:47:37 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.remotefs [None req-a635b04b-9d70-4a5e-8e27-9c2118794dcc tempest-TestStampPattern-1378957900 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-420cd972-7ecb-4fdb-abf1-d859698bbb94(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87444) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 10 04:47:37 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-a635b04b-9d70-4a5e-8e27-9c2118794dcc tempest-TestStampPattern-1378957900 None] will copy from snapshot at /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-420cd972-7ecb-4fdb-abf1-d859698bbb94 {{(pid=87444) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jul 10 04:47:37 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-a635b04b-9d70-4a5e-8e27-9c2118794dcc tempest-TestStampPattern-1378957900 None] Creating direct copy from snapshot {{(pid=87444) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jul 10 04:47:37 devstack cinder-volume[87444]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5141b01-91ad-456c-aaf9-d68243c3460b]: (4, 'qcow2') {{(pid=88499) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 04:47:37 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-a635b04b-9d70-4a5e-8e27-9c2118794dcc tempest-TestStampPattern-1378957900 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-420cd972-7ecb-4fdb-abf1-d859698bbb94 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:47:38 devstack sudo[100660]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-420cd972-7ecb-4fdb-abf1-d859698bbb94 Jul 10 04:47:38 devstack sudo[100660]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:47:38 devstack sudo[100656]: pam_unix(sudo:session): session closed for user root Jul 10 04:47:38 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-8f7b1fc5-e818-4870-b15e-15adea61d38d tempest-TestInstancesWithCinderVolumes-1741196733 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-7d23f8f0-4475-43cb-b423-8aeb7a87c98d" returned: 0 in 1.117s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:47:38 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-8f7b1fc5-e818-4870-b15e-15adea61d38d tempest-TestInstancesWithCinderVolumes-1741196733 None] Lock "cinder-quobyte-7d23f8f0-4475-43cb-b423-8aeb7a87c98d" released by "delete_volume" :: held 2.718s {{(pid=87444) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 04:47:38 devstack cinder-volume[87444]: WARNING cinder.quota [None req-8f7b1fc5-e818-4870-b15e-15adea61d38d tempest-TestInstancesWithCinderVolumes-1741196733 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-944885022-1262683356 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-944885022-1262683356, it is now deprecated. Please use the default quota class for default quota. Jul 10 04:47:38 devstack cinder-volume[87444]: WARNING cinder.quota [None req-8f7b1fc5-e818-4870-b15e-15adea61d38d tempest-TestInstancesWithCinderVolumes-1741196733 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-944885022-1262683356 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-944885022-1262683356, it is now deprecated. Please use the default quota class for default quota. Jul 10 04:47:38 devstack cinder-volume[87444]: DEBUG cinder.quota [None req-8f7b1fc5-e818-4870-b15e-15adea61d38d tempest-TestInstancesWithCinderVolumes-1741196733 None] Created reservations ['b05128e9-3a63-4524-9bf4-767fddab7c33', '98171d75-1ece-4d0c-84cc-ad9b5760205a', '97bba320-4459-4283-b04a-02daf5f8ef45', 'a871a278-dc88-49ef-8897-0ebbccf796f3'] {{(pid=87444) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 04:47:38 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-8f7b1fc5-e818-4870-b15e-15adea61d38d tempest-TestInstancesWithCinderVolumes-1741196733 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 04:47:38 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-8f7b1fc5-e818-4870-b15e-15adea61d38d tempest-TestInstancesWithCinderVolumes-1741196733 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 04:47:38 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-8f7b1fc5-e818-4870-b15e-15adea61d38d tempest-TestInstancesWithCinderVolumes-1741196733 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922': None} {{(pid=87444) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 04:47:38 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-8f7b1fc5-e818-4870-b15e-15adea61d38d tempest-TestInstancesWithCinderVolumes-1741196733 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922'] {{(pid=87444) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 04:47:38 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-8f7b1fc5-e818-4870-b15e-15adea61d38d tempest-TestInstancesWithCinderVolumes-1741196733 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 04:47:38 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-8f7b1fc5-e818-4870-b15e-15adea61d38d tempest-TestInstancesWithCinderVolumes-1741196733 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:47:38 devstack sudo[100664]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097 Jul 10 04:47:38 devstack sudo[100664]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:47:39 devstack sudo[100660]: pam_unix(sudo:session): session closed for user root Jul 10 04:47:39 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-a635b04b-9d70-4a5e-8e27-9c2118794dcc tempest-TestStampPattern-1378957900 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-420cd972-7ecb-4fdb-abf1-d859698bbb94" returned: 0 in 2.252s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:47:39 devstack cinder-volume[87444]: DEBUG cinder.utils [None req-a635b04b-9d70-4a5e-8e27-9c2118794dcc tempest-TestStampPattern-1378957900 None] Path /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-1619d28f-d75b-43c4-9227-e309e35ee077 not found in is_blk_device check {{(pid=87444) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 10 04:47:39 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-a635b04b-9d70-4a5e-8e27-9c2118794dcc tempest-TestStampPattern-1378957900 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-420cd972-7ecb-4fdb-abf1-d859698bbb94 /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-1619d28f-d75b-43c4-9227-e309e35ee077 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:47:40 devstack sudo[100688]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-420cd972-7ecb-4fdb-abf1-d859698bbb94 /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-1619d28f-d75b-43c4-9227-e309e35ee077 Jul 10 04:47:40 devstack sudo[100688]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:47:40 devstack sudo[100664]: pam_unix(sudo:session): session closed for user root Jul 10 04:47:40 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-8f7b1fc5-e818-4870-b15e-15adea61d38d tempest-TestInstancesWithCinderVolumes-1741196733 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097" returned: 0 in 1.443s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:47:40 devstack cinder-volume[87444]: DEBUG cinder.manager [None req-8f7b1fc5-e818-4870-b15e-15adea61d38d tempest-TestInstancesWithCinderVolumes-1741196733 None] Notifying Schedulers of capabilities ... {{(pid=87444) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 04:47:40 devstack cinder-volume[87444]: INFO cinder.volume.manager [None req-8f7b1fc5-e818-4870-b15e-15adea61d38d tempest-TestInstancesWithCinderVolumes-1741196733 None] Deleted volume successfully. Jul 10 04:47:40 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-8f7b1fc5-e818-4870-b15e-15adea61d38d tempest-TestInstancesWithCinderVolumes-1741196733 None] Lock "cinder-7d23f8f0-4475-43cb-b423-8aeb7a87c98d-delete_volume" released by "delete_volume" :: held 4.486s {{(pid=87444) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 04:47:48 devstack cinder-volume[87444]: DEBUG dbcounter [-] [87444] Writing DB stats cinder:UPDATE=52,cinder:DELETE=6,cinder:SELECT=60,cinder:INSERT=12 {{(pid=87444) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 10 04:47:48 devstack sudo[100688]: pam_unix(sudo:session): session closed for user root Jul 10 04:47:48 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-a635b04b-9d70-4a5e-8e27-9c2118794dcc tempest-TestStampPattern-1378957900 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-420cd972-7ecb-4fdb-abf1-d859698bbb94 /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-1619d28f-d75b-43c4-9227-e309e35ee077" returned: 0 in 8.885s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:47:48 devstack cinder-volume[87444]: DEBUG oslo.privsep.daemon [-] privsep: reply[82828b8c-d01d-41b2-995d-193fcc1d5974]: (4, 'qcow2') {{(pid=88499) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 04:47:48 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-a635b04b-9d70-4a5e-8e27-9c2118794dcc tempest-TestStampPattern-1378957900 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-420cd972-7ecb-4fdb-abf1-d859698bbb94 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:47:49 devstack sudo[100714]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-420cd972-7ecb-4fdb-abf1-d859698bbb94 Jul 10 04:47:49 devstack sudo[100714]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:47:50 devstack cinder-volume[87444]: DEBUG dbcounter [-] [87444] Writing DB stats cinder:UPDATE=67,cinder:SELECT=57,cinder:INSERT=13,cinder:DELETE=5 {{(pid=87444) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 10 04:47:50 devstack sudo[100714]: pam_unix(sudo:session): session closed for user root Jul 10 04:47:50 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-a635b04b-9d70-4a5e-8e27-9c2118794dcc tempest-TestStampPattern-1378957900 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-420cd972-7ecb-4fdb-abf1-d859698bbb94" returned: 0 in 1.977s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:47:50 devstack cinder-volume[87444]: DEBUG cinder.image.image_utils [None req-a635b04b-9d70-4a5e-8e27-9c2118794dcc tempest-TestStampPattern-1378957900 None] Image conversion details: src /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-420cd972-7ecb-4fdb-abf1-d859698bbb94, size 1024.00 MB, duration 8.89 sec, destination /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-1619d28f-d75b-43c4-9227-e309e35ee077 {{(pid=87444) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:561}} Jul 10 04:47:50 devstack cinder-volume[87444]: INFO cinder.image.image_utils [None req-a635b04b-9d70-4a5e-8e27-9c2118794dcc tempest-TestStampPattern-1378957900 None] Converted 1024.00 MB image at 115.24 MB/s Jul 10 04:47:50 devstack cinder-volume[87444]: WARNING cinder.volume.drivers.remotefs [None req-a635b04b-9d70-4a5e-8e27-9c2118794dcc tempest-TestStampPattern-1378957900 None] /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-1619d28f-d75b-43c4-9227-e309e35ee077 is being set with open permissions: ugo+rw Jul 10 04:47:50 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-a635b04b-9d70-4a5e-8e27-9c2118794dcc tempest-TestStampPattern-1378957900 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-1619d28f-d75b-43c4-9227-e309e35ee077 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:47:50 devstack sudo[100754]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-1619d28f-d75b-43c4-9227-e309e35ee077 Jul 10 04:47:50 devstack sudo[100754]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:47:52 devstack sudo[100754]: pam_unix(sudo:session): session closed for user root Jul 10 04:47:52 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-a635b04b-9d70-4a5e-8e27-9c2118794dcc tempest-TestStampPattern-1378957900 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-1619d28f-d75b-43c4-9227-e309e35ee077" returned: 0 in 1.191s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:47:52 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-a635b04b-9d70-4a5e-8e27-9c2118794dcc tempest-TestStampPattern-1378957900 None] Lock "cinder-quobyte-1619d28f-d75b-43c4-9227-e309e35ee077" released by "_copy_volume_from_snapshot" :: held 16.001s {{(pid=87444) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 04:47:52 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-a635b04b-9d70-4a5e-8e27-9c2118794dcc tempest-TestStampPattern-1378957900 None] Lock "cinder-quobyte-377c9456-51f8-4392-818b-e5e1f7eb7f99-1619d28f-d75b-43c4-9227-e309e35ee077" released by "_create_volume_from_snapshot" :: held 16.062s {{(pid=87444) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 04:47:52 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-a635b04b-9d70-4a5e-8e27-9c2118794dcc tempest-TestStampPattern-1378957900 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 16.091s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 04:47:52 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-a635b04b-9d70-4a5e-8e27-9c2118794dcc tempest-TestStampPattern-1378957900 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (27fdf2c9-b94e-4131-b25e-0c4137aeea3d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1619d28f-d75b-43c4-9227-e309e35ee077', 'volume_size': 1, 'snapshot_id': '377c9456-51f8-4392-818b-e5e1f7eb7f99'}' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:47:52 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-a635b04b-9d70-4a5e-8e27-9c2118794dcc tempest-TestStampPattern-1378957900 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7b73067f-1284-4e39-a0d1-03a80bef58b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:47:52 devstack cinder-volume[87444]: INFO cinder.volume.flows.manager.create_volume [None req-a635b04b-9d70-4a5e-8e27-9c2118794dcc tempest-TestStampPattern-1378957900 None] Volume volume-1619d28f-d75b-43c4-9227-e309e35ee077 (1619d28f-d75b-43c4-9227-e309e35ee077): created successfully Jul 10 04:47:52 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-a635b04b-9d70-4a5e-8e27-9c2118794dcc tempest-TestStampPattern-1378957900 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7b73067f-1284-4e39-a0d1-03a80bef58b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:47:52 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-a635b04b-9d70-4a5e-8e27-9c2118794dcc tempest-TestStampPattern-1378957900 None] Flow 'volume_create_manager' (368a0504-2e22-475f-a666-bebeb2d133ad) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87444) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 04:47:52 devstack cinder-volume[87444]: INFO cinder.volume.manager [None req-a635b04b-9d70-4a5e-8e27-9c2118794dcc tempest-TestStampPattern-1378957900 None] Created volume successfully. Jul 10 04:47:54 devstack cinder-volume[87444]: INFO cinder.volume.manager [req-59729110-eaf2-424a-b9f6-20bd40e555a0 req-47e45d0f-8068-4a81-a376-8344c522d23d tempest-TestInstancesWithCinderVolumes-1741196733 None] Terminate volume connection completed successfully. Jul 10 04:47:54 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [req-59729110-eaf2-424a-b9f6-20bd40e555a0 req-47e45d0f-8068-4a81-a376-8344c522d23d tempest-TestInstancesWithCinderVolumes-1741196733 None] Deleting attachment c8df2f00-e038-4e4c-962c-59e4c61a37d2. {{(pid=87444) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 10 04:47:57 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-3a0c48a2-bf80-4f28-bc79-fd9932384392 tempest-TestInstancesWithCinderVolumes-1741196733 None] Acquiring lock "cinder-51f17d86-5d8b-4a30-b599-e679ed47dd26-delete_volume" by "delete_volume" {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 04:47:57 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-3a0c48a2-bf80-4f28-bc79-fd9932384392 tempest-TestInstancesWithCinderVolumes-1741196733 None] Lock "cinder-51f17d86-5d8b-4a30-b599-e679ed47dd26-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 04:47:58 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-3a0c48a2-bf80-4f28-bc79-fd9932384392 tempest-TestInstancesWithCinderVolumes-1741196733 None] Acquiring lock "cinder-quobyte-51f17d86-5d8b-4a30-b599-e679ed47dd26" by "delete_volume" {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 04:47:58 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-3a0c48a2-bf80-4f28-bc79-fd9932384392 tempest-TestInstancesWithCinderVolumes-1741196733 None] Lock "cinder-quobyte-51f17d86-5d8b-4a30-b599-e679ed47dd26" acquired by "delete_volume" :: waited 0.016s {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 04:47:58 devstack cinder-volume[87444]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5b616d5-3c37-4aad-902e-c24bfd5e6d07]: (4, 'raw') {{(pid=88499) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 04:47:58 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-3a0c48a2-bf80-4f28-bc79-fd9932384392 tempest-TestInstancesWithCinderVolumes-1741196733 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-51f17d86-5d8b-4a30-b599-e679ed47dd26 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:47:58 devstack sudo[100852]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-51f17d86-5d8b-4a30-b599-e679ed47dd26 Jul 10 04:47:58 devstack sudo[100852]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:47:59 devstack sudo[100852]: pam_unix(sudo:session): session closed for user root Jul 10 04:47:59 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-3a0c48a2-bf80-4f28-bc79-fd9932384392 tempest-TestInstancesWithCinderVolumes-1741196733 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-51f17d86-5d8b-4a30-b599-e679ed47dd26" returned: 0 in 0.994s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:47:59 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-3a0c48a2-bf80-4f28-bc79-fd9932384392 tempest-TestInstancesWithCinderVolumes-1741196733 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-51f17d86-5d8b-4a30-b599-e679ed47dd26 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:47:59 devstack sudo[100857]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-51f17d86-5d8b-4a30-b599-e679ed47dd26 Jul 10 04:47:59 devstack sudo[100857]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:48:00 devstack sudo[100857]: pam_unix(sudo:session): session closed for user root Jul 10 04:48:00 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-3a0c48a2-bf80-4f28-bc79-fd9932384392 tempest-TestInstancesWithCinderVolumes-1741196733 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-51f17d86-5d8b-4a30-b599-e679ed47dd26" returned: 1 in 1.169s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:48:00 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-3a0c48a2-bf80-4f28-bc79-fd9932384392 tempest-TestInstancesWithCinderVolumes-1741196733 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-51f17d86-5d8b-4a30-b599-e679ed47dd26' failed. Not Retrying. {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 10 04:48:00 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-3a0c48a2-bf80-4f28-bc79-fd9932384392 tempest-TestInstancesWithCinderVolumes-1741196733 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-51f17d86-5d8b-4a30-b599-e679ed47dd26 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:48:00 devstack sudo[100866]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-51f17d86-5d8b-4a30-b599-e679ed47dd26 Jul 10 04:48:00 devstack sudo[100866]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:48:01 devstack sudo[100866]: pam_unix(sudo:session): session closed for user root Jul 10 04:48:01 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-3a0c48a2-bf80-4f28-bc79-fd9932384392 tempest-TestInstancesWithCinderVolumes-1741196733 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-51f17d86-5d8b-4a30-b599-e679ed47dd26" returned: 0 in 1.340s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:48:01 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-3a0c48a2-bf80-4f28-bc79-fd9932384392 tempest-TestInstancesWithCinderVolumes-1741196733 None] Lock "cinder-quobyte-51f17d86-5d8b-4a30-b599-e679ed47dd26" released by "delete_volume" :: held 3.614s {{(pid=87444) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 04:48:01 devstack cinder-volume[87444]: WARNING cinder.quota [None req-3a0c48a2-bf80-4f28-bc79-fd9932384392 tempest-TestInstancesWithCinderVolumes-1741196733 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-26197682-341791688 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-26197682-341791688, it is now deprecated. Please use the default quota class for default quota. Jul 10 04:48:01 devstack cinder-volume[87444]: WARNING cinder.quota [None req-3a0c48a2-bf80-4f28-bc79-fd9932384392 tempest-TestInstancesWithCinderVolumes-1741196733 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-26197682-341791688 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-26197682-341791688, it is now deprecated. Please use the default quota class for default quota. Jul 10 04:48:01 devstack cinder-volume[87444]: DEBUG cinder.quota [None req-3a0c48a2-bf80-4f28-bc79-fd9932384392 tempest-TestInstancesWithCinderVolumes-1741196733 None] Created reservations ['cce4467b-4e6d-4820-8ac3-65ff87afaf53', 'bc7fec8f-8513-4b94-b9ef-7716007be848', '066d9e35-1696-453c-8d39-424781a74280', 'a43c1832-b077-49b5-ad5a-3df2c7eeef87'] {{(pid=87444) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 04:48:01 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-3a0c48a2-bf80-4f28-bc79-fd9932384392 tempest-TestInstancesWithCinderVolumes-1741196733 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 04:48:01 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-3a0c48a2-bf80-4f28-bc79-fd9932384392 tempest-TestInstancesWithCinderVolumes-1741196733 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 04:48:01 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-3a0c48a2-bf80-4f28-bc79-fd9932384392 tempest-TestInstancesWithCinderVolumes-1741196733 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922': None} {{(pid=87444) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 04:48:01 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-3a0c48a2-bf80-4f28-bc79-fd9932384392 tempest-TestInstancesWithCinderVolumes-1741196733 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922'] {{(pid=87444) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 04:48:01 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-3a0c48a2-bf80-4f28-bc79-fd9932384392 tempest-TestInstancesWithCinderVolumes-1741196733 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 04:48:01 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-3a0c48a2-bf80-4f28-bc79-fd9932384392 tempest-TestInstancesWithCinderVolumes-1741196733 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:48:01 devstack sudo[100877]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097 Jul 10 04:48:01 devstack sudo[100877]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:48:03 devstack sudo[100877]: pam_unix(sudo:session): session closed for user root Jul 10 04:48:03 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-3a0c48a2-bf80-4f28-bc79-fd9932384392 tempest-TestInstancesWithCinderVolumes-1741196733 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097" returned: 0 in 1.256s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:48:03 devstack cinder-volume[87444]: DEBUG cinder.manager [None req-3a0c48a2-bf80-4f28-bc79-fd9932384392 tempest-TestInstancesWithCinderVolumes-1741196733 None] Notifying Schedulers of capabilities ... {{(pid=87444) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 04:48:03 devstack cinder-volume[87444]: INFO cinder.volume.manager [None req-3a0c48a2-bf80-4f28-bc79-fd9932384392 tempest-TestInstancesWithCinderVolumes-1741196733 None] Deleted volume successfully. Jul 10 04:48:03 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-3a0c48a2-bf80-4f28-bc79-fd9932384392 tempest-TestInstancesWithCinderVolumes-1741196733 None] Lock "cinder-51f17d86-5d8b-4a30-b599-e679ed47dd26-delete_volume" released by "delete_volume" :: held 5.215s {{(pid=87444) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 04:48:06 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [req-f610ec67-8182-4768-8af9-323f3d0d5828 req-4cce738b-bf83-41aa-af2d-fdb6a8c2858f tempest-TestServerVolumeAttachmentScenario-922014933 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 04:48:06 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [req-f610ec67-8182-4768-8af9-323f3d0d5828 req-4cce738b-bf83-41aa-af2d-fdb6a8c2858f tempest-TestServerVolumeAttachmentScenario-922014933 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 04:48:06 devstack cinder-volume[87444]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8b79389-537c-41aa-b2a9-92668b420f78]: (4, 'qcow2') {{(pid=88499) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 04:48:06 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [req-f610ec67-8182-4768-8af9-323f3d0d5828 req-4cce738b-bf83-41aa-af2d-fdb6a8c2858f tempest-TestServerVolumeAttachmentScenario-922014933 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-6b52b010-e7a2-4354-8dc9-fb362998af6e {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:48:06 devstack sudo[100908]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-6b52b010-e7a2-4354-8dc9-fb362998af6e Jul 10 04:48:06 devstack sudo[100908]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:48:07 devstack sudo[100908]: pam_unix(sudo:session): session closed for user root Jul 10 04:48:07 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [req-f610ec67-8182-4768-8af9-323f3d0d5828 req-4cce738b-bf83-41aa-af2d-fdb6a8c2858f tempest-TestServerVolumeAttachmentScenario-922014933 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-6b52b010-e7a2-4354-8dc9-fb362998af6e" returned: 0 in 1.438s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:48:07 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [req-f610ec67-8182-4768-8af9-323f3d0d5828 req-4cce738b-bf83-41aa-af2d-fdb6a8c2858f tempest-TestServerVolumeAttachmentScenario-922014933 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.483s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 04:48:07 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [req-f610ec67-8182-4768-8af9-323f3d0d5828 req-4cce738b-bf83-41aa-af2d-fdb6a8c2858f tempest-TestServerVolumeAttachmentScenario-922014933 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922', 'name': 'volume-6b52b010-e7a2-4354-8dc9-fb362998af6e', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '68a24190-5cf6-4d35-9df7-0d360c129791', 'enforce_multipath': True} {{(pid=87444) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 10 04:48:07 devstack cinder-volume[87444]: INFO cinder.volume.manager [req-f610ec67-8182-4768-8af9-323f3d0d5828 req-4cce738b-bf83-41aa-af2d-fdb6a8c2858f tempest-TestServerVolumeAttachmentScenario-922014933 None] attachment_update completed successfully. Jul 10 04:48:17 devstack cinder-volume[87444]: DEBUG dbcounter [-] [87444] Writing DB stats cinder:UPDATE=14,cinder:DELETE=2,cinder:SELECT=7,cinder:INSERT=2 {{(pid=87444) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 10 04:48:17 devstack cinder-volume[87444]: DEBUG dbcounter [-] [87444] Writing DB stats cinder:SELECT=17,cinder:UPDATE=8,cinder:INSERT=2 {{(pid=87444) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 10 04:48:18 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [req-d03e3abf-8b2e-477c-879a-59bc15d3aa46 req-59df9f81-6ff0-4930-95c7-cc94de966991 tempest-TestServerVolumeAttachmentScenario-922014933 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 04:48:18 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [req-d03e3abf-8b2e-477c-879a-59bc15d3aa46 req-59df9f81-6ff0-4930-95c7-cc94de966991 tempest-TestServerVolumeAttachmentScenario-922014933 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.002s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 04:48:18 devstack cinder-volume[87444]: DEBUG oslo.privsep.daemon [-] privsep: reply[9202743a-887e-4aca-a3ab-9e9b15111b66]: (4, 'qcow2') {{(pid=88499) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 04:48:18 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [req-d03e3abf-8b2e-477c-879a-59bc15d3aa46 req-59df9f81-6ff0-4930-95c7-cc94de966991 tempest-TestServerVolumeAttachmentScenario-922014933 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-3ba472a0-8c20-4406-b602-b04311be740e {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:48:19 devstack sudo[101395]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-3ba472a0-8c20-4406-b602-b04311be740e Jul 10 04:48:19 devstack sudo[101395]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:48:19 devstack cinder-volume[87444]: DEBUG cinder.volume.flows.manager.create_volume [None req-9b48bce5-2723-450e-994e-153bc967dcc9 tempest-CreateVolumesFromImageTest-1429462829 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87444) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 04:48:19 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-9b48bce5-2723-450e-994e-153bc967dcc9 tempest-CreateVolumesFromImageTest-1429462829 None] Flow 'volume_create_manager' (887228e4-405b-4732-83cd-b2f7bc55de6d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 04:48:19 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-9b48bce5-2723-450e-994e-153bc967dcc9 tempest-CreateVolumesFromImageTest-1429462829 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2ac5ff6c-0714-4473-a3c7-5c06855789d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:48:19 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-9b48bce5-2723-450e-994e-153bc967dcc9 tempest-CreateVolumesFromImageTest-1429462829 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2ac5ff6c-0714-4473-a3c7-5c06855789d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T02:48:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1668304141',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9d93d07f-103b-4ebe-a542-14ffec2adaee,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2245b5d6c1e0455fa95b84bf05a64095',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T02:48:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T02:48:19Z,use_quota=True,user_id='15b10bd271f44b83b68a20ca5f3a27ca',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(317e369e-1e06-434d-ae95-a335f0e6c903),volume_type_id=317e369e-1e06-434d-ae95-a335f0e6c903)' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:48:19 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-9b48bce5-2723-450e-994e-153bc967dcc9 tempest-CreateVolumesFromImageTest-1429462829 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (91387876-a591-44e7-b86f-fb7ef019079e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:48:19 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-9b48bce5-2723-450e-994e-153bc967dcc9 tempest-CreateVolumesFromImageTest-1429462829 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (91387876-a591-44e7-b86f-fb7ef019079e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:48:19 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-9b48bce5-2723-450e-994e-153bc967dcc9 tempest-CreateVolumesFromImageTest-1429462829 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3a444129-8e22-4f4c-96b1-d9accff94c02) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:48:19 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-9b48bce5-2723-450e-994e-153bc967dcc9 tempest-CreateVolumesFromImageTest-1429462829 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3a444129-8e22-4f4c-96b1-d9accff94c02) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9d93d07f-103b-4ebe-a542-14ffec2adaee', 'volume_name': 'volume-9d93d07f-103b-4ebe-a542-14ffec2adaee', 'volume_size': 1}' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:48:19 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-9b48bce5-2723-450e-994e-153bc967dcc9 tempest-CreateVolumesFromImageTest-1429462829 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9665ba8c-d0e4-4303-a3d2-99eb78841da5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:48:19 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-9b48bce5-2723-450e-994e-153bc967dcc9 tempest-CreateVolumesFromImageTest-1429462829 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9665ba8c-d0e4-4303-a3d2-99eb78841da5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:48:19 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-9b48bce5-2723-450e-994e-153bc967dcc9 tempest-CreateVolumesFromImageTest-1429462829 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (43dd2fe6-42d0-4a56-9da1-06846c5ac780) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:48:19 devstack cinder-volume[87444]: INFO cinder.volume.flows.manager.create_volume [None req-9b48bce5-2723-450e-994e-153bc967dcc9 tempest-CreateVolumesFromImageTest-1429462829 None] Volume 9d93d07f-103b-4ebe-a542-14ffec2adaee: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9d93d07f-103b-4ebe-a542-14ffec2adaee', 'volume_size': 1} Jul 10 04:48:19 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-9b48bce5-2723-450e-994e-153bc967dcc9 tempest-CreateVolumesFromImageTest-1429462829 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 04:48:19 devstack cinder-volume[87444]: DEBUG cinder.volume.flows.manager.create_volume [None req-cf3833bc-02cd-4cd3-8845-cad79e8fad37 tempest-CreateVolumesFromImageTest-1429462829 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87444) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 04:48:19 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-cf3833bc-02cd-4cd3-8845-cad79e8fad37 tempest-CreateVolumesFromImageTest-1429462829 None] Flow 'volume_create_manager' (6a9c59e1-d596-49ea-aa77-fe84870d470b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 04:48:19 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-cf3833bc-02cd-4cd3-8845-cad79e8fad37 tempest-CreateVolumesFromImageTest-1429462829 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (154b7054-0d3b-4402-b590-beb333dcc5f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:48:19 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-cf3833bc-02cd-4cd3-8845-cad79e8fad37 tempest-CreateVolumesFromImageTest-1429462829 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (154b7054-0d3b-4402-b590-beb333dcc5f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T02:48:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-2026510589',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=694e1057-d982-422a-b12f-40b10a3fe726,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2245b5d6c1e0455fa95b84bf05a64095',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T02:48:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T02:48:20Z,use_quota=True,user_id='15b10bd271f44b83b68a20ca5f3a27ca',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(317e369e-1e06-434d-ae95-a335f0e6c903),volume_type_id=317e369e-1e06-434d-ae95-a335f0e6c903)' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:48:19 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-cf3833bc-02cd-4cd3-8845-cad79e8fad37 tempest-CreateVolumesFromImageTest-1429462829 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (db16acff-33be-4d8b-bd1f-20dc3879efac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:48:19 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-cf3833bc-02cd-4cd3-8845-cad79e8fad37 tempest-CreateVolumesFromImageTest-1429462829 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (db16acff-33be-4d8b-bd1f-20dc3879efac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:48:19 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-cf3833bc-02cd-4cd3-8845-cad79e8fad37 tempest-CreateVolumesFromImageTest-1429462829 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fcb7eb5b-49da-4556-9584-614341a99075) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:48:19 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-cf3833bc-02cd-4cd3-8845-cad79e8fad37 tempest-CreateVolumesFromImageTest-1429462829 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fcb7eb5b-49da-4556-9584-614341a99075) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '694e1057-d982-422a-b12f-40b10a3fe726', 'volume_name': 'volume-694e1057-d982-422a-b12f-40b10a3fe726', 'volume_size': 1}' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:48:19 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-cf3833bc-02cd-4cd3-8845-cad79e8fad37 tempest-CreateVolumesFromImageTest-1429462829 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (86929a1f-2fcd-46f9-9191-8505c6e4245b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:48:19 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-cf3833bc-02cd-4cd3-8845-cad79e8fad37 tempest-CreateVolumesFromImageTest-1429462829 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (86929a1f-2fcd-46f9-9191-8505c6e4245b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:48:19 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-cf3833bc-02cd-4cd3-8845-cad79e8fad37 tempest-CreateVolumesFromImageTest-1429462829 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c42a1d0d-a1e4-4c11-8ac0-be7033486578) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:48:19 devstack cinder-volume[87444]: INFO cinder.volume.flows.manager.create_volume [None req-cf3833bc-02cd-4cd3-8845-cad79e8fad37 tempest-CreateVolumesFromImageTest-1429462829 None] Volume 694e1057-d982-422a-b12f-40b10a3fe726: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-694e1057-d982-422a-b12f-40b10a3fe726', 'volume_size': 1} Jul 10 04:48:19 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-cf3833bc-02cd-4cd3-8845-cad79e8fad37 tempest-CreateVolumesFromImageTest-1429462829 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 04:48:20 devstack sudo[101395]: pam_unix(sudo:session): session closed for user root Jul 10 04:48:20 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [req-d03e3abf-8b2e-477c-879a-59bc15d3aa46 req-59df9f81-6ff0-4930-95c7-cc94de966991 tempest-TestServerVolumeAttachmentScenario-922014933 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-3ba472a0-8c20-4406-b602-b04311be740e" returned: 0 in 1.263s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:48:20 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [req-d03e3abf-8b2e-477c-879a-59bc15d3aa46 req-59df9f81-6ff0-4930-95c7-cc94de966991 tempest-TestServerVolumeAttachmentScenario-922014933 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.288s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 04:48:20 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-9b48bce5-2723-450e-994e-153bc967dcc9 tempest-CreateVolumesFromImageTest-1429462829 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.756s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 04:48:20 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-9b48bce5-2723-450e-994e-153bc967dcc9 tempest-CreateVolumesFromImageTest-1429462829 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T02:48:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1668304141',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9d93d07f-103b-4ebe-a542-14ffec2adaee,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2245b5d6c1e0455fa95b84bf05a64095',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T02:48:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T02:48:19Z,use_quota=True,user_id='15b10bd271f44b83b68a20ca5f3a27ca',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(317e369e-1e06-434d-ae95-a335f0e6c903),volume_type_id=317e369e-1e06-434d-ae95-a335f0e6c903)}" {{(pid=87444) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 04:48:20 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.remotefs [None req-9b48bce5-2723-450e-994e-153bc967dcc9 tempest-CreateVolumesFromImageTest-1429462829 None] Creating volume 9d93d07f-103b-4ebe-a542-14ffec2adaee {{(pid=87444) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 04:48:20 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-9b48bce5-2723-450e-994e-153bc967dcc9 tempest-CreateVolumesFromImageTest-1429462829 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 04:48:20 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-9b48bce5-2723-450e-994e-153bc967dcc9 tempest-CreateVolumesFromImageTest-1429462829 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 04:48:20 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-9b48bce5-2723-450e-994e-153bc967dcc9 tempest-CreateVolumesFromImageTest-1429462829 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922': None} {{(pid=87444) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 04:48:20 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-9b48bce5-2723-450e-994e-153bc967dcc9 tempest-CreateVolumesFromImageTest-1429462829 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922'] {{(pid=87444) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 04:48:20 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-9b48bce5-2723-450e-994e-153bc967dcc9 tempest-CreateVolumesFromImageTest-1429462829 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 04:48:20 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-9b48bce5-2723-450e-994e-153bc967dcc9 tempest-CreateVolumesFromImageTest-1429462829 None] Selected osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922 as target Quobyte volume. {{(pid=87444) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 04:48:20 devstack cinder-volume[87444]: INFO cinder.volume.drivers.remotefs [None req-9b48bce5-2723-450e-994e-153bc967dcc9 tempest-CreateVolumesFromImageTest-1429462829 None] casted to osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922 Jul 10 04:48:20 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-9b48bce5-2723-450e-994e-153bc967dcc9 tempest-CreateVolumesFromImageTest-1429462829 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-9d93d07f-103b-4ebe-a542-14ffec2adaee 1073741824 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:48:20 devstack sudo[101400]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-9d93d07f-103b-4ebe-a542-14ffec2adaee 1073741824 Jul 10 04:48:20 devstack sudo[101400]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:48:20 devstack cinder-volume[87444]: DEBUG cinder.volume.flows.manager.create_volume [None req-604d8547-2071-46c9-9381-9e596d4b9b42 tempest-CreateVolumesFromImageTest-1429462829 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87444) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 04:48:20 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-604d8547-2071-46c9-9381-9e596d4b9b42 tempest-CreateVolumesFromImageTest-1429462829 None] Flow 'volume_create_manager' (6fd95ff3-9aee-4f34-b228-8a3316d52f08) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 04:48:20 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-604d8547-2071-46c9-9381-9e596d4b9b42 tempest-CreateVolumesFromImageTest-1429462829 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b5fc12c5-c79f-4713-9c17-b18d04f68425) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:48:20 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-604d8547-2071-46c9-9381-9e596d4b9b42 tempest-CreateVolumesFromImageTest-1429462829 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b5fc12c5-c79f-4713-9c17-b18d04f68425) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T02:48:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-370489154',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d4a58323-6eac-4d73-b5ab-d4317058d705,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2245b5d6c1e0455fa95b84bf05a64095',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T02:48:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T02:48:20Z,use_quota=True,user_id='15b10bd271f44b83b68a20ca5f3a27ca',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(317e369e-1e06-434d-ae95-a335f0e6c903),volume_type_id=317e369e-1e06-434d-ae95-a335f0e6c903)' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:48:20 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-604d8547-2071-46c9-9381-9e596d4b9b42 tempest-CreateVolumesFromImageTest-1429462829 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (15c76ea4-5aa6-4187-a7fb-1dba05b8dd09) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:48:20 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-604d8547-2071-46c9-9381-9e596d4b9b42 tempest-CreateVolumesFromImageTest-1429462829 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (15c76ea4-5aa6-4187-a7fb-1dba05b8dd09) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:48:20 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-604d8547-2071-46c9-9381-9e596d4b9b42 tempest-CreateVolumesFromImageTest-1429462829 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (053dceda-77c3-4f47-a01e-04f101ec9766) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:48:20 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-604d8547-2071-46c9-9381-9e596d4b9b42 tempest-CreateVolumesFromImageTest-1429462829 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (053dceda-77c3-4f47-a01e-04f101ec9766) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd4a58323-6eac-4d73-b5ab-d4317058d705', 'volume_name': 'volume-d4a58323-6eac-4d73-b5ab-d4317058d705', 'volume_size': 1}' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:48:20 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-604d8547-2071-46c9-9381-9e596d4b9b42 tempest-CreateVolumesFromImageTest-1429462829 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0e096b6b-2821-4159-bcab-d6b3bfa8d7f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:48:20 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-604d8547-2071-46c9-9381-9e596d4b9b42 tempest-CreateVolumesFromImageTest-1429462829 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0e096b6b-2821-4159-bcab-d6b3bfa8d7f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:48:20 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-604d8547-2071-46c9-9381-9e596d4b9b42 tempest-CreateVolumesFromImageTest-1429462829 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1dd172e1-8e63-4f1d-99e4-de786518f51d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:48:20 devstack cinder-volume[87444]: INFO cinder.volume.flows.manager.create_volume [None req-604d8547-2071-46c9-9381-9e596d4b9b42 tempest-CreateVolumesFromImageTest-1429462829 None] Volume d4a58323-6eac-4d73-b5ab-d4317058d705: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d4a58323-6eac-4d73-b5ab-d4317058d705', 'volume_size': 1} Jul 10 04:48:20 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-604d8547-2071-46c9-9381-9e596d4b9b42 tempest-CreateVolumesFromImageTest-1429462829 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 04:48:20 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [req-d03e3abf-8b2e-477c-879a-59bc15d3aa46 req-59df9f81-6ff0-4930-95c7-cc94de966991 tempest-TestServerVolumeAttachmentScenario-922014933 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922', 'name': 'volume-3ba472a0-8c20-4406-b602-b04311be740e', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'd77f791b-b941-49a3-9a2c-d0b370123f79', 'enforce_multipath': True} {{(pid=87444) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 10 04:48:20 devstack cinder-volume[87444]: INFO cinder.volume.manager [req-d03e3abf-8b2e-477c-879a-59bc15d3aa46 req-59df9f81-6ff0-4930-95c7-cc94de966991 tempest-TestServerVolumeAttachmentScenario-922014933 None] attachment_update completed successfully. Jul 10 04:48:20 devstack cinder-volume[87444]: DEBUG cinder.volume.flows.manager.create_volume [None req-1df1f3b8-da92-43a0-a0ce-8dfdf0d93fea tempest-CreateVolumesFromImageTest-1429462829 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87444) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 04:48:20 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-1df1f3b8-da92-43a0-a0ce-8dfdf0d93fea tempest-CreateVolumesFromImageTest-1429462829 None] Flow 'volume_create_manager' (b9f4b1d1-34bc-41e4-88fd-7b5dc5b448f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 04:48:20 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-1df1f3b8-da92-43a0-a0ce-8dfdf0d93fea tempest-CreateVolumesFromImageTest-1429462829 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (506f9434-3654-4fbc-9838-45bed8a6828b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:48:20 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-1df1f3b8-da92-43a0-a0ce-8dfdf0d93fea tempest-CreateVolumesFromImageTest-1429462829 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (506f9434-3654-4fbc-9838-45bed8a6828b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T02:48:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1654245082',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bcdd36a4-e749-4e79-bde9-e2939a518280,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2245b5d6c1e0455fa95b84bf05a64095',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T02:48:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T02:48:21Z,use_quota=True,user_id='15b10bd271f44b83b68a20ca5f3a27ca',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(317e369e-1e06-434d-ae95-a335f0e6c903),volume_type_id=317e369e-1e06-434d-ae95-a335f0e6c903)' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:48:20 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-1df1f3b8-da92-43a0-a0ce-8dfdf0d93fea tempest-CreateVolumesFromImageTest-1429462829 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3f5d883c-e014-49ff-8a1f-1cb5cca28cfb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:48:20 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-1df1f3b8-da92-43a0-a0ce-8dfdf0d93fea tempest-CreateVolumesFromImageTest-1429462829 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3f5d883c-e014-49ff-8a1f-1cb5cca28cfb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:48:20 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-1df1f3b8-da92-43a0-a0ce-8dfdf0d93fea tempest-CreateVolumesFromImageTest-1429462829 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d87027ff-0e9f-484f-8abc-ed3dd962e408) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:48:20 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-1df1f3b8-da92-43a0-a0ce-8dfdf0d93fea tempest-CreateVolumesFromImageTest-1429462829 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d87027ff-0e9f-484f-8abc-ed3dd962e408) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bcdd36a4-e749-4e79-bde9-e2939a518280', 'volume_name': 'volume-bcdd36a4-e749-4e79-bde9-e2939a518280', 'volume_size': 1}' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:48:20 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-1df1f3b8-da92-43a0-a0ce-8dfdf0d93fea tempest-CreateVolumesFromImageTest-1429462829 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1810c0a9-0de7-4971-9ff5-f22ec1e2e1e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:48:20 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-1df1f3b8-da92-43a0-a0ce-8dfdf0d93fea tempest-CreateVolumesFromImageTest-1429462829 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1810c0a9-0de7-4971-9ff5-f22ec1e2e1e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:48:20 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-1df1f3b8-da92-43a0-a0ce-8dfdf0d93fea tempest-CreateVolumesFromImageTest-1429462829 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (599d17fe-acc0-41d9-bada-34556ad56a99) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:48:20 devstack cinder-volume[87444]: INFO cinder.volume.flows.manager.create_volume [None req-1df1f3b8-da92-43a0-a0ce-8dfdf0d93fea tempest-CreateVolumesFromImageTest-1429462829 None] Volume bcdd36a4-e749-4e79-bde9-e2939a518280: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bcdd36a4-e749-4e79-bde9-e2939a518280', 'volume_size': 1} Jul 10 04:48:20 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-1df1f3b8-da92-43a0-a0ce-8dfdf0d93fea tempest-CreateVolumesFromImageTest-1429462829 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 04:48:21 devstack cinder-volume[87444]: DEBUG cinder.volume.flows.manager.create_volume [None req-725c3749-6a1b-4387-bb2f-f8b7e7cc520c tempest-CreateVolumesFromImageTest-1429462829 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87444) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 04:48:21 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-725c3749-6a1b-4387-bb2f-f8b7e7cc520c tempest-CreateVolumesFromImageTest-1429462829 None] Flow 'volume_create_manager' (67882f99-0c34-45f7-8187-dacb03e69f0d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 04:48:21 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-725c3749-6a1b-4387-bb2f-f8b7e7cc520c tempest-CreateVolumesFromImageTest-1429462829 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a8913d10-cd55-46d5-9ba6-e15c2cc21adc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:48:21 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-725c3749-6a1b-4387-bb2f-f8b7e7cc520c tempest-CreateVolumesFromImageTest-1429462829 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a8913d10-cd55-46d5-9ba6-e15c2cc21adc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T02:48:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1648219299',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4d621b59-a8f2-4a6f-bb60-e5fb636a0951,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2245b5d6c1e0455fa95b84bf05a64095',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T02:48:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T02:48:21Z,use_quota=True,user_id='15b10bd271f44b83b68a20ca5f3a27ca',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(317e369e-1e06-434d-ae95-a335f0e6c903),volume_type_id=317e369e-1e06-434d-ae95-a335f0e6c903)' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:48:21 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-725c3749-6a1b-4387-bb2f-f8b7e7cc520c tempest-CreateVolumesFromImageTest-1429462829 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (06e921e9-8840-44ef-a312-a26d25658897) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:48:21 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-725c3749-6a1b-4387-bb2f-f8b7e7cc520c tempest-CreateVolumesFromImageTest-1429462829 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (06e921e9-8840-44ef-a312-a26d25658897) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:48:21 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-725c3749-6a1b-4387-bb2f-f8b7e7cc520c tempest-CreateVolumesFromImageTest-1429462829 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (822935ab-5a5b-4669-a18a-35a10383d4d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:48:21 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-725c3749-6a1b-4387-bb2f-f8b7e7cc520c tempest-CreateVolumesFromImageTest-1429462829 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (822935ab-5a5b-4669-a18a-35a10383d4d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4d621b59-a8f2-4a6f-bb60-e5fb636a0951', 'volume_name': 'volume-4d621b59-a8f2-4a6f-bb60-e5fb636a0951', 'volume_size': 1}' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:48:21 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-725c3749-6a1b-4387-bb2f-f8b7e7cc520c tempest-CreateVolumesFromImageTest-1429462829 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9a2f2302-2395-4c4d-9097-435796e95278) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:48:21 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-725c3749-6a1b-4387-bb2f-f8b7e7cc520c tempest-CreateVolumesFromImageTest-1429462829 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9a2f2302-2395-4c4d-9097-435796e95278) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:48:21 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-725c3749-6a1b-4387-bb2f-f8b7e7cc520c tempest-CreateVolumesFromImageTest-1429462829 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (50de4f5a-acc1-4ce0-b7ab-145eefdc3fe2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:48:21 devstack cinder-volume[87444]: INFO cinder.volume.flows.manager.create_volume [None req-725c3749-6a1b-4387-bb2f-f8b7e7cc520c tempest-CreateVolumesFromImageTest-1429462829 None] Volume 4d621b59-a8f2-4a6f-bb60-e5fb636a0951: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4d621b59-a8f2-4a6f-bb60-e5fb636a0951', 'volume_size': 1} Jul 10 04:48:21 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-725c3749-6a1b-4387-bb2f-f8b7e7cc520c tempest-CreateVolumesFromImageTest-1429462829 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 04:48:21 devstack sudo[101400]: pam_unix(sudo:session): session closed for user root Jul 10 04:48:21 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-9b48bce5-2723-450e-994e-153bc967dcc9 tempest-CreateVolumesFromImageTest-1429462829 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-9d93d07f-103b-4ebe-a542-14ffec2adaee 1073741824" returned: 0 in 1.150s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:48:21 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-9b48bce5-2723-450e-994e-153bc967dcc9 tempest-CreateVolumesFromImageTest-1429462829 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-9d93d07f-103b-4ebe-a542-14ffec2adaee {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:48:21 devstack sudo[101406]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-9d93d07f-103b-4ebe-a542-14ffec2adaee Jul 10 04:48:21 devstack sudo[101406]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:48:22 devstack sudo[101406]: pam_unix(sudo:session): session closed for user root Jul 10 04:48:22 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-9b48bce5-2723-450e-994e-153bc967dcc9 tempest-CreateVolumesFromImageTest-1429462829 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-9d93d07f-103b-4ebe-a542-14ffec2adaee" returned: 0 in 0.700s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:48:22 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-9b48bce5-2723-450e-994e-153bc967dcc9 tempest-CreateVolumesFromImageTest-1429462829 None] <== create_volume: return (1896ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922'} {{(pid=87444) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 04:48:22 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-9b48bce5-2723-450e-994e-153bc967dcc9 tempest-CreateVolumesFromImageTest-1429462829 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.899s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 04:48:22 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-cf3833bc-02cd-4cd3-8845-cad79e8fad37 tempest-CreateVolumesFromImageTest-1429462829 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.345s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 04:48:22 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-cf3833bc-02cd-4cd3-8845-cad79e8fad37 tempest-CreateVolumesFromImageTest-1429462829 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T02:48:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-2026510589',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=694e1057-d982-422a-b12f-40b10a3fe726,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2245b5d6c1e0455fa95b84bf05a64095',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T02:48:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T02:48:20Z,use_quota=True,user_id='15b10bd271f44b83b68a20ca5f3a27ca',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(317e369e-1e06-434d-ae95-a335f0e6c903),volume_type_id=317e369e-1e06-434d-ae95-a335f0e6c903)}" {{(pid=87444) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 04:48:22 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.remotefs [None req-cf3833bc-02cd-4cd3-8845-cad79e8fad37 tempest-CreateVolumesFromImageTest-1429462829 None] Creating volume 694e1057-d982-422a-b12f-40b10a3fe726 {{(pid=87444) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 04:48:22 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-cf3833bc-02cd-4cd3-8845-cad79e8fad37 tempest-CreateVolumesFromImageTest-1429462829 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 04:48:22 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-cf3833bc-02cd-4cd3-8845-cad79e8fad37 tempest-CreateVolumesFromImageTest-1429462829 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 04:48:22 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-cf3833bc-02cd-4cd3-8845-cad79e8fad37 tempest-CreateVolumesFromImageTest-1429462829 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922': None} {{(pid=87444) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 04:48:22 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-cf3833bc-02cd-4cd3-8845-cad79e8fad37 tempest-CreateVolumesFromImageTest-1429462829 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922'] {{(pid=87444) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 04:48:22 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-cf3833bc-02cd-4cd3-8845-cad79e8fad37 tempest-CreateVolumesFromImageTest-1429462829 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 04:48:22 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-cf3833bc-02cd-4cd3-8845-cad79e8fad37 tempest-CreateVolumesFromImageTest-1429462829 None] Selected osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922 as target Quobyte volume. {{(pid=87444) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 04:48:22 devstack cinder-volume[87444]: INFO cinder.volume.drivers.remotefs [None req-cf3833bc-02cd-4cd3-8845-cad79e8fad37 tempest-CreateVolumesFromImageTest-1429462829 None] casted to osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922 Jul 10 04:48:22 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-cf3833bc-02cd-4cd3-8845-cad79e8fad37 tempest-CreateVolumesFromImageTest-1429462829 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-694e1057-d982-422a-b12f-40b10a3fe726 1073741824 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:48:22 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-9b48bce5-2723-450e-994e-153bc967dcc9 tempest-CreateVolumesFromImageTest-1429462829 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (43dd2fe6-42d0-4a56-9da1-06846c5ac780) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9d93d07f-103b-4ebe-a542-14ffec2adaee', 'volume_size': 1}' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:48:22 devstack sudo[101411]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-694e1057-d982-422a-b12f-40b10a3fe726 1073741824 Jul 10 04:48:22 devstack sudo[101411]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:48:22 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-9b48bce5-2723-450e-994e-153bc967dcc9 tempest-CreateVolumesFromImageTest-1429462829 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d0937d29-817e-4cda-804d-99d765d69adf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:48:22 devstack cinder-volume[87444]: INFO cinder.volume.flows.manager.create_volume [None req-9b48bce5-2723-450e-994e-153bc967dcc9 tempest-CreateVolumesFromImageTest-1429462829 None] Volume volume-9d93d07f-103b-4ebe-a542-14ffec2adaee (9d93d07f-103b-4ebe-a542-14ffec2adaee): created successfully Jul 10 04:48:22 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-9b48bce5-2723-450e-994e-153bc967dcc9 tempest-CreateVolumesFromImageTest-1429462829 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d0937d29-817e-4cda-804d-99d765d69adf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:48:22 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-9b48bce5-2723-450e-994e-153bc967dcc9 tempest-CreateVolumesFromImageTest-1429462829 None] Flow 'volume_create_manager' (887228e4-405b-4732-83cd-b2f7bc55de6d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87444) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 04:48:22 devstack cinder-volume[87444]: INFO cinder.volume.manager [None req-9b48bce5-2723-450e-994e-153bc967dcc9 tempest-CreateVolumesFromImageTest-1429462829 None] Created volume successfully. Jul 10 04:48:23 devstack sudo[101411]: pam_unix(sudo:session): session closed for user root Jul 10 04:48:23 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-cf3833bc-02cd-4cd3-8845-cad79e8fad37 tempest-CreateVolumesFromImageTest-1429462829 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-694e1057-d982-422a-b12f-40b10a3fe726 1073741824" returned: 0 in 0.991s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:48:23 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-cf3833bc-02cd-4cd3-8845-cad79e8fad37 tempest-CreateVolumesFromImageTest-1429462829 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-694e1057-d982-422a-b12f-40b10a3fe726 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:48:23 devstack sudo[101430]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-694e1057-d982-422a-b12f-40b10a3fe726 Jul 10 04:48:23 devstack sudo[101430]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:48:23 devstack sudo[101430]: pam_unix(sudo:session): session closed for user root Jul 10 04:48:23 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-cf3833bc-02cd-4cd3-8845-cad79e8fad37 tempest-CreateVolumesFromImageTest-1429462829 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-694e1057-d982-422a-b12f-40b10a3fe726" returned: 0 in 0.743s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:48:23 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-cf3833bc-02cd-4cd3-8845-cad79e8fad37 tempest-CreateVolumesFromImageTest-1429462829 None] <== create_volume: return (1796ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922'} {{(pid=87444) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 04:48:23 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-cf3833bc-02cd-4cd3-8845-cad79e8fad37 tempest-CreateVolumesFromImageTest-1429462829 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.799s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 04:48:23 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-604d8547-2071-46c9-9381-9e596d4b9b42 tempest-CreateVolumesFromImageTest-1429462829 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.517s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 04:48:23 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-604d8547-2071-46c9-9381-9e596d4b9b42 tempest-CreateVolumesFromImageTest-1429462829 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T02:48:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-370489154',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d4a58323-6eac-4d73-b5ab-d4317058d705,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2245b5d6c1e0455fa95b84bf05a64095',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T02:48:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T02:48:20Z,use_quota=True,user_id='15b10bd271f44b83b68a20ca5f3a27ca',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(317e369e-1e06-434d-ae95-a335f0e6c903),volume_type_id=317e369e-1e06-434d-ae95-a335f0e6c903)}" {{(pid=87444) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 04:48:23 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.remotefs [None req-604d8547-2071-46c9-9381-9e596d4b9b42 tempest-CreateVolumesFromImageTest-1429462829 None] Creating volume d4a58323-6eac-4d73-b5ab-d4317058d705 {{(pid=87444) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 04:48:23 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-604d8547-2071-46c9-9381-9e596d4b9b42 tempest-CreateVolumesFromImageTest-1429462829 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 04:48:23 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-604d8547-2071-46c9-9381-9e596d4b9b42 tempest-CreateVolumesFromImageTest-1429462829 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 04:48:23 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-604d8547-2071-46c9-9381-9e596d4b9b42 tempest-CreateVolumesFromImageTest-1429462829 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922': None} {{(pid=87444) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 04:48:23 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-604d8547-2071-46c9-9381-9e596d4b9b42 tempest-CreateVolumesFromImageTest-1429462829 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922'] {{(pid=87444) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 04:48:23 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-604d8547-2071-46c9-9381-9e596d4b9b42 tempest-CreateVolumesFromImageTest-1429462829 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 04:48:23 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-604d8547-2071-46c9-9381-9e596d4b9b42 tempest-CreateVolumesFromImageTest-1429462829 None] Selected osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922 as target Quobyte volume. {{(pid=87444) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 04:48:23 devstack cinder-volume[87444]: INFO cinder.volume.drivers.remotefs [None req-604d8547-2071-46c9-9381-9e596d4b9b42 tempest-CreateVolumesFromImageTest-1429462829 None] casted to osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922 Jul 10 04:48:23 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-604d8547-2071-46c9-9381-9e596d4b9b42 tempest-CreateVolumesFromImageTest-1429462829 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-d4a58323-6eac-4d73-b5ab-d4317058d705 1073741824 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:48:23 devstack sudo[101434]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-d4a58323-6eac-4d73-b5ab-d4317058d705 1073741824 Jul 10 04:48:23 devstack sudo[101434]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:48:23 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-cf3833bc-02cd-4cd3-8845-cad79e8fad37 tempest-CreateVolumesFromImageTest-1429462829 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c42a1d0d-a1e4-4c11-8ac0-be7033486578) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-694e1057-d982-422a-b12f-40b10a3fe726', 'volume_size': 1}' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:48:23 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-cf3833bc-02cd-4cd3-8845-cad79e8fad37 tempest-CreateVolumesFromImageTest-1429462829 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fae570ee-1bfe-46d6-a13f-fadad1791213) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:48:23 devstack cinder-volume[87444]: INFO cinder.volume.flows.manager.create_volume [None req-cf3833bc-02cd-4cd3-8845-cad79e8fad37 tempest-CreateVolumesFromImageTest-1429462829 None] Volume volume-694e1057-d982-422a-b12f-40b10a3fe726 (694e1057-d982-422a-b12f-40b10a3fe726): created successfully Jul 10 04:48:23 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-cf3833bc-02cd-4cd3-8845-cad79e8fad37 tempest-CreateVolumesFromImageTest-1429462829 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fae570ee-1bfe-46d6-a13f-fadad1791213) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:48:24 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-cf3833bc-02cd-4cd3-8845-cad79e8fad37 tempest-CreateVolumesFromImageTest-1429462829 None] Flow 'volume_create_manager' (6a9c59e1-d596-49ea-aa77-fe84870d470b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87444) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 04:48:24 devstack cinder-volume[87444]: INFO cinder.volume.manager [None req-cf3833bc-02cd-4cd3-8845-cad79e8fad37 tempest-CreateVolumesFromImageTest-1429462829 None] Created volume successfully. Jul 10 04:48:24 devstack sudo[101434]: pam_unix(sudo:session): session closed for user root Jul 10 04:48:24 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-604d8547-2071-46c9-9381-9e596d4b9b42 tempest-CreateVolumesFromImageTest-1429462829 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-d4a58323-6eac-4d73-b5ab-d4317058d705 1073741824" returned: 0 in 0.917s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:48:24 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-604d8547-2071-46c9-9381-9e596d4b9b42 tempest-CreateVolumesFromImageTest-1429462829 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-d4a58323-6eac-4d73-b5ab-d4317058d705 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:48:24 devstack sudo[101444]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-d4a58323-6eac-4d73-b5ab-d4317058d705 Jul 10 04:48:24 devstack sudo[101444]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:48:25 devstack sudo[101444]: pam_unix(sudo:session): session closed for user root Jul 10 04:48:25 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-604d8547-2071-46c9-9381-9e596d4b9b42 tempest-CreateVolumesFromImageTest-1429462829 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-d4a58323-6eac-4d73-b5ab-d4317058d705" returned: 0 in 0.633s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:48:25 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-604d8547-2071-46c9-9381-9e596d4b9b42 tempest-CreateVolumesFromImageTest-1429462829 None] <== create_volume: return (1595ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922'} {{(pid=87444) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 04:48:25 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-604d8547-2071-46c9-9381-9e596d4b9b42 tempest-CreateVolumesFromImageTest-1429462829 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.600s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 04:48:25 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-1df1f3b8-da92-43a0-a0ce-8dfdf0d93fea tempest-CreateVolumesFromImageTest-1429462829 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.715s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 04:48:25 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-1df1f3b8-da92-43a0-a0ce-8dfdf0d93fea tempest-CreateVolumesFromImageTest-1429462829 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T02:48:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1654245082',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bcdd36a4-e749-4e79-bde9-e2939a518280,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2245b5d6c1e0455fa95b84bf05a64095',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T02:48:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T02:48:21Z,use_quota=True,user_id='15b10bd271f44b83b68a20ca5f3a27ca',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(317e369e-1e06-434d-ae95-a335f0e6c903),volume_type_id=317e369e-1e06-434d-ae95-a335f0e6c903)}" {{(pid=87444) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 04:48:25 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.remotefs [None req-1df1f3b8-da92-43a0-a0ce-8dfdf0d93fea tempest-CreateVolumesFromImageTest-1429462829 None] Creating volume bcdd36a4-e749-4e79-bde9-e2939a518280 {{(pid=87444) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 04:48:25 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-1df1f3b8-da92-43a0-a0ce-8dfdf0d93fea tempest-CreateVolumesFromImageTest-1429462829 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 04:48:25 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-1df1f3b8-da92-43a0-a0ce-8dfdf0d93fea tempest-CreateVolumesFromImageTest-1429462829 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 04:48:25 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-1df1f3b8-da92-43a0-a0ce-8dfdf0d93fea tempest-CreateVolumesFromImageTest-1429462829 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922': None} {{(pid=87444) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 04:48:25 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-1df1f3b8-da92-43a0-a0ce-8dfdf0d93fea tempest-CreateVolumesFromImageTest-1429462829 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922'] {{(pid=87444) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 04:48:25 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-1df1f3b8-da92-43a0-a0ce-8dfdf0d93fea tempest-CreateVolumesFromImageTest-1429462829 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 04:48:25 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-1df1f3b8-da92-43a0-a0ce-8dfdf0d93fea tempest-CreateVolumesFromImageTest-1429462829 None] Selected osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922 as target Quobyte volume. {{(pid=87444) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 04:48:25 devstack cinder-volume[87444]: INFO cinder.volume.drivers.remotefs [None req-1df1f3b8-da92-43a0-a0ce-8dfdf0d93fea tempest-CreateVolumesFromImageTest-1429462829 None] casted to osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922 Jul 10 04:48:25 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-1df1f3b8-da92-43a0-a0ce-8dfdf0d93fea tempest-CreateVolumesFromImageTest-1429462829 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-bcdd36a4-e749-4e79-bde9-e2939a518280 1073741824 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:48:25 devstack sudo[101450]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-bcdd36a4-e749-4e79-bde9-e2939a518280 1073741824 Jul 10 04:48:25 devstack sudo[101450]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:48:25 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-604d8547-2071-46c9-9381-9e596d4b9b42 tempest-CreateVolumesFromImageTest-1429462829 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1dd172e1-8e63-4f1d-99e4-de786518f51d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d4a58323-6eac-4d73-b5ab-d4317058d705', 'volume_size': 1}' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:48:25 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-604d8547-2071-46c9-9381-9e596d4b9b42 tempest-CreateVolumesFromImageTest-1429462829 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2e370f08-2367-4f43-b26f-92df62e8ba40) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:48:25 devstack cinder-volume[87444]: INFO cinder.volume.flows.manager.create_volume [None req-604d8547-2071-46c9-9381-9e596d4b9b42 tempest-CreateVolumesFromImageTest-1429462829 None] Volume volume-d4a58323-6eac-4d73-b5ab-d4317058d705 (d4a58323-6eac-4d73-b5ab-d4317058d705): created successfully Jul 10 04:48:25 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-604d8547-2071-46c9-9381-9e596d4b9b42 tempest-CreateVolumesFromImageTest-1429462829 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2e370f08-2367-4f43-b26f-92df62e8ba40) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:48:25 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-604d8547-2071-46c9-9381-9e596d4b9b42 tempest-CreateVolumesFromImageTest-1429462829 None] Flow 'volume_create_manager' (6fd95ff3-9aee-4f34-b228-8a3316d52f08) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87444) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 04:48:25 devstack cinder-volume[87444]: INFO cinder.volume.manager [None req-604d8547-2071-46c9-9381-9e596d4b9b42 tempest-CreateVolumesFromImageTest-1429462829 None] Created volume successfully. Jul 10 04:48:26 devstack cinder-volume[87444]: INFO cinder.volume.manager [req-ae959e26-ef12-4a8b-be1a-cccb9b11d23a req-df93edeb-65c2-4b4c-abe1-c5dc432923cb tempest-TestServerVolumeAttachmentScenario-922014933 None] Terminate volume connection completed successfully. Jul 10 04:48:26 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [req-ae959e26-ef12-4a8b-be1a-cccb9b11d23a req-df93edeb-65c2-4b4c-abe1-c5dc432923cb tempest-TestServerVolumeAttachmentScenario-922014933 None] Deleting attachment d77f791b-b941-49a3-9a2c-d0b370123f79. {{(pid=87444) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 10 04:48:26 devstack sudo[101450]: pam_unix(sudo:session): session closed for user root Jul 10 04:48:26 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-1df1f3b8-da92-43a0-a0ce-8dfdf0d93fea tempest-CreateVolumesFromImageTest-1429462829 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-bcdd36a4-e749-4e79-bde9-e2939a518280 1073741824" returned: 0 in 0.814s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:48:26 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-1df1f3b8-da92-43a0-a0ce-8dfdf0d93fea tempest-CreateVolumesFromImageTest-1429462829 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-bcdd36a4-e749-4e79-bde9-e2939a518280 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:48:26 devstack sudo[101458]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-bcdd36a4-e749-4e79-bde9-e2939a518280 Jul 10 04:48:26 devstack sudo[101458]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:48:27 devstack sudo[101458]: pam_unix(sudo:session): session closed for user root Jul 10 04:48:27 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-1df1f3b8-da92-43a0-a0ce-8dfdf0d93fea tempest-CreateVolumesFromImageTest-1429462829 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-bcdd36a4-e749-4e79-bde9-e2939a518280" returned: 0 in 0.646s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:48:27 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-1df1f3b8-da92-43a0-a0ce-8dfdf0d93fea tempest-CreateVolumesFromImageTest-1429462829 None] <== create_volume: return (1498ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922'} {{(pid=87444) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 04:48:27 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-1df1f3b8-da92-43a0-a0ce-8dfdf0d93fea tempest-CreateVolumesFromImageTest-1429462829 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.502s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 04:48:27 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-725c3749-6a1b-4387-bb2f-f8b7e7cc520c tempest-CreateVolumesFromImageTest-1429462829 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.669s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 04:48:27 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-725c3749-6a1b-4387-bb2f-f8b7e7cc520c tempest-CreateVolumesFromImageTest-1429462829 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T02:48:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1648219299',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4d621b59-a8f2-4a6f-bb60-e5fb636a0951,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2245b5d6c1e0455fa95b84bf05a64095',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T02:48:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T02:48:21Z,use_quota=True,user_id='15b10bd271f44b83b68a20ca5f3a27ca',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(317e369e-1e06-434d-ae95-a335f0e6c903),volume_type_id=317e369e-1e06-434d-ae95-a335f0e6c903)}" {{(pid=87444) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 04:48:27 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.remotefs [None req-725c3749-6a1b-4387-bb2f-f8b7e7cc520c tempest-CreateVolumesFromImageTest-1429462829 None] Creating volume 4d621b59-a8f2-4a6f-bb60-e5fb636a0951 {{(pid=87444) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 04:48:27 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-725c3749-6a1b-4387-bb2f-f8b7e7cc520c tempest-CreateVolumesFromImageTest-1429462829 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 04:48:27 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-725c3749-6a1b-4387-bb2f-f8b7e7cc520c tempest-CreateVolumesFromImageTest-1429462829 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 04:48:27 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-725c3749-6a1b-4387-bb2f-f8b7e7cc520c tempest-CreateVolumesFromImageTest-1429462829 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922': None} {{(pid=87444) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 04:48:27 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-725c3749-6a1b-4387-bb2f-f8b7e7cc520c tempest-CreateVolumesFromImageTest-1429462829 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922'] {{(pid=87444) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 04:48:27 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-725c3749-6a1b-4387-bb2f-f8b7e7cc520c tempest-CreateVolumesFromImageTest-1429462829 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 04:48:27 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-725c3749-6a1b-4387-bb2f-f8b7e7cc520c tempest-CreateVolumesFromImageTest-1429462829 None] Selected osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922 as target Quobyte volume. {{(pid=87444) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 04:48:27 devstack cinder-volume[87444]: INFO cinder.volume.drivers.remotefs [None req-725c3749-6a1b-4387-bb2f-f8b7e7cc520c tempest-CreateVolumesFromImageTest-1429462829 None] casted to osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922 Jul 10 04:48:27 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-725c3749-6a1b-4387-bb2f-f8b7e7cc520c tempest-CreateVolumesFromImageTest-1429462829 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-4d621b59-a8f2-4a6f-bb60-e5fb636a0951 1073741824 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:48:27 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-1df1f3b8-da92-43a0-a0ce-8dfdf0d93fea tempest-CreateVolumesFromImageTest-1429462829 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (599d17fe-acc0-41d9-bada-34556ad56a99) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bcdd36a4-e749-4e79-bde9-e2939a518280', 'volume_size': 1}' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:48:27 devstack sudo[101461]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-4d621b59-a8f2-4a6f-bb60-e5fb636a0951 1073741824 Jul 10 04:48:27 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-1df1f3b8-da92-43a0-a0ce-8dfdf0d93fea tempest-CreateVolumesFromImageTest-1429462829 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (722c5466-7ea2-4f81-a5de-6640fdf28ad1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:48:27 devstack sudo[101461]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:48:27 devstack cinder-volume[87444]: INFO cinder.volume.flows.manager.create_volume [None req-1df1f3b8-da92-43a0-a0ce-8dfdf0d93fea tempest-CreateVolumesFromImageTest-1429462829 None] Volume volume-bcdd36a4-e749-4e79-bde9-e2939a518280 (bcdd36a4-e749-4e79-bde9-e2939a518280): created successfully Jul 10 04:48:27 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-1df1f3b8-da92-43a0-a0ce-8dfdf0d93fea tempest-CreateVolumesFromImageTest-1429462829 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (722c5466-7ea2-4f81-a5de-6640fdf28ad1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:48:27 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-1df1f3b8-da92-43a0-a0ce-8dfdf0d93fea tempest-CreateVolumesFromImageTest-1429462829 None] Flow 'volume_create_manager' (b9f4b1d1-34bc-41e4-88fd-7b5dc5b448f5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87444) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 04:48:27 devstack cinder-volume[87444]: INFO cinder.volume.manager [None req-1df1f3b8-da92-43a0-a0ce-8dfdf0d93fea tempest-CreateVolumesFromImageTest-1429462829 None] Created volume successfully. Jul 10 04:48:27 devstack sudo[101461]: pam_unix(sudo:session): session closed for user root Jul 10 04:48:27 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-725c3749-6a1b-4387-bb2f-f8b7e7cc520c tempest-CreateVolumesFromImageTest-1429462829 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-4d621b59-a8f2-4a6f-bb60-e5fb636a0951 1073741824" returned: 0 in 0.890s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:48:27 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-725c3749-6a1b-4387-bb2f-f8b7e7cc520c tempest-CreateVolumesFromImageTest-1429462829 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-4d621b59-a8f2-4a6f-bb60-e5fb636a0951 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:48:27 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [req-004dbaeb-4a58-4be1-8177-b7003cbeaadc req-be8dd35c-eb01-47b6-a24a-f9f721309d95 tempest-TestStampPattern-1378957900 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 04:48:27 devstack sudo[101475]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-4d621b59-a8f2-4a6f-bb60-e5fb636a0951 Jul 10 04:48:27 devstack sudo[101475]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:48:28 devstack sudo[101475]: pam_unix(sudo:session): session closed for user root Jul 10 04:48:28 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-725c3749-6a1b-4387-bb2f-f8b7e7cc520c tempest-CreateVolumesFromImageTest-1429462829 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-4d621b59-a8f2-4a6f-bb60-e5fb636a0951" returned: 0 in 0.699s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:48:28 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-725c3749-6a1b-4387-bb2f-f8b7e7cc520c tempest-CreateVolumesFromImageTest-1429462829 None] <== create_volume: return (1635ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922'} {{(pid=87444) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 04:48:28 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-725c3749-6a1b-4387-bb2f-f8b7e7cc520c tempest-CreateVolumesFromImageTest-1429462829 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.638s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 04:48:28 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [req-004dbaeb-4a58-4be1-8177-b7003cbeaadc req-be8dd35c-eb01-47b6-a24a-f9f721309d95 tempest-TestStampPattern-1378957900 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.684s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 04:48:28 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-725c3749-6a1b-4387-bb2f-f8b7e7cc520c tempest-CreateVolumesFromImageTest-1429462829 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (50de4f5a-acc1-4ce0-b7ab-145eefdc3fe2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4d621b59-a8f2-4a6f-bb60-e5fb636a0951', 'volume_size': 1}' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:48:28 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-725c3749-6a1b-4387-bb2f-f8b7e7cc520c tempest-CreateVolumesFromImageTest-1429462829 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e4f72ccb-4e49-4f7b-9db7-0bf3bab4f016) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:48:28 devstack cinder-volume[87444]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1c6aa7a-5ddb-4e96-98ae-2bd598e27955]: (4, 'qcow2') {{(pid=88499) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 04:48:28 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [req-004dbaeb-4a58-4be1-8177-b7003cbeaadc req-be8dd35c-eb01-47b6-a24a-f9f721309d95 tempest-TestStampPattern-1378957900 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-1619d28f-d75b-43c4-9227-e309e35ee077 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:48:28 devstack cinder-volume[87444]: INFO cinder.volume.flows.manager.create_volume [None req-725c3749-6a1b-4387-bb2f-f8b7e7cc520c tempest-CreateVolumesFromImageTest-1429462829 None] Volume volume-4d621b59-a8f2-4a6f-bb60-e5fb636a0951 (4d621b59-a8f2-4a6f-bb60-e5fb636a0951): created successfully Jul 10 04:48:28 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-725c3749-6a1b-4387-bb2f-f8b7e7cc520c tempest-CreateVolumesFromImageTest-1429462829 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e4f72ccb-4e49-4f7b-9db7-0bf3bab4f016) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:48:28 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-725c3749-6a1b-4387-bb2f-f8b7e7cc520c tempest-CreateVolumesFromImageTest-1429462829 None] Flow 'volume_create_manager' (67882f99-0c34-45f7-8187-dacb03e69f0d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87444) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 04:48:28 devstack cinder-volume[87444]: INFO cinder.volume.manager [None req-725c3749-6a1b-4387-bb2f-f8b7e7cc520c tempest-CreateVolumesFromImageTest-1429462829 None] Created volume successfully. Jul 10 04:48:28 devstack sudo[101502]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-1619d28f-d75b-43c4-9227-e309e35ee077 Jul 10 04:48:28 devstack sudo[101502]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:48:28 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-862577d9-f822-44b8-bf3b-b82abc3cfdf3 tempest-CreateVolumesFromImageTest-1429462829 None] Acquiring lock "cinder-4d621b59-a8f2-4a6f-bb60-e5fb636a0951-delete_volume" by "delete_volume" {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 04:48:29 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-862577d9-f822-44b8-bf3b-b82abc3cfdf3 tempest-CreateVolumesFromImageTest-1429462829 None] Lock "cinder-4d621b59-a8f2-4a6f-bb60-e5fb636a0951-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 04:48:29 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-862577d9-f822-44b8-bf3b-b82abc3cfdf3 tempest-CreateVolumesFromImageTest-1429462829 None] Acquiring lock "cinder-quobyte-4d621b59-a8f2-4a6f-bb60-e5fb636a0951" by "delete_volume" {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 04:48:29 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-862577d9-f822-44b8-bf3b-b82abc3cfdf3 tempest-CreateVolumesFromImageTest-1429462829 None] Lock "cinder-quobyte-4d621b59-a8f2-4a6f-bb60-e5fb636a0951" acquired by "delete_volume" :: waited 0.019s {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 04:48:29 devstack cinder-volume[87444]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce8f696e-abee-43bc-bdba-b1abc68c9c82]: (4, 'qcow2') {{(pid=88499) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 04:48:29 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-862577d9-f822-44b8-bf3b-b82abc3cfdf3 tempest-CreateVolumesFromImageTest-1429462829 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-4d621b59-a8f2-4a6f-bb60-e5fb636a0951 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:48:29 devstack sudo[101504]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-4d621b59-a8f2-4a6f-bb60-e5fb636a0951 Jul 10 04:48:29 devstack sudo[101504]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:48:29 devstack sudo[101502]: pam_unix(sudo:session): session closed for user root Jul 10 04:48:29 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [req-004dbaeb-4a58-4be1-8177-b7003cbeaadc req-be8dd35c-eb01-47b6-a24a-f9f721309d95 tempest-TestStampPattern-1378957900 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-1619d28f-d75b-43c4-9227-e309e35ee077" returned: 0 in 0.908s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:48:29 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [req-004dbaeb-4a58-4be1-8177-b7003cbeaadc req-be8dd35c-eb01-47b6-a24a-f9f721309d95 tempest-TestStampPattern-1378957900 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.944s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 04:48:29 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [req-004dbaeb-4a58-4be1-8177-b7003cbeaadc req-be8dd35c-eb01-47b6-a24a-f9f721309d95 tempest-TestStampPattern-1378957900 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922', 'name': 'volume-1619d28f-d75b-43c4-9227-e309e35ee077', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '9d11507e-8197-4b0d-87b8-fbe65a0974d7', 'enforce_multipath': True} {{(pid=87444) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 10 04:48:29 devstack cinder-volume[87444]: INFO cinder.volume.manager [req-004dbaeb-4a58-4be1-8177-b7003cbeaadc req-be8dd35c-eb01-47b6-a24a-f9f721309d95 tempest-TestStampPattern-1378957900 None] attachment_update completed successfully. Jul 10 04:48:29 devstack cinder-volume[87444]: INFO cinder.volume.manager [req-08189866-2970-4c70-8742-184f94521d0c req-b5d0acaa-a221-4c3c-b9a8-3bee475d2c1c tempest-TestServerVolumeAttachmentScenario-922014933 None] Terminate volume connection completed successfully. Jul 10 04:48:29 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [req-08189866-2970-4c70-8742-184f94521d0c req-b5d0acaa-a221-4c3c-b9a8-3bee475d2c1c tempest-TestServerVolumeAttachmentScenario-922014933 None] Deleting attachment 68a24190-5cf6-4d35-9df7-0d360c129791. {{(pid=87444) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 10 04:48:30 devstack sudo[101504]: pam_unix(sudo:session): session closed for user root Jul 10 04:48:30 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-862577d9-f822-44b8-bf3b-b82abc3cfdf3 tempest-CreateVolumesFromImageTest-1429462829 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-4d621b59-a8f2-4a6f-bb60-e5fb636a0951" returned: 0 in 0.902s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:48:30 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-862577d9-f822-44b8-bf3b-b82abc3cfdf3 tempest-CreateVolumesFromImageTest-1429462829 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-4d621b59-a8f2-4a6f-bb60-e5fb636a0951 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:48:30 devstack sudo[101518]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-4d621b59-a8f2-4a6f-bb60-e5fb636a0951 Jul 10 04:48:30 devstack sudo[101518]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:48:30 devstack sudo[101518]: pam_unix(sudo:session): session closed for user root Jul 10 04:48:30 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-862577d9-f822-44b8-bf3b-b82abc3cfdf3 tempest-CreateVolumesFromImageTest-1429462829 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-4d621b59-a8f2-4a6f-bb60-e5fb636a0951" returned: 0 in 0.701s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:48:30 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-862577d9-f822-44b8-bf3b-b82abc3cfdf3 tempest-CreateVolumesFromImageTest-1429462829 None] Lock "cinder-quobyte-4d621b59-a8f2-4a6f-bb60-e5fb636a0951" released by "delete_volume" :: held 1.656s {{(pid=87444) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 04:48:30 devstack cinder-volume[87444]: DEBUG cinder.quota [None req-862577d9-f822-44b8-bf3b-b82abc3cfdf3 tempest-CreateVolumesFromImageTest-1429462829 None] Created reservations ['a75051ab-2de4-4acc-9647-095f6baddd94', '9f1537b3-5f34-41bf-8ec3-0fee41de9c2f', 'd5def270-b419-44cb-a2c4-225caf5e0073', '3e394538-d91e-4214-866d-8a19964f6ce1'] {{(pid=87444) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 04:48:30 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-862577d9-f822-44b8-bf3b-b82abc3cfdf3 tempest-CreateVolumesFromImageTest-1429462829 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 04:48:30 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-862577d9-f822-44b8-bf3b-b82abc3cfdf3 tempest-CreateVolumesFromImageTest-1429462829 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 04:48:30 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-862577d9-f822-44b8-bf3b-b82abc3cfdf3 tempest-CreateVolumesFromImageTest-1429462829 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922': None} {{(pid=87444) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 04:48:30 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-862577d9-f822-44b8-bf3b-b82abc3cfdf3 tempest-CreateVolumesFromImageTest-1429462829 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922'] {{(pid=87444) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 04:48:30 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-862577d9-f822-44b8-bf3b-b82abc3cfdf3 tempest-CreateVolumesFromImageTest-1429462829 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 04:48:30 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-862577d9-f822-44b8-bf3b-b82abc3cfdf3 tempest-CreateVolumesFromImageTest-1429462829 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:48:30 devstack sudo[101901]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097 Jul 10 04:48:30 devstack sudo[101901]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:48:31 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-b896efc8-8ea7-4f95-a4eb-f1cf9acc3fa1 tempest-CreateVolumesFromImageTest-1429462829 None] Acquiring lock "cinder-bcdd36a4-e749-4e79-bde9-e2939a518280-delete_volume" by "delete_volume" {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 04:48:31 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-b896efc8-8ea7-4f95-a4eb-f1cf9acc3fa1 tempest-CreateVolumesFromImageTest-1429462829 None] Lock "cinder-bcdd36a4-e749-4e79-bde9-e2939a518280-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 04:48:31 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-b896efc8-8ea7-4f95-a4eb-f1cf9acc3fa1 tempest-CreateVolumesFromImageTest-1429462829 None] Acquiring lock "cinder-quobyte-bcdd36a4-e749-4e79-bde9-e2939a518280" by "delete_volume" {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 04:48:31 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-b896efc8-8ea7-4f95-a4eb-f1cf9acc3fa1 tempest-CreateVolumesFromImageTest-1429462829 None] Lock "cinder-quobyte-bcdd36a4-e749-4e79-bde9-e2939a518280" acquired by "delete_volume" :: waited 0.016s {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 04:48:31 devstack cinder-volume[87444]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c815f56-3cf7-4da7-af80-29eef4d5d42e]: (4, 'qcow2') {{(pid=88499) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 04:48:31 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-b896efc8-8ea7-4f95-a4eb-f1cf9acc3fa1 tempest-CreateVolumesFromImageTest-1429462829 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-bcdd36a4-e749-4e79-bde9-e2939a518280 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:48:31 devstack sudo[101903]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-bcdd36a4-e749-4e79-bde9-e2939a518280 Jul 10 04:48:31 devstack sudo[101903]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:48:31 devstack sudo[101901]: pam_unix(sudo:session): session closed for user root Jul 10 04:48:31 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-862577d9-f822-44b8-bf3b-b82abc3cfdf3 tempest-CreateVolumesFromImageTest-1429462829 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097" returned: 0 in 0.687s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:48:31 devstack cinder-volume[87444]: DEBUG cinder.manager [None req-862577d9-f822-44b8-bf3b-b82abc3cfdf3 tempest-CreateVolumesFromImageTest-1429462829 None] Notifying Schedulers of capabilities ... {{(pid=87444) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 04:48:31 devstack cinder-volume[87444]: INFO cinder.volume.manager [None req-862577d9-f822-44b8-bf3b-b82abc3cfdf3 tempest-CreateVolumesFromImageTest-1429462829 None] Deleted volume successfully. Jul 10 04:48:31 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-862577d9-f822-44b8-bf3b-b82abc3cfdf3 tempest-CreateVolumesFromImageTest-1429462829 None] Lock "cinder-4d621b59-a8f2-4a6f-bb60-e5fb636a0951-delete_volume" released by "delete_volume" :: held 2.588s {{(pid=87444) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 04:48:32 devstack sudo[101903]: pam_unix(sudo:session): session closed for user root Jul 10 04:48:32 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-b896efc8-8ea7-4f95-a4eb-f1cf9acc3fa1 tempest-CreateVolumesFromImageTest-1429462829 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-bcdd36a4-e749-4e79-bde9-e2939a518280" returned: 0 in 0.810s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:48:32 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-b896efc8-8ea7-4f95-a4eb-f1cf9acc3fa1 tempest-CreateVolumesFromImageTest-1429462829 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-bcdd36a4-e749-4e79-bde9-e2939a518280 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:48:32 devstack sudo[101909]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-bcdd36a4-e749-4e79-bde9-e2939a518280 Jul 10 04:48:32 devstack sudo[101909]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:48:32 devstack sudo[101909]: pam_unix(sudo:session): session closed for user root Jul 10 04:48:32 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-b896efc8-8ea7-4f95-a4eb-f1cf9acc3fa1 tempest-CreateVolumesFromImageTest-1429462829 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-bcdd36a4-e749-4e79-bde9-e2939a518280" returned: 0 in 0.673s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:48:32 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-b896efc8-8ea7-4f95-a4eb-f1cf9acc3fa1 tempest-CreateVolumesFromImageTest-1429462829 None] Lock "cinder-quobyte-bcdd36a4-e749-4e79-bde9-e2939a518280" released by "delete_volume" :: held 1.525s {{(pid=87444) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 04:48:32 devstack cinder-volume[87444]: DEBUG cinder.quota [None req-b896efc8-8ea7-4f95-a4eb-f1cf9acc3fa1 tempest-CreateVolumesFromImageTest-1429462829 None] Created reservations ['2ccc37d1-9a81-4842-aaab-c2ffebe146a1', '435f7233-8536-41e3-98e5-03fc7cb31919', '0fc23992-f35b-47b3-8dc2-7cc0053fb2a3', '889785f4-8345-4783-8ab7-4da7a28a8d65'] {{(pid=87444) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 04:48:32 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-b896efc8-8ea7-4f95-a4eb-f1cf9acc3fa1 tempest-CreateVolumesFromImageTest-1429462829 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 04:48:32 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-b896efc8-8ea7-4f95-a4eb-f1cf9acc3fa1 tempest-CreateVolumesFromImageTest-1429462829 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 04:48:32 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-b896efc8-8ea7-4f95-a4eb-f1cf9acc3fa1 tempest-CreateVolumesFromImageTest-1429462829 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922': None} {{(pid=87444) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 04:48:32 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-b896efc8-8ea7-4f95-a4eb-f1cf9acc3fa1 tempest-CreateVolumesFromImageTest-1429462829 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922'] {{(pid=87444) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 04:48:32 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-b896efc8-8ea7-4f95-a4eb-f1cf9acc3fa1 tempest-CreateVolumesFromImageTest-1429462829 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 04:48:32 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-b896efc8-8ea7-4f95-a4eb-f1cf9acc3fa1 tempest-CreateVolumesFromImageTest-1429462829 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:48:32 devstack sudo[101912]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097 Jul 10 04:48:32 devstack sudo[101912]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:48:33 devstack cinder-volume[87444]: DEBUG oslo_service.periodic_task [None req-01f0ce3e-6850-4e14-881d-e40d3c4ad6e5 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87444) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 10 04:48:33 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-01f0ce3e-6850-4e14-881d-e40d3c4ad6e5 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 04:48:33 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-01f0ce3e-6850-4e14-881d-e40d3c4ad6e5 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 04:48:33 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-01f0ce3e-6850-4e14-881d-e40d3c4ad6e5 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922': None} {{(pid=87444) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 04:48:33 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-01f0ce3e-6850-4e14-881d-e40d3c4ad6e5 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922'] {{(pid=87444) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 04:48:33 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-01f0ce3e-6850-4e14-881d-e40d3c4ad6e5 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 04:48:33 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-01f0ce3e-6850-4e14-881d-e40d3c4ad6e5 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:48:33 devstack sudo[101914]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097 Jul 10 04:48:33 devstack sudo[101914]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:48:33 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-e0f37257-9728-4408-b1d9-1008e57c3690 tempest-CreateVolumesFromImageTest-1429462829 None] Acquiring lock "cinder-d4a58323-6eac-4d73-b5ab-d4317058d705-delete_volume" by "delete_volume" {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 04:48:33 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-e0f37257-9728-4408-b1d9-1008e57c3690 tempest-CreateVolumesFromImageTest-1429462829 None] Lock "cinder-d4a58323-6eac-4d73-b5ab-d4317058d705-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 04:48:33 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-e0f37257-9728-4408-b1d9-1008e57c3690 tempest-CreateVolumesFromImageTest-1429462829 None] Acquiring lock "cinder-quobyte-d4a58323-6eac-4d73-b5ab-d4317058d705" by "delete_volume" {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 04:48:33 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-e0f37257-9728-4408-b1d9-1008e57c3690 tempest-CreateVolumesFromImageTest-1429462829 None] Lock "cinder-quobyte-d4a58323-6eac-4d73-b5ab-d4317058d705" acquired by "delete_volume" :: waited 0.030s {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 04:48:33 devstack cinder-volume[87444]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b1cbfe0-1912-4d0f-b095-28dc328df449]: (4, 'qcow2') {{(pid=88499) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 04:48:33 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-e0f37257-9728-4408-b1d9-1008e57c3690 tempest-CreateVolumesFromImageTest-1429462829 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-d4a58323-6eac-4d73-b5ab-d4317058d705 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:48:33 devstack sudo[101912]: pam_unix(sudo:session): session closed for user root Jul 10 04:48:33 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-b896efc8-8ea7-4f95-a4eb-f1cf9acc3fa1 tempest-CreateVolumesFromImageTest-1429462829 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097" returned: 0 in 0.815s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:48:33 devstack cinder-volume[87444]: DEBUG cinder.manager [None req-b896efc8-8ea7-4f95-a4eb-f1cf9acc3fa1 tempest-CreateVolumesFromImageTest-1429462829 None] Notifying Schedulers of capabilities ... {{(pid=87444) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 04:48:33 devstack cinder-volume[87444]: INFO cinder.volume.manager [None req-b896efc8-8ea7-4f95-a4eb-f1cf9acc3fa1 tempest-CreateVolumesFromImageTest-1429462829 None] Deleted volume successfully. Jul 10 04:48:33 devstack sudo[101923]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-d4a58323-6eac-4d73-b5ab-d4317058d705 Jul 10 04:48:33 devstack sudo[101923]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:48:33 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-b896efc8-8ea7-4f95-a4eb-f1cf9acc3fa1 tempest-CreateVolumesFromImageTest-1429462829 None] Lock "cinder-bcdd36a4-e749-4e79-bde9-e2939a518280-delete_volume" released by "delete_volume" :: held 2.540s {{(pid=87444) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 04:48:33 devstack sudo[101914]: pam_unix(sudo:session): session closed for user root Jul 10 04:48:33 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-01f0ce3e-6850-4e14-881d-e40d3c4ad6e5 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097" returned: 0 in 0.864s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:48:33 devstack cinder-volume[87444]: DEBUG cinder.manager [None req-01f0ce3e-6850-4e14-881d-e40d3c4ad6e5 None None] Notifying Schedulers of capabilities ... {{(pid=87444) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 04:48:33 devstack cinder-volume[87444]: DEBUG oslo_service.periodic_task [None req-01f0ce3e-6850-4e14-881d-e40d3c4ad6e5 None None] Running periodic task VolumeManager._thread_info {{(pid=87444) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 10 04:48:33 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-01f0ce3e-6850-4e14-881d-e40d3c4ad6e5 None None] thread count: 28 {{(pid=87444) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 10 04:48:33 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-01f0ce3e-6850-4e14-881d-e40d3c4ad6e5 None None] thread info: [<_MainThread(MainThread, started 126839257915520)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87444) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 10 04:48:34 devstack sudo[101923]: pam_unix(sudo:session): session closed for user root Jul 10 04:48:34 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-e0f37257-9728-4408-b1d9-1008e57c3690 tempest-CreateVolumesFromImageTest-1429462829 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-d4a58323-6eac-4d73-b5ab-d4317058d705" returned: 0 in 1.076s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:48:34 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-e0f37257-9728-4408-b1d9-1008e57c3690 tempest-CreateVolumesFromImageTest-1429462829 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-d4a58323-6eac-4d73-b5ab-d4317058d705 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:48:34 devstack sudo[101960]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-d4a58323-6eac-4d73-b5ab-d4317058d705 Jul 10 04:48:34 devstack sudo[101960]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:48:35 devstack sudo[101960]: pam_unix(sudo:session): session closed for user root Jul 10 04:48:35 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-e0f37257-9728-4408-b1d9-1008e57c3690 tempest-CreateVolumesFromImageTest-1429462829 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-d4a58323-6eac-4d73-b5ab-d4317058d705" returned: 0 in 0.961s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:48:35 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-e0f37257-9728-4408-b1d9-1008e57c3690 tempest-CreateVolumesFromImageTest-1429462829 None] Lock "cinder-quobyte-d4a58323-6eac-4d73-b5ab-d4317058d705" released by "delete_volume" :: held 2.126s {{(pid=87444) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 04:48:35 devstack cinder-volume[87444]: DEBUG cinder.quota [None req-e0f37257-9728-4408-b1d9-1008e57c3690 tempest-CreateVolumesFromImageTest-1429462829 None] Created reservations ['cde246fc-e969-45be-9394-cae97be1fbcd', '0a0548b5-ad24-4224-99f2-4f38814c9e2e', 'c0f7ce56-5358-4abf-a88b-9a80ba07f7fe', 'd78ca431-c724-4ee9-ba7f-20cea8eb791c'] {{(pid=87444) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 04:48:35 devstack cinder-volume[87444]: DEBUG cinder.volume.flows.manager.create_volume [None req-b23e9adc-b06b-4840-9909-cc09f196c8d9 tempest-TestServerVolumeAttachScenarioOldVersion-885288560 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87444) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 04:48:35 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-b23e9adc-b06b-4840-9909-cc09f196c8d9 tempest-TestServerVolumeAttachScenarioOldVersion-885288560 None] Flow 'volume_create_manager' (7662fe73-2d42-4abf-854b-db4f1bd709d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 04:48:35 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-b23e9adc-b06b-4840-9909-cc09f196c8d9 tempest-TestServerVolumeAttachScenarioOldVersion-885288560 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6b9cd3e8-78ef-4afe-847d-36f34f797b46) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:48:35 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-b23e9adc-b06b-4840-9909-cc09f196c8d9 tempest-TestServerVolumeAttachScenarioOldVersion-885288560 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6b9cd3e8-78ef-4afe-847d-36f34f797b46) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T02:48:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachScenarioOldVersion-volume-450428109',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=04f3bea2-0951-40d0-ad5e-5b78fba1aa16,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='aaed028845664958a3463477db59fe5e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T02:48:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T02:48:36Z,use_quota=True,user_id='c0bb5e4f951245858f3240628da96332',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(317e369e-1e06-434d-ae95-a335f0e6c903),volume_type_id=317e369e-1e06-434d-ae95-a335f0e6c903)' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:48:35 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-b23e9adc-b06b-4840-9909-cc09f196c8d9 tempest-TestServerVolumeAttachScenarioOldVersion-885288560 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (920d6406-8e8d-4425-a80b-8ab1ab5b4d33) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:48:35 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-b23e9adc-b06b-4840-9909-cc09f196c8d9 tempest-TestServerVolumeAttachScenarioOldVersion-885288560 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (920d6406-8e8d-4425-a80b-8ab1ab5b4d33) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:48:35 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-b23e9adc-b06b-4840-9909-cc09f196c8d9 tempest-TestServerVolumeAttachScenarioOldVersion-885288560 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c0867b4d-076d-4611-a001-69479727e6cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:48:35 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-b23e9adc-b06b-4840-9909-cc09f196c8d9 tempest-TestServerVolumeAttachScenarioOldVersion-885288560 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c0867b4d-076d-4611-a001-69479727e6cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '04f3bea2-0951-40d0-ad5e-5b78fba1aa16', 'volume_name': 'volume-04f3bea2-0951-40d0-ad5e-5b78fba1aa16', 'volume_size': 1}' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:48:35 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-b23e9adc-b06b-4840-9909-cc09f196c8d9 tempest-TestServerVolumeAttachScenarioOldVersion-885288560 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8889c395-07c4-4278-baf6-dde1a89446b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:48:35 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-b23e9adc-b06b-4840-9909-cc09f196c8d9 tempest-TestServerVolumeAttachScenarioOldVersion-885288560 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8889c395-07c4-4278-baf6-dde1a89446b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:48:35 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-b23e9adc-b06b-4840-9909-cc09f196c8d9 tempest-TestServerVolumeAttachScenarioOldVersion-885288560 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7c26d1aa-be28-4697-8de8-fef2a0a292ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:48:35 devstack cinder-volume[87444]: INFO cinder.volume.flows.manager.create_volume [None req-b23e9adc-b06b-4840-9909-cc09f196c8d9 tempest-TestServerVolumeAttachScenarioOldVersion-885288560 None] Volume 04f3bea2-0951-40d0-ad5e-5b78fba1aa16: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-04f3bea2-0951-40d0-ad5e-5b78fba1aa16', 'volume_size': 1} Jul 10 04:48:35 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-b23e9adc-b06b-4840-9909-cc09f196c8d9 tempest-TestServerVolumeAttachScenarioOldVersion-885288560 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 04:48:35 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-b23e9adc-b06b-4840-9909-cc09f196c8d9 tempest-TestServerVolumeAttachScenarioOldVersion-885288560 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 04:48:35 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-b23e9adc-b06b-4840-9909-cc09f196c8d9 tempest-TestServerVolumeAttachScenarioOldVersion-885288560 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T02:48:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachScenarioOldVersion-volume-450428109',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=04f3bea2-0951-40d0-ad5e-5b78fba1aa16,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='aaed028845664958a3463477db59fe5e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T02:48:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T02:48:36Z,use_quota=True,user_id='c0bb5e4f951245858f3240628da96332',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(317e369e-1e06-434d-ae95-a335f0e6c903),volume_type_id=317e369e-1e06-434d-ae95-a335f0e6c903)}" {{(pid=87444) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 04:48:35 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.remotefs [None req-b23e9adc-b06b-4840-9909-cc09f196c8d9 tempest-TestServerVolumeAttachScenarioOldVersion-885288560 None] Creating volume 04f3bea2-0951-40d0-ad5e-5b78fba1aa16 {{(pid=87444) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 04:48:35 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-b23e9adc-b06b-4840-9909-cc09f196c8d9 tempest-TestServerVolumeAttachScenarioOldVersion-885288560 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 04:48:35 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-b23e9adc-b06b-4840-9909-cc09f196c8d9 tempest-TestServerVolumeAttachScenarioOldVersion-885288560 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 04:48:35 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-b23e9adc-b06b-4840-9909-cc09f196c8d9 tempest-TestServerVolumeAttachScenarioOldVersion-885288560 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922': None} {{(pid=87444) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 04:48:35 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-b23e9adc-b06b-4840-9909-cc09f196c8d9 tempest-TestServerVolumeAttachScenarioOldVersion-885288560 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922'] {{(pid=87444) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 04:48:35 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-b23e9adc-b06b-4840-9909-cc09f196c8d9 tempest-TestServerVolumeAttachScenarioOldVersion-885288560 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 04:48:35 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-b23e9adc-b06b-4840-9909-cc09f196c8d9 tempest-TestServerVolumeAttachScenarioOldVersion-885288560 None] Selected osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922 as target Quobyte volume. {{(pid=87444) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 04:48:35 devstack cinder-volume[87444]: INFO cinder.volume.drivers.remotefs [None req-b23e9adc-b06b-4840-9909-cc09f196c8d9 tempest-TestServerVolumeAttachScenarioOldVersion-885288560 None] casted to osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922 Jul 10 04:48:35 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-b23e9adc-b06b-4840-9909-cc09f196c8d9 tempest-TestServerVolumeAttachScenarioOldVersion-885288560 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-04f3bea2-0951-40d0-ad5e-5b78fba1aa16 1073741824 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:48:36 devstack sudo[101971]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-04f3bea2-0951-40d0-ad5e-5b78fba1aa16 1073741824 Jul 10 04:48:36 devstack sudo[101971]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:48:36 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-e0f37257-9728-4408-b1d9-1008e57c3690 tempest-CreateVolumesFromImageTest-1429462829 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 04:48:36 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-e0f37257-9728-4408-b1d9-1008e57c3690 tempest-CreateVolumesFromImageTest-1429462829 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 04:48:36 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-e0f37257-9728-4408-b1d9-1008e57c3690 tempest-CreateVolumesFromImageTest-1429462829 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922': None} {{(pid=87444) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 04:48:36 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-e0f37257-9728-4408-b1d9-1008e57c3690 tempest-CreateVolumesFromImageTest-1429462829 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922'] {{(pid=87444) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 04:48:36 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-e0f37257-9728-4408-b1d9-1008e57c3690 tempest-CreateVolumesFromImageTest-1429462829 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 04:48:36 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-e0f37257-9728-4408-b1d9-1008e57c3690 tempest-CreateVolumesFromImageTest-1429462829 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:48:36 devstack sudo[101973]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097 Jul 10 04:48:36 devstack sudo[101973]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:48:36 devstack cinder-volume[87444]: INFO cinder.volume.manager [req-9ecf90d0-93a6-48e6-8b3d-23e925c2400b req-1d4c9796-3399-44d7-af0f-6eb0afee11d7 tempest-TestStampPattern-1378957900 None] Terminate volume connection completed successfully. Jul 10 04:48:36 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [req-9ecf90d0-93a6-48e6-8b3d-23e925c2400b req-1d4c9796-3399-44d7-af0f-6eb0afee11d7 tempest-TestStampPattern-1378957900 None] Deleting attachment 9d11507e-8197-4b0d-87b8-fbe65a0974d7. {{(pid=87444) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 10 04:48:36 devstack sudo[101973]: pam_unix(sudo:session): session closed for user root Jul 10 04:48:36 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-e0f37257-9728-4408-b1d9-1008e57c3690 tempest-CreateVolumesFromImageTest-1429462829 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097" returned: 0 in 0.826s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:48:36 devstack cinder-volume[87444]: DEBUG cinder.manager [None req-e0f37257-9728-4408-b1d9-1008e57c3690 tempest-CreateVolumesFromImageTest-1429462829 None] Notifying Schedulers of capabilities ... {{(pid=87444) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 04:48:36 devstack cinder-volume[87444]: INFO cinder.volume.manager [None req-e0f37257-9728-4408-b1d9-1008e57c3690 tempest-CreateVolumesFromImageTest-1429462829 None] Deleted volume successfully. Jul 10 04:48:36 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-e0f37257-9728-4408-b1d9-1008e57c3690 tempest-CreateVolumesFromImageTest-1429462829 None] Lock "cinder-d4a58323-6eac-4d73-b5ab-d4317058d705-delete_volume" released by "delete_volume" :: held 3.348s {{(pid=87444) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 04:48:36 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-f5a4200b-90d3-47ec-9dfa-51c0fa65b919 tempest-CreateVolumesFromImageTest-1429462829 None] Acquiring lock "cinder-694e1057-d982-422a-b12f-40b10a3fe726-delete_volume" by "delete_volume" {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 04:48:36 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-f5a4200b-90d3-47ec-9dfa-51c0fa65b919 tempest-CreateVolumesFromImageTest-1429462829 None] Lock "cinder-694e1057-d982-422a-b12f-40b10a3fe726-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 04:48:36 devstack sudo[101971]: pam_unix(sudo:session): session closed for user root Jul 10 04:48:36 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-b23e9adc-b06b-4840-9909-cc09f196c8d9 tempest-TestServerVolumeAttachScenarioOldVersion-885288560 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-04f3bea2-0951-40d0-ad5e-5b78fba1aa16 1073741824" returned: 0 in 1.016s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:48:37 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-f5a4200b-90d3-47ec-9dfa-51c0fa65b919 tempest-CreateVolumesFromImageTest-1429462829 None] Acquiring lock "cinder-quobyte-694e1057-d982-422a-b12f-40b10a3fe726" by "delete_volume" {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 04:48:37 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-f5a4200b-90d3-47ec-9dfa-51c0fa65b919 tempest-CreateVolumesFromImageTest-1429462829 None] Lock "cinder-quobyte-694e1057-d982-422a-b12f-40b10a3fe726" acquired by "delete_volume" :: waited 0.026s {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 04:48:37 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-b23e9adc-b06b-4840-9909-cc09f196c8d9 tempest-TestServerVolumeAttachScenarioOldVersion-885288560 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-04f3bea2-0951-40d0-ad5e-5b78fba1aa16 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:48:37 devstack cinder-volume[87444]: DEBUG oslo.privsep.daemon [-] privsep: reply[27bd9d79-8960-431a-8d52-cd2758011dd6]: (4, 'qcow2') {{(pid=88499) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 04:48:37 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-f5a4200b-90d3-47ec-9dfa-51c0fa65b919 tempest-CreateVolumesFromImageTest-1429462829 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-694e1057-d982-422a-b12f-40b10a3fe726 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:48:37 devstack sudo[102040]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-04f3bea2-0951-40d0-ad5e-5b78fba1aa16 Jul 10 04:48:37 devstack sudo[102040]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:48:37 devstack sudo[102041]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-694e1057-d982-422a-b12f-40b10a3fe726 Jul 10 04:48:37 devstack sudo[102041]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:48:37 devstack sudo[102040]: pam_unix(sudo:session): session closed for user root Jul 10 04:48:37 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-b23e9adc-b06b-4840-9909-cc09f196c8d9 tempest-TestServerVolumeAttachScenarioOldVersion-885288560 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-04f3bea2-0951-40d0-ad5e-5b78fba1aa16" returned: 0 in 0.796s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:48:37 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-b23e9adc-b06b-4840-9909-cc09f196c8d9 tempest-TestServerVolumeAttachScenarioOldVersion-885288560 None] <== create_volume: return (1890ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922'} {{(pid=87444) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 04:48:37 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-b23e9adc-b06b-4840-9909-cc09f196c8d9 tempest-TestServerVolumeAttachScenarioOldVersion-885288560 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.892s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 04:48:37 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-b23e9adc-b06b-4840-9909-cc09f196c8d9 tempest-TestServerVolumeAttachScenarioOldVersion-885288560 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7c26d1aa-be28-4697-8de8-fef2a0a292ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-04f3bea2-0951-40d0-ad5e-5b78fba1aa16', 'volume_size': 1}' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:48:37 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-b23e9adc-b06b-4840-9909-cc09f196c8d9 tempest-TestServerVolumeAttachScenarioOldVersion-885288560 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aeea4bfc-be3a-4ca7-b5f1-757fd8c9d6c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:48:37 devstack cinder-volume[87444]: INFO cinder.volume.flows.manager.create_volume [None req-b23e9adc-b06b-4840-9909-cc09f196c8d9 tempest-TestServerVolumeAttachScenarioOldVersion-885288560 None] Volume volume-04f3bea2-0951-40d0-ad5e-5b78fba1aa16 (04f3bea2-0951-40d0-ad5e-5b78fba1aa16): created successfully Jul 10 04:48:37 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-b23e9adc-b06b-4840-9909-cc09f196c8d9 tempest-TestServerVolumeAttachScenarioOldVersion-885288560 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aeea4bfc-be3a-4ca7-b5f1-757fd8c9d6c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:48:37 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-b23e9adc-b06b-4840-9909-cc09f196c8d9 tempest-TestServerVolumeAttachScenarioOldVersion-885288560 None] Flow 'volume_create_manager' (7662fe73-2d42-4abf-854b-db4f1bd709d3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87444) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 04:48:37 devstack cinder-volume[87444]: INFO cinder.volume.manager [None req-b23e9adc-b06b-4840-9909-cc09f196c8d9 tempest-TestServerVolumeAttachScenarioOldVersion-885288560 None] Created volume successfully. Jul 10 04:48:37 devstack sudo[102041]: pam_unix(sudo:session): session closed for user root Jul 10 04:48:37 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-f5a4200b-90d3-47ec-9dfa-51c0fa65b919 tempest-CreateVolumesFromImageTest-1429462829 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-694e1057-d982-422a-b12f-40b10a3fe726" returned: 0 in 0.899s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:48:37 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-f5a4200b-90d3-47ec-9dfa-51c0fa65b919 tempest-CreateVolumesFromImageTest-1429462829 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-694e1057-d982-422a-b12f-40b10a3fe726 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:48:38 devstack sudo[102050]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-694e1057-d982-422a-b12f-40b10a3fe726 Jul 10 04:48:38 devstack sudo[102050]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:48:38 devstack sudo[102050]: pam_unix(sudo:session): session closed for user root Jul 10 04:48:38 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-f5a4200b-90d3-47ec-9dfa-51c0fa65b919 tempest-CreateVolumesFromImageTest-1429462829 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-694e1057-d982-422a-b12f-40b10a3fe726" returned: 0 in 0.669s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:48:38 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-f5a4200b-90d3-47ec-9dfa-51c0fa65b919 tempest-CreateVolumesFromImageTest-1429462829 None] Lock "cinder-quobyte-694e1057-d982-422a-b12f-40b10a3fe726" released by "delete_volume" :: held 1.630s {{(pid=87444) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 04:48:38 devstack cinder-volume[87444]: DEBUG cinder.quota [None req-f5a4200b-90d3-47ec-9dfa-51c0fa65b919 tempest-CreateVolumesFromImageTest-1429462829 None] Created reservations ['8274ee82-d2ef-4a32-87ae-5a74c9aef427', '04be7612-1cbb-46c6-a767-ae13903c2339', 'd9d3e837-d381-4367-971f-6b149890ff52', '4e64c593-2666-4f57-93de-79fd77273342'] {{(pid=87444) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 04:48:38 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-f5a4200b-90d3-47ec-9dfa-51c0fa65b919 tempest-CreateVolumesFromImageTest-1429462829 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 04:48:38 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-f5a4200b-90d3-47ec-9dfa-51c0fa65b919 tempest-CreateVolumesFromImageTest-1429462829 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 04:48:38 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-f5a4200b-90d3-47ec-9dfa-51c0fa65b919 tempest-CreateVolumesFromImageTest-1429462829 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922': None} {{(pid=87444) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 04:48:38 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-f5a4200b-90d3-47ec-9dfa-51c0fa65b919 tempest-CreateVolumesFromImageTest-1429462829 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922'] {{(pid=87444) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 04:48:38 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-f5a4200b-90d3-47ec-9dfa-51c0fa65b919 tempest-CreateVolumesFromImageTest-1429462829 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 04:48:38 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-f5a4200b-90d3-47ec-9dfa-51c0fa65b919 tempest-CreateVolumesFromImageTest-1429462829 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:48:38 devstack sudo[102054]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097 Jul 10 04:48:38 devstack sudo[102054]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:48:39 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-3689d6e6-077e-449e-ae25-0d0ecc38b191 tempest-CreateVolumesFromImageTest-1429462829 None] Acquiring lock "cinder-9d93d07f-103b-4ebe-a542-14ffec2adaee-delete_volume" by "delete_volume" {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 04:48:39 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-3689d6e6-077e-449e-ae25-0d0ecc38b191 tempest-CreateVolumesFromImageTest-1429462829 None] Lock "cinder-9d93d07f-103b-4ebe-a542-14ffec2adaee-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 04:48:39 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-3689d6e6-077e-449e-ae25-0d0ecc38b191 tempest-CreateVolumesFromImageTest-1429462829 None] Acquiring lock "cinder-quobyte-9d93d07f-103b-4ebe-a542-14ffec2adaee" by "delete_volume" {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 04:48:39 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-3689d6e6-077e-449e-ae25-0d0ecc38b191 tempest-CreateVolumesFromImageTest-1429462829 None] Lock "cinder-quobyte-9d93d07f-103b-4ebe-a542-14ffec2adaee" acquired by "delete_volume" :: waited 0.021s {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 04:48:39 devstack cinder-volume[87444]: DEBUG oslo.privsep.daemon [-] privsep: reply[8079e61d-790f-4952-9ba9-f97bb3567223]: (4, 'qcow2') {{(pid=88499) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 04:48:39 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-3689d6e6-077e-449e-ae25-0d0ecc38b191 tempest-CreateVolumesFromImageTest-1429462829 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-9d93d07f-103b-4ebe-a542-14ffec2adaee {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:48:39 devstack sudo[102059]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-9d93d07f-103b-4ebe-a542-14ffec2adaee Jul 10 04:48:39 devstack sudo[102059]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:48:39 devstack sudo[102054]: pam_unix(sudo:session): session closed for user root Jul 10 04:48:39 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-f5a4200b-90d3-47ec-9dfa-51c0fa65b919 tempest-CreateVolumesFromImageTest-1429462829 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097" returned: 0 in 0.843s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:48:39 devstack cinder-volume[87444]: DEBUG cinder.manager [None req-f5a4200b-90d3-47ec-9dfa-51c0fa65b919 tempest-CreateVolumesFromImageTest-1429462829 None] Notifying Schedulers of capabilities ... {{(pid=87444) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 04:48:39 devstack cinder-volume[87444]: INFO cinder.volume.manager [None req-f5a4200b-90d3-47ec-9dfa-51c0fa65b919 tempest-CreateVolumesFromImageTest-1429462829 None] Deleted volume successfully. Jul 10 04:48:39 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-f5a4200b-90d3-47ec-9dfa-51c0fa65b919 tempest-CreateVolumesFromImageTest-1429462829 None] Lock "cinder-694e1057-d982-422a-b12f-40b10a3fe726-delete_volume" released by "delete_volume" :: held 2.731s {{(pid=87444) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 04:48:40 devstack sudo[102059]: pam_unix(sudo:session): session closed for user root Jul 10 04:48:40 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-3689d6e6-077e-449e-ae25-0d0ecc38b191 tempest-CreateVolumesFromImageTest-1429462829 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-9d93d07f-103b-4ebe-a542-14ffec2adaee" returned: 0 in 0.874s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:48:40 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-3689d6e6-077e-449e-ae25-0d0ecc38b191 tempest-CreateVolumesFromImageTest-1429462829 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-9d93d07f-103b-4ebe-a542-14ffec2adaee {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:48:40 devstack sudo[102081]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-9d93d07f-103b-4ebe-a542-14ffec2adaee Jul 10 04:48:40 devstack sudo[102081]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:48:41 devstack sudo[102081]: pam_unix(sudo:session): session closed for user root Jul 10 04:48:41 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-3689d6e6-077e-449e-ae25-0d0ecc38b191 tempest-CreateVolumesFromImageTest-1429462829 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-9d93d07f-103b-4ebe-a542-14ffec2adaee" returned: 0 in 0.819s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:48:41 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-3689d6e6-077e-449e-ae25-0d0ecc38b191 tempest-CreateVolumesFromImageTest-1429462829 None] Lock "cinder-quobyte-9d93d07f-103b-4ebe-a542-14ffec2adaee" released by "delete_volume" :: held 1.756s {{(pid=87444) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 04:48:41 devstack cinder-volume[87444]: DEBUG cinder.quota [None req-3689d6e6-077e-449e-ae25-0d0ecc38b191 tempest-CreateVolumesFromImageTest-1429462829 None] Created reservations ['fecf1202-84ea-44a4-9ffd-4d5750df0a3a', 'ac317f63-b61b-46f1-b8d5-d0809e4bd827', 'ac299316-3d94-4348-969a-8a004c7ce5e8', '1e421925-2c0e-4dc1-942a-973b7d4c7d6a'] {{(pid=87444) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 04:48:41 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-3689d6e6-077e-449e-ae25-0d0ecc38b191 tempest-CreateVolumesFromImageTest-1429462829 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 04:48:41 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-3689d6e6-077e-449e-ae25-0d0ecc38b191 tempest-CreateVolumesFromImageTest-1429462829 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 04:48:41 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-3689d6e6-077e-449e-ae25-0d0ecc38b191 tempest-CreateVolumesFromImageTest-1429462829 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922': None} {{(pid=87444) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 04:48:41 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-3689d6e6-077e-449e-ae25-0d0ecc38b191 tempest-CreateVolumesFromImageTest-1429462829 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922'] {{(pid=87444) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 04:48:41 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-3689d6e6-077e-449e-ae25-0d0ecc38b191 tempest-CreateVolumesFromImageTest-1429462829 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 04:48:41 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-3689d6e6-077e-449e-ae25-0d0ecc38b191 tempest-CreateVolumesFromImageTest-1429462829 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:48:41 devstack sudo[102096]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097 Jul 10 04:48:41 devstack sudo[102096]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:48:41 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-711acc46-6b6f-4a33-a7ef-2a94ea71c344 tempest-TestServerVolumeAttachmentScenario-922014933 None] Acquiring lock "cinder-3ba472a0-8c20-4406-b602-b04311be740e-delete_volume" by "delete_volume" {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 04:48:41 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-711acc46-6b6f-4a33-a7ef-2a94ea71c344 tempest-TestServerVolumeAttachmentScenario-922014933 None] Lock "cinder-3ba472a0-8c20-4406-b602-b04311be740e-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 04:48:41 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-711acc46-6b6f-4a33-a7ef-2a94ea71c344 tempest-TestServerVolumeAttachmentScenario-922014933 None] Acquiring lock "cinder-quobyte-3ba472a0-8c20-4406-b602-b04311be740e" by "delete_volume" {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 04:48:41 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-711acc46-6b6f-4a33-a7ef-2a94ea71c344 tempest-TestServerVolumeAttachmentScenario-922014933 None] Lock "cinder-quobyte-3ba472a0-8c20-4406-b602-b04311be740e" acquired by "delete_volume" :: waited 0.028s {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 04:48:41 devstack cinder-volume[87444]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4998ba8-af2b-4d5c-9160-3d10fd90ffa9]: (4, 'qcow2') {{(pid=88499) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 04:48:41 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-711acc46-6b6f-4a33-a7ef-2a94ea71c344 tempest-TestServerVolumeAttachmentScenario-922014933 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-3ba472a0-8c20-4406-b602-b04311be740e {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:48:41 devstack sudo[102098]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-3ba472a0-8c20-4406-b602-b04311be740e Jul 10 04:48:41 devstack sudo[102098]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:48:42 devstack sudo[102096]: pam_unix(sudo:session): session closed for user root Jul 10 04:48:42 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-3689d6e6-077e-449e-ae25-0d0ecc38b191 tempest-CreateVolumesFromImageTest-1429462829 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097" returned: 0 in 1.308s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:48:42 devstack cinder-volume[87444]: DEBUG cinder.manager [None req-3689d6e6-077e-449e-ae25-0d0ecc38b191 tempest-CreateVolumesFromImageTest-1429462829 None] Notifying Schedulers of capabilities ... {{(pid=87444) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 04:48:42 devstack cinder-volume[87444]: INFO cinder.volume.manager [None req-3689d6e6-077e-449e-ae25-0d0ecc38b191 tempest-CreateVolumesFromImageTest-1429462829 None] Deleted volume successfully. Jul 10 04:48:42 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-3689d6e6-077e-449e-ae25-0d0ecc38b191 tempest-CreateVolumesFromImageTest-1429462829 None] Lock "cinder-9d93d07f-103b-4ebe-a542-14ffec2adaee-delete_volume" released by "delete_volume" :: held 3.404s {{(pid=87444) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 04:48:42 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [req-bc291e4f-dd61-4cb6-a200-836b9e323c30 req-bc308049-b308-4965-937f-455f1195f647 tempest-TestServerVolumeAttachScenarioOldVersion-885288560 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 04:48:42 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [req-bc291e4f-dd61-4cb6-a200-836b9e323c30 req-bc308049-b308-4965-937f-455f1195f647 tempest-TestServerVolumeAttachScenarioOldVersion-885288560 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.002s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 04:48:42 devstack cinder-volume[87444]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ad4211d-3ff6-4bbd-ac4b-290f337f007e]: (4, 'qcow2') {{(pid=88499) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 04:48:42 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [req-bc291e4f-dd61-4cb6-a200-836b9e323c30 req-bc308049-b308-4965-937f-455f1195f647 tempest-TestServerVolumeAttachScenarioOldVersion-885288560 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-04f3bea2-0951-40d0-ad5e-5b78fba1aa16 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:48:42 devstack sudo[102132]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-04f3bea2-0951-40d0-ad5e-5b78fba1aa16 Jul 10 04:48:42 devstack sudo[102132]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:48:42 devstack sudo[102098]: pam_unix(sudo:session): session closed for user root Jul 10 04:48:42 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-711acc46-6b6f-4a33-a7ef-2a94ea71c344 tempest-TestServerVolumeAttachmentScenario-922014933 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-3ba472a0-8c20-4406-b602-b04311be740e" returned: 0 in 1.416s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:48:42 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-711acc46-6b6f-4a33-a7ef-2a94ea71c344 tempest-TestServerVolumeAttachmentScenario-922014933 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-3ba472a0-8c20-4406-b602-b04311be740e {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:48:42 devstack sudo[102134]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-3ba472a0-8c20-4406-b602-b04311be740e Jul 10 04:48:42 devstack sudo[102134]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:48:43 devstack sudo[102132]: pam_unix(sudo:session): session closed for user root Jul 10 04:48:43 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [req-bc291e4f-dd61-4cb6-a200-836b9e323c30 req-bc308049-b308-4965-937f-455f1195f647 tempest-TestServerVolumeAttachScenarioOldVersion-885288560 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-04f3bea2-0951-40d0-ad5e-5b78fba1aa16" returned: 0 in 0.957s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:48:43 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [req-bc291e4f-dd61-4cb6-a200-836b9e323c30 req-bc308049-b308-4965-937f-455f1195f647 tempest-TestServerVolumeAttachScenarioOldVersion-885288560 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.987s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 04:48:43 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [req-bc291e4f-dd61-4cb6-a200-836b9e323c30 req-bc308049-b308-4965-937f-455f1195f647 tempest-TestServerVolumeAttachScenarioOldVersion-885288560 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922', 'name': 'volume-04f3bea2-0951-40d0-ad5e-5b78fba1aa16', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '9118645d-48b7-4da1-b7f5-e3013752272a', 'enforce_multipath': True} {{(pid=87444) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 10 04:48:43 devstack cinder-volume[87444]: INFO cinder.volume.manager [req-bc291e4f-dd61-4cb6-a200-836b9e323c30 req-bc308049-b308-4965-937f-455f1195f647 tempest-TestServerVolumeAttachScenarioOldVersion-885288560 None] attachment_update completed successfully. Jul 10 04:48:43 devstack sudo[102134]: pam_unix(sudo:session): session closed for user root Jul 10 04:48:43 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-711acc46-6b6f-4a33-a7ef-2a94ea71c344 tempest-TestServerVolumeAttachmentScenario-922014933 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-3ba472a0-8c20-4406-b602-b04311be740e" returned: 0 in 0.956s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:48:43 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-711acc46-6b6f-4a33-a7ef-2a94ea71c344 tempest-TestServerVolumeAttachmentScenario-922014933 None] Lock "cinder-quobyte-3ba472a0-8c20-4406-b602-b04311be740e" released by "delete_volume" :: held 2.434s {{(pid=87444) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 04:48:43 devstack cinder-volume[87444]: DEBUG cinder.quota [None req-711acc46-6b6f-4a33-a7ef-2a94ea71c344 tempest-TestServerVolumeAttachmentScenario-922014933 None] Created reservations ['f574b076-52d5-4d4b-a988-24d519e12c45', '0788985f-7bc0-401f-a09c-4a047f66c979', '17bae3b5-cec5-413d-b479-6144f22641cf', 'a20ba4a1-b1d6-4668-a16c-22367d33c262'] {{(pid=87444) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 04:48:43 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-711acc46-6b6f-4a33-a7ef-2a94ea71c344 tempest-TestServerVolumeAttachmentScenario-922014933 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 04:48:43 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-711acc46-6b6f-4a33-a7ef-2a94ea71c344 tempest-TestServerVolumeAttachmentScenario-922014933 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 04:48:43 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-711acc46-6b6f-4a33-a7ef-2a94ea71c344 tempest-TestServerVolumeAttachmentScenario-922014933 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922': None} {{(pid=87444) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 04:48:43 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-711acc46-6b6f-4a33-a7ef-2a94ea71c344 tempest-TestServerVolumeAttachmentScenario-922014933 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922'] {{(pid=87444) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 04:48:43 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-711acc46-6b6f-4a33-a7ef-2a94ea71c344 tempest-TestServerVolumeAttachmentScenario-922014933 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 04:48:43 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-711acc46-6b6f-4a33-a7ef-2a94ea71c344 tempest-TestServerVolumeAttachmentScenario-922014933 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:48:44 devstack sudo[102142]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097 Jul 10 04:48:44 devstack sudo[102142]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:48:44 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-89105101-00d3-417e-80f7-2881c92428d5 tempest-TestServerVolumeAttachmentScenario-922014933 None] Acquiring lock "cinder-6b52b010-e7a2-4354-8dc9-fb362998af6e-delete_volume" by "delete_volume" {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 04:48:44 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-89105101-00d3-417e-80f7-2881c92428d5 tempest-TestServerVolumeAttachmentScenario-922014933 None] Lock "cinder-6b52b010-e7a2-4354-8dc9-fb362998af6e-delete_volume" acquired by "delete_volume" :: waited 0.052s {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 04:48:44 devstack sudo[102142]: pam_unix(sudo:session): session closed for user root Jul 10 04:48:44 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-711acc46-6b6f-4a33-a7ef-2a94ea71c344 tempest-TestServerVolumeAttachmentScenario-922014933 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097" returned: 0 in 0.800s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:48:44 devstack cinder-volume[87444]: DEBUG cinder.manager [None req-711acc46-6b6f-4a33-a7ef-2a94ea71c344 tempest-TestServerVolumeAttachmentScenario-922014933 None] Notifying Schedulers of capabilities ... {{(pid=87444) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 04:48:44 devstack cinder-volume[87444]: INFO cinder.volume.manager [None req-711acc46-6b6f-4a33-a7ef-2a94ea71c344 tempest-TestServerVolumeAttachmentScenario-922014933 None] Deleted volume successfully. Jul 10 04:48:44 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-89105101-00d3-417e-80f7-2881c92428d5 tempest-TestServerVolumeAttachmentScenario-922014933 None] Acquiring lock "cinder-quobyte-6b52b010-e7a2-4354-8dc9-fb362998af6e" by "delete_volume" {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 04:48:44 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-711acc46-6b6f-4a33-a7ef-2a94ea71c344 tempest-TestServerVolumeAttachmentScenario-922014933 None] Lock "cinder-3ba472a0-8c20-4406-b602-b04311be740e-delete_volume" released by "delete_volume" :: held 3.507s {{(pid=87444) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 04:48:44 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-89105101-00d3-417e-80f7-2881c92428d5 tempest-TestServerVolumeAttachmentScenario-922014933 None] Lock "cinder-quobyte-6b52b010-e7a2-4354-8dc9-fb362998af6e" acquired by "delete_volume" :: waited 0.020s {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 04:48:44 devstack cinder-volume[87444]: DEBUG oslo.privsep.daemon [-] privsep: reply[32f13687-ea10-4c5a-af60-25f937607a88]: (4, 'qcow2') {{(pid=88499) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 04:48:44 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-89105101-00d3-417e-80f7-2881c92428d5 tempest-TestServerVolumeAttachmentScenario-922014933 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-6b52b010-e7a2-4354-8dc9-fb362998af6e {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:48:45 devstack sudo[102211]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-6b52b010-e7a2-4354-8dc9-fb362998af6e Jul 10 04:48:45 devstack sudo[102211]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:48:45 devstack sudo[102211]: pam_unix(sudo:session): session closed for user root Jul 10 04:48:45 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-89105101-00d3-417e-80f7-2881c92428d5 tempest-TestServerVolumeAttachmentScenario-922014933 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-6b52b010-e7a2-4354-8dc9-fb362998af6e" returned: 0 in 0.922s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:48:45 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-89105101-00d3-417e-80f7-2881c92428d5 tempest-TestServerVolumeAttachmentScenario-922014933 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-6b52b010-e7a2-4354-8dc9-fb362998af6e {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:48:45 devstack sudo[102532]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-6b52b010-e7a2-4354-8dc9-fb362998af6e Jul 10 04:48:45 devstack sudo[102532]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:48:45 devstack cinder-volume[87444]: DEBUG cinder.volume.flows.manager.create_volume [None req-dcaf502b-1463-4ec1-95fe-f031068aa221 tempest-CreateVolumesFromSourceVolumeTest-1814858877 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87444) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 04:48:45 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-dcaf502b-1463-4ec1-95fe-f031068aa221 tempest-CreateVolumesFromSourceVolumeTest-1814858877 None] Flow 'volume_create_manager' (c5311265-e6e5-4920-96e5-0c5e0eaee1e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 04:48:45 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-dcaf502b-1463-4ec1-95fe-f031068aa221 tempest-CreateVolumesFromSourceVolumeTest-1814858877 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5b64622c-a5dc-4dc1-9355-2e264d93bca3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:48:45 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-dcaf502b-1463-4ec1-95fe-f031068aa221 tempest-CreateVolumesFromSourceVolumeTest-1814858877 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5b64622c-a5dc-4dc1-9355-2e264d93bca3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T02:48:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-61687639',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f6c15956-a911-4053-b6e0-6d57c17d8a8c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4ddfcf19fb26443caa09ffa4dc8241e3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T02:48:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T02:48:46Z,use_quota=True,user_id='e0f7f09f71e34388be57583bd8403e10',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(317e369e-1e06-434d-ae95-a335f0e6c903),volume_type_id=317e369e-1e06-434d-ae95-a335f0e6c903)' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:48:45 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-dcaf502b-1463-4ec1-95fe-f031068aa221 tempest-CreateVolumesFromSourceVolumeTest-1814858877 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1ebde501-a1ee-4993-9b3f-e57f9d08470a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:48:45 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-dcaf502b-1463-4ec1-95fe-f031068aa221 tempest-CreateVolumesFromSourceVolumeTest-1814858877 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1ebde501-a1ee-4993-9b3f-e57f9d08470a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:48:45 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-dcaf502b-1463-4ec1-95fe-f031068aa221 tempest-CreateVolumesFromSourceVolumeTest-1814858877 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (27d9c108-50d3-46eb-92cd-05230fa51ea2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:48:45 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-dcaf502b-1463-4ec1-95fe-f031068aa221 tempest-CreateVolumesFromSourceVolumeTest-1814858877 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (27d9c108-50d3-46eb-92cd-05230fa51ea2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f6c15956-a911-4053-b6e0-6d57c17d8a8c', 'volume_name': 'volume-f6c15956-a911-4053-b6e0-6d57c17d8a8c', 'volume_size': 1}' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:48:45 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-dcaf502b-1463-4ec1-95fe-f031068aa221 tempest-CreateVolumesFromSourceVolumeTest-1814858877 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ad29825d-3071-4e82-a3ac-37ce5249fe8c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:48:45 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-dcaf502b-1463-4ec1-95fe-f031068aa221 tempest-CreateVolumesFromSourceVolumeTest-1814858877 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ad29825d-3071-4e82-a3ac-37ce5249fe8c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:48:45 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-dcaf502b-1463-4ec1-95fe-f031068aa221 tempest-CreateVolumesFromSourceVolumeTest-1814858877 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bbd40641-ee1a-4af1-b993-ac578310a9a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:48:45 devstack cinder-volume[87444]: INFO cinder.volume.flows.manager.create_volume [None req-dcaf502b-1463-4ec1-95fe-f031068aa221 tempest-CreateVolumesFromSourceVolumeTest-1814858877 None] Volume f6c15956-a911-4053-b6e0-6d57c17d8a8c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f6c15956-a911-4053-b6e0-6d57c17d8a8c', 'volume_size': 1} Jul 10 04:48:45 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-dcaf502b-1463-4ec1-95fe-f031068aa221 tempest-CreateVolumesFromSourceVolumeTest-1814858877 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 04:48:45 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-dcaf502b-1463-4ec1-95fe-f031068aa221 tempest-CreateVolumesFromSourceVolumeTest-1814858877 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 04:48:45 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-dcaf502b-1463-4ec1-95fe-f031068aa221 tempest-CreateVolumesFromSourceVolumeTest-1814858877 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T02:48:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-61687639',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f6c15956-a911-4053-b6e0-6d57c17d8a8c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4ddfcf19fb26443caa09ffa4dc8241e3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T02:48:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T02:48:46Z,use_quota=True,user_id='e0f7f09f71e34388be57583bd8403e10',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(317e369e-1e06-434d-ae95-a335f0e6c903),volume_type_id=317e369e-1e06-434d-ae95-a335f0e6c903)}" {{(pid=87444) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 04:48:45 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.remotefs [None req-dcaf502b-1463-4ec1-95fe-f031068aa221 tempest-CreateVolumesFromSourceVolumeTest-1814858877 None] Creating volume f6c15956-a911-4053-b6e0-6d57c17d8a8c {{(pid=87444) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 04:48:45 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-dcaf502b-1463-4ec1-95fe-f031068aa221 tempest-CreateVolumesFromSourceVolumeTest-1814858877 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 04:48:45 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-dcaf502b-1463-4ec1-95fe-f031068aa221 tempest-CreateVolumesFromSourceVolumeTest-1814858877 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 04:48:45 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-dcaf502b-1463-4ec1-95fe-f031068aa221 tempest-CreateVolumesFromSourceVolumeTest-1814858877 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922': None} {{(pid=87444) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 04:48:45 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-dcaf502b-1463-4ec1-95fe-f031068aa221 tempest-CreateVolumesFromSourceVolumeTest-1814858877 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922'] {{(pid=87444) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 04:48:45 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-dcaf502b-1463-4ec1-95fe-f031068aa221 tempest-CreateVolumesFromSourceVolumeTest-1814858877 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 04:48:45 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-dcaf502b-1463-4ec1-95fe-f031068aa221 tempest-CreateVolumesFromSourceVolumeTest-1814858877 None] Selected osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922 as target Quobyte volume. {{(pid=87444) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 04:48:45 devstack cinder-volume[87444]: INFO cinder.volume.drivers.remotefs [None req-dcaf502b-1463-4ec1-95fe-f031068aa221 tempest-CreateVolumesFromSourceVolumeTest-1814858877 None] casted to osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922 Jul 10 04:48:45 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-dcaf502b-1463-4ec1-95fe-f031068aa221 tempest-CreateVolumesFromSourceVolumeTest-1814858877 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-f6c15956-a911-4053-b6e0-6d57c17d8a8c 1073741824 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:48:45 devstack sudo[102534]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-f6c15956-a911-4053-b6e0-6d57c17d8a8c 1073741824 Jul 10 04:48:45 devstack sudo[102534]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:48:46 devstack sudo[102532]: pam_unix(sudo:session): session closed for user root Jul 10 04:48:46 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-89105101-00d3-417e-80f7-2881c92428d5 tempest-TestServerVolumeAttachmentScenario-922014933 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-6b52b010-e7a2-4354-8dc9-fb362998af6e" returned: 0 in 0.665s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:48:46 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-89105101-00d3-417e-80f7-2881c92428d5 tempest-TestServerVolumeAttachmentScenario-922014933 None] Lock "cinder-quobyte-6b52b010-e7a2-4354-8dc9-fb362998af6e" released by "delete_volume" :: held 1.633s {{(pid=87444) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 04:48:46 devstack cinder-volume[87444]: DEBUG cinder.quota [None req-89105101-00d3-417e-80f7-2881c92428d5 tempest-TestServerVolumeAttachmentScenario-922014933 None] Created reservations ['aa17293f-744d-4884-b2fe-848190fcc63c', 'c5a68307-5070-4743-bc04-b879424b4577', 'aa28f53a-d8d8-4f1f-b933-6370d0b7377a', '95a062b7-e160-48b4-9395-44bb33c7b75e'] {{(pid=87444) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 04:48:46 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-89105101-00d3-417e-80f7-2881c92428d5 tempest-TestServerVolumeAttachmentScenario-922014933 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 04:48:46 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-89105101-00d3-417e-80f7-2881c92428d5 tempest-TestServerVolumeAttachmentScenario-922014933 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 04:48:46 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-89105101-00d3-417e-80f7-2881c92428d5 tempest-TestServerVolumeAttachmentScenario-922014933 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922': None} {{(pid=87444) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 04:48:46 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-89105101-00d3-417e-80f7-2881c92428d5 tempest-TestServerVolumeAttachmentScenario-922014933 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922'] {{(pid=87444) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 04:48:46 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-89105101-00d3-417e-80f7-2881c92428d5 tempest-TestServerVolumeAttachmentScenario-922014933 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 04:48:46 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-89105101-00d3-417e-80f7-2881c92428d5 tempest-TestServerVolumeAttachmentScenario-922014933 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:48:46 devstack sudo[102546]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097 Jul 10 04:48:46 devstack sudo[102546]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:48:46 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-307af523-11f6-49f8-b25c-77e493f81b4e tempest-TestStampPattern-1378957900 None] Acquiring lock "cinder-1619d28f-d75b-43c4-9227-e309e35ee077-delete_volume" by "delete_volume" {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 04:48:46 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-307af523-11f6-49f8-b25c-77e493f81b4e tempest-TestStampPattern-1378957900 None] Lock "cinder-1619d28f-d75b-43c4-9227-e309e35ee077-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 04:48:46 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-307af523-11f6-49f8-b25c-77e493f81b4e tempest-TestStampPattern-1378957900 None] Acquiring lock "cinder-quobyte-1619d28f-d75b-43c4-9227-e309e35ee077" by "delete_volume" {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 04:48:46 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-307af523-11f6-49f8-b25c-77e493f81b4e tempest-TestStampPattern-1378957900 None] Lock "cinder-quobyte-1619d28f-d75b-43c4-9227-e309e35ee077" acquired by "delete_volume" :: waited 0.016s {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 04:48:46 devstack sudo[102534]: pam_unix(sudo:session): session closed for user root Jul 10 04:48:46 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-dcaf502b-1463-4ec1-95fe-f031068aa221 tempest-CreateVolumesFromSourceVolumeTest-1814858877 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-f6c15956-a911-4053-b6e0-6d57c17d8a8c 1073741824" returned: 0 in 1.028s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:48:47 devstack cinder-volume[87444]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4688d14-04a3-4564-86db-64f0b9403e03]: (4, 'qcow2') {{(pid=88499) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 04:48:47 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-307af523-11f6-49f8-b25c-77e493f81b4e tempest-TestStampPattern-1378957900 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-1619d28f-d75b-43c4-9227-e309e35ee077 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:48:47 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-dcaf502b-1463-4ec1-95fe-f031068aa221 tempest-CreateVolumesFromSourceVolumeTest-1814858877 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-f6c15956-a911-4053-b6e0-6d57c17d8a8c {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:48:47 devstack sudo[102550]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-f6c15956-a911-4053-b6e0-6d57c17d8a8c Jul 10 04:48:47 devstack sudo[102550]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:48:47 devstack sudo[102549]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-1619d28f-d75b-43c4-9227-e309e35ee077 Jul 10 04:48:47 devstack sudo[102549]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:48:47 devstack sudo[102546]: pam_unix(sudo:session): session closed for user root Jul 10 04:48:47 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-89105101-00d3-417e-80f7-2881c92428d5 tempest-TestServerVolumeAttachmentScenario-922014933 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097" returned: 0 in 0.848s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:48:47 devstack cinder-volume[87444]: DEBUG cinder.manager [None req-89105101-00d3-417e-80f7-2881c92428d5 tempest-TestServerVolumeAttachmentScenario-922014933 None] Notifying Schedulers of capabilities ... {{(pid=87444) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 04:48:47 devstack cinder-volume[87444]: INFO cinder.volume.manager [None req-89105101-00d3-417e-80f7-2881c92428d5 tempest-TestServerVolumeAttachmentScenario-922014933 None] Deleted volume successfully. Jul 10 04:48:47 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-89105101-00d3-417e-80f7-2881c92428d5 tempest-TestServerVolumeAttachmentScenario-922014933 None] Lock "cinder-6b52b010-e7a2-4354-8dc9-fb362998af6e-delete_volume" released by "delete_volume" :: held 2.753s {{(pid=87444) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 04:48:47 devstack sudo[102550]: pam_unix(sudo:session): session closed for user root Jul 10 04:48:47 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-dcaf502b-1463-4ec1-95fe-f031068aa221 tempest-CreateVolumesFromSourceVolumeTest-1814858877 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-f6c15956-a911-4053-b6e0-6d57c17d8a8c" returned: 0 in 0.726s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:48:47 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-dcaf502b-1463-4ec1-95fe-f031068aa221 tempest-CreateVolumesFromSourceVolumeTest-1814858877 None] <== create_volume: return (1827ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922'} {{(pid=87444) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 04:48:47 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-dcaf502b-1463-4ec1-95fe-f031068aa221 tempest-CreateVolumesFromSourceVolumeTest-1814858877 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.829s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 04:48:47 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-dcaf502b-1463-4ec1-95fe-f031068aa221 tempest-CreateVolumesFromSourceVolumeTest-1814858877 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bbd40641-ee1a-4af1-b993-ac578310a9a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f6c15956-a911-4053-b6e0-6d57c17d8a8c', 'volume_size': 1}' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:48:47 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-dcaf502b-1463-4ec1-95fe-f031068aa221 tempest-CreateVolumesFromSourceVolumeTest-1814858877 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3d41e1af-1c83-4a15-9aad-0f6fb8bb0252) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:48:47 devstack cinder-volume[87444]: INFO cinder.volume.flows.manager.create_volume [None req-dcaf502b-1463-4ec1-95fe-f031068aa221 tempest-CreateVolumesFromSourceVolumeTest-1814858877 None] Volume volume-f6c15956-a911-4053-b6e0-6d57c17d8a8c (f6c15956-a911-4053-b6e0-6d57c17d8a8c): created successfully Jul 10 04:48:47 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-dcaf502b-1463-4ec1-95fe-f031068aa221 tempest-CreateVolumesFromSourceVolumeTest-1814858877 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3d41e1af-1c83-4a15-9aad-0f6fb8bb0252) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:48:47 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-dcaf502b-1463-4ec1-95fe-f031068aa221 tempest-CreateVolumesFromSourceVolumeTest-1814858877 None] Flow 'volume_create_manager' (c5311265-e6e5-4920-96e5-0c5e0eaee1e0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87444) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 04:48:47 devstack cinder-volume[87444]: INFO cinder.volume.manager [None req-dcaf502b-1463-4ec1-95fe-f031068aa221 tempest-CreateVolumesFromSourceVolumeTest-1814858877 None] Created volume successfully. Jul 10 04:48:47 devstack sudo[102549]: pam_unix(sudo:session): session closed for user root Jul 10 04:48:47 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-307af523-11f6-49f8-b25c-77e493f81b4e tempest-TestStampPattern-1378957900 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-1619d28f-d75b-43c4-9227-e309e35ee077" returned: 0 in 0.961s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:48:47 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-307af523-11f6-49f8-b25c-77e493f81b4e tempest-TestStampPattern-1378957900 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-1619d28f-d75b-43c4-9227-e309e35ee077 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:48:48 devstack sudo[102559]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-1619d28f-d75b-43c4-9227-e309e35ee077 Jul 10 04:48:48 devstack sudo[102559]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:48:48 devstack cinder-volume[87444]: DEBUG cinder.volume.flows.manager.create_volume [None req-ff457849-040a-40d5-a512-601cd00ebe1f tempest-CreateVolumesFromSourceVolumeTest-1814858877 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87444) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 04:48:48 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-ff457849-040a-40d5-a512-601cd00ebe1f tempest-CreateVolumesFromSourceVolumeTest-1814858877 None] Flow 'volume_create_manager' (6a3510d5-893e-4bdd-bbbf-b5fa33fdabd9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 04:48:48 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-ff457849-040a-40d5-a512-601cd00ebe1f tempest-CreateVolumesFromSourceVolumeTest-1814858877 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f7c29640-45eb-4260-843f-38de37d3cd77) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:48:48 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-ff457849-040a-40d5-a512-601cd00ebe1f tempest-CreateVolumesFromSourceVolumeTest-1814858877 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f7c29640-45eb-4260-843f-38de37d3cd77) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T02:48:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-846201643',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6f36f1cd-0829-461c-8cb3-a30c775109be,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4ddfcf19fb26443caa09ffa4dc8241e3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T02:48:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T02:48:49Z,use_quota=True,user_id='e0f7f09f71e34388be57583bd8403e10',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(317e369e-1e06-434d-ae95-a335f0e6c903),volume_type_id=317e369e-1e06-434d-ae95-a335f0e6c903)' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:48:48 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-ff457849-040a-40d5-a512-601cd00ebe1f tempest-CreateVolumesFromSourceVolumeTest-1814858877 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (19f6706d-0536-43e8-bba5-1b1d9049591f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:48:48 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-ff457849-040a-40d5-a512-601cd00ebe1f tempest-CreateVolumesFromSourceVolumeTest-1814858877 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (19f6706d-0536-43e8-bba5-1b1d9049591f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:48:48 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-ff457849-040a-40d5-a512-601cd00ebe1f tempest-CreateVolumesFromSourceVolumeTest-1814858877 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (504063ca-9237-4d06-8e77-663397118514) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:48:48 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-ff457849-040a-40d5-a512-601cd00ebe1f tempest-CreateVolumesFromSourceVolumeTest-1814858877 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (504063ca-9237-4d06-8e77-663397118514) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6f36f1cd-0829-461c-8cb3-a30c775109be', 'volume_name': 'volume-6f36f1cd-0829-461c-8cb3-a30c775109be', 'volume_size': 1}' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:48:48 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-ff457849-040a-40d5-a512-601cd00ebe1f tempest-CreateVolumesFromSourceVolumeTest-1814858877 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e9c41a8c-d372-43b8-9d4a-ffcaef0be7b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:48:48 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-ff457849-040a-40d5-a512-601cd00ebe1f tempest-CreateVolumesFromSourceVolumeTest-1814858877 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e9c41a8c-d372-43b8-9d4a-ffcaef0be7b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:48:48 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-ff457849-040a-40d5-a512-601cd00ebe1f tempest-CreateVolumesFromSourceVolumeTest-1814858877 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1fb7ecdf-9e27-481b-84c4-3ef9afc5eaf9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:48:48 devstack cinder-volume[87444]: INFO cinder.volume.flows.manager.create_volume [None req-ff457849-040a-40d5-a512-601cd00ebe1f tempest-CreateVolumesFromSourceVolumeTest-1814858877 None] Volume 6f36f1cd-0829-461c-8cb3-a30c775109be: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6f36f1cd-0829-461c-8cb3-a30c775109be', 'volume_size': 1} Jul 10 04:48:48 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-ff457849-040a-40d5-a512-601cd00ebe1f tempest-CreateVolumesFromSourceVolumeTest-1814858877 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 04:48:48 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-ff457849-040a-40d5-a512-601cd00ebe1f tempest-CreateVolumesFromSourceVolumeTest-1814858877 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 04:48:48 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-ff457849-040a-40d5-a512-601cd00ebe1f tempest-CreateVolumesFromSourceVolumeTest-1814858877 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T02:48:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-846201643',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6f36f1cd-0829-461c-8cb3-a30c775109be,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4ddfcf19fb26443caa09ffa4dc8241e3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T02:48:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T02:48:49Z,use_quota=True,user_id='e0f7f09f71e34388be57583bd8403e10',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(317e369e-1e06-434d-ae95-a335f0e6c903),volume_type_id=317e369e-1e06-434d-ae95-a335f0e6c903)}" {{(pid=87444) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 04:48:48 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.remotefs [None req-ff457849-040a-40d5-a512-601cd00ebe1f tempest-CreateVolumesFromSourceVolumeTest-1814858877 None] Creating volume 6f36f1cd-0829-461c-8cb3-a30c775109be {{(pid=87444) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 04:48:48 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-ff457849-040a-40d5-a512-601cd00ebe1f tempest-CreateVolumesFromSourceVolumeTest-1814858877 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 04:48:48 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-ff457849-040a-40d5-a512-601cd00ebe1f tempest-CreateVolumesFromSourceVolumeTest-1814858877 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 04:48:48 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-ff457849-040a-40d5-a512-601cd00ebe1f tempest-CreateVolumesFromSourceVolumeTest-1814858877 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922': None} {{(pid=87444) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 04:48:48 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-ff457849-040a-40d5-a512-601cd00ebe1f tempest-CreateVolumesFromSourceVolumeTest-1814858877 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922'] {{(pid=87444) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 04:48:48 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-ff457849-040a-40d5-a512-601cd00ebe1f tempest-CreateVolumesFromSourceVolumeTest-1814858877 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 04:48:48 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-ff457849-040a-40d5-a512-601cd00ebe1f tempest-CreateVolumesFromSourceVolumeTest-1814858877 None] Selected osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922 as target Quobyte volume. {{(pid=87444) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 04:48:48 devstack cinder-volume[87444]: INFO cinder.volume.drivers.remotefs [None req-ff457849-040a-40d5-a512-601cd00ebe1f tempest-CreateVolumesFromSourceVolumeTest-1814858877 None] casted to osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922 Jul 10 04:48:48 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-ff457849-040a-40d5-a512-601cd00ebe1f tempest-CreateVolumesFromSourceVolumeTest-1814858877 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-6f36f1cd-0829-461c-8cb3-a30c775109be 1073741824 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:48:48 devstack sudo[102564]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-6f36f1cd-0829-461c-8cb3-a30c775109be 1073741824 Jul 10 04:48:48 devstack sudo[102564]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:48:48 devstack sudo[102559]: pam_unix(sudo:session): session closed for user root Jul 10 04:48:48 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-307af523-11f6-49f8-b25c-77e493f81b4e tempest-TestStampPattern-1378957900 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-1619d28f-d75b-43c4-9227-e309e35ee077" returned: 0 in 0.969s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:48:48 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-307af523-11f6-49f8-b25c-77e493f81b4e tempest-TestStampPattern-1378957900 None] Lock "cinder-quobyte-1619d28f-d75b-43c4-9227-e309e35ee077" released by "delete_volume" :: held 2.012s {{(pid=87444) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 04:48:49 devstack cinder-volume[87444]: DEBUG cinder.volume.flows.manager.create_volume [None req-2d0409b9-76dc-4dd1-a54c-211772c81f6c tempest-CreateVolumesFromSourceVolumeTest-1814858877 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87444) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 04:48:49 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-2d0409b9-76dc-4dd1-a54c-211772c81f6c tempest-CreateVolumesFromSourceVolumeTest-1814858877 None] Flow 'volume_create_manager' (31a5ed12-ba08-4f80-8cc1-688c2e909d3b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 04:48:49 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-2d0409b9-76dc-4dd1-a54c-211772c81f6c tempest-CreateVolumesFromSourceVolumeTest-1814858877 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2ad8d258-eade-47c0-b023-92b9fec25517) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:48:49 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-2d0409b9-76dc-4dd1-a54c-211772c81f6c tempest-CreateVolumesFromSourceVolumeTest-1814858877 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2ad8d258-eade-47c0-b023-92b9fec25517) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T02:48:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-301924509',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=57c10965-f481-4be1-8188-c2ab20b5f6aa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4ddfcf19fb26443caa09ffa4dc8241e3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T02:48:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T02:48:49Z,use_quota=True,user_id='e0f7f09f71e34388be57583bd8403e10',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(317e369e-1e06-434d-ae95-a335f0e6c903),volume_type_id=317e369e-1e06-434d-ae95-a335f0e6c903)' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:48:49 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-2d0409b9-76dc-4dd1-a54c-211772c81f6c tempest-CreateVolumesFromSourceVolumeTest-1814858877 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9ce704c7-5585-4a33-a004-ea695f262db6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:48:49 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-2d0409b9-76dc-4dd1-a54c-211772c81f6c tempest-CreateVolumesFromSourceVolumeTest-1814858877 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9ce704c7-5585-4a33-a004-ea695f262db6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:48:49 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-2d0409b9-76dc-4dd1-a54c-211772c81f6c tempest-CreateVolumesFromSourceVolumeTest-1814858877 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e095967f-175e-48ef-a759-79772d6a6709) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:48:49 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-2d0409b9-76dc-4dd1-a54c-211772c81f6c tempest-CreateVolumesFromSourceVolumeTest-1814858877 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e095967f-175e-48ef-a759-79772d6a6709) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '57c10965-f481-4be1-8188-c2ab20b5f6aa', 'volume_name': 'volume-57c10965-f481-4be1-8188-c2ab20b5f6aa', 'volume_size': 1}' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:48:49 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-2d0409b9-76dc-4dd1-a54c-211772c81f6c tempest-CreateVolumesFromSourceVolumeTest-1814858877 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (54e88cec-ec4a-4a11-920f-222b3891c349) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:48:49 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-2d0409b9-76dc-4dd1-a54c-211772c81f6c tempest-CreateVolumesFromSourceVolumeTest-1814858877 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (54e88cec-ec4a-4a11-920f-222b3891c349) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:48:49 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-2d0409b9-76dc-4dd1-a54c-211772c81f6c tempest-CreateVolumesFromSourceVolumeTest-1814858877 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6adc5bdb-8aab-4398-a02d-227f1d63e283) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:48:49 devstack cinder-volume[87444]: INFO cinder.volume.flows.manager.create_volume [None req-2d0409b9-76dc-4dd1-a54c-211772c81f6c tempest-CreateVolumesFromSourceVolumeTest-1814858877 None] Volume 57c10965-f481-4be1-8188-c2ab20b5f6aa: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-57c10965-f481-4be1-8188-c2ab20b5f6aa', 'volume_size': 1} Jul 10 04:48:49 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-2d0409b9-76dc-4dd1-a54c-211772c81f6c tempest-CreateVolumesFromSourceVolumeTest-1814858877 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 04:48:49 devstack cinder-volume[87444]: DEBUG cinder.quota [None req-307af523-11f6-49f8-b25c-77e493f81b4e tempest-TestStampPattern-1378957900 None] Created reservations ['26924a9a-6cf4-47a0-a6fc-b0948a19d03e', 'e97f75c8-24a8-4cdc-994b-7396b61bc175', 'a2fe39e1-1306-42ec-a159-92e16758fddd', '28e5461f-29f7-4d6d-acea-f3f3db3f95aa'] {{(pid=87444) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 04:48:49 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-307af523-11f6-49f8-b25c-77e493f81b4e tempest-TestStampPattern-1378957900 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 04:48:49 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-307af523-11f6-49f8-b25c-77e493f81b4e tempest-TestStampPattern-1378957900 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 04:48:49 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-307af523-11f6-49f8-b25c-77e493f81b4e tempest-TestStampPattern-1378957900 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922': None} {{(pid=87444) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 04:48:49 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-307af523-11f6-49f8-b25c-77e493f81b4e tempest-TestStampPattern-1378957900 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922'] {{(pid=87444) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 04:48:49 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-307af523-11f6-49f8-b25c-77e493f81b4e tempest-TestStampPattern-1378957900 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 04:48:49 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-307af523-11f6-49f8-b25c-77e493f81b4e tempest-TestStampPattern-1378957900 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:48:49 devstack sudo[102566]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097 Jul 10 04:48:49 devstack sudo[102566]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:48:49 devstack cinder-volume[87444]: DEBUG cinder.volume.flows.manager.create_volume [None req-95118947-6c71-4192-bdef-94ecb9e25876 tempest-CreateVolumesFromSourceVolumeTest-1814858877 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87444) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 04:48:49 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-95118947-6c71-4192-bdef-94ecb9e25876 tempest-CreateVolumesFromSourceVolumeTest-1814858877 None] Flow 'volume_create_manager' (22a7e11e-8698-4b02-91b8-6013aa57f29a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 04:48:50 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-95118947-6c71-4192-bdef-94ecb9e25876 tempest-CreateVolumesFromSourceVolumeTest-1814858877 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b1f478e8-fc3f-4ab1-9ee8-5862724bd2eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:48:50 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-95118947-6c71-4192-bdef-94ecb9e25876 tempest-CreateVolumesFromSourceVolumeTest-1814858877 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b1f478e8-fc3f-4ab1-9ee8-5862724bd2eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T02:48:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-701559494',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bd71c748-29e7-47c9-a98d-8ca9461165b8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4ddfcf19fb26443caa09ffa4dc8241e3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T02:48:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T02:48:50Z,use_quota=True,user_id='e0f7f09f71e34388be57583bd8403e10',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(317e369e-1e06-434d-ae95-a335f0e6c903),volume_type_id=317e369e-1e06-434d-ae95-a335f0e6c903)' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:48:50 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-95118947-6c71-4192-bdef-94ecb9e25876 tempest-CreateVolumesFromSourceVolumeTest-1814858877 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7d0dad3e-8797-4c4b-addd-425314ed94ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:48:50 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-95118947-6c71-4192-bdef-94ecb9e25876 tempest-CreateVolumesFromSourceVolumeTest-1814858877 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7d0dad3e-8797-4c4b-addd-425314ed94ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:48:50 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-95118947-6c71-4192-bdef-94ecb9e25876 tempest-CreateVolumesFromSourceVolumeTest-1814858877 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2a4a1423-0f9f-484d-a58e-1855f3b9312a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:48:50 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-95118947-6c71-4192-bdef-94ecb9e25876 tempest-CreateVolumesFromSourceVolumeTest-1814858877 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2a4a1423-0f9f-484d-a58e-1855f3b9312a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bd71c748-29e7-47c9-a98d-8ca9461165b8', 'volume_name': 'volume-bd71c748-29e7-47c9-a98d-8ca9461165b8', 'volume_size': 1}' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:48:50 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-95118947-6c71-4192-bdef-94ecb9e25876 tempest-CreateVolumesFromSourceVolumeTest-1814858877 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9543c065-aa92-4a7c-ad05-653c071eea93) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:48:50 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-95118947-6c71-4192-bdef-94ecb9e25876 tempest-CreateVolumesFromSourceVolumeTest-1814858877 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9543c065-aa92-4a7c-ad05-653c071eea93) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:48:50 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-95118947-6c71-4192-bdef-94ecb9e25876 tempest-CreateVolumesFromSourceVolumeTest-1814858877 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (312b31ba-46d3-494e-914f-a2a3077545b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:48:50 devstack cinder-volume[87444]: INFO cinder.volume.flows.manager.create_volume [None req-95118947-6c71-4192-bdef-94ecb9e25876 tempest-CreateVolumesFromSourceVolumeTest-1814858877 None] Volume bd71c748-29e7-47c9-a98d-8ca9461165b8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bd71c748-29e7-47c9-a98d-8ca9461165b8', 'volume_size': 1} Jul 10 04:48:50 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-95118947-6c71-4192-bdef-94ecb9e25876 tempest-CreateVolumesFromSourceVolumeTest-1814858877 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 04:48:50 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-009cba2b-a2b0-46c3-991c-540f23febeb8 tempest-TestStampPattern-1378957900 None] Acquiring lock "cinder-377c9456-51f8-4392-818b-e5e1f7eb7f99-delete_snapshot" by "delete_snapshot" {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 04:48:50 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-009cba2b-a2b0-46c3-991c-540f23febeb8 tempest-TestStampPattern-1378957900 None] Lock "cinder-377c9456-51f8-4392-818b-e5e1f7eb7f99-delete_snapshot" acquired by "delete_snapshot" :: waited 0.053s {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 04:48:50 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-009cba2b-a2b0-46c3-991c-540f23febeb8 tempest-TestStampPattern-1378957900 None] Acquiring lock "cinder-quobyte-420cd972-7ecb-4fdb-abf1-d859698bbb94" by "delete_snapshot" {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 04:48:50 devstack sudo[102566]: pam_unix(sudo:session): session closed for user root Jul 10 04:48:50 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-307af523-11f6-49f8-b25c-77e493f81b4e tempest-TestStampPattern-1378957900 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097" returned: 0 in 1.093s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:48:50 devstack cinder-volume[87444]: DEBUG cinder.manager [None req-307af523-11f6-49f8-b25c-77e493f81b4e tempest-TestStampPattern-1378957900 None] Notifying Schedulers of capabilities ... {{(pid=87444) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 04:48:50 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-009cba2b-a2b0-46c3-991c-540f23febeb8 tempest-TestStampPattern-1378957900 None] Lock "cinder-quobyte-420cd972-7ecb-4fdb-abf1-d859698bbb94" acquired by "delete_snapshot" :: waited 0.067s {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 04:48:50 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-009cba2b-a2b0-46c3-991c-540f23febeb8 tempest-TestStampPattern-1378957900 None] Acquiring lock "cinder-quobyte-377c9456-51f8-4392-818b-e5e1f7eb7f99" by "_delete_snapshot" {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 04:48:50 devstack cinder-volume[87444]: INFO cinder.volume.manager [None req-307af523-11f6-49f8-b25c-77e493f81b4e tempest-TestStampPattern-1378957900 None] Deleted volume successfully. Jul 10 04:48:50 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-009cba2b-a2b0-46c3-991c-540f23febeb8 tempest-TestStampPattern-1378957900 None] Lock "cinder-quobyte-377c9456-51f8-4392-818b-e5e1f7eb7f99" acquired by "_delete_snapshot" :: waited 0.053s {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 04:48:50 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.remotefs [None req-009cba2b-a2b0-46c3-991c-540f23febeb8 tempest-TestStampPattern-1378957900 None] Deleting offline snapshot 377c9456-51f8-4392-818b-e5e1f7eb7f99 of volume 420cd972-7ecb-4fdb-abf1-d859698bbb94 {{(pid=87444) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 10 04:48:50 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.remotefs [None req-009cba2b-a2b0-46c3-991c-540f23febeb8 tempest-TestStampPattern-1378957900 None] snapshot_file for this snap is: volume-420cd972-7ecb-4fdb-abf1-d859698bbb94.377c9456-51f8-4392-818b-e5e1f7eb7f99 {{(pid=87444) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 10 04:48:50 devstack cinder-volume[87444]: DEBUG oslo.privsep.daemon [-] privsep: reply[d500ae3c-5330-4d80-9eba-83940328eb4f]: (4, 'qcow2') {{(pid=88499) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 04:48:50 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-009cba2b-a2b0-46c3-991c-540f23febeb8 tempest-TestStampPattern-1378957900 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-420cd972-7ecb-4fdb-abf1-d859698bbb94.377c9456-51f8-4392-818b-e5e1f7eb7f99 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:48:50 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-307af523-11f6-49f8-b25c-77e493f81b4e tempest-TestStampPattern-1378957900 None] Lock "cinder-1619d28f-d75b-43c4-9227-e309e35ee077-delete_volume" released by "delete_volume" :: held 3.788s {{(pid=87444) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 04:48:50 devstack sudo[102573]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-420cd972-7ecb-4fdb-abf1-d859698bbb94.377c9456-51f8-4392-818b-e5e1f7eb7f99 Jul 10 04:48:50 devstack sudo[102564]: pam_unix(sudo:session): session closed for user root Jul 10 04:48:50 devstack sudo[102573]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:48:50 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-ff457849-040a-40d5-a512-601cd00ebe1f tempest-CreateVolumesFromSourceVolumeTest-1814858877 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-6f36f1cd-0829-461c-8cb3-a30c775109be 1073741824" returned: 0 in 2.018s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:48:50 devstack cinder-volume[87444]: DEBUG cinder.volume.flows.manager.create_volume [None req-24b18b62-2efd-4819-8c7a-f2831ffd811b tempest-CreateVolumesFromSourceVolumeTest-1814858877 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87444) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 04:48:50 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-24b18b62-2efd-4819-8c7a-f2831ffd811b tempest-CreateVolumesFromSourceVolumeTest-1814858877 None] Flow 'volume_create_manager' (e1661b38-16e5-4aba-9f9a-7400f33e6903) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 04:48:50 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-24b18b62-2efd-4819-8c7a-f2831ffd811b tempest-CreateVolumesFromSourceVolumeTest-1814858877 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (db9a05ef-20ea-47dd-a499-1369657e4630) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:48:50 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-ff457849-040a-40d5-a512-601cd00ebe1f tempest-CreateVolumesFromSourceVolumeTest-1814858877 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-6f36f1cd-0829-461c-8cb3-a30c775109be {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:48:51 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-24b18b62-2efd-4819-8c7a-f2831ffd811b tempest-CreateVolumesFromSourceVolumeTest-1814858877 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (db9a05ef-20ea-47dd-a499-1369657e4630) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T02:48:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1479400341',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=67679359-4853-45b1-9296-5e584d9eb487,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4ddfcf19fb26443caa09ffa4dc8241e3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T02:48:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T02:48:51Z,use_quota=True,user_id='e0f7f09f71e34388be57583bd8403e10',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(317e369e-1e06-434d-ae95-a335f0e6c903),volume_type_id=317e369e-1e06-434d-ae95-a335f0e6c903)' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:48:51 devstack sudo[102575]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-6f36f1cd-0829-461c-8cb3-a30c775109be Jul 10 04:48:51 devstack sudo[102575]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:48:51 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-24b18b62-2efd-4819-8c7a-f2831ffd811b tempest-CreateVolumesFromSourceVolumeTest-1814858877 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (28c7e6ed-2a13-4b6d-b871-d48d1f72a07a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:48:51 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-24b18b62-2efd-4819-8c7a-f2831ffd811b tempest-CreateVolumesFromSourceVolumeTest-1814858877 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (28c7e6ed-2a13-4b6d-b871-d48d1f72a07a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:48:51 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-24b18b62-2efd-4819-8c7a-f2831ffd811b tempest-CreateVolumesFromSourceVolumeTest-1814858877 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (11a83c5b-20d6-4ca5-acf0-4dbfda7597b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:48:51 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-24b18b62-2efd-4819-8c7a-f2831ffd811b tempest-CreateVolumesFromSourceVolumeTest-1814858877 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (11a83c5b-20d6-4ca5-acf0-4dbfda7597b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '67679359-4853-45b1-9296-5e584d9eb487', 'volume_name': 'volume-67679359-4853-45b1-9296-5e584d9eb487', 'volume_size': 1}' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:48:51 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-24b18b62-2efd-4819-8c7a-f2831ffd811b tempest-CreateVolumesFromSourceVolumeTest-1814858877 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (42dfa70f-75de-40df-b48c-0864db0ee6ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:48:51 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-24b18b62-2efd-4819-8c7a-f2831ffd811b tempest-CreateVolumesFromSourceVolumeTest-1814858877 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (42dfa70f-75de-40df-b48c-0864db0ee6ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:48:51 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-24b18b62-2efd-4819-8c7a-f2831ffd811b tempest-CreateVolumesFromSourceVolumeTest-1814858877 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8f0dcca6-28d4-40e3-81f5-fbd8d3612de2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:48:51 devstack cinder-volume[87444]: INFO cinder.volume.flows.manager.create_volume [None req-24b18b62-2efd-4819-8c7a-f2831ffd811b tempest-CreateVolumesFromSourceVolumeTest-1814858877 None] Volume 67679359-4853-45b1-9296-5e584d9eb487: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-67679359-4853-45b1-9296-5e584d9eb487', 'volume_size': 1} Jul 10 04:48:51 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-24b18b62-2efd-4819-8c7a-f2831ffd811b tempest-CreateVolumesFromSourceVolumeTest-1814858877 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 04:48:51 devstack cinder-volume[87444]: DEBUG cinder.volume.flows.manager.create_volume [None req-ffba9f7f-e007-4d35-aa9c-ffca74641bde tempest-CreateVolumesFromSourceVolumeTest-1814858877 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87444) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 04:48:51 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-ffba9f7f-e007-4d35-aa9c-ffca74641bde tempest-CreateVolumesFromSourceVolumeTest-1814858877 None] Flow 'volume_create_manager' (6eabef9f-acc5-4f45-8791-e4961dcfeb23) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 04:48:51 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-ffba9f7f-e007-4d35-aa9c-ffca74641bde tempest-CreateVolumesFromSourceVolumeTest-1814858877 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d58878c3-cf34-4bfd-94eb-b6eabf702a61) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:48:51 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-ffba9f7f-e007-4d35-aa9c-ffca74641bde tempest-CreateVolumesFromSourceVolumeTest-1814858877 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d58878c3-cf34-4bfd-94eb-b6eabf702a61) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T02:48:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1840798241',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0322633e-92cd-4ba8-8519-576c72499d96,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4ddfcf19fb26443caa09ffa4dc8241e3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T02:48:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T02:48:51Z,use_quota=True,user_id='e0f7f09f71e34388be57583bd8403e10',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(317e369e-1e06-434d-ae95-a335f0e6c903),volume_type_id=317e369e-1e06-434d-ae95-a335f0e6c903)' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:48:51 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-ffba9f7f-e007-4d35-aa9c-ffca74641bde tempest-CreateVolumesFromSourceVolumeTest-1814858877 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (44716b52-c339-45e9-a41b-e1e1f82c309c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:48:51 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-ffba9f7f-e007-4d35-aa9c-ffca74641bde tempest-CreateVolumesFromSourceVolumeTest-1814858877 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (44716b52-c339-45e9-a41b-e1e1f82c309c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:48:51 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-ffba9f7f-e007-4d35-aa9c-ffca74641bde tempest-CreateVolumesFromSourceVolumeTest-1814858877 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (178cbf04-ee5d-4a42-a742-075a812488e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:48:51 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-ffba9f7f-e007-4d35-aa9c-ffca74641bde tempest-CreateVolumesFromSourceVolumeTest-1814858877 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (178cbf04-ee5d-4a42-a742-075a812488e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0322633e-92cd-4ba8-8519-576c72499d96', 'volume_name': 'volume-0322633e-92cd-4ba8-8519-576c72499d96', 'volume_size': 1}' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:48:51 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-ffba9f7f-e007-4d35-aa9c-ffca74641bde tempest-CreateVolumesFromSourceVolumeTest-1814858877 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (10f27e3e-7c34-475a-81b3-e47d1966d1ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:48:51 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-ffba9f7f-e007-4d35-aa9c-ffca74641bde tempest-CreateVolumesFromSourceVolumeTest-1814858877 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (10f27e3e-7c34-475a-81b3-e47d1966d1ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:48:51 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-ffba9f7f-e007-4d35-aa9c-ffca74641bde tempest-CreateVolumesFromSourceVolumeTest-1814858877 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9462fb50-6ffe-48a4-8784-5a056ae60b43) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:48:51 devstack cinder-volume[87444]: INFO cinder.volume.flows.manager.create_volume [None req-ffba9f7f-e007-4d35-aa9c-ffca74641bde tempest-CreateVolumesFromSourceVolumeTest-1814858877 None] Volume 0322633e-92cd-4ba8-8519-576c72499d96: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0322633e-92cd-4ba8-8519-576c72499d96', 'volume_size': 1} Jul 10 04:48:51 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-ffba9f7f-e007-4d35-aa9c-ffca74641bde tempest-CreateVolumesFromSourceVolumeTest-1814858877 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 04:48:51 devstack cinder-volume[87444]: INFO cinder.volume.manager [req-8ef06cdf-0c97-471c-8ba6-63a7df14696e req-1d945b3d-fdd6-459f-bc5e-d373befc3f5d tempest-TestServerVolumeAttachScenarioOldVersion-885288560 None] Terminate volume connection completed successfully. Jul 10 04:48:51 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [req-8ef06cdf-0c97-471c-8ba6-63a7df14696e req-1d945b3d-fdd6-459f-bc5e-d373befc3f5d tempest-TestServerVolumeAttachScenarioOldVersion-885288560 None] Deleting attachment 9118645d-48b7-4da1-b7f5-e3013752272a. {{(pid=87444) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 10 04:48:51 devstack sudo[102573]: pam_unix(sudo:session): session closed for user root Jul 10 04:48:51 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-009cba2b-a2b0-46c3-991c-540f23febeb8 tempest-TestStampPattern-1378957900 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-420cd972-7ecb-4fdb-abf1-d859698bbb94.377c9456-51f8-4392-818b-e5e1f7eb7f99" returned: 0 in 1.235s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:48:51 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.remotefs [None req-009cba2b-a2b0-46c3-991c-540f23febeb8 tempest-TestStampPattern-1378957900 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-420cd972-7ecb-4fdb-abf1-d859698bbb94(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87444) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 10 04:48:51 devstack cinder-volume[87444]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b6fd072-0435-42d8-9110-ca57088f9ee0]: (4, 'qcow2') {{(pid=88499) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 04:48:51 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-009cba2b-a2b0-46c3-991c-540f23febeb8 tempest-TestStampPattern-1378957900 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-420cd972-7ecb-4fdb-abf1-d859698bbb94 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:48:51 devstack sudo[102575]: pam_unix(sudo:session): session closed for user root Jul 10 04:48:51 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-ff457849-040a-40d5-a512-601cd00ebe1f tempest-CreateVolumesFromSourceVolumeTest-1814858877 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-6f36f1cd-0829-461c-8cb3-a30c775109be" returned: 0 in 0.972s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:48:51 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-ff457849-040a-40d5-a512-601cd00ebe1f tempest-CreateVolumesFromSourceVolumeTest-1814858877 None] <== create_volume: return (3169ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922'} {{(pid=87444) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 04:48:51 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-ff457849-040a-40d5-a512-601cd00ebe1f tempest-CreateVolumesFromSourceVolumeTest-1814858877 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 3.176s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 04:48:51 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-2d0409b9-76dc-4dd1-a54c-211772c81f6c tempest-CreateVolumesFromSourceVolumeTest-1814858877 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.696s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 04:48:51 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-2d0409b9-76dc-4dd1-a54c-211772c81f6c tempest-CreateVolumesFromSourceVolumeTest-1814858877 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T02:48:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-301924509',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=57c10965-f481-4be1-8188-c2ab20b5f6aa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4ddfcf19fb26443caa09ffa4dc8241e3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T02:48:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T02:48:49Z,use_quota=True,user_id='e0f7f09f71e34388be57583bd8403e10',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(317e369e-1e06-434d-ae95-a335f0e6c903),volume_type_id=317e369e-1e06-434d-ae95-a335f0e6c903)}" {{(pid=87444) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 04:48:51 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.remotefs [None req-2d0409b9-76dc-4dd1-a54c-211772c81f6c tempest-CreateVolumesFromSourceVolumeTest-1814858877 None] Creating volume 57c10965-f481-4be1-8188-c2ab20b5f6aa {{(pid=87444) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 04:48:51 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-2d0409b9-76dc-4dd1-a54c-211772c81f6c tempest-CreateVolumesFromSourceVolumeTest-1814858877 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 04:48:51 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-2d0409b9-76dc-4dd1-a54c-211772c81f6c tempest-CreateVolumesFromSourceVolumeTest-1814858877 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 04:48:51 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-2d0409b9-76dc-4dd1-a54c-211772c81f6c tempest-CreateVolumesFromSourceVolumeTest-1814858877 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922': None} {{(pid=87444) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 04:48:51 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-2d0409b9-76dc-4dd1-a54c-211772c81f6c tempest-CreateVolumesFromSourceVolumeTest-1814858877 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922'] {{(pid=87444) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 04:48:51 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-2d0409b9-76dc-4dd1-a54c-211772c81f6c tempest-CreateVolumesFromSourceVolumeTest-1814858877 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 04:48:51 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-2d0409b9-76dc-4dd1-a54c-211772c81f6c tempest-CreateVolumesFromSourceVolumeTest-1814858877 None] Selected osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922 as target Quobyte volume. {{(pid=87444) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 04:48:51 devstack cinder-volume[87444]: INFO cinder.volume.drivers.remotefs [None req-2d0409b9-76dc-4dd1-a54c-211772c81f6c tempest-CreateVolumesFromSourceVolumeTest-1814858877 None] casted to osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922 Jul 10 04:48:51 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-2d0409b9-76dc-4dd1-a54c-211772c81f6c tempest-CreateVolumesFromSourceVolumeTest-1814858877 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-57c10965-f481-4be1-8188-c2ab20b5f6aa 1073741824 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:48:51 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-ff457849-040a-40d5-a512-601cd00ebe1f tempest-CreateVolumesFromSourceVolumeTest-1814858877 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1fb7ecdf-9e27-481b-84c4-3ef9afc5eaf9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6f36f1cd-0829-461c-8cb3-a30c775109be', 'volume_size': 1}' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:48:52 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-ff457849-040a-40d5-a512-601cd00ebe1f tempest-CreateVolumesFromSourceVolumeTest-1814858877 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (54da412a-8deb-40f0-b549-8b776ce8b55d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:48:52 devstack sudo[102610]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-57c10965-f481-4be1-8188-c2ab20b5f6aa 1073741824 Jul 10 04:48:52 devstack sudo[102610]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:48:52 devstack cinder-volume[87444]: INFO cinder.volume.flows.manager.create_volume [None req-ff457849-040a-40d5-a512-601cd00ebe1f tempest-CreateVolumesFromSourceVolumeTest-1814858877 None] Volume volume-6f36f1cd-0829-461c-8cb3-a30c775109be (6f36f1cd-0829-461c-8cb3-a30c775109be): created successfully Jul 10 04:48:52 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-ff457849-040a-40d5-a512-601cd00ebe1f tempest-CreateVolumesFromSourceVolumeTest-1814858877 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (54da412a-8deb-40f0-b549-8b776ce8b55d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:48:52 devstack sudo[102609]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-420cd972-7ecb-4fdb-abf1-d859698bbb94 Jul 10 04:48:52 devstack sudo[102609]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:48:52 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-ff457849-040a-40d5-a512-601cd00ebe1f tempest-CreateVolumesFromSourceVolumeTest-1814858877 None] Flow 'volume_create_manager' (6a3510d5-893e-4bdd-bbbf-b5fa33fdabd9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87444) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 04:48:52 devstack cinder-volume[87444]: INFO cinder.volume.manager [None req-ff457849-040a-40d5-a512-601cd00ebe1f tempest-CreateVolumesFromSourceVolumeTest-1814858877 None] Created volume successfully. Jul 10 04:48:52 devstack sudo[102609]: pam_unix(sudo:session): session closed for user root Jul 10 04:48:52 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-009cba2b-a2b0-46c3-991c-540f23febeb8 tempest-TestStampPattern-1378957900 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-420cd972-7ecb-4fdb-abf1-d859698bbb94" returned: 0 in 0.919s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:48:52 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-009cba2b-a2b0-46c3-991c-540f23febeb8 tempest-TestStampPattern-1378957900 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-420cd972-7ecb-4fdb-abf1-d859698bbb94.377c9456-51f8-4392-818b-e5e1f7eb7f99 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:48:52 devstack sudo[102621]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-420cd972-7ecb-4fdb-abf1-d859698bbb94.377c9456-51f8-4392-818b-e5e1f7eb7f99 Jul 10 04:48:52 devstack sudo[102621]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:48:53 devstack sudo[102610]: pam_unix(sudo:session): session closed for user root Jul 10 04:48:53 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-2d0409b9-76dc-4dd1-a54c-211772c81f6c tempest-CreateVolumesFromSourceVolumeTest-1814858877 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-57c10965-f481-4be1-8188-c2ab20b5f6aa 1073741824" returned: 0 in 1.122s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:48:53 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-2d0409b9-76dc-4dd1-a54c-211772c81f6c tempest-CreateVolumesFromSourceVolumeTest-1814858877 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-57c10965-f481-4be1-8188-c2ab20b5f6aa {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:48:53 devstack sudo[102623]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-57c10965-f481-4be1-8188-c2ab20b5f6aa Jul 10 04:48:53 devstack sudo[102623]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:48:53 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-d20cdfc6-80db-46bb-878d-5e2a66a87984 tempest-TestServerVolumeAttachScenarioOldVersion-885288560 None] Acquiring lock "cinder-04f3bea2-0951-40d0-ad5e-5b78fba1aa16-delete_volume" by "delete_volume" {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 04:48:53 devstack sudo[102621]: pam_unix(sudo:session): session closed for user root Jul 10 04:48:53 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-d20cdfc6-80db-46bb-878d-5e2a66a87984 tempest-TestServerVolumeAttachScenarioOldVersion-885288560 None] Lock "cinder-04f3bea2-0951-40d0-ad5e-5b78fba1aa16-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 04:48:53 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-009cba2b-a2b0-46c3-991c-540f23febeb8 tempest-TestStampPattern-1378957900 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-420cd972-7ecb-4fdb-abf1-d859698bbb94.377c9456-51f8-4392-818b-e5e1f7eb7f99" returned: 0 in 0.926s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:48:53 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-009cba2b-a2b0-46c3-991c-540f23febeb8 tempest-TestStampPattern-1378957900 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-420cd972-7ecb-4fdb-abf1-d859698bbb94.377c9456-51f8-4392-818b-e5e1f7eb7f99 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:48:53 devstack sudo[102630]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-420cd972-7ecb-4fdb-abf1-d859698bbb94.377c9456-51f8-4392-818b-e5e1f7eb7f99 Jul 10 04:48:53 devstack sudo[102630]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:48:53 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-d20cdfc6-80db-46bb-878d-5e2a66a87984 tempest-TestServerVolumeAttachScenarioOldVersion-885288560 None] Acquiring lock "cinder-quobyte-04f3bea2-0951-40d0-ad5e-5b78fba1aa16" by "delete_volume" {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 04:48:53 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-d20cdfc6-80db-46bb-878d-5e2a66a87984 tempest-TestServerVolumeAttachScenarioOldVersion-885288560 None] Lock "cinder-quobyte-04f3bea2-0951-40d0-ad5e-5b78fba1aa16" acquired by "delete_volume" :: waited 0.023s {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 04:48:53 devstack cinder-volume[87444]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6b525bf-3ee5-45cc-9fab-f4beafeff06d]: (4, 'qcow2') {{(pid=88499) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 04:48:53 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-d20cdfc6-80db-46bb-878d-5e2a66a87984 tempest-TestServerVolumeAttachScenarioOldVersion-885288560 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-04f3bea2-0951-40d0-ad5e-5b78fba1aa16 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:48:53 devstack sudo[102623]: pam_unix(sudo:session): session closed for user root Jul 10 04:48:54 devstack sudo[102633]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-04f3bea2-0951-40d0-ad5e-5b78fba1aa16 Jul 10 04:48:54 devstack sudo[102633]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:48:54 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-2d0409b9-76dc-4dd1-a54c-211772c81f6c tempest-CreateVolumesFromSourceVolumeTest-1814858877 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-57c10965-f481-4be1-8188-c2ab20b5f6aa" returned: 0 in 0.858s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:48:54 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-2d0409b9-76dc-4dd1-a54c-211772c81f6c tempest-CreateVolumesFromSourceVolumeTest-1814858877 None] <== create_volume: return (2049ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922'} {{(pid=87444) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 04:48:54 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-2d0409b9-76dc-4dd1-a54c-211772c81f6c tempest-CreateVolumesFromSourceVolumeTest-1814858877 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.052s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 04:48:54 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-95118947-6c71-4192-bdef-94ecb9e25876 tempest-CreateVolumesFromSourceVolumeTest-1814858877 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.923s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 04:48:54 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-95118947-6c71-4192-bdef-94ecb9e25876 tempest-CreateVolumesFromSourceVolumeTest-1814858877 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T02:48:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-701559494',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bd71c748-29e7-47c9-a98d-8ca9461165b8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4ddfcf19fb26443caa09ffa4dc8241e3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T02:48:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T02:48:50Z,use_quota=True,user_id='e0f7f09f71e34388be57583bd8403e10',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(317e369e-1e06-434d-ae95-a335f0e6c903),volume_type_id=317e369e-1e06-434d-ae95-a335f0e6c903)}" {{(pid=87444) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 04:48:54 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.remotefs [None req-95118947-6c71-4192-bdef-94ecb9e25876 tempest-CreateVolumesFromSourceVolumeTest-1814858877 None] Creating volume bd71c748-29e7-47c9-a98d-8ca9461165b8 {{(pid=87444) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 04:48:54 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-95118947-6c71-4192-bdef-94ecb9e25876 tempest-CreateVolumesFromSourceVolumeTest-1814858877 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 04:48:54 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-95118947-6c71-4192-bdef-94ecb9e25876 tempest-CreateVolumesFromSourceVolumeTest-1814858877 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 04:48:54 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-95118947-6c71-4192-bdef-94ecb9e25876 tempest-CreateVolumesFromSourceVolumeTest-1814858877 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922': None} {{(pid=87444) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 04:48:54 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-95118947-6c71-4192-bdef-94ecb9e25876 tempest-CreateVolumesFromSourceVolumeTest-1814858877 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922'] {{(pid=87444) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 04:48:54 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-95118947-6c71-4192-bdef-94ecb9e25876 tempest-CreateVolumesFromSourceVolumeTest-1814858877 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 04:48:54 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-95118947-6c71-4192-bdef-94ecb9e25876 tempest-CreateVolumesFromSourceVolumeTest-1814858877 None] Selected osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922 as target Quobyte volume. {{(pid=87444) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 04:48:54 devstack cinder-volume[87444]: INFO cinder.volume.drivers.remotefs [None req-95118947-6c71-4192-bdef-94ecb9e25876 tempest-CreateVolumesFromSourceVolumeTest-1814858877 None] casted to osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922 Jul 10 04:48:54 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-95118947-6c71-4192-bdef-94ecb9e25876 tempest-CreateVolumesFromSourceVolumeTest-1814858877 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-bd71c748-29e7-47c9-a98d-8ca9461165b8 1073741824 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:48:54 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-2d0409b9-76dc-4dd1-a54c-211772c81f6c tempest-CreateVolumesFromSourceVolumeTest-1814858877 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6adc5bdb-8aab-4398-a02d-227f1d63e283) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-57c10965-f481-4be1-8188-c2ab20b5f6aa', 'volume_size': 1}' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:48:54 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-2d0409b9-76dc-4dd1-a54c-211772c81f6c tempest-CreateVolumesFromSourceVolumeTest-1814858877 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (385e921d-dce4-4d45-b231-8639f9c3c593) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:48:54 devstack sudo[102635]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-bd71c748-29e7-47c9-a98d-8ca9461165b8 1073741824 Jul 10 04:48:54 devstack sudo[102635]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:48:54 devstack cinder-volume[87444]: INFO cinder.volume.flows.manager.create_volume [None req-2d0409b9-76dc-4dd1-a54c-211772c81f6c tempest-CreateVolumesFromSourceVolumeTest-1814858877 None] Volume volume-57c10965-f481-4be1-8188-c2ab20b5f6aa (57c10965-f481-4be1-8188-c2ab20b5f6aa): created successfully Jul 10 04:48:54 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-2d0409b9-76dc-4dd1-a54c-211772c81f6c tempest-CreateVolumesFromSourceVolumeTest-1814858877 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (385e921d-dce4-4d45-b231-8639f9c3c593) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:48:54 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-2d0409b9-76dc-4dd1-a54c-211772c81f6c tempest-CreateVolumesFromSourceVolumeTest-1814858877 None] Flow 'volume_create_manager' (31a5ed12-ba08-4f80-8cc1-688c2e909d3b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87444) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 04:48:54 devstack cinder-volume[87444]: INFO cinder.volume.manager [None req-2d0409b9-76dc-4dd1-a54c-211772c81f6c tempest-CreateVolumesFromSourceVolumeTest-1814858877 None] Created volume successfully. Jul 10 04:48:54 devstack sudo[102630]: pam_unix(sudo:session): session closed for user root Jul 10 04:48:54 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-009cba2b-a2b0-46c3-991c-540f23febeb8 tempest-TestStampPattern-1378957900 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-420cd972-7ecb-4fdb-abf1-d859698bbb94.377c9456-51f8-4392-818b-e5e1f7eb7f99" returned: 0 in 0.901s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:48:54 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-009cba2b-a2b0-46c3-991c-540f23febeb8 tempest-TestStampPattern-1378957900 None] Lock "cinder-quobyte-377c9456-51f8-4392-818b-e5e1f7eb7f99" released by "_delete_snapshot" :: held 4.141s {{(pid=87444) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 04:48:54 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-009cba2b-a2b0-46c3-991c-540f23febeb8 tempest-TestStampPattern-1378957900 None] Lock "cinder-quobyte-420cd972-7ecb-4fdb-abf1-d859698bbb94" released by "delete_snapshot" :: held 4.221s {{(pid=87444) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 04:48:54 devstack sudo[102633]: pam_unix(sudo:session): session closed for user root Jul 10 04:48:54 devstack cinder-volume[87444]: DEBUG cinder.quota [None req-009cba2b-a2b0-46c3-991c-540f23febeb8 tempest-TestStampPattern-1378957900 None] Created reservations ['b3f0a879-2d46-4600-860c-d3e6d7dec71e', '7c1d6876-e0ab-4e26-a819-c82fa1698048', '9339acc5-4dae-478a-812b-c03462096553', '4c0654ff-3a3f-4669-8bb3-3947fb5c3ac9'] {{(pid=87444) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 04:48:54 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-d20cdfc6-80db-46bb-878d-5e2a66a87984 tempest-TestServerVolumeAttachScenarioOldVersion-885288560 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-04f3bea2-0951-40d0-ad5e-5b78fba1aa16" returned: 0 in 0.956s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:48:54 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-d20cdfc6-80db-46bb-878d-5e2a66a87984 tempest-TestServerVolumeAttachScenarioOldVersion-885288560 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-04f3bea2-0951-40d0-ad5e-5b78fba1aa16 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:48:54 devstack sudo[102645]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-04f3bea2-0951-40d0-ad5e-5b78fba1aa16 Jul 10 04:48:54 devstack sudo[102645]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:48:54 devstack cinder-volume[87444]: INFO cinder.volume.manager [None req-009cba2b-a2b0-46c3-991c-540f23febeb8 tempest-TestStampPattern-1378957900 None] Delete snapshot completed successfully. Jul 10 04:48:54 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-009cba2b-a2b0-46c3-991c-540f23febeb8 tempest-TestStampPattern-1378957900 None] Lock "cinder-377c9456-51f8-4392-818b-e5e1f7eb7f99-delete_snapshot" released by "delete_snapshot" :: held 4.518s {{(pid=87444) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 04:48:55 devstack sudo[102635]: pam_unix(sudo:session): session closed for user root Jul 10 04:48:55 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-95118947-6c71-4192-bdef-94ecb9e25876 tempest-CreateVolumesFromSourceVolumeTest-1814858877 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-bd71c748-29e7-47c9-a98d-8ca9461165b8 1073741824" returned: 0 in 1.133s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:48:55 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-95118947-6c71-4192-bdef-94ecb9e25876 tempest-CreateVolumesFromSourceVolumeTest-1814858877 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-bd71c748-29e7-47c9-a98d-8ca9461165b8 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:48:55 devstack sudo[102648]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-bd71c748-29e7-47c9-a98d-8ca9461165b8 Jul 10 04:48:55 devstack sudo[102648]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:48:55 devstack sudo[102645]: pam_unix(sudo:session): session closed for user root Jul 10 04:48:55 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-d20cdfc6-80db-46bb-878d-5e2a66a87984 tempest-TestServerVolumeAttachScenarioOldVersion-885288560 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-04f3bea2-0951-40d0-ad5e-5b78fba1aa16" returned: 0 in 0.722s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:48:55 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-d20cdfc6-80db-46bb-878d-5e2a66a87984 tempest-TestServerVolumeAttachScenarioOldVersion-885288560 None] Lock "cinder-quobyte-04f3bea2-0951-40d0-ad5e-5b78fba1aa16" released by "delete_volume" :: held 1.733s {{(pid=87444) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 04:48:55 devstack cinder-volume[87444]: DEBUG cinder.quota [None req-d20cdfc6-80db-46bb-878d-5e2a66a87984 tempest-TestServerVolumeAttachScenarioOldVersion-885288560 None] Created reservations ['d667bb0a-9316-47b6-8336-80a6b37658fb', '686a8a57-ba66-40be-8804-2de03cb0bf22', '8a2e49a4-8b78-4f01-b71d-15c062d3332c', '59578828-1c50-439c-9450-72e9236875aa'] {{(pid=87444) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 04:48:55 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-d20cdfc6-80db-46bb-878d-5e2a66a87984 tempest-TestServerVolumeAttachScenarioOldVersion-885288560 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 04:48:55 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-d20cdfc6-80db-46bb-878d-5e2a66a87984 tempest-TestServerVolumeAttachScenarioOldVersion-885288560 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 04:48:55 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-d20cdfc6-80db-46bb-878d-5e2a66a87984 tempest-TestServerVolumeAttachScenarioOldVersion-885288560 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922': None} {{(pid=87444) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 04:48:55 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-d20cdfc6-80db-46bb-878d-5e2a66a87984 tempest-TestServerVolumeAttachScenarioOldVersion-885288560 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922'] {{(pid=87444) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 04:48:55 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-d20cdfc6-80db-46bb-878d-5e2a66a87984 tempest-TestServerVolumeAttachScenarioOldVersion-885288560 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.026s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 04:48:55 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-d20cdfc6-80db-46bb-878d-5e2a66a87984 tempest-TestServerVolumeAttachScenarioOldVersion-885288560 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:48:55 devstack sudo[102651]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097 Jul 10 04:48:55 devstack sudo[102651]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:48:56 devstack sudo[102648]: pam_unix(sudo:session): session closed for user root Jul 10 04:48:56 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-95118947-6c71-4192-bdef-94ecb9e25876 tempest-CreateVolumesFromSourceVolumeTest-1814858877 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-bd71c748-29e7-47c9-a98d-8ca9461165b8" returned: 0 in 1.038s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:48:56 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-95118947-6c71-4192-bdef-94ecb9e25876 tempest-CreateVolumesFromSourceVolumeTest-1814858877 None] <== create_volume: return (2232ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922'} {{(pid=87444) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 04:48:56 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-95118947-6c71-4192-bdef-94ecb9e25876 tempest-CreateVolumesFromSourceVolumeTest-1814858877 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.236s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 04:48:56 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-24b18b62-2efd-4819-8c7a-f2831ffd811b tempest-CreateVolumesFromSourceVolumeTest-1814858877 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.150s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 04:48:56 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-24b18b62-2efd-4819-8c7a-f2831ffd811b tempest-CreateVolumesFromSourceVolumeTest-1814858877 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T02:48:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1479400341',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=67679359-4853-45b1-9296-5e584d9eb487,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4ddfcf19fb26443caa09ffa4dc8241e3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T02:48:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T02:48:51Z,use_quota=True,user_id='e0f7f09f71e34388be57583bd8403e10',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(317e369e-1e06-434d-ae95-a335f0e6c903),volume_type_id=317e369e-1e06-434d-ae95-a335f0e6c903)}" {{(pid=87444) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 04:48:56 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.remotefs [None req-24b18b62-2efd-4819-8c7a-f2831ffd811b tempest-CreateVolumesFromSourceVolumeTest-1814858877 None] Creating volume 67679359-4853-45b1-9296-5e584d9eb487 {{(pid=87444) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 04:48:56 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-24b18b62-2efd-4819-8c7a-f2831ffd811b tempest-CreateVolumesFromSourceVolumeTest-1814858877 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 04:48:56 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-24b18b62-2efd-4819-8c7a-f2831ffd811b tempest-CreateVolumesFromSourceVolumeTest-1814858877 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 04:48:56 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-24b18b62-2efd-4819-8c7a-f2831ffd811b tempest-CreateVolumesFromSourceVolumeTest-1814858877 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922': None} {{(pid=87444) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 04:48:56 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-24b18b62-2efd-4819-8c7a-f2831ffd811b tempest-CreateVolumesFromSourceVolumeTest-1814858877 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922'] {{(pid=87444) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 04:48:56 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-24b18b62-2efd-4819-8c7a-f2831ffd811b tempest-CreateVolumesFromSourceVolumeTest-1814858877 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 04:48:56 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-24b18b62-2efd-4819-8c7a-f2831ffd811b tempest-CreateVolumesFromSourceVolumeTest-1814858877 None] Selected osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922 as target Quobyte volume. {{(pid=87444) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 04:48:56 devstack cinder-volume[87444]: INFO cinder.volume.drivers.remotefs [None req-24b18b62-2efd-4819-8c7a-f2831ffd811b tempest-CreateVolumesFromSourceVolumeTest-1814858877 None] casted to osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922 Jul 10 04:48:56 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-24b18b62-2efd-4819-8c7a-f2831ffd811b tempest-CreateVolumesFromSourceVolumeTest-1814858877 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-67679359-4853-45b1-9296-5e584d9eb487 1073741824 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:48:56 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-95118947-6c71-4192-bdef-94ecb9e25876 tempest-CreateVolumesFromSourceVolumeTest-1814858877 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (312b31ba-46d3-494e-914f-a2a3077545b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bd71c748-29e7-47c9-a98d-8ca9461165b8', 'volume_size': 1}' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:48:56 devstack sudo[102654]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-67679359-4853-45b1-9296-5e584d9eb487 1073741824 Jul 10 04:48:56 devstack sudo[102654]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:48:56 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-95118947-6c71-4192-bdef-94ecb9e25876 tempest-CreateVolumesFromSourceVolumeTest-1814858877 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (81ce0e55-759f-4ebf-880c-14a522e3f3e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:48:56 devstack cinder-volume[87444]: INFO cinder.volume.flows.manager.create_volume [None req-95118947-6c71-4192-bdef-94ecb9e25876 tempest-CreateVolumesFromSourceVolumeTest-1814858877 None] Volume volume-bd71c748-29e7-47c9-a98d-8ca9461165b8 (bd71c748-29e7-47c9-a98d-8ca9461165b8): created successfully Jul 10 04:48:56 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-95118947-6c71-4192-bdef-94ecb9e25876 tempest-CreateVolumesFromSourceVolumeTest-1814858877 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (81ce0e55-759f-4ebf-880c-14a522e3f3e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:48:56 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-95118947-6c71-4192-bdef-94ecb9e25876 tempest-CreateVolumesFromSourceVolumeTest-1814858877 None] Flow 'volume_create_manager' (22a7e11e-8698-4b02-91b8-6013aa57f29a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87444) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 04:48:56 devstack cinder-volume[87444]: INFO cinder.volume.manager [None req-95118947-6c71-4192-bdef-94ecb9e25876 tempest-CreateVolumesFromSourceVolumeTest-1814858877 None] Created volume successfully. Jul 10 04:48:56 devstack sudo[102651]: pam_unix(sudo:session): session closed for user root Jul 10 04:48:56 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-d20cdfc6-80db-46bb-878d-5e2a66a87984 tempest-TestServerVolumeAttachScenarioOldVersion-885288560 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097" returned: 0 in 0.831s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:48:56 devstack cinder-volume[87444]: DEBUG cinder.manager [None req-d20cdfc6-80db-46bb-878d-5e2a66a87984 tempest-TestServerVolumeAttachScenarioOldVersion-885288560 None] Notifying Schedulers of capabilities ... {{(pid=87444) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 04:48:56 devstack cinder-volume[87444]: INFO cinder.volume.manager [None req-d20cdfc6-80db-46bb-878d-5e2a66a87984 tempest-TestServerVolumeAttachScenarioOldVersion-885288560 None] Deleted volume successfully. Jul 10 04:48:56 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-d20cdfc6-80db-46bb-878d-5e2a66a87984 tempest-TestServerVolumeAttachScenarioOldVersion-885288560 None] Lock "cinder-04f3bea2-0951-40d0-ad5e-5b78fba1aa16-delete_volume" released by "delete_volume" :: held 2.967s {{(pid=87444) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 04:48:57 devstack sudo[102654]: pam_unix(sudo:session): session closed for user root Jul 10 04:48:57 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-24b18b62-2efd-4819-8c7a-f2831ffd811b tempest-CreateVolumesFromSourceVolumeTest-1814858877 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-67679359-4853-45b1-9296-5e584d9eb487 1073741824" returned: 0 in 1.250s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:48:57 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-24b18b62-2efd-4819-8c7a-f2831ffd811b tempest-CreateVolumesFromSourceVolumeTest-1814858877 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-67679359-4853-45b1-9296-5e584d9eb487 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:48:57 devstack sudo[102670]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-67679359-4853-45b1-9296-5e584d9eb487 Jul 10 04:48:57 devstack sudo[102670]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:48:58 devstack sudo[102670]: pam_unix(sudo:session): session closed for user root Jul 10 04:48:58 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-24b18b62-2efd-4819-8c7a-f2831ffd811b tempest-CreateVolumesFromSourceVolumeTest-1814858877 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-67679359-4853-45b1-9296-5e584d9eb487" returned: 0 in 0.893s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:48:58 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-24b18b62-2efd-4819-8c7a-f2831ffd811b tempest-CreateVolumesFromSourceVolumeTest-1814858877 None] <== create_volume: return (2197ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922'} {{(pid=87444) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 04:48:58 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-24b18b62-2efd-4819-8c7a-f2831ffd811b tempest-CreateVolumesFromSourceVolumeTest-1814858877 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.203s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 04:48:58 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-ffba9f7f-e007-4d35-aa9c-ffca74641bde tempest-CreateVolumesFromSourceVolumeTest-1814858877 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.846s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 04:48:58 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-ffba9f7f-e007-4d35-aa9c-ffca74641bde tempest-CreateVolumesFromSourceVolumeTest-1814858877 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T02:48:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1840798241',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0322633e-92cd-4ba8-8519-576c72499d96,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4ddfcf19fb26443caa09ffa4dc8241e3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T02:48:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T02:48:51Z,use_quota=True,user_id='e0f7f09f71e34388be57583bd8403e10',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(317e369e-1e06-434d-ae95-a335f0e6c903),volume_type_id=317e369e-1e06-434d-ae95-a335f0e6c903)}" {{(pid=87444) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 04:48:58 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.remotefs [None req-ffba9f7f-e007-4d35-aa9c-ffca74641bde tempest-CreateVolumesFromSourceVolumeTest-1814858877 None] Creating volume 0322633e-92cd-4ba8-8519-576c72499d96 {{(pid=87444) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 04:48:58 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-ffba9f7f-e007-4d35-aa9c-ffca74641bde tempest-CreateVolumesFromSourceVolumeTest-1814858877 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 04:48:58 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-ffba9f7f-e007-4d35-aa9c-ffca74641bde tempest-CreateVolumesFromSourceVolumeTest-1814858877 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 04:48:58 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-ffba9f7f-e007-4d35-aa9c-ffca74641bde tempest-CreateVolumesFromSourceVolumeTest-1814858877 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922': None} {{(pid=87444) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 04:48:58 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-ffba9f7f-e007-4d35-aa9c-ffca74641bde tempest-CreateVolumesFromSourceVolumeTest-1814858877 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922'] {{(pid=87444) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 04:48:58 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-ffba9f7f-e007-4d35-aa9c-ffca74641bde tempest-CreateVolumesFromSourceVolumeTest-1814858877 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 04:48:58 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-ffba9f7f-e007-4d35-aa9c-ffca74641bde tempest-CreateVolumesFromSourceVolumeTest-1814858877 None] Selected osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922 as target Quobyte volume. {{(pid=87444) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 04:48:58 devstack cinder-volume[87444]: INFO cinder.volume.drivers.remotefs [None req-ffba9f7f-e007-4d35-aa9c-ffca74641bde tempest-CreateVolumesFromSourceVolumeTest-1814858877 None] casted to osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922 Jul 10 04:48:58 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-ffba9f7f-e007-4d35-aa9c-ffca74641bde tempest-CreateVolumesFromSourceVolumeTest-1814858877 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-0322633e-92cd-4ba8-8519-576c72499d96 1073741824 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:48:58 devstack sudo[102689]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-0322633e-92cd-4ba8-8519-576c72499d96 1073741824 Jul 10 04:48:58 devstack sudo[102689]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:48:58 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-24b18b62-2efd-4819-8c7a-f2831ffd811b tempest-CreateVolumesFromSourceVolumeTest-1814858877 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8f0dcca6-28d4-40e3-81f5-fbd8d3612de2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-67679359-4853-45b1-9296-5e584d9eb487', 'volume_size': 1}' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:48:58 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-24b18b62-2efd-4819-8c7a-f2831ffd811b tempest-CreateVolumesFromSourceVolumeTest-1814858877 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (18a28c1b-6773-4805-8571-4f5d7d34a01f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:48:58 devstack cinder-volume[87444]: INFO cinder.volume.flows.manager.create_volume [None req-24b18b62-2efd-4819-8c7a-f2831ffd811b tempest-CreateVolumesFromSourceVolumeTest-1814858877 None] Volume volume-67679359-4853-45b1-9296-5e584d9eb487 (67679359-4853-45b1-9296-5e584d9eb487): created successfully Jul 10 04:48:58 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-24b18b62-2efd-4819-8c7a-f2831ffd811b tempest-CreateVolumesFromSourceVolumeTest-1814858877 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (18a28c1b-6773-4805-8571-4f5d7d34a01f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:48:58 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-24b18b62-2efd-4819-8c7a-f2831ffd811b tempest-CreateVolumesFromSourceVolumeTest-1814858877 None] Flow 'volume_create_manager' (e1661b38-16e5-4aba-9f9a-7400f33e6903) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87444) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 04:48:58 devstack cinder-volume[87444]: INFO cinder.volume.manager [None req-24b18b62-2efd-4819-8c7a-f2831ffd811b tempest-CreateVolumesFromSourceVolumeTest-1814858877 None] Created volume successfully. Jul 10 04:48:59 devstack sudo[102689]: pam_unix(sudo:session): session closed for user root Jul 10 04:48:59 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-ffba9f7f-e007-4d35-aa9c-ffca74641bde tempest-CreateVolumesFromSourceVolumeTest-1814858877 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-0322633e-92cd-4ba8-8519-576c72499d96 1073741824" returned: 0 in 1.313s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:48:59 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-ffba9f7f-e007-4d35-aa9c-ffca74641bde tempest-CreateVolumesFromSourceVolumeTest-1814858877 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-0322633e-92cd-4ba8-8519-576c72499d96 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:48:59 devstack sudo[102717]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-0322633e-92cd-4ba8-8519-576c72499d96 Jul 10 04:48:59 devstack sudo[102717]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:49:00 devstack sudo[102717]: pam_unix(sudo:session): session closed for user root Jul 10 04:49:00 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-ffba9f7f-e007-4d35-aa9c-ffca74641bde tempest-CreateVolumesFromSourceVolumeTest-1814858877 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-0322633e-92cd-4ba8-8519-576c72499d96" returned: 0 in 0.830s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:49:00 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-ffba9f7f-e007-4d35-aa9c-ffca74641bde tempest-CreateVolumesFromSourceVolumeTest-1814858877 None] <== create_volume: return (2196ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922'} {{(pid=87444) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 04:49:00 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-ffba9f7f-e007-4d35-aa9c-ffca74641bde tempest-CreateVolumesFromSourceVolumeTest-1814858877 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.200s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 04:49:00 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-ffba9f7f-e007-4d35-aa9c-ffca74641bde tempest-CreateVolumesFromSourceVolumeTest-1814858877 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9462fb50-6ffe-48a4-8784-5a056ae60b43) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0322633e-92cd-4ba8-8519-576c72499d96', 'volume_size': 1}' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:49:00 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-ffba9f7f-e007-4d35-aa9c-ffca74641bde tempest-CreateVolumesFromSourceVolumeTest-1814858877 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8c4a90fa-17b5-4f92-b8bf-93fafe604e55) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:49:00 devstack cinder-volume[87444]: INFO cinder.volume.flows.manager.create_volume [None req-ffba9f7f-e007-4d35-aa9c-ffca74641bde tempest-CreateVolumesFromSourceVolumeTest-1814858877 None] Volume volume-0322633e-92cd-4ba8-8519-576c72499d96 (0322633e-92cd-4ba8-8519-576c72499d96): created successfully Jul 10 04:49:00 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-ffba9f7f-e007-4d35-aa9c-ffca74641bde tempest-CreateVolumesFromSourceVolumeTest-1814858877 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8c4a90fa-17b5-4f92-b8bf-93fafe604e55) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:49:00 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-ffba9f7f-e007-4d35-aa9c-ffca74641bde tempest-CreateVolumesFromSourceVolumeTest-1814858877 None] Flow 'volume_create_manager' (6eabef9f-acc5-4f45-8791-e4961dcfeb23) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87444) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 04:49:00 devstack cinder-volume[87444]: INFO cinder.volume.manager [None req-ffba9f7f-e007-4d35-aa9c-ffca74641bde tempest-CreateVolumesFromSourceVolumeTest-1814858877 None] Created volume successfully. Jul 10 04:49:01 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-67f890d0-2c9c-40f3-bef9-e8ad82a45e28 tempest-CreateVolumesFromSourceVolumeTest-1814858877 None] Acquiring lock "cinder-0322633e-92cd-4ba8-8519-576c72499d96-delete_volume" by "delete_volume" {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 04:49:01 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-67f890d0-2c9c-40f3-bef9-e8ad82a45e28 tempest-CreateVolumesFromSourceVolumeTest-1814858877 None] Lock "cinder-0322633e-92cd-4ba8-8519-576c72499d96-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 04:49:01 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-67f890d0-2c9c-40f3-bef9-e8ad82a45e28 tempest-CreateVolumesFromSourceVolumeTest-1814858877 None] Acquiring lock "cinder-quobyte-0322633e-92cd-4ba8-8519-576c72499d96" by "delete_volume" {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 04:49:01 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-67f890d0-2c9c-40f3-bef9-e8ad82a45e28 tempest-CreateVolumesFromSourceVolumeTest-1814858877 None] Lock "cinder-quobyte-0322633e-92cd-4ba8-8519-576c72499d96" acquired by "delete_volume" :: waited 0.015s {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 04:49:01 devstack cinder-volume[87444]: DEBUG oslo.privsep.daemon [-] privsep: reply[37030b0f-0e65-472d-a766-4c9f9a6e02b3]: (4, 'qcow2') {{(pid=88499) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 04:49:01 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-67f890d0-2c9c-40f3-bef9-e8ad82a45e28 tempest-CreateVolumesFromSourceVolumeTest-1814858877 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-0322633e-92cd-4ba8-8519-576c72499d96 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:49:01 devstack sudo[102724]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-0322633e-92cd-4ba8-8519-576c72499d96 Jul 10 04:49:01 devstack sudo[102724]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:49:02 devstack sudo[102724]: pam_unix(sudo:session): session closed for user root Jul 10 04:49:02 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-67f890d0-2c9c-40f3-bef9-e8ad82a45e28 tempest-CreateVolumesFromSourceVolumeTest-1814858877 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-0322633e-92cd-4ba8-8519-576c72499d96" returned: 0 in 0.850s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:49:02 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-67f890d0-2c9c-40f3-bef9-e8ad82a45e28 tempest-CreateVolumesFromSourceVolumeTest-1814858877 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-0322633e-92cd-4ba8-8519-576c72499d96 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:49:02 devstack sudo[102731]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-0322633e-92cd-4ba8-8519-576c72499d96 Jul 10 04:49:02 devstack sudo[102731]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:49:03 devstack sudo[102731]: pam_unix(sudo:session): session closed for user root Jul 10 04:49:03 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-67f890d0-2c9c-40f3-bef9-e8ad82a45e28 tempest-CreateVolumesFromSourceVolumeTest-1814858877 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-0322633e-92cd-4ba8-8519-576c72499d96" returned: 0 in 0.706s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:49:03 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-67f890d0-2c9c-40f3-bef9-e8ad82a45e28 tempest-CreateVolumesFromSourceVolumeTest-1814858877 None] Lock "cinder-quobyte-0322633e-92cd-4ba8-8519-576c72499d96" released by "delete_volume" :: held 1.616s {{(pid=87444) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 04:49:03 devstack cinder-volume[87444]: DEBUG cinder.quota [None req-67f890d0-2c9c-40f3-bef9-e8ad82a45e28 tempest-CreateVolumesFromSourceVolumeTest-1814858877 None] Created reservations ['feefcf30-602d-4a27-b8b3-9314fc125fa4', 'cb2b27ba-3093-4c81-b83d-af9a6113da16', '1b8c6448-91da-490e-b665-e294cf101675', '580ead55-03a2-455f-825e-93fa65450ea6'] {{(pid=87444) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 04:49:03 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-67f890d0-2c9c-40f3-bef9-e8ad82a45e28 tempest-CreateVolumesFromSourceVolumeTest-1814858877 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 04:49:03 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-67f890d0-2c9c-40f3-bef9-e8ad82a45e28 tempest-CreateVolumesFromSourceVolumeTest-1814858877 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 04:49:03 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-67f890d0-2c9c-40f3-bef9-e8ad82a45e28 tempest-CreateVolumesFromSourceVolumeTest-1814858877 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922': None} {{(pid=87444) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 04:49:03 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-67f890d0-2c9c-40f3-bef9-e8ad82a45e28 tempest-CreateVolumesFromSourceVolumeTest-1814858877 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922'] {{(pid=87444) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 04:49:03 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-67f890d0-2c9c-40f3-bef9-e8ad82a45e28 tempest-CreateVolumesFromSourceVolumeTest-1814858877 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 04:49:03 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-67f890d0-2c9c-40f3-bef9-e8ad82a45e28 tempest-CreateVolumesFromSourceVolumeTest-1814858877 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:49:03 devstack sudo[102735]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097 Jul 10 04:49:03 devstack sudo[102735]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:49:03 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-6656c069-5b19-483f-8507-d5911a8017ae tempest-CreateVolumesFromSourceVolumeTest-1814858877 None] Acquiring lock "cinder-67679359-4853-45b1-9296-5e584d9eb487-delete_volume" by "delete_volume" {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 04:49:03 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-6656c069-5b19-483f-8507-d5911a8017ae tempest-CreateVolumesFromSourceVolumeTest-1814858877 None] Lock "cinder-67679359-4853-45b1-9296-5e584d9eb487-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 04:49:03 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-6656c069-5b19-483f-8507-d5911a8017ae tempest-CreateVolumesFromSourceVolumeTest-1814858877 None] Acquiring lock "cinder-quobyte-67679359-4853-45b1-9296-5e584d9eb487" by "delete_volume" {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 04:49:04 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-6656c069-5b19-483f-8507-d5911a8017ae tempest-CreateVolumesFromSourceVolumeTest-1814858877 None] Lock "cinder-quobyte-67679359-4853-45b1-9296-5e584d9eb487" acquired by "delete_volume" :: waited 0.022s {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 04:49:04 devstack cinder-volume[87444]: DEBUG oslo.privsep.daemon [-] privsep: reply[3649c20f-e0ab-41c9-8937-63743dae1843]: (4, 'qcow2') {{(pid=88499) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 04:49:04 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-6656c069-5b19-483f-8507-d5911a8017ae tempest-CreateVolumesFromSourceVolumeTest-1814858877 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-67679359-4853-45b1-9296-5e584d9eb487 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:49:04 devstack sudo[102737]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-67679359-4853-45b1-9296-5e584d9eb487 Jul 10 04:49:04 devstack sudo[102737]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:49:04 devstack sudo[102735]: pam_unix(sudo:session): session closed for user root Jul 10 04:49:04 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-67f890d0-2c9c-40f3-bef9-e8ad82a45e28 tempest-CreateVolumesFromSourceVolumeTest-1814858877 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097" returned: 0 in 0.760s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:49:04 devstack cinder-volume[87444]: DEBUG cinder.manager [None req-67f890d0-2c9c-40f3-bef9-e8ad82a45e28 tempest-CreateVolumesFromSourceVolumeTest-1814858877 None] Notifying Schedulers of capabilities ... {{(pid=87444) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 04:49:04 devstack cinder-volume[87444]: INFO cinder.volume.manager [None req-67f890d0-2c9c-40f3-bef9-e8ad82a45e28 tempest-CreateVolumesFromSourceVolumeTest-1814858877 None] Deleted volume successfully. Jul 10 04:49:04 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-67f890d0-2c9c-40f3-bef9-e8ad82a45e28 tempest-CreateVolumesFromSourceVolumeTest-1814858877 None] Lock "cinder-0322633e-92cd-4ba8-8519-576c72499d96-delete_volume" released by "delete_volume" :: held 2.625s {{(pid=87444) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 04:49:04 devstack sudo[102737]: pam_unix(sudo:session): session closed for user root Jul 10 04:49:04 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-6656c069-5b19-483f-8507-d5911a8017ae tempest-CreateVolumesFromSourceVolumeTest-1814858877 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-67679359-4853-45b1-9296-5e584d9eb487" returned: 0 in 0.923s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:49:04 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-6656c069-5b19-483f-8507-d5911a8017ae tempest-CreateVolumesFromSourceVolumeTest-1814858877 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-67679359-4853-45b1-9296-5e584d9eb487 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:49:04 devstack sudo[102744]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-67679359-4853-45b1-9296-5e584d9eb487 Jul 10 04:49:04 devstack sudo[102744]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:49:05 devstack sudo[102744]: pam_unix(sudo:session): session closed for user root Jul 10 04:49:05 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-6656c069-5b19-483f-8507-d5911a8017ae tempest-CreateVolumesFromSourceVolumeTest-1814858877 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-67679359-4853-45b1-9296-5e584d9eb487" returned: 0 in 0.762s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:49:05 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-6656c069-5b19-483f-8507-d5911a8017ae tempest-CreateVolumesFromSourceVolumeTest-1814858877 None] Lock "cinder-quobyte-67679359-4853-45b1-9296-5e584d9eb487" released by "delete_volume" :: held 1.725s {{(pid=87444) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 04:49:05 devstack cinder-volume[87444]: DEBUG cinder.quota [None req-6656c069-5b19-483f-8507-d5911a8017ae tempest-CreateVolumesFromSourceVolumeTest-1814858877 None] Created reservations ['31371659-7925-49ba-ab2e-ccff305fede7', '28e23495-59dd-4c96-9b2b-ae8e0c593ed9', '9c1675e9-304e-4ae5-abef-f879a587e013', '9b0b2036-a3a7-4dc4-8f12-f7d3cd909d39'] {{(pid=87444) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 04:49:05 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-6656c069-5b19-483f-8507-d5911a8017ae tempest-CreateVolumesFromSourceVolumeTest-1814858877 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 04:49:05 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-6656c069-5b19-483f-8507-d5911a8017ae tempest-CreateVolumesFromSourceVolumeTest-1814858877 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 04:49:05 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-6656c069-5b19-483f-8507-d5911a8017ae tempest-CreateVolumesFromSourceVolumeTest-1814858877 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922': None} {{(pid=87444) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 04:49:05 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-6656c069-5b19-483f-8507-d5911a8017ae tempest-CreateVolumesFromSourceVolumeTest-1814858877 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922'] {{(pid=87444) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 04:49:05 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-6656c069-5b19-483f-8507-d5911a8017ae tempest-CreateVolumesFromSourceVolumeTest-1814858877 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 04:49:05 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-6656c069-5b19-483f-8507-d5911a8017ae tempest-CreateVolumesFromSourceVolumeTest-1814858877 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:49:05 devstack sudo[102747]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097 Jul 10 04:49:05 devstack sudo[102747]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:49:06 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-63ec964a-afff-4444-8cca-bcc94527dd48 tempest-TestStampPattern-1378957900 None] Acquiring lock "cinder-420cd972-7ecb-4fdb-abf1-d859698bbb94-delete_volume" by "delete_volume" {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 04:49:06 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-63ec964a-afff-4444-8cca-bcc94527dd48 tempest-TestStampPattern-1378957900 None] Lock "cinder-420cd972-7ecb-4fdb-abf1-d859698bbb94-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 04:49:06 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-d2f89365-633f-49f0-b7ac-13a0f069210d tempest-CreateVolumesFromSourceVolumeTest-1814858877 None] Acquiring lock "cinder-bd71c748-29e7-47c9-a98d-8ca9461165b8-delete_volume" by "delete_volume" {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 04:49:06 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-d2f89365-633f-49f0-b7ac-13a0f069210d tempest-CreateVolumesFromSourceVolumeTest-1814858877 None] Lock "cinder-bd71c748-29e7-47c9-a98d-8ca9461165b8-delete_volume" acquired by "delete_volume" :: waited 0.043s {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 04:49:06 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-63ec964a-afff-4444-8cca-bcc94527dd48 tempest-TestStampPattern-1378957900 None] Acquiring lock "cinder-quobyte-420cd972-7ecb-4fdb-abf1-d859698bbb94" by "delete_volume" {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 04:49:06 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-63ec964a-afff-4444-8cca-bcc94527dd48 tempest-TestStampPattern-1378957900 None] Lock "cinder-quobyte-420cd972-7ecb-4fdb-abf1-d859698bbb94" acquired by "delete_volume" :: waited 0.027s {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 04:49:06 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-d2f89365-633f-49f0-b7ac-13a0f069210d tempest-CreateVolumesFromSourceVolumeTest-1814858877 None] Acquiring lock "cinder-quobyte-bd71c748-29e7-47c9-a98d-8ca9461165b8" by "delete_volume" {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 04:49:06 devstack cinder-volume[87444]: DEBUG oslo.privsep.daemon [-] privsep: reply[13c037d4-c266-45cb-bd97-59a02eb89572]: (4, 'qcow2') {{(pid=88499) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 04:49:06 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-63ec964a-afff-4444-8cca-bcc94527dd48 tempest-TestStampPattern-1378957900 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-420cd972-7ecb-4fdb-abf1-d859698bbb94 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:49:06 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-d2f89365-633f-49f0-b7ac-13a0f069210d tempest-CreateVolumesFromSourceVolumeTest-1814858877 None] Lock "cinder-quobyte-bd71c748-29e7-47c9-a98d-8ca9461165b8" acquired by "delete_volume" :: waited 0.041s {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 04:49:06 devstack cinder-volume[87444]: DEBUG oslo.privsep.daemon [-] privsep: reply[f46fa2bc-2ee3-4a1a-a71a-e7a26577cfa1]: (4, 'qcow2') {{(pid=88499) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 04:49:06 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-d2f89365-633f-49f0-b7ac-13a0f069210d tempest-CreateVolumesFromSourceVolumeTest-1814858877 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-bd71c748-29e7-47c9-a98d-8ca9461165b8 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:49:06 devstack sudo[102749]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-420cd972-7ecb-4fdb-abf1-d859698bbb94 Jul 10 04:49:06 devstack sudo[102749]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:49:06 devstack sudo[102747]: pam_unix(sudo:session): session closed for user root Jul 10 04:49:06 devstack sudo[102750]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-bd71c748-29e7-47c9-a98d-8ca9461165b8 Jul 10 04:49:06 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-6656c069-5b19-483f-8507-d5911a8017ae tempest-CreateVolumesFromSourceVolumeTest-1814858877 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097" returned: 0 in 0.825s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:49:06 devstack sudo[102750]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:49:06 devstack cinder-volume[87444]: DEBUG cinder.manager [None req-6656c069-5b19-483f-8507-d5911a8017ae tempest-CreateVolumesFromSourceVolumeTest-1814858877 None] Notifying Schedulers of capabilities ... {{(pid=87444) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 04:49:06 devstack cinder-volume[87444]: INFO cinder.volume.manager [None req-6656c069-5b19-483f-8507-d5911a8017ae tempest-CreateVolumesFromSourceVolumeTest-1814858877 None] Deleted volume successfully. Jul 10 04:49:06 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-6656c069-5b19-483f-8507-d5911a8017ae tempest-CreateVolumesFromSourceVolumeTest-1814858877 None] Lock "cinder-67679359-4853-45b1-9296-5e584d9eb487-delete_volume" released by "delete_volume" :: held 2.831s {{(pid=87444) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 04:49:07 devstack sudo[102749]: pam_unix(sudo:session): session closed for user root Jul 10 04:49:07 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-63ec964a-afff-4444-8cca-bcc94527dd48 tempest-TestStampPattern-1378957900 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-420cd972-7ecb-4fdb-abf1-d859698bbb94" returned: 0 in 1.005s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:49:07 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-63ec964a-afff-4444-8cca-bcc94527dd48 tempest-TestStampPattern-1378957900 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-420cd972-7ecb-4fdb-abf1-d859698bbb94 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:49:07 devstack sudo[102761]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-420cd972-7ecb-4fdb-abf1-d859698bbb94 Jul 10 04:49:07 devstack sudo[102761]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:49:07 devstack sudo[102750]: pam_unix(sudo:session): session closed for user root Jul 10 04:49:07 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-d2f89365-633f-49f0-b7ac-13a0f069210d tempest-CreateVolumesFromSourceVolumeTest-1814858877 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-bd71c748-29e7-47c9-a98d-8ca9461165b8" returned: 0 in 1.094s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:49:07 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-d2f89365-633f-49f0-b7ac-13a0f069210d tempest-CreateVolumesFromSourceVolumeTest-1814858877 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-bd71c748-29e7-47c9-a98d-8ca9461165b8 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:49:07 devstack sudo[102763]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-bd71c748-29e7-47c9-a98d-8ca9461165b8 Jul 10 04:49:07 devstack sudo[102763]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:49:08 devstack sudo[102761]: pam_unix(sudo:session): session closed for user root Jul 10 04:49:08 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-63ec964a-afff-4444-8cca-bcc94527dd48 tempest-TestStampPattern-1378957900 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-420cd972-7ecb-4fdb-abf1-d859698bbb94" returned: 0 in 0.959s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:49:08 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-63ec964a-afff-4444-8cca-bcc94527dd48 tempest-TestStampPattern-1378957900 None] Lock "cinder-quobyte-420cd972-7ecb-4fdb-abf1-d859698bbb94" released by "delete_volume" :: held 2.058s {{(pid=87444) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 04:49:08 devstack cinder-volume[87444]: DEBUG cinder.quota [None req-63ec964a-afff-4444-8cca-bcc94527dd48 tempest-TestStampPattern-1378957900 None] Created reservations ['9191e260-841f-4ede-b419-64cf062af6cd', 'e4627d0e-8f76-4bb7-8ab2-29f073460245', 'f36ce7b7-ec00-4502-af24-e1c32eaaa75d', '42b11770-3c9d-4ec1-8405-b388786011a0'] {{(pid=87444) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 04:49:08 devstack sudo[102763]: pam_unix(sudo:session): session closed for user root Jul 10 04:49:08 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-d2f89365-633f-49f0-b7ac-13a0f069210d tempest-CreateVolumesFromSourceVolumeTest-1814858877 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-bd71c748-29e7-47c9-a98d-8ca9461165b8" returned: 0 in 0.952s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:49:08 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-d2f89365-633f-49f0-b7ac-13a0f069210d tempest-CreateVolumesFromSourceVolumeTest-1814858877 None] Lock "cinder-quobyte-bd71c748-29e7-47c9-a98d-8ca9461165b8" released by "delete_volume" :: held 2.118s {{(pid=87444) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 04:49:08 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-63ec964a-afff-4444-8cca-bcc94527dd48 tempest-TestStampPattern-1378957900 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 04:49:08 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-63ec964a-afff-4444-8cca-bcc94527dd48 tempest-TestStampPattern-1378957900 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 04:49:08 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-63ec964a-afff-4444-8cca-bcc94527dd48 tempest-TestStampPattern-1378957900 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922': None} {{(pid=87444) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 04:49:08 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-63ec964a-afff-4444-8cca-bcc94527dd48 tempest-TestStampPattern-1378957900 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922'] {{(pid=87444) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 04:49:08 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-63ec964a-afff-4444-8cca-bcc94527dd48 tempest-TestStampPattern-1378957900 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 04:49:08 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-63ec964a-afff-4444-8cca-bcc94527dd48 tempest-TestStampPattern-1378957900 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:49:08 devstack sudo[102767]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097 Jul 10 04:49:08 devstack sudo[102767]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:49:08 devstack cinder-volume[87444]: DEBUG cinder.quota [None req-d2f89365-633f-49f0-b7ac-13a0f069210d tempest-CreateVolumesFromSourceVolumeTest-1814858877 None] Created reservations ['9c9a29ad-90a7-43ca-880a-2f81f25f4126', '6961ca75-6728-42d5-828d-2b08be2b1c50', '0c6af259-709f-45e9-99a4-53e824dccb95', 'a362562f-3c79-479d-9cbf-f1516529ddae'] {{(pid=87444) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 04:49:08 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-d2f89365-633f-49f0-b7ac-13a0f069210d tempest-CreateVolumesFromSourceVolumeTest-1814858877 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 04:49:08 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-d2f89365-633f-49f0-b7ac-13a0f069210d tempest-CreateVolumesFromSourceVolumeTest-1814858877 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 04:49:08 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-d2f89365-633f-49f0-b7ac-13a0f069210d tempest-CreateVolumesFromSourceVolumeTest-1814858877 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922': None} {{(pid=87444) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 04:49:08 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-d2f89365-633f-49f0-b7ac-13a0f069210d tempest-CreateVolumesFromSourceVolumeTest-1814858877 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922'] {{(pid=87444) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 04:49:08 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-d2f89365-633f-49f0-b7ac-13a0f069210d tempest-CreateVolumesFromSourceVolumeTest-1814858877 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 04:49:08 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-d2f89365-633f-49f0-b7ac-13a0f069210d tempest-CreateVolumesFromSourceVolumeTest-1814858877 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:49:08 devstack sudo[102769]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097 Jul 10 04:49:08 devstack sudo[102769]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:49:09 devstack sudo[102767]: pam_unix(sudo:session): session closed for user root Jul 10 04:49:09 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-63ec964a-afff-4444-8cca-bcc94527dd48 tempest-TestStampPattern-1378957900 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097" returned: 0 in 1.070s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:49:09 devstack cinder-volume[87444]: DEBUG cinder.manager [None req-63ec964a-afff-4444-8cca-bcc94527dd48 tempest-TestStampPattern-1378957900 None] Notifying Schedulers of capabilities ... {{(pid=87444) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 04:49:09 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-bbc83fa4-b583-406b-966c-b6b173151c8e tempest-CreateVolumesFromSourceVolumeTest-1814858877 None] Acquiring lock "cinder-57c10965-f481-4be1-8188-c2ab20b5f6aa-delete_volume" by "delete_volume" {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 04:49:09 devstack cinder-volume[87444]: INFO cinder.volume.manager [None req-63ec964a-afff-4444-8cca-bcc94527dd48 tempest-TestStampPattern-1378957900 None] Deleted volume successfully. Jul 10 04:49:09 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-bbc83fa4-b583-406b-966c-b6b173151c8e tempest-CreateVolumesFromSourceVolumeTest-1814858877 None] Lock "cinder-57c10965-f481-4be1-8188-c2ab20b5f6aa-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 04:49:09 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-63ec964a-afff-4444-8cca-bcc94527dd48 tempest-TestStampPattern-1378957900 None] Lock "cinder-420cd972-7ecb-4fdb-abf1-d859698bbb94-delete_volume" released by "delete_volume" :: held 3.514s {{(pid=87444) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 04:49:09 devstack sudo[102769]: pam_unix(sudo:session): session closed for user root Jul 10 04:49:09 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-d2f89365-633f-49f0-b7ac-13a0f069210d tempest-CreateVolumesFromSourceVolumeTest-1814858877 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097" returned: 0 in 0.993s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:49:09 devstack cinder-volume[87444]: DEBUG cinder.manager [None req-d2f89365-633f-49f0-b7ac-13a0f069210d tempest-CreateVolumesFromSourceVolumeTest-1814858877 None] Notifying Schedulers of capabilities ... {{(pid=87444) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 04:49:09 devstack cinder-volume[87444]: INFO cinder.volume.manager [None req-d2f89365-633f-49f0-b7ac-13a0f069210d tempest-CreateVolumesFromSourceVolumeTest-1814858877 None] Deleted volume successfully. Jul 10 04:49:09 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-bbc83fa4-b583-406b-966c-b6b173151c8e tempest-CreateVolumesFromSourceVolumeTest-1814858877 None] Acquiring lock "cinder-quobyte-57c10965-f481-4be1-8188-c2ab20b5f6aa" by "delete_volume" {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 04:49:09 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-d2f89365-633f-49f0-b7ac-13a0f069210d tempest-CreateVolumesFromSourceVolumeTest-1814858877 None] Lock "cinder-bd71c748-29e7-47c9-a98d-8ca9461165b8-delete_volume" released by "delete_volume" :: held 3.519s {{(pid=87444) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 04:49:09 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-bbc83fa4-b583-406b-966c-b6b173151c8e tempest-CreateVolumesFromSourceVolumeTest-1814858877 None] Lock "cinder-quobyte-57c10965-f481-4be1-8188-c2ab20b5f6aa" acquired by "delete_volume" :: waited 0.024s {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 04:49:09 devstack cinder-volume[87444]: DEBUG oslo.privsep.daemon [-] privsep: reply[235b4f35-4df4-4e31-86c3-24fb4d80322b]: (4, 'qcow2') {{(pid=88499) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 04:49:09 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-bbc83fa4-b583-406b-966c-b6b173151c8e tempest-CreateVolumesFromSourceVolumeTest-1814858877 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-57c10965-f481-4be1-8188-c2ab20b5f6aa {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:49:10 devstack sudo[102773]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-57c10965-f481-4be1-8188-c2ab20b5f6aa Jul 10 04:49:10 devstack sudo[102773]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:49:10 devstack sudo[102773]: pam_unix(sudo:session): session closed for user root Jul 10 04:49:10 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-bbc83fa4-b583-406b-966c-b6b173151c8e tempest-CreateVolumesFromSourceVolumeTest-1814858877 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-57c10965-f481-4be1-8188-c2ab20b5f6aa" returned: 0 in 0.903s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:49:10 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-bbc83fa4-b583-406b-966c-b6b173151c8e tempest-CreateVolumesFromSourceVolumeTest-1814858877 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-57c10965-f481-4be1-8188-c2ab20b5f6aa {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:49:10 devstack sudo[102778]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-57c10965-f481-4be1-8188-c2ab20b5f6aa Jul 10 04:49:10 devstack sudo[102778]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:49:11 devstack sudo[102778]: pam_unix(sudo:session): session closed for user root Jul 10 04:49:11 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-bbc83fa4-b583-406b-966c-b6b173151c8e tempest-CreateVolumesFromSourceVolumeTest-1814858877 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-57c10965-f481-4be1-8188-c2ab20b5f6aa" returned: 0 in 0.816s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:49:11 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-bbc83fa4-b583-406b-966c-b6b173151c8e tempest-CreateVolumesFromSourceVolumeTest-1814858877 None] Lock "cinder-quobyte-57c10965-f481-4be1-8188-c2ab20b5f6aa" released by "delete_volume" :: held 1.776s {{(pid=87444) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 04:49:11 devstack cinder-volume[87444]: DEBUG cinder.quota [None req-bbc83fa4-b583-406b-966c-b6b173151c8e tempest-CreateVolumesFromSourceVolumeTest-1814858877 None] Created reservations ['d4812547-411c-4a30-8f6b-988fbe3830da', 'be8a6661-5710-475a-9555-9f907de6cf79', '5b3ed3a8-b055-4648-8e61-d4ed1d83ceeb', '65b7a4cb-1d29-417e-bd70-2835c0bdf669'] {{(pid=87444) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 04:49:11 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-bbc83fa4-b583-406b-966c-b6b173151c8e tempest-CreateVolumesFromSourceVolumeTest-1814858877 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 04:49:11 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-bbc83fa4-b583-406b-966c-b6b173151c8e tempest-CreateVolumesFromSourceVolumeTest-1814858877 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 04:49:11 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-bbc83fa4-b583-406b-966c-b6b173151c8e tempest-CreateVolumesFromSourceVolumeTest-1814858877 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922': None} {{(pid=87444) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 04:49:11 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-bbc83fa4-b583-406b-966c-b6b173151c8e tempest-CreateVolumesFromSourceVolumeTest-1814858877 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922'] {{(pid=87444) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 04:49:11 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-bbc83fa4-b583-406b-966c-b6b173151c8e tempest-CreateVolumesFromSourceVolumeTest-1814858877 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 04:49:11 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-bbc83fa4-b583-406b-966c-b6b173151c8e tempest-CreateVolumesFromSourceVolumeTest-1814858877 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:49:11 devstack sudo[102781]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097 Jul 10 04:49:11 devstack sudo[102781]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:49:12 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-70c6fe19-f54e-4d5c-a8d7-141a11637084 tempest-CreateVolumesFromSourceVolumeTest-1814858877 None] Acquiring lock "cinder-6f36f1cd-0829-461c-8cb3-a30c775109be-delete_volume" by "delete_volume" {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 04:49:12 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-70c6fe19-f54e-4d5c-a8d7-141a11637084 tempest-CreateVolumesFromSourceVolumeTest-1814858877 None] Lock "cinder-6f36f1cd-0829-461c-8cb3-a30c775109be-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 04:49:12 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-70c6fe19-f54e-4d5c-a8d7-141a11637084 tempest-CreateVolumesFromSourceVolumeTest-1814858877 None] Acquiring lock "cinder-quobyte-6f36f1cd-0829-461c-8cb3-a30c775109be" by "delete_volume" {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 04:49:12 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-70c6fe19-f54e-4d5c-a8d7-141a11637084 tempest-CreateVolumesFromSourceVolumeTest-1814858877 None] Lock "cinder-quobyte-6f36f1cd-0829-461c-8cb3-a30c775109be" acquired by "delete_volume" :: waited 0.025s {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 04:49:12 devstack cinder-volume[87444]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f7bc858-12cd-4239-927c-e978633934f1]: (4, 'qcow2') {{(pid=88499) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 04:49:12 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-70c6fe19-f54e-4d5c-a8d7-141a11637084 tempest-CreateVolumesFromSourceVolumeTest-1814858877 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-6f36f1cd-0829-461c-8cb3-a30c775109be {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:49:12 devstack sudo[102783]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-6f36f1cd-0829-461c-8cb3-a30c775109be Jul 10 04:49:12 devstack sudo[102783]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:49:12 devstack sudo[102781]: pam_unix(sudo:session): session closed for user root Jul 10 04:49:12 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-bbc83fa4-b583-406b-966c-b6b173151c8e tempest-CreateVolumesFromSourceVolumeTest-1814858877 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097" returned: 0 in 0.933s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:49:12 devstack cinder-volume[87444]: DEBUG cinder.manager [None req-bbc83fa4-b583-406b-966c-b6b173151c8e tempest-CreateVolumesFromSourceVolumeTest-1814858877 None] Notifying Schedulers of capabilities ... {{(pid=87444) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 04:49:12 devstack cinder-volume[87444]: INFO cinder.volume.manager [None req-bbc83fa4-b583-406b-966c-b6b173151c8e tempest-CreateVolumesFromSourceVolumeTest-1814858877 None] Deleted volume successfully. Jul 10 04:49:12 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-bbc83fa4-b583-406b-966c-b6b173151c8e tempest-CreateVolumesFromSourceVolumeTest-1814858877 None] Lock "cinder-57c10965-f481-4be1-8188-c2ab20b5f6aa-delete_volume" released by "delete_volume" :: held 2.992s {{(pid=87444) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 04:49:13 devstack sudo[102783]: pam_unix(sudo:session): session closed for user root Jul 10 04:49:13 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-70c6fe19-f54e-4d5c-a8d7-141a11637084 tempest-CreateVolumesFromSourceVolumeTest-1814858877 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-6f36f1cd-0829-461c-8cb3-a30c775109be" returned: 0 in 0.963s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:49:13 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-70c6fe19-f54e-4d5c-a8d7-141a11637084 tempest-CreateVolumesFromSourceVolumeTest-1814858877 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-6f36f1cd-0829-461c-8cb3-a30c775109be {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:49:13 devstack sudo[102791]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-6f36f1cd-0829-461c-8cb3-a30c775109be Jul 10 04:49:13 devstack sudo[102791]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:49:13 devstack sudo[102791]: pam_unix(sudo:session): session closed for user root Jul 10 04:49:13 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-70c6fe19-f54e-4d5c-a8d7-141a11637084 tempest-CreateVolumesFromSourceVolumeTest-1814858877 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-6f36f1cd-0829-461c-8cb3-a30c775109be" returned: 0 in 0.691s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:49:13 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-70c6fe19-f54e-4d5c-a8d7-141a11637084 tempest-CreateVolumesFromSourceVolumeTest-1814858877 None] Lock "cinder-quobyte-6f36f1cd-0829-461c-8cb3-a30c775109be" released by "delete_volume" :: held 1.707s {{(pid=87444) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 04:49:13 devstack cinder-volume[87444]: DEBUG cinder.quota [None req-70c6fe19-f54e-4d5c-a8d7-141a11637084 tempest-CreateVolumesFromSourceVolumeTest-1814858877 None] Created reservations ['2e4d2fcc-b5b0-4731-abbb-a99b62934ef7', '85932e83-8251-48e7-b47f-d418c8de8a16', '30528b07-9685-4809-86f1-5e91271d82aa', '5d4e9fa6-b206-4c76-b72a-86444826aa53'] {{(pid=87444) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 04:49:14 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-70c6fe19-f54e-4d5c-a8d7-141a11637084 tempest-CreateVolumesFromSourceVolumeTest-1814858877 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 04:49:14 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-70c6fe19-f54e-4d5c-a8d7-141a11637084 tempest-CreateVolumesFromSourceVolumeTest-1814858877 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 04:49:14 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-70c6fe19-f54e-4d5c-a8d7-141a11637084 tempest-CreateVolumesFromSourceVolumeTest-1814858877 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922': None} {{(pid=87444) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 04:49:14 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-70c6fe19-f54e-4d5c-a8d7-141a11637084 tempest-CreateVolumesFromSourceVolumeTest-1814858877 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922'] {{(pid=87444) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 04:49:14 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-70c6fe19-f54e-4d5c-a8d7-141a11637084 tempest-CreateVolumesFromSourceVolumeTest-1814858877 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 04:49:14 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-70c6fe19-f54e-4d5c-a8d7-141a11637084 tempest-CreateVolumesFromSourceVolumeTest-1814858877 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:49:14 devstack sudo[102795]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097 Jul 10 04:49:14 devstack sudo[102795]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:49:14 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-8b79a349-347c-4434-ad8d-327adef356ca tempest-CreateVolumesFromSourceVolumeTest-1814858877 None] Acquiring lock "cinder-f6c15956-a911-4053-b6e0-6d57c17d8a8c-delete_volume" by "delete_volume" {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 04:49:14 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-8b79a349-347c-4434-ad8d-327adef356ca tempest-CreateVolumesFromSourceVolumeTest-1814858877 None] Lock "cinder-f6c15956-a911-4053-b6e0-6d57c17d8a8c-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 04:49:14 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-8b79a349-347c-4434-ad8d-327adef356ca tempest-CreateVolumesFromSourceVolumeTest-1814858877 None] Acquiring lock "cinder-quobyte-f6c15956-a911-4053-b6e0-6d57c17d8a8c" by "delete_volume" {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 04:49:14 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-8b79a349-347c-4434-ad8d-327adef356ca tempest-CreateVolumesFromSourceVolumeTest-1814858877 None] Lock "cinder-quobyte-f6c15956-a911-4053-b6e0-6d57c17d8a8c" acquired by "delete_volume" :: waited 0.023s {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 04:49:14 devstack cinder-volume[87444]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd75547b-9b13-45b1-a08a-93cf9e40db84]: (4, 'qcow2') {{(pid=88499) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 04:49:14 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-8b79a349-347c-4434-ad8d-327adef356ca tempest-CreateVolumesFromSourceVolumeTest-1814858877 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-f6c15956-a911-4053-b6e0-6d57c17d8a8c {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:49:14 devstack sudo[102797]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-f6c15956-a911-4053-b6e0-6d57c17d8a8c Jul 10 04:49:14 devstack sudo[102797]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:49:14 devstack sudo[102795]: pam_unix(sudo:session): session closed for user root Jul 10 04:49:14 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-70c6fe19-f54e-4d5c-a8d7-141a11637084 tempest-CreateVolumesFromSourceVolumeTest-1814858877 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097" returned: 0 in 0.820s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:49:14 devstack cinder-volume[87444]: DEBUG cinder.manager [None req-70c6fe19-f54e-4d5c-a8d7-141a11637084 tempest-CreateVolumesFromSourceVolumeTest-1814858877 None] Notifying Schedulers of capabilities ... {{(pid=87444) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 04:49:14 devstack cinder-volume[87444]: INFO cinder.volume.manager [None req-70c6fe19-f54e-4d5c-a8d7-141a11637084 tempest-CreateVolumesFromSourceVolumeTest-1814858877 None] Deleted volume successfully. Jul 10 04:49:14 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-70c6fe19-f54e-4d5c-a8d7-141a11637084 tempest-CreateVolumesFromSourceVolumeTest-1814858877 None] Lock "cinder-6f36f1cd-0829-461c-8cb3-a30c775109be-delete_volume" released by "delete_volume" :: held 2.829s {{(pid=87444) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 04:49:15 devstack sudo[102797]: pam_unix(sudo:session): session closed for user root Jul 10 04:49:15 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-8b79a349-347c-4434-ad8d-327adef356ca tempest-CreateVolumesFromSourceVolumeTest-1814858877 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-f6c15956-a911-4053-b6e0-6d57c17d8a8c" returned: 0 in 1.024s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:49:15 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-8b79a349-347c-4434-ad8d-327adef356ca tempest-CreateVolumesFromSourceVolumeTest-1814858877 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-f6c15956-a911-4053-b6e0-6d57c17d8a8c {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:49:15 devstack sudo[102803]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-f6c15956-a911-4053-b6e0-6d57c17d8a8c Jul 10 04:49:15 devstack sudo[102803]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:49:16 devstack sudo[102803]: pam_unix(sudo:session): session closed for user root Jul 10 04:49:16 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-8b79a349-347c-4434-ad8d-327adef356ca tempest-CreateVolumesFromSourceVolumeTest-1814858877 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-f6c15956-a911-4053-b6e0-6d57c17d8a8c" returned: 0 in 0.859s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:49:16 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-8b79a349-347c-4434-ad8d-327adef356ca tempest-CreateVolumesFromSourceVolumeTest-1814858877 None] Lock "cinder-quobyte-f6c15956-a911-4053-b6e0-6d57c17d8a8c" released by "delete_volume" :: held 1.945s {{(pid=87444) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 04:49:16 devstack cinder-volume[87444]: DEBUG cinder.quota [None req-8b79a349-347c-4434-ad8d-327adef356ca tempest-CreateVolumesFromSourceVolumeTest-1814858877 None] Created reservations ['b2754686-696b-4ca9-89b3-2a77bd141b10', 'aad482e4-ce83-46ba-8d11-fce8bcd568f3', '515453d9-1511-49ef-831b-a938a35b9837', '19c05a5a-ae2c-46e9-b5f1-1177015da2aa'] {{(pid=87444) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 04:49:16 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-8b79a349-347c-4434-ad8d-327adef356ca tempest-CreateVolumesFromSourceVolumeTest-1814858877 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 04:49:16 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-8b79a349-347c-4434-ad8d-327adef356ca tempest-CreateVolumesFromSourceVolumeTest-1814858877 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 04:49:16 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-8b79a349-347c-4434-ad8d-327adef356ca tempest-CreateVolumesFromSourceVolumeTest-1814858877 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922': None} {{(pid=87444) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 04:49:16 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-8b79a349-347c-4434-ad8d-327adef356ca tempest-CreateVolumesFromSourceVolumeTest-1814858877 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922'] {{(pid=87444) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 04:49:16 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-8b79a349-347c-4434-ad8d-327adef356ca tempest-CreateVolumesFromSourceVolumeTest-1814858877 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 04:49:16 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-8b79a349-347c-4434-ad8d-327adef356ca tempest-CreateVolumesFromSourceVolumeTest-1814858877 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:49:16 devstack sudo[102807]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097 Jul 10 04:49:16 devstack sudo[102807]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:49:17 devstack sudo[102807]: pam_unix(sudo:session): session closed for user root Jul 10 04:49:17 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-8b79a349-347c-4434-ad8d-327adef356ca tempest-CreateVolumesFromSourceVolumeTest-1814858877 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097" returned: 0 in 0.809s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:49:17 devstack cinder-volume[87444]: DEBUG cinder.manager [None req-8b79a349-347c-4434-ad8d-327adef356ca tempest-CreateVolumesFromSourceVolumeTest-1814858877 None] Notifying Schedulers of capabilities ... {{(pid=87444) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 04:49:17 devstack cinder-volume[87444]: INFO cinder.volume.manager [None req-8b79a349-347c-4434-ad8d-327adef356ca tempest-CreateVolumesFromSourceVolumeTest-1814858877 None] Deleted volume successfully. Jul 10 04:49:17 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-8b79a349-347c-4434-ad8d-327adef356ca tempest-CreateVolumesFromSourceVolumeTest-1814858877 None] Lock "cinder-f6c15956-a911-4053-b6e0-6d57c17d8a8c-delete_volume" released by "delete_volume" :: held 3.048s {{(pid=87444) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 04:49:26 devstack cinder-volume[87444]: DEBUG dbcounter [-] [87444] Writing DB stats cinder:SELECT=126,cinder:UPDATE=184,cinder:INSERT=41,cinder:DELETE=13 {{(pid=87444) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 10 04:49:27 devstack cinder-volume[87444]: DEBUG dbcounter [-] [87444] Writing DB stats cinder:SELECT=134,cinder:UPDATE=164,cinder:INSERT=39,cinder:DELETE=15 {{(pid=87444) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 10 04:49:30 devstack cinder-volume[87444]: DEBUG cinder.volume.flows.manager.create_volume [None req-6e2b52b3-b01e-4b9a-9153-88b954daeb78 tempest-ProjectReaderTests-820994271 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87444) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 04:49:30 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-6e2b52b3-b01e-4b9a-9153-88b954daeb78 tempest-ProjectReaderTests-820994271 None] Flow 'volume_create_manager' (c66071a2-e5ff-48f3-ac76-8dbdcdaa53ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 04:49:30 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-6e2b52b3-b01e-4b9a-9153-88b954daeb78 tempest-ProjectReaderTests-820994271 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a584d2ba-aecb-4f42-b1b5-f362f1576b3c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:49:30 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-6e2b52b3-b01e-4b9a-9153-88b954daeb78 tempest-ProjectReaderTests-820994271 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a584d2ba-aecb-4f42-b1b5-f362f1576b3c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T02:49:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1130275181',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=78529426-ffb6-4aff-acbe-3b71453d05e5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='470e3d956a5245208bd3ef78f1cb00e6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T02:49:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T02:49:30Z,use_quota=True,user_id='f8791f162a0f41a9a4ae6f738813098e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(317e369e-1e06-434d-ae95-a335f0e6c903),volume_type_id=317e369e-1e06-434d-ae95-a335f0e6c903)' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:49:30 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-6e2b52b3-b01e-4b9a-9153-88b954daeb78 tempest-ProjectReaderTests-820994271 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0d44ef7e-c382-4907-9a40-efb1fa4a696d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:49:30 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-6e2b52b3-b01e-4b9a-9153-88b954daeb78 tempest-ProjectReaderTests-820994271 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0d44ef7e-c382-4907-9a40-efb1fa4a696d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:49:30 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-6e2b52b3-b01e-4b9a-9153-88b954daeb78 tempest-ProjectReaderTests-820994271 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5f54c35b-2691-47da-9923-d93e917dadd7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:49:30 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-6e2b52b3-b01e-4b9a-9153-88b954daeb78 tempest-ProjectReaderTests-820994271 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5f54c35b-2691-47da-9923-d93e917dadd7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '78529426-ffb6-4aff-acbe-3b71453d05e5', 'volume_name': 'volume-78529426-ffb6-4aff-acbe-3b71453d05e5', 'volume_size': 1}' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:49:30 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-6e2b52b3-b01e-4b9a-9153-88b954daeb78 tempest-ProjectReaderTests-820994271 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4fe8a117-871c-42b2-a36d-baf17e79bacc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:49:30 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-6e2b52b3-b01e-4b9a-9153-88b954daeb78 tempest-ProjectReaderTests-820994271 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4fe8a117-871c-42b2-a36d-baf17e79bacc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:49:30 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-6e2b52b3-b01e-4b9a-9153-88b954daeb78 tempest-ProjectReaderTests-820994271 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dc21df8a-613c-4cbe-84b8-4aa83153cd88) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:49:30 devstack cinder-volume[87444]: INFO cinder.volume.flows.manager.create_volume [None req-6e2b52b3-b01e-4b9a-9153-88b954daeb78 tempest-ProjectReaderTests-820994271 None] Volume 78529426-ffb6-4aff-acbe-3b71453d05e5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-78529426-ffb6-4aff-acbe-3b71453d05e5', 'volume_size': 1} Jul 10 04:49:30 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-6e2b52b3-b01e-4b9a-9153-88b954daeb78 tempest-ProjectReaderTests-820994271 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 04:49:30 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-6e2b52b3-b01e-4b9a-9153-88b954daeb78 tempest-ProjectReaderTests-820994271 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 04:49:30 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-6e2b52b3-b01e-4b9a-9153-88b954daeb78 tempest-ProjectReaderTests-820994271 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T02:49:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1130275181',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=78529426-ffb6-4aff-acbe-3b71453d05e5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='470e3d956a5245208bd3ef78f1cb00e6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T02:49:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T02:49:30Z,use_quota=True,user_id='f8791f162a0f41a9a4ae6f738813098e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(317e369e-1e06-434d-ae95-a335f0e6c903),volume_type_id=317e369e-1e06-434d-ae95-a335f0e6c903)}" {{(pid=87444) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 04:49:30 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.remotefs [None req-6e2b52b3-b01e-4b9a-9153-88b954daeb78 tempest-ProjectReaderTests-820994271 None] Creating volume 78529426-ffb6-4aff-acbe-3b71453d05e5 {{(pid=87444) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 04:49:30 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-6e2b52b3-b01e-4b9a-9153-88b954daeb78 tempest-ProjectReaderTests-820994271 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 04:49:30 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-6e2b52b3-b01e-4b9a-9153-88b954daeb78 tempest-ProjectReaderTests-820994271 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 04:49:30 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-6e2b52b3-b01e-4b9a-9153-88b954daeb78 tempest-ProjectReaderTests-820994271 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922': None} {{(pid=87444) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 04:49:30 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-6e2b52b3-b01e-4b9a-9153-88b954daeb78 tempest-ProjectReaderTests-820994271 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922'] {{(pid=87444) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 04:49:30 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-6e2b52b3-b01e-4b9a-9153-88b954daeb78 tempest-ProjectReaderTests-820994271 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 04:49:30 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-6e2b52b3-b01e-4b9a-9153-88b954daeb78 tempest-ProjectReaderTests-820994271 None] Selected osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922 as target Quobyte volume. {{(pid=87444) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 04:49:30 devstack cinder-volume[87444]: INFO cinder.volume.drivers.remotefs [None req-6e2b52b3-b01e-4b9a-9153-88b954daeb78 tempest-ProjectReaderTests-820994271 None] casted to osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922 Jul 10 04:49:30 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-6e2b52b3-b01e-4b9a-9153-88b954daeb78 tempest-ProjectReaderTests-820994271 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-78529426-ffb6-4aff-acbe-3b71453d05e5 1073741824 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:49:30 devstack sudo[102815]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-78529426-ffb6-4aff-acbe-3b71453d05e5 1073741824 Jul 10 04:49:30 devstack sudo[102815]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:49:31 devstack sudo[102815]: pam_unix(sudo:session): session closed for user root Jul 10 04:49:31 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-6e2b52b3-b01e-4b9a-9153-88b954daeb78 tempest-ProjectReaderTests-820994271 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-78529426-ffb6-4aff-acbe-3b71453d05e5 1073741824" returned: 0 in 1.076s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:49:31 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-6e2b52b3-b01e-4b9a-9153-88b954daeb78 tempest-ProjectReaderTests-820994271 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-78529426-ffb6-4aff-acbe-3b71453d05e5 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:49:31 devstack sudo[102821]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-78529426-ffb6-4aff-acbe-3b71453d05e5 Jul 10 04:49:31 devstack sudo[102821]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:49:32 devstack sudo[102821]: pam_unix(sudo:session): session closed for user root Jul 10 04:49:32 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-6e2b52b3-b01e-4b9a-9153-88b954daeb78 tempest-ProjectReaderTests-820994271 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-78529426-ffb6-4aff-acbe-3b71453d05e5" returned: 0 in 0.983s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:49:32 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-6e2b52b3-b01e-4b9a-9153-88b954daeb78 tempest-ProjectReaderTests-820994271 None] <== create_volume: return (2112ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922'} {{(pid=87444) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 04:49:32 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-6e2b52b3-b01e-4b9a-9153-88b954daeb78 tempest-ProjectReaderTests-820994271 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.117s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 04:49:32 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-6e2b52b3-b01e-4b9a-9153-88b954daeb78 tempest-ProjectReaderTests-820994271 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dc21df8a-613c-4cbe-84b8-4aa83153cd88) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-78529426-ffb6-4aff-acbe-3b71453d05e5', 'volume_size': 1}' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:49:32 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-6e2b52b3-b01e-4b9a-9153-88b954daeb78 tempest-ProjectReaderTests-820994271 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (592408b2-e7a3-42fd-b8bb-a2ee6f14bfec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:49:32 devstack cinder-volume[87444]: INFO cinder.volume.flows.manager.create_volume [None req-6e2b52b3-b01e-4b9a-9153-88b954daeb78 tempest-ProjectReaderTests-820994271 None] Volume volume-78529426-ffb6-4aff-acbe-3b71453d05e5 (78529426-ffb6-4aff-acbe-3b71453d05e5): created successfully Jul 10 04:49:32 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-6e2b52b3-b01e-4b9a-9153-88b954daeb78 tempest-ProjectReaderTests-820994271 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (592408b2-e7a3-42fd-b8bb-a2ee6f14bfec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:49:32 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-6e2b52b3-b01e-4b9a-9153-88b954daeb78 tempest-ProjectReaderTests-820994271 None] Flow 'volume_create_manager' (c66071a2-e5ff-48f3-ac76-8dbdcdaa53ea) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87444) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 04:49:32 devstack cinder-volume[87444]: INFO cinder.volume.manager [None req-6e2b52b3-b01e-4b9a-9153-88b954daeb78 tempest-ProjectReaderTests-820994271 None] Created volume successfully. Jul 10 04:49:33 devstack cinder-volume[87444]: DEBUG oslo_service.periodic_task [None req-01f0ce3e-6850-4e14-881d-e40d3c4ad6e5 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87444) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 10 04:49:33 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-01f0ce3e-6850-4e14-881d-e40d3c4ad6e5 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 04:49:33 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-01f0ce3e-6850-4e14-881d-e40d3c4ad6e5 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 04:49:33 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-01f0ce3e-6850-4e14-881d-e40d3c4ad6e5 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922': None} {{(pid=87444) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 04:49:33 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-01f0ce3e-6850-4e14-881d-e40d3c4ad6e5 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922'] {{(pid=87444) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 04:49:33 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-01f0ce3e-6850-4e14-881d-e40d3c4ad6e5 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 04:49:33 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-01f0ce3e-6850-4e14-881d-e40d3c4ad6e5 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:49:33 devstack sudo[102824]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097 Jul 10 04:49:33 devstack sudo[102824]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:49:33 devstack sudo[102824]: pam_unix(sudo:session): session closed for user root Jul 10 04:49:33 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-01f0ce3e-6850-4e14-881d-e40d3c4ad6e5 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097" returned: 0 in 0.851s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:49:33 devstack cinder-volume[87444]: DEBUG cinder.manager [None req-01f0ce3e-6850-4e14-881d-e40d3c4ad6e5 None None] Notifying Schedulers of capabilities ... {{(pid=87444) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 04:49:33 devstack cinder-volume[87444]: DEBUG oslo_service.periodic_task [None req-01f0ce3e-6850-4e14-881d-e40d3c4ad6e5 None None] Running periodic task VolumeManager._thread_info {{(pid=87444) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 10 04:49:33 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-01f0ce3e-6850-4e14-881d-e40d3c4ad6e5 None None] thread count: 28 {{(pid=87444) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 10 04:49:33 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-01f0ce3e-6850-4e14-881d-e40d3c4ad6e5 None None] thread info: [<_MainThread(MainThread, started 126839257915520)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87444) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 10 04:49:34 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-8b8b0090-93c3-48ec-be41-86926ebee0a2 tempest-ProjectReaderTests-820994271 None] Acquiring lock "cinder-78529426-ffb6-4aff-acbe-3b71453d05e5-delete_volume" by "delete_volume" {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 04:49:34 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-8b8b0090-93c3-48ec-be41-86926ebee0a2 tempest-ProjectReaderTests-820994271 None] Lock "cinder-78529426-ffb6-4aff-acbe-3b71453d05e5-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 04:49:34 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-8b8b0090-93c3-48ec-be41-86926ebee0a2 tempest-ProjectReaderTests-820994271 None] Acquiring lock "cinder-quobyte-78529426-ffb6-4aff-acbe-3b71453d05e5" by "delete_volume" {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 04:49:34 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-8b8b0090-93c3-48ec-be41-86926ebee0a2 tempest-ProjectReaderTests-820994271 None] Lock "cinder-quobyte-78529426-ffb6-4aff-acbe-3b71453d05e5" acquired by "delete_volume" :: waited 0.022s {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 04:49:34 devstack cinder-volume[87444]: DEBUG cinder.volume.flows.manager.create_volume [None req-3242b1fe-7a17-4ca7-a5a7-7916483b264f tempest-VolumeAndVolumeTypeFromImageTest-382088631 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87444) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 04:49:34 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-3242b1fe-7a17-4ca7-a5a7-7916483b264f tempest-VolumeAndVolumeTypeFromImageTest-382088631 None] Flow 'volume_create_manager' (8320762d-5df0-40f0-be56-c9456f557515) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 04:49:34 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-3242b1fe-7a17-4ca7-a5a7-7916483b264f tempest-VolumeAndVolumeTypeFromImageTest-382088631 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4cf87346-e5d9-4189-a0c7-843008211648) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:49:34 devstack cinder-volume[87444]: DEBUG oslo.privsep.daemon [-] privsep: reply[7acf5e1a-eded-46ff-90a5-c349303387ed]: (4, 'qcow2') {{(pid=88499) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 04:49:34 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-8b8b0090-93c3-48ec-be41-86926ebee0a2 tempest-ProjectReaderTests-820994271 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-78529426-ffb6-4aff-acbe-3b71453d05e5 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:49:34 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-3242b1fe-7a17-4ca7-a5a7-7916483b264f tempest-VolumeAndVolumeTypeFromImageTest-382088631 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4cf87346-e5d9-4189-a0c7-843008211648) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T02:49:34Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2488f7a8-ee5c-4619-9699-35e98c194a03,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4e0dfe5ed0a649e1b0382f82c6477510',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T02:49:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T02:49:34Z,use_quota=True,user_id='69c6c5cf459648169a8761f65b88512f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(508b4066-a959-40ca-ad6b-61274b71dfdc),volume_type_id=508b4066-a959-40ca-ad6b-61274b71dfdc)' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:49:34 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-3242b1fe-7a17-4ca7-a5a7-7916483b264f tempest-VolumeAndVolumeTypeFromImageTest-382088631 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1edb6061-f7dd-4026-9f90-149d7a0187ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:49:34 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-3242b1fe-7a17-4ca7-a5a7-7916483b264f tempest-VolumeAndVolumeTypeFromImageTest-382088631 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1edb6061-f7dd-4026-9f90-149d7a0187ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:49:34 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-3242b1fe-7a17-4ca7-a5a7-7916483b264f tempest-VolumeAndVolumeTypeFromImageTest-382088631 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (490596e9-3c07-4033-9aea-bb2bf02ff2c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:49:34 devstack cinder-volume[87444]: DEBUG cinder.image.glance [None req-3242b1fe-7a17-4ca7-a5a7-7916483b264f tempest-VolumeAndVolumeTypeFromImageTest-382088631 None] Creating Keystone auth plugin from conf {{(pid=87444) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jul 10 04:49:34 devstack sudo[102828]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-78529426-ffb6-4aff-acbe-3b71453d05e5 Jul 10 04:49:34 devstack sudo[102828]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:49:35 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-3242b1fe-7a17-4ca7-a5a7-7916483b264f tempest-VolumeAndVolumeTypeFromImageTest-382088631 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (490596e9-3c07-4033-9aea-bb2bf02ff2c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '2488f7a8-ee5c-4619-9699-35e98c194a03', 'volume_name': 'volume-2488f7a8-ee5c-4619-9699-35e98c194a03', 'volume_size': 1, 'image_id': '476ea92a-bf56-4e73-a1b0-bfdd1a0c86ec', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/476ea92a-bf56-4e73-a1b0-bfdd1a0c86ec', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '80a47fa462b8e5765206371866e5910b', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '4e0dfe5ed0a649e1b0382f82c6477510', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '99ffd30e1be620ad030985581c986d69b06af921439bb7f395466f90ffd8be109df5f5738aa4ed9a1c81a71c68fdc80389c034b464fb03676cf42f72433df429', 'id': '476ea92a-bf56-4e73-a1b0-bfdd1a0c86ec', 'created_at': datetime.datetime(2026, 7, 10, 2, 49, 31, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 10, 2, 49, 33, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/476ea92a-bf56-4e73-a1b0-bfdd1a0c86ec/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:49:35 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-3242b1fe-7a17-4ca7-a5a7-7916483b264f tempest-VolumeAndVolumeTypeFromImageTest-382088631 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (728bcf1f-ca91-4d10-8b65-885eeae96b20) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:49:35 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-3242b1fe-7a17-4ca7-a5a7-7916483b264f tempest-VolumeAndVolumeTypeFromImageTest-382088631 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (728bcf1f-ca91-4d10-8b65-885eeae96b20) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:49:35 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-3242b1fe-7a17-4ca7-a5a7-7916483b264f tempest-VolumeAndVolumeTypeFromImageTest-382088631 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (218a3e7f-4f6e-44f8-b8c3-bd2dbb40a336) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:49:35 devstack cinder-volume[87444]: INFO cinder.volume.flows.manager.create_volume [None req-3242b1fe-7a17-4ca7-a5a7-7916483b264f tempest-VolumeAndVolumeTypeFromImageTest-382088631 None] Volume 2488f7a8-ee5c-4619-9699-35e98c194a03: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-2488f7a8-ee5c-4619-9699-35e98c194a03', 'volume_size': 1, 'image_id': '476ea92a-bf56-4e73-a1b0-bfdd1a0c86ec', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/476ea92a-bf56-4e73-a1b0-bfdd1a0c86ec', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '80a47fa462b8e5765206371866e5910b', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '4e0dfe5ed0a649e1b0382f82c6477510', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '99ffd30e1be620ad030985581c986d69b06af921439bb7f395466f90ffd8be109df5f5738aa4ed9a1c81a71c68fdc80389c034b464fb03676cf42f72433df429', 'id': '476ea92a-bf56-4e73-a1b0-bfdd1a0c86ec', 'created_at': datetime.datetime(2026, 7, 10, 2, 49, 31, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 10, 2, 49, 33, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/476ea92a-bf56-4e73-a1b0-bfdd1a0c86ec/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': } Jul 10 04:49:35 devstack cinder-volume[87444]: DEBUG cinder.volume.flows.manager.create_volume [None req-3242b1fe-7a17-4ca7-a5a7-7916483b264f tempest-VolumeAndVolumeTypeFromImageTest-382088631 None] Trying to clone 2488f7a8-ee5c-4619-9699-35e98c194a03 from image 476ea92a-bf56-4e73-a1b0-bfdd1a0c86ec at location (None, [{'url': 'file:///opt/stack/data/glance/images/476ea92a-bf56-4e73-a1b0-bfdd1a0c86ec', 'metadata': {}}]). {{(pid=87444) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jul 10 04:49:35 devstack cinder-volume[87444]: DEBUG cinder.volume.flows.manager.create_volume [None req-6f6ffb34-f084-481d-a11b-d5c28bf9d2b2 tempest-TestShelveInstance-1751178727 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87444) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 04:49:35 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-6f6ffb34-f084-481d-a11b-d5c28bf9d2b2 tempest-TestShelveInstance-1751178727 None] Flow 'volume_create_manager' (e9bbe212-ef58-4c9f-a3db-dea8d555e053) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 04:49:35 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-6f6ffb34-f084-481d-a11b-d5c28bf9d2b2 tempest-TestShelveInstance-1751178727 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (26b0a9f5-3d58-4b35-9b0b-d034ada75b4d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:49:35 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-6f6ffb34-f084-481d-a11b-d5c28bf9d2b2 tempest-TestShelveInstance-1751178727 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (26b0a9f5-3d58-4b35-9b0b-d034ada75b4d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T02:49:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-235517543',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=42c78259-797d-4508-807c-77c3d325d344,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='58175c9c22ca426886fb96226308122a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T02:49:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T02:49:35Z,use_quota=True,user_id='df7b496a5dd145c28ae8b656a6b3d26e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(317e369e-1e06-434d-ae95-a335f0e6c903),volume_type_id=317e369e-1e06-434d-ae95-a335f0e6c903)' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:49:35 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-6f6ffb34-f084-481d-a11b-d5c28bf9d2b2 tempest-TestShelveInstance-1751178727 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (baa0f6b5-2e21-4313-b530-7c1f5d81426a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:49:35 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-6f6ffb34-f084-481d-a11b-d5c28bf9d2b2 tempest-TestShelveInstance-1751178727 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (baa0f6b5-2e21-4313-b530-7c1f5d81426a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:49:35 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-6f6ffb34-f084-481d-a11b-d5c28bf9d2b2 tempest-TestShelveInstance-1751178727 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (43bd925d-711e-4933-aaca-5d715106a021) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:49:35 devstack cinder-volume[87444]: DEBUG cinder.image.glance [None req-6f6ffb34-f084-481d-a11b-d5c28bf9d2b2 tempest-TestShelveInstance-1751178727 None] Creating Keystone auth plugin from conf {{(pid=87444) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jul 10 04:49:35 devstack cinder-volume[87444]: DEBUG cinder.image.image_utils [None req-3242b1fe-7a17-4ca7-a5a7-7916483b264f tempest-VolumeAndVolumeTypeFromImageTest-382088631 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_476ea92a-bf56-4e73-a1b0-bfdd1a0c86ec_zs5cj6jzdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=87444) fetch /opt/stack/cinder/cinder/image/image_utils.py:765}} Jul 10 04:49:35 devstack cinder-volume[87444]: INFO cinder.image.image_utils [None req-3242b1fe-7a17-4ca7-a5a7-7916483b264f tempest-VolumeAndVolumeTypeFromImageTest-382088631 None] Image download 0.00 MB at 0.00 MB/s Jul 10 04:49:35 devstack cinder-volume[87444]: DEBUG oslo.privsep.daemon [-] privsep: reply[edce2d58-539c-4cd8-9cc5-f0c176b1d49a]: (4, 'raw') {{(pid=88499) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 04:49:35 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-3242b1fe-7a17-4ca7-a5a7-7916483b264f tempest-VolumeAndVolumeTypeFromImageTest-382088631 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_476ea92a-bf56-4e73-a1b0-bfdd1a0c86ec_zs5cj6jzdevstack@QuobyteHD {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:49:35 devstack sudo[102828]: pam_unix(sudo:session): session closed for user root Jul 10 04:49:35 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-8b8b0090-93c3-48ec-be41-86926ebee0a2 tempest-ProjectReaderTests-820994271 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-78529426-ffb6-4aff-acbe-3b71453d05e5" returned: 0 in 0.987s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:49:35 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-8b8b0090-93c3-48ec-be41-86926ebee0a2 tempest-ProjectReaderTests-820994271 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-78529426-ffb6-4aff-acbe-3b71453d05e5 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:49:35 devstack sudo[102834]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-78529426-ffb6-4aff-acbe-3b71453d05e5 Jul 10 04:49:35 devstack sudo[102834]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:49:35 devstack sudo[102833]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_476ea92a-bf56-4e73-a1b0-bfdd1a0c86ec_zs5cj6jzdevstack@QuobyteHD Jul 10 04:49:35 devstack sudo[102833]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:49:35 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-6f6ffb34-f084-481d-a11b-d5c28bf9d2b2 tempest-TestShelveInstance-1751178727 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (43bd925d-711e-4933-aaca-5d715106a021) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '42c78259-797d-4508-807c-77c3d325d344', 'volume_name': 'volume-42c78259-797d-4508-807c-77c3d325d344', 'volume_size': 1, 'image_id': '5ac2ee4b-64bc-499a-b553-ae96ba343fc0', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/5ac2ee4b-64bc-499a-b553-ae96ba343fc0', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'ca4bb946b593473194351a84617cf92e', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '5ac2ee4b-64bc-499a-b553-ae96ba343fc0', 'created_at': datetime.datetime(2026, 7, 10, 2, 26, 36, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 10, 2, 26, 38, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/5ac2ee4b-64bc-499a-b553-ae96ba343fc0/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:49:35 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-6f6ffb34-f084-481d-a11b-d5c28bf9d2b2 tempest-TestShelveInstance-1751178727 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (50952c0b-ca60-4b3f-9a8c-112f402c9c1d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:49:35 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-6f6ffb34-f084-481d-a11b-d5c28bf9d2b2 tempest-TestShelveInstance-1751178727 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (50952c0b-ca60-4b3f-9a8c-112f402c9c1d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:49:35 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-6f6ffb34-f084-481d-a11b-d5c28bf9d2b2 tempest-TestShelveInstance-1751178727 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6778b457-3d50-48d6-b494-d544a24db415) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:49:35 devstack cinder-volume[87444]: INFO cinder.volume.flows.manager.create_volume [None req-6f6ffb34-f084-481d-a11b-d5c28bf9d2b2 tempest-TestShelveInstance-1751178727 None] Volume 42c78259-797d-4508-807c-77c3d325d344: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-42c78259-797d-4508-807c-77c3d325d344', 'volume_size': 1, 'image_id': '5ac2ee4b-64bc-499a-b553-ae96ba343fc0', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/5ac2ee4b-64bc-499a-b553-ae96ba343fc0', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'ca4bb946b593473194351a84617cf92e', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '5ac2ee4b-64bc-499a-b553-ae96ba343fc0', 'created_at': datetime.datetime(2026, 7, 10, 2, 26, 36, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 10, 2, 26, 38, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/5ac2ee4b-64bc-499a-b553-ae96ba343fc0/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Jul 10 04:49:35 devstack cinder-volume[87444]: DEBUG cinder.volume.flows.manager.create_volume [None req-6f6ffb34-f084-481d-a11b-d5c28bf9d2b2 tempest-TestShelveInstance-1751178727 None] Trying to clone 42c78259-797d-4508-807c-77c3d325d344 from image 5ac2ee4b-64bc-499a-b553-ae96ba343fc0 at location (None, [{'url': 'file:///opt/stack/data/glance/images/5ac2ee4b-64bc-499a-b553-ae96ba343fc0', 'metadata': {}}]). {{(pid=87444) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jul 10 04:49:36 devstack sudo[102834]: pam_unix(sudo:session): session closed for user root Jul 10 04:49:36 devstack cinder-volume[87444]: DEBUG cinder.image.image_utils [None req-6f6ffb34-f084-481d-a11b-d5c28bf9d2b2 tempest-TestShelveInstance-1751178727 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_5ac2ee4b-64bc-499a-b553-ae96ba343fc0_cq9lxu8xdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=87444) fetch /opt/stack/cinder/cinder/image/image_utils.py:765}} Jul 10 04:49:36 devstack cinder-volume[87444]: INFO cinder.image.image_utils [None req-6f6ffb34-f084-481d-a11b-d5c28bf9d2b2 tempest-TestShelveInstance-1751178727 None] Image download 20.69 MB at 20.69 MB/s Jul 10 04:49:36 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-8b8b0090-93c3-48ec-be41-86926ebee0a2 tempest-ProjectReaderTests-820994271 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-78529426-ffb6-4aff-acbe-3b71453d05e5" returned: 0 in 0.911s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:49:36 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-8b8b0090-93c3-48ec-be41-86926ebee0a2 tempest-ProjectReaderTests-820994271 None] Lock "cinder-quobyte-78529426-ffb6-4aff-acbe-3b71453d05e5" released by "delete_volume" :: held 1.987s {{(pid=87444) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 04:49:36 devstack cinder-volume[87444]: DEBUG oslo.privsep.daemon [-] privsep: reply[269701cc-3f2c-47b6-a2d7-e6a8f622c87c]: (4, 'qcow2') {{(pid=88499) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 04:49:36 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-6f6ffb34-f084-481d-a11b-d5c28bf9d2b2 tempest-TestShelveInstance-1751178727 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_5ac2ee4b-64bc-499a-b553-ae96ba343fc0_cq9lxu8xdevstack@QuobyteHD {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:49:36 devstack sudo[102833]: pam_unix(sudo:session): session closed for user root Jul 10 04:49:36 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-3242b1fe-7a17-4ca7-a5a7-7916483b264f tempest-VolumeAndVolumeTypeFromImageTest-382088631 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_476ea92a-bf56-4e73-a1b0-bfdd1a0c86ec_zs5cj6jzdevstack@QuobyteHD" returned: 0 in 1.033s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:49:36 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-3242b1fe-7a17-4ca7-a5a7-7916483b264f tempest-VolumeAndVolumeTypeFromImageTest-382088631 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_476ea92a-bf56-4e73-a1b0-bfdd1a0c86ec_zs5cj6jzdevstack@QuobyteHD {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:49:36 devstack cinder-volume[87444]: DEBUG cinder.quota [None req-8b8b0090-93c3-48ec-be41-86926ebee0a2 tempest-ProjectReaderTests-820994271 None] Created reservations ['92fbe73c-eb01-41a0-ac34-f1ee7e78df01', '785f747d-2fa3-42b6-ae86-deb5c0de7e07', '4e386044-4535-4ff7-a191-be0e9b8c997f', '1cd53658-13e7-42c4-b55b-a9969a86616f'] {{(pid=87444) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 04:49:36 devstack sudo[102842]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_5ac2ee4b-64bc-499a-b553-ae96ba343fc0_cq9lxu8xdevstack@QuobyteHD Jul 10 04:49:36 devstack sudo[102842]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:49:36 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-8b8b0090-93c3-48ec-be41-86926ebee0a2 tempest-ProjectReaderTests-820994271 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 04:49:36 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-8b8b0090-93c3-48ec-be41-86926ebee0a2 tempest-ProjectReaderTests-820994271 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 04:49:36 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-8b8b0090-93c3-48ec-be41-86926ebee0a2 tempest-ProjectReaderTests-820994271 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922': None} {{(pid=87444) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 04:49:36 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-8b8b0090-93c3-48ec-be41-86926ebee0a2 tempest-ProjectReaderTests-820994271 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922'] {{(pid=87444) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 04:49:36 devstack sudo[102843]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_476ea92a-bf56-4e73-a1b0-bfdd1a0c86ec_zs5cj6jzdevstack@QuobyteHD Jul 10 04:49:36 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-8b8b0090-93c3-48ec-be41-86926ebee0a2 tempest-ProjectReaderTests-820994271 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 04:49:36 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-8b8b0090-93c3-48ec-be41-86926ebee0a2 tempest-ProjectReaderTests-820994271 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:49:36 devstack sudo[102843]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:49:36 devstack sudo[102846]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097 Jul 10 04:49:36 devstack sudo[102846]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:49:37 devstack sudo[102843]: pam_unix(sudo:session): session closed for user root Jul 10 04:49:37 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-3242b1fe-7a17-4ca7-a5a7-7916483b264f tempest-VolumeAndVolumeTypeFromImageTest-382088631 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_476ea92a-bf56-4e73-a1b0-bfdd1a0c86ec_zs5cj6jzdevstack@QuobyteHD" returned: 1 in 1.067s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:49:37 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-3242b1fe-7a17-4ca7-a5a7-7916483b264f tempest-VolumeAndVolumeTypeFromImageTest-382088631 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_476ea92a-bf56-4e73-a1b0-bfdd1a0c86ec_zs5cj6jzdevstack@QuobyteHD' failed. Not Retrying. {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 10 04:49:37 devstack cinder-volume[87444]: DEBUG cinder.image.image_utils [None req-3242b1fe-7a17-4ca7-a5a7-7916483b264f tempest-VolumeAndVolumeTypeFromImageTest-382088631 None] Temporary image 476ea92a-bf56-4e73-a1b0-bfdd1a0c86ec is fetched for user 69c6c5cf459648169a8761f65b88512f. {{(pid=87444) fetch /opt/stack/cinder/cinder/image/image_utils.py:1464}} Jul 10 04:49:37 devstack cinder-volume[87444]: DEBUG oslo.privsep.daemon [-] privsep: reply[d511ab66-79dc-4df1-a2f7-9d5ab5848b6d]: (4, 'raw') {{(pid=88499) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 04:49:37 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-3242b1fe-7a17-4ca7-a5a7-7916483b264f tempest-VolumeAndVolumeTypeFromImageTest-382088631 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_476ea92a-bf56-4e73-a1b0-bfdd1a0c86ec_zs5cj6jzdevstack@QuobyteHD {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:49:37 devstack sudo[102842]: pam_unix(sudo:session): session closed for user root Jul 10 04:49:37 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-6f6ffb34-f084-481d-a11b-d5c28bf9d2b2 tempest-TestShelveInstance-1751178727 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_5ac2ee4b-64bc-499a-b553-ae96ba343fc0_cq9lxu8xdevstack@QuobyteHD" returned: 0 in 1.403s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:49:37 devstack cinder-volume[87444]: DEBUG cinder.image.image_utils [None req-6f6ffb34-f084-481d-a11b-d5c28bf9d2b2 tempest-TestShelveInstance-1751178727 None] Temporary image 5ac2ee4b-64bc-499a-b553-ae96ba343fc0 is fetched for user df7b496a5dd145c28ae8b656a6b3d26e. {{(pid=87444) fetch /opt/stack/cinder/cinder/image/image_utils.py:1464}} Jul 10 04:49:37 devstack sudo[102869]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_476ea92a-bf56-4e73-a1b0-bfdd1a0c86ec_zs5cj6jzdevstack@QuobyteHD Jul 10 04:49:37 devstack sudo[102869]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:49:37 devstack sudo[102846]: pam_unix(sudo:session): session closed for user root Jul 10 04:49:37 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-8b8b0090-93c3-48ec-be41-86926ebee0a2 tempest-ProjectReaderTests-820994271 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097" returned: 0 in 1.236s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:49:37 devstack cinder-volume[87444]: DEBUG cinder.manager [None req-8b8b0090-93c3-48ec-be41-86926ebee0a2 tempest-ProjectReaderTests-820994271 None] Notifying Schedulers of capabilities ... {{(pid=87444) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 04:49:37 devstack cinder-volume[87444]: INFO cinder.volume.manager [None req-8b8b0090-93c3-48ec-be41-86926ebee0a2 tempest-ProjectReaderTests-820994271 None] Deleted volume successfully. Jul 10 04:49:37 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-8b8b0090-93c3-48ec-be41-86926ebee0a2 tempest-ProjectReaderTests-820994271 None] Lock "cinder-78529426-ffb6-4aff-acbe-3b71453d05e5-delete_volume" released by "delete_volume" :: held 3.674s {{(pid=87444) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 04:49:38 devstack cinder-volume[87444]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae36e5de-5a7a-4ead-84f3-c06b160ae9a5]: (4, 'qcow2') {{(pid=88499) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 04:49:38 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-6f6ffb34-f084-481d-a11b-d5c28bf9d2b2 tempest-TestShelveInstance-1751178727 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_5ac2ee4b-64bc-499a-b553-ae96ba343fc0_cq9lxu8xdevstack@QuobyteHD {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:49:38 devstack cinder-volume[87444]: DEBUG cinder.volume.flows.manager.create_volume [None req-324d3657-c827-4a1e-a98b-cae8d1338a96 tempest-ProjectReaderTests-820994271 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87444) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 04:49:38 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-324d3657-c827-4a1e-a98b-cae8d1338a96 tempest-ProjectReaderTests-820994271 None] Flow 'volume_create_manager' (b57791db-a70d-4693-a5d9-249e0928b111) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 04:49:38 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-324d3657-c827-4a1e-a98b-cae8d1338a96 tempest-ProjectReaderTests-820994271 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (583dafc0-2e40-498f-9d61-7113a0531635) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:49:38 devstack sudo[102891]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_5ac2ee4b-64bc-499a-b553-ae96ba343fc0_cq9lxu8xdevstack@QuobyteHD Jul 10 04:49:38 devstack sudo[102891]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:49:38 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-324d3657-c827-4a1e-a98b-cae8d1338a96 tempest-ProjectReaderTests-820994271 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (583dafc0-2e40-498f-9d61-7113a0531635) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T02:49:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1282529910',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=76f1d637-d56b-463b-b122-aa2f5927d3b1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='470e3d956a5245208bd3ef78f1cb00e6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T02:49:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T02:49:38Z,use_quota=True,user_id='f8791f162a0f41a9a4ae6f738813098e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(317e369e-1e06-434d-ae95-a335f0e6c903),volume_type_id=317e369e-1e06-434d-ae95-a335f0e6c903)' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:49:38 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-324d3657-c827-4a1e-a98b-cae8d1338a96 tempest-ProjectReaderTests-820994271 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a72a641d-1bc5-4ff7-bb5a-7a5f8683e496) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:49:38 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-324d3657-c827-4a1e-a98b-cae8d1338a96 tempest-ProjectReaderTests-820994271 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a72a641d-1bc5-4ff7-bb5a-7a5f8683e496) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:49:38 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-324d3657-c827-4a1e-a98b-cae8d1338a96 tempest-ProjectReaderTests-820994271 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0c1b8f35-93d8-4a19-8d2d-70052eefe473) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:49:38 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-324d3657-c827-4a1e-a98b-cae8d1338a96 tempest-ProjectReaderTests-820994271 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0c1b8f35-93d8-4a19-8d2d-70052eefe473) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '76f1d637-d56b-463b-b122-aa2f5927d3b1', 'volume_name': 'volume-76f1d637-d56b-463b-b122-aa2f5927d3b1', 'volume_size': 1}' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:49:38 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-324d3657-c827-4a1e-a98b-cae8d1338a96 tempest-ProjectReaderTests-820994271 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c3772124-4e3c-4956-b555-135a3db429eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:49:38 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-324d3657-c827-4a1e-a98b-cae8d1338a96 tempest-ProjectReaderTests-820994271 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c3772124-4e3c-4956-b555-135a3db429eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:49:38 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-324d3657-c827-4a1e-a98b-cae8d1338a96 tempest-ProjectReaderTests-820994271 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (36bf2e3c-5b4f-453f-89d3-67a2b1731c21) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:49:38 devstack cinder-volume[87444]: INFO cinder.volume.flows.manager.create_volume [None req-324d3657-c827-4a1e-a98b-cae8d1338a96 tempest-ProjectReaderTests-820994271 None] Volume 76f1d637-d56b-463b-b122-aa2f5927d3b1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-76f1d637-d56b-463b-b122-aa2f5927d3b1', 'volume_size': 1} Jul 10 04:49:38 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-324d3657-c827-4a1e-a98b-cae8d1338a96 tempest-ProjectReaderTests-820994271 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 04:49:38 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-324d3657-c827-4a1e-a98b-cae8d1338a96 tempest-ProjectReaderTests-820994271 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 04:49:38 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-324d3657-c827-4a1e-a98b-cae8d1338a96 tempest-ProjectReaderTests-820994271 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T02:49:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1282529910',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=76f1d637-d56b-463b-b122-aa2f5927d3b1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='470e3d956a5245208bd3ef78f1cb00e6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T02:49:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T02:49:38Z,use_quota=True,user_id='f8791f162a0f41a9a4ae6f738813098e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(317e369e-1e06-434d-ae95-a335f0e6c903),volume_type_id=317e369e-1e06-434d-ae95-a335f0e6c903)}" {{(pid=87444) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 04:49:38 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.remotefs [None req-324d3657-c827-4a1e-a98b-cae8d1338a96 tempest-ProjectReaderTests-820994271 None] Creating volume 76f1d637-d56b-463b-b122-aa2f5927d3b1 {{(pid=87444) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 04:49:38 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-324d3657-c827-4a1e-a98b-cae8d1338a96 tempest-ProjectReaderTests-820994271 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 04:49:38 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-324d3657-c827-4a1e-a98b-cae8d1338a96 tempest-ProjectReaderTests-820994271 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 04:49:38 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-324d3657-c827-4a1e-a98b-cae8d1338a96 tempest-ProjectReaderTests-820994271 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922': None} {{(pid=87444) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 04:49:38 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-324d3657-c827-4a1e-a98b-cae8d1338a96 tempest-ProjectReaderTests-820994271 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922'] {{(pid=87444) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 04:49:38 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-324d3657-c827-4a1e-a98b-cae8d1338a96 tempest-ProjectReaderTests-820994271 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.031s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 04:49:38 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-324d3657-c827-4a1e-a98b-cae8d1338a96 tempest-ProjectReaderTests-820994271 None] Selected osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922 as target Quobyte volume. {{(pid=87444) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 04:49:38 devstack cinder-volume[87444]: INFO cinder.volume.drivers.remotefs [None req-324d3657-c827-4a1e-a98b-cae8d1338a96 tempest-ProjectReaderTests-820994271 None] casted to osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922 Jul 10 04:49:38 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-324d3657-c827-4a1e-a98b-cae8d1338a96 tempest-ProjectReaderTests-820994271 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-76f1d637-d56b-463b-b122-aa2f5927d3b1 1073741824 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:49:38 devstack sudo[102895]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-76f1d637-d56b-463b-b122-aa2f5927d3b1 1073741824 Jul 10 04:49:38 devstack sudo[102895]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:49:38 devstack sudo[102869]: pam_unix(sudo:session): session closed for user root Jul 10 04:49:38 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-3242b1fe-7a17-4ca7-a5a7-7916483b264f tempest-VolumeAndVolumeTypeFromImageTest-382088631 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_476ea92a-bf56-4e73-a1b0-bfdd1a0c86ec_zs5cj6jzdevstack@QuobyteHD" returned: 0 in 1.185s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:49:38 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-3242b1fe-7a17-4ca7-a5a7-7916483b264f tempest-VolumeAndVolumeTypeFromImageTest-382088631 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_476ea92a-bf56-4e73-a1b0-bfdd1a0c86ec_zs5cj6jzdevstack@QuobyteHD {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:49:38 devstack sudo[102891]: pam_unix(sudo:session): session closed for user root Jul 10 04:49:38 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-6f6ffb34-f084-481d-a11b-d5c28bf9d2b2 tempest-TestShelveInstance-1751178727 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_5ac2ee4b-64bc-499a-b553-ae96ba343fc0_cq9lxu8xdevstack@QuobyteHD" returned: 0 in 0.913s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:49:38 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-6f6ffb34-f084-481d-a11b-d5c28bf9d2b2 tempest-TestShelveInstance-1751178727 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 04:49:39 devstack sudo[102903]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_476ea92a-bf56-4e73-a1b0-bfdd1a0c86ec_zs5cj6jzdevstack@QuobyteHD Jul 10 04:49:39 devstack sudo[102903]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:49:39 devstack sudo[102895]: pam_unix(sudo:session): session closed for user root Jul 10 04:49:39 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-324d3657-c827-4a1e-a98b-cae8d1338a96 tempest-ProjectReaderTests-820994271 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-76f1d637-d56b-463b-b122-aa2f5927d3b1 1073741824" returned: 0 in 1.049s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:49:39 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-324d3657-c827-4a1e-a98b-cae8d1338a96 tempest-ProjectReaderTests-820994271 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-76f1d637-d56b-463b-b122-aa2f5927d3b1 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:49:39 devstack sudo[102909]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-76f1d637-d56b-463b-b122-aa2f5927d3b1 Jul 10 04:49:39 devstack sudo[102909]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:49:39 devstack sudo[102903]: pam_unix(sudo:session): session closed for user root Jul 10 04:49:39 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-3242b1fe-7a17-4ca7-a5a7-7916483b264f tempest-VolumeAndVolumeTypeFromImageTest-382088631 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_476ea92a-bf56-4e73-a1b0-bfdd1a0c86ec_zs5cj6jzdevstack@QuobyteHD" returned: 1 in 0.775s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:49:39 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-3242b1fe-7a17-4ca7-a5a7-7916483b264f tempest-VolumeAndVolumeTypeFromImageTest-382088631 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_476ea92a-bf56-4e73-a1b0-bfdd1a0c86ec_zs5cj6jzdevstack@QuobyteHD' failed. Not Retrying. {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 10 04:49:39 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-3242b1fe-7a17-4ca7-a5a7-7916483b264f tempest-VolumeAndVolumeTypeFromImageTest-382088631 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 04:49:40 devstack sudo[102909]: pam_unix(sudo:session): session closed for user root Jul 10 04:49:40 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-324d3657-c827-4a1e-a98b-cae8d1338a96 tempest-ProjectReaderTests-820994271 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-76f1d637-d56b-463b-b122-aa2f5927d3b1" returned: 0 in 0.682s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:49:40 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-324d3657-c827-4a1e-a98b-cae8d1338a96 tempest-ProjectReaderTests-820994271 None] <== create_volume: return (1816ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922'} {{(pid=87444) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 04:49:40 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-324d3657-c827-4a1e-a98b-cae8d1338a96 tempest-ProjectReaderTests-820994271 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.820s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 04:49:40 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-6f6ffb34-f084-481d-a11b-d5c28bf9d2b2 tempest-TestShelveInstance-1751178727 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.176s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 04:49:40 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-6f6ffb34-f084-481d-a11b-d5c28bf9d2b2 tempest-TestShelveInstance-1751178727 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T02:49:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-235517543',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=42c78259-797d-4508-807c-77c3d325d344,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='58175c9c22ca426886fb96226308122a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T02:49:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T02:49:35Z,use_quota=True,user_id='df7b496a5dd145c28ae8b656a6b3d26e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(317e369e-1e06-434d-ae95-a335f0e6c903),volume_type_id=317e369e-1e06-434d-ae95-a335f0e6c903)}" {{(pid=87444) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 04:49:40 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.remotefs [None req-6f6ffb34-f084-481d-a11b-d5c28bf9d2b2 tempest-TestShelveInstance-1751178727 None] Creating volume 42c78259-797d-4508-807c-77c3d325d344 {{(pid=87444) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 04:49:40 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-6f6ffb34-f084-481d-a11b-d5c28bf9d2b2 tempest-TestShelveInstance-1751178727 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 04:49:40 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-6f6ffb34-f084-481d-a11b-d5c28bf9d2b2 tempest-TestShelveInstance-1751178727 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 04:49:40 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-6f6ffb34-f084-481d-a11b-d5c28bf9d2b2 tempest-TestShelveInstance-1751178727 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922': None} {{(pid=87444) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 04:49:40 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-6f6ffb34-f084-481d-a11b-d5c28bf9d2b2 tempest-TestShelveInstance-1751178727 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922'] {{(pid=87444) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 04:49:40 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-6f6ffb34-f084-481d-a11b-d5c28bf9d2b2 tempest-TestShelveInstance-1751178727 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 04:49:40 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-6f6ffb34-f084-481d-a11b-d5c28bf9d2b2 tempest-TestShelveInstance-1751178727 None] Selected osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922 as target Quobyte volume. {{(pid=87444) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 04:49:40 devstack cinder-volume[87444]: INFO cinder.volume.drivers.remotefs [None req-6f6ffb34-f084-481d-a11b-d5c28bf9d2b2 tempest-TestShelveInstance-1751178727 None] casted to osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922 Jul 10 04:49:40 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-6f6ffb34-f084-481d-a11b-d5c28bf9d2b2 tempest-TestShelveInstance-1751178727 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-42c78259-797d-4508-807c-77c3d325d344 1073741824 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:49:40 devstack sudo[102917]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-42c78259-797d-4508-807c-77c3d325d344 1073741824 Jul 10 04:49:40 devstack sudo[102917]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:49:40 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-324d3657-c827-4a1e-a98b-cae8d1338a96 tempest-ProjectReaderTests-820994271 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (36bf2e3c-5b4f-453f-89d3-67a2b1731c21) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-76f1d637-d56b-463b-b122-aa2f5927d3b1', 'volume_size': 1}' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:49:40 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-324d3657-c827-4a1e-a98b-cae8d1338a96 tempest-ProjectReaderTests-820994271 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (70709045-e0e2-454f-a9a2-ac9ac817ad3d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:49:40 devstack cinder-volume[87444]: INFO cinder.volume.flows.manager.create_volume [None req-324d3657-c827-4a1e-a98b-cae8d1338a96 tempest-ProjectReaderTests-820994271 None] Volume volume-76f1d637-d56b-463b-b122-aa2f5927d3b1 (76f1d637-d56b-463b-b122-aa2f5927d3b1): created successfully Jul 10 04:49:40 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-324d3657-c827-4a1e-a98b-cae8d1338a96 tempest-ProjectReaderTests-820994271 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (70709045-e0e2-454f-a9a2-ac9ac817ad3d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:49:40 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-324d3657-c827-4a1e-a98b-cae8d1338a96 tempest-ProjectReaderTests-820994271 None] Flow 'volume_create_manager' (b57791db-a70d-4693-a5d9-249e0928b111) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87444) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 04:49:40 devstack cinder-volume[87444]: INFO cinder.volume.manager [None req-324d3657-c827-4a1e-a98b-cae8d1338a96 tempest-ProjectReaderTests-820994271 None] Created volume successfully. Jul 10 04:49:40 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-a8e50d69-7f14-4b16-a8cf-4ef0e1f64b77 tempest-ProjectReaderTests-820994271 None] Acquiring lock "cinder-76f1d637-d56b-463b-b122-aa2f5927d3b1-delete_volume" by "delete_volume" {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 04:49:41 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-a8e50d69-7f14-4b16-a8cf-4ef0e1f64b77 tempest-ProjectReaderTests-820994271 None] Lock "cinder-76f1d637-d56b-463b-b122-aa2f5927d3b1-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 04:49:41 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-a8e50d69-7f14-4b16-a8cf-4ef0e1f64b77 tempest-ProjectReaderTests-820994271 None] Acquiring lock "cinder-quobyte-76f1d637-d56b-463b-b122-aa2f5927d3b1" by "delete_volume" {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 04:49:41 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-a8e50d69-7f14-4b16-a8cf-4ef0e1f64b77 tempest-ProjectReaderTests-820994271 None] Lock "cinder-quobyte-76f1d637-d56b-463b-b122-aa2f5927d3b1" acquired by "delete_volume" :: waited 0.019s {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 04:49:41 devstack sudo[102917]: pam_unix(sudo:session): session closed for user root Jul 10 04:49:41 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-6f6ffb34-f084-481d-a11b-d5c28bf9d2b2 tempest-TestShelveInstance-1751178727 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-42c78259-797d-4508-807c-77c3d325d344 1073741824" returned: 0 in 0.956s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:49:41 devstack cinder-volume[87444]: DEBUG oslo.privsep.daemon [-] privsep: reply[847e0a8b-5657-495d-91e6-c23c1c333bfd]: (4, 'qcow2') {{(pid=88499) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 04:49:41 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-a8e50d69-7f14-4b16-a8cf-4ef0e1f64b77 tempest-ProjectReaderTests-820994271 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-76f1d637-d56b-463b-b122-aa2f5927d3b1 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:49:41 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-6f6ffb34-f084-481d-a11b-d5c28bf9d2b2 tempest-TestShelveInstance-1751178727 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-42c78259-797d-4508-807c-77c3d325d344 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:49:41 devstack sudo[102923]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-42c78259-797d-4508-807c-77c3d325d344 Jul 10 04:49:41 devstack sudo[102923]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:49:41 devstack sudo[102922]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-76f1d637-d56b-463b-b122-aa2f5927d3b1 Jul 10 04:49:41 devstack sudo[102922]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:49:41 devstack sudo[102923]: pam_unix(sudo:session): session closed for user root Jul 10 04:49:41 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-6f6ffb34-f084-481d-a11b-d5c28bf9d2b2 tempest-TestShelveInstance-1751178727 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-42c78259-797d-4508-807c-77c3d325d344" returned: 0 in 0.712s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:49:41 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-6f6ffb34-f084-481d-a11b-d5c28bf9d2b2 tempest-TestShelveInstance-1751178727 None] <== create_volume: return (1723ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922'} {{(pid=87444) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 04:49:41 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-6f6ffb34-f084-481d-a11b-d5c28bf9d2b2 tempest-TestShelveInstance-1751178727 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.727s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 04:49:41 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-3242b1fe-7a17-4ca7-a5a7-7916483b264f tempest-VolumeAndVolumeTypeFromImageTest-382088631 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.159s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 04:49:41 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-3242b1fe-7a17-4ca7-a5a7-7916483b264f tempest-VolumeAndVolumeTypeFromImageTest-382088631 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T02:49:34Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2488f7a8-ee5c-4619-9699-35e98c194a03,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4e0dfe5ed0a649e1b0382f82c6477510',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T02:49:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T02:49:34Z,use_quota=True,user_id='69c6c5cf459648169a8761f65b88512f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(508b4066-a959-40ca-ad6b-61274b71dfdc),volume_type_id=508b4066-a959-40ca-ad6b-61274b71dfdc)}" {{(pid=87444) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 04:49:41 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.remotefs [None req-3242b1fe-7a17-4ca7-a5a7-7916483b264f tempest-VolumeAndVolumeTypeFromImageTest-382088631 None] Creating volume 2488f7a8-ee5c-4619-9699-35e98c194a03 {{(pid=87444) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 04:49:41 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-3242b1fe-7a17-4ca7-a5a7-7916483b264f tempest-VolumeAndVolumeTypeFromImageTest-382088631 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 04:49:41 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-3242b1fe-7a17-4ca7-a5a7-7916483b264f tempest-VolumeAndVolumeTypeFromImageTest-382088631 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 04:49:41 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-3242b1fe-7a17-4ca7-a5a7-7916483b264f tempest-VolumeAndVolumeTypeFromImageTest-382088631 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922': None} {{(pid=87444) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 04:49:41 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-3242b1fe-7a17-4ca7-a5a7-7916483b264f tempest-VolumeAndVolumeTypeFromImageTest-382088631 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922'] {{(pid=87444) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 04:49:41 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-3242b1fe-7a17-4ca7-a5a7-7916483b264f tempest-VolumeAndVolumeTypeFromImageTest-382088631 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 04:49:41 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-3242b1fe-7a17-4ca7-a5a7-7916483b264f tempest-VolumeAndVolumeTypeFromImageTest-382088631 None] Selected osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922 as target Quobyte volume. {{(pid=87444) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 04:49:41 devstack cinder-volume[87444]: INFO cinder.volume.drivers.remotefs [None req-3242b1fe-7a17-4ca7-a5a7-7916483b264f tempest-VolumeAndVolumeTypeFromImageTest-382088631 None] casted to osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922 Jul 10 04:49:41 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-3242b1fe-7a17-4ca7-a5a7-7916483b264f tempest-VolumeAndVolumeTypeFromImageTest-382088631 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-2488f7a8-ee5c-4619-9699-35e98c194a03 1073741824 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:49:41 devstack sudo[102930]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-2488f7a8-ee5c-4619-9699-35e98c194a03 1073741824 Jul 10 04:49:41 devstack sudo[102930]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:49:41 devstack cinder-volume[87444]: DEBUG cinder.volume.volume_utils [None req-6f6ffb34-f084-481d-a11b-d5c28bf9d2b2 tempest-TestShelveInstance-1751178727 None] Attempting download of 5ac2ee4b-64bc-499a-b553-ae96ba343fc0 ((None, [{'url': 'file:///opt/stack/data/glance/images/5ac2ee4b-64bc-499a-b553-ae96ba343fc0', 'metadata': {}}])) to volume 42c78259-797d-4508-807c-77c3d325d344. {{(pid=87444) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jul 10 04:49:41 devstack sudo[102922]: pam_unix(sudo:session): session closed for user root Jul 10 04:49:41 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-a8e50d69-7f14-4b16-a8cf-4ef0e1f64b77 tempest-ProjectReaderTests-820994271 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-76f1d637-d56b-463b-b122-aa2f5927d3b1" returned: 0 in 0.869s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:49:41 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-a8e50d69-7f14-4b16-a8cf-4ef0e1f64b77 tempest-ProjectReaderTests-820994271 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-76f1d637-d56b-463b-b122-aa2f5927d3b1 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:49:41 devstack cinder-volume[87444]: DEBUG oslo.privsep.daemon [-] privsep: reply[0fc68f7b-d6a1-4bd9-8fd8-d0406b1e3a84]: (4, 'raw') {{(pid=88499) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 04:49:41 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-6f6ffb34-f084-481d-a11b-d5c28bf9d2b2 tempest-TestShelveInstance-1751178727 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_5ac2ee4b-64bc-499a-b553-ae96ba343fc0_yy1rcdtg {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:49:42 devstack sudo[102932]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-76f1d637-d56b-463b-b122-aa2f5927d3b1 Jul 10 04:49:42 devstack sudo[102932]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:49:42 devstack sudo[102933]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_5ac2ee4b-64bc-499a-b553-ae96ba343fc0_yy1rcdtg Jul 10 04:49:42 devstack sudo[102933]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:49:42 devstack sudo[102932]: pam_unix(sudo:session): session closed for user root Jul 10 04:49:42 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-a8e50d69-7f14-4b16-a8cf-4ef0e1f64b77 tempest-ProjectReaderTests-820994271 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-76f1d637-d56b-463b-b122-aa2f5927d3b1" returned: 0 in 0.963s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:49:42 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-a8e50d69-7f14-4b16-a8cf-4ef0e1f64b77 tempest-ProjectReaderTests-820994271 None] Lock "cinder-quobyte-76f1d637-d56b-463b-b122-aa2f5927d3b1" released by "delete_volume" :: held 1.888s {{(pid=87444) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 04:49:42 devstack sudo[102933]: pam_unix(sudo:session): session closed for user root Jul 10 04:49:42 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-6f6ffb34-f084-481d-a11b-d5c28bf9d2b2 tempest-TestShelveInstance-1751178727 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_5ac2ee4b-64bc-499a-b553-ae96ba343fc0_yy1rcdtg" returned: 0 in 0.994s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:49:42 devstack sudo[102930]: pam_unix(sudo:session): session closed for user root Jul 10 04:49:42 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-6f6ffb34-f084-481d-a11b-d5c28bf9d2b2 tempest-TestShelveInstance-1751178727 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_5ac2ee4b-64bc-499a-b553-ae96ba343fc0_yy1rcdtg {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:49:43 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-3242b1fe-7a17-4ca7-a5a7-7916483b264f tempest-VolumeAndVolumeTypeFromImageTest-382088631 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-2488f7a8-ee5c-4619-9699-35e98c194a03 1073741824" returned: 0 in 1.162s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:49:43 devstack cinder-volume[87444]: DEBUG cinder.quota [None req-a8e50d69-7f14-4b16-a8cf-4ef0e1f64b77 tempest-ProjectReaderTests-820994271 None] Created reservations ['7758b9ce-c0fe-4697-b692-cec05a639ddc', '07a86821-4858-45a0-9b64-f63c51f81b0c', '808cd144-b091-4afd-a21f-728882ab0a84', '31bd0276-d7ea-4441-90ba-75baf1bdfc51'] {{(pid=87444) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 04:49:43 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-3242b1fe-7a17-4ca7-a5a7-7916483b264f tempest-VolumeAndVolumeTypeFromImageTest-382088631 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-2488f7a8-ee5c-4619-9699-35e98c194a03 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:49:43 devstack sudo[102943]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-2488f7a8-ee5c-4619-9699-35e98c194a03 Jul 10 04:49:43 devstack sudo[102943]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:49:43 devstack sudo[102942]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_5ac2ee4b-64bc-499a-b553-ae96ba343fc0_yy1rcdtg Jul 10 04:49:43 devstack sudo[102942]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:49:43 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-a8e50d69-7f14-4b16-a8cf-4ef0e1f64b77 tempest-ProjectReaderTests-820994271 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 04:49:43 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-a8e50d69-7f14-4b16-a8cf-4ef0e1f64b77 tempest-ProjectReaderTests-820994271 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 04:49:43 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-a8e50d69-7f14-4b16-a8cf-4ef0e1f64b77 tempest-ProjectReaderTests-820994271 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922': None} {{(pid=87444) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 04:49:43 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-a8e50d69-7f14-4b16-a8cf-4ef0e1f64b77 tempest-ProjectReaderTests-820994271 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922'] {{(pid=87444) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 04:49:43 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-a8e50d69-7f14-4b16-a8cf-4ef0e1f64b77 tempest-ProjectReaderTests-820994271 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 04:49:43 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-a8e50d69-7f14-4b16-a8cf-4ef0e1f64b77 tempest-ProjectReaderTests-820994271 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:49:43 devstack sudo[102946]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097 Jul 10 04:49:43 devstack sudo[102946]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:49:43 devstack sudo[102943]: pam_unix(sudo:session): session closed for user root Jul 10 04:49:43 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-3242b1fe-7a17-4ca7-a5a7-7916483b264f tempest-VolumeAndVolumeTypeFromImageTest-382088631 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-2488f7a8-ee5c-4619-9699-35e98c194a03" returned: 0 in 0.797s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:49:43 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-3242b1fe-7a17-4ca7-a5a7-7916483b264f tempest-VolumeAndVolumeTypeFromImageTest-382088631 None] <== create_volume: return (2028ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922'} {{(pid=87444) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 04:49:43 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-3242b1fe-7a17-4ca7-a5a7-7916483b264f tempest-VolumeAndVolumeTypeFromImageTest-382088631 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.034s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 04:49:43 devstack cinder-volume[87444]: DEBUG cinder.volume.volume_utils [None req-3242b1fe-7a17-4ca7-a5a7-7916483b264f tempest-VolumeAndVolumeTypeFromImageTest-382088631 None] Attempting download of 476ea92a-bf56-4e73-a1b0-bfdd1a0c86ec ((None, [{'url': 'file:///opt/stack/data/glance/images/476ea92a-bf56-4e73-a1b0-bfdd1a0c86ec', 'metadata': {}}])) to volume 2488f7a8-ee5c-4619-9699-35e98c194a03. {{(pid=87444) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jul 10 04:49:44 devstack cinder-volume[87444]: DEBUG oslo.privsep.daemon [-] privsep: reply[3be01dbb-6849-4e7c-bd8a-e04df6639504]: (4, 'raw') {{(pid=88499) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 04:49:44 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-3242b1fe-7a17-4ca7-a5a7-7916483b264f tempest-VolumeAndVolumeTypeFromImageTest-382088631 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_476ea92a-bf56-4e73-a1b0-bfdd1a0c86ec_so8gl7rx {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:49:44 devstack cinder-volume[87444]: DEBUG cinder.volume.flows.manager.create_volume [None req-9a19e1be-137f-4a84-aebe-8e3d85340f8d tempest-ProjectReaderTests-820994271 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87444) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 04:49:44 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-9a19e1be-137f-4a84-aebe-8e3d85340f8d tempest-ProjectReaderTests-820994271 None] Flow 'volume_create_manager' (87c4a0b7-6ee4-425c-b1e2-f5f975c4f3fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 04:49:44 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-9a19e1be-137f-4a84-aebe-8e3d85340f8d tempest-ProjectReaderTests-820994271 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (474dbd21-5f8a-4fb2-89cd-7119056a3de7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:49:44 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-9a19e1be-137f-4a84-aebe-8e3d85340f8d tempest-ProjectReaderTests-820994271 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (474dbd21-5f8a-4fb2-89cd-7119056a3de7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T02:49:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1145682162',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f83f1766-39c7-4358-8741-012e839bb96f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='470e3d956a5245208bd3ef78f1cb00e6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T02:49:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T02:49:44Z,use_quota=True,user_id='f8791f162a0f41a9a4ae6f738813098e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(317e369e-1e06-434d-ae95-a335f0e6c903),volume_type_id=317e369e-1e06-434d-ae95-a335f0e6c903)' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:49:44 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-9a19e1be-137f-4a84-aebe-8e3d85340f8d tempest-ProjectReaderTests-820994271 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (460af6d1-6f21-4aba-beb7-f90d8ebb7d2d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:49:44 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-9a19e1be-137f-4a84-aebe-8e3d85340f8d tempest-ProjectReaderTests-820994271 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (460af6d1-6f21-4aba-beb7-f90d8ebb7d2d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:49:44 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-9a19e1be-137f-4a84-aebe-8e3d85340f8d tempest-ProjectReaderTests-820994271 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (62060359-5be7-4087-8d24-7925728d2e6d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:49:44 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-9a19e1be-137f-4a84-aebe-8e3d85340f8d tempest-ProjectReaderTests-820994271 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (62060359-5be7-4087-8d24-7925728d2e6d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f83f1766-39c7-4358-8741-012e839bb96f', 'volume_name': 'volume-f83f1766-39c7-4358-8741-012e839bb96f', 'volume_size': 1}' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:49:44 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-9a19e1be-137f-4a84-aebe-8e3d85340f8d tempest-ProjectReaderTests-820994271 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (609ba13f-0289-4547-9840-c37853de97ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:49:44 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-9a19e1be-137f-4a84-aebe-8e3d85340f8d tempest-ProjectReaderTests-820994271 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (609ba13f-0289-4547-9840-c37853de97ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:49:44 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-9a19e1be-137f-4a84-aebe-8e3d85340f8d tempest-ProjectReaderTests-820994271 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2c7efd3f-8366-429c-a231-779db256dee7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:49:44 devstack sudo[102950]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_476ea92a-bf56-4e73-a1b0-bfdd1a0c86ec_so8gl7rx Jul 10 04:49:44 devstack sudo[102950]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:49:44 devstack cinder-volume[87444]: INFO cinder.volume.flows.manager.create_volume [None req-9a19e1be-137f-4a84-aebe-8e3d85340f8d tempest-ProjectReaderTests-820994271 None] Volume f83f1766-39c7-4358-8741-012e839bb96f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f83f1766-39c7-4358-8741-012e839bb96f', 'volume_size': 1} Jul 10 04:49:44 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-9a19e1be-137f-4a84-aebe-8e3d85340f8d tempest-ProjectReaderTests-820994271 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 04:49:44 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-9a19e1be-137f-4a84-aebe-8e3d85340f8d tempest-ProjectReaderTests-820994271 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 04:49:44 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-9a19e1be-137f-4a84-aebe-8e3d85340f8d tempest-ProjectReaderTests-820994271 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T02:49:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1145682162',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f83f1766-39c7-4358-8741-012e839bb96f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='470e3d956a5245208bd3ef78f1cb00e6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T02:49:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T02:49:44Z,use_quota=True,user_id='f8791f162a0f41a9a4ae6f738813098e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(317e369e-1e06-434d-ae95-a335f0e6c903),volume_type_id=317e369e-1e06-434d-ae95-a335f0e6c903)}" {{(pid=87444) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 04:49:44 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.remotefs [None req-9a19e1be-137f-4a84-aebe-8e3d85340f8d tempest-ProjectReaderTests-820994271 None] Creating volume f83f1766-39c7-4358-8741-012e839bb96f {{(pid=87444) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 04:49:44 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-9a19e1be-137f-4a84-aebe-8e3d85340f8d tempest-ProjectReaderTests-820994271 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 04:49:44 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-9a19e1be-137f-4a84-aebe-8e3d85340f8d tempest-ProjectReaderTests-820994271 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.006s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 04:49:44 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-9a19e1be-137f-4a84-aebe-8e3d85340f8d tempest-ProjectReaderTests-820994271 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922': None} {{(pid=87444) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 04:49:44 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-9a19e1be-137f-4a84-aebe-8e3d85340f8d tempest-ProjectReaderTests-820994271 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922'] {{(pid=87444) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 04:49:44 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-9a19e1be-137f-4a84-aebe-8e3d85340f8d tempest-ProjectReaderTests-820994271 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 04:49:44 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-9a19e1be-137f-4a84-aebe-8e3d85340f8d tempest-ProjectReaderTests-820994271 None] Selected osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922 as target Quobyte volume. {{(pid=87444) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 04:49:44 devstack cinder-volume[87444]: INFO cinder.volume.drivers.remotefs [None req-9a19e1be-137f-4a84-aebe-8e3d85340f8d tempest-ProjectReaderTests-820994271 None] casted to osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922 Jul 10 04:49:44 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-9a19e1be-137f-4a84-aebe-8e3d85340f8d tempest-ProjectReaderTests-820994271 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-f83f1766-39c7-4358-8741-012e839bb96f 1073741824 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:49:44 devstack sudo[102955]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-f83f1766-39c7-4358-8741-012e839bb96f 1073741824 Jul 10 04:49:44 devstack sudo[102955]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:49:44 devstack sudo[102946]: pam_unix(sudo:session): session closed for user root Jul 10 04:49:44 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-a8e50d69-7f14-4b16-a8cf-4ef0e1f64b77 tempest-ProjectReaderTests-820994271 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097" returned: 0 in 1.235s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:49:44 devstack cinder-volume[87444]: DEBUG cinder.manager [None req-a8e50d69-7f14-4b16-a8cf-4ef0e1f64b77 tempest-ProjectReaderTests-820994271 None] Notifying Schedulers of capabilities ... {{(pid=87444) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 04:49:44 devstack sudo[102942]: pam_unix(sudo:session): session closed for user root Jul 10 04:49:44 devstack cinder-volume[87444]: INFO cinder.volume.manager [None req-a8e50d69-7f14-4b16-a8cf-4ef0e1f64b77 tempest-ProjectReaderTests-820994271 None] Deleted volume successfully. Jul 10 04:49:44 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-6f6ffb34-f084-481d-a11b-d5c28bf9d2b2 tempest-TestShelveInstance-1751178727 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_5ac2ee4b-64bc-499a-b553-ae96ba343fc0_yy1rcdtg" returned: 1 in 1.483s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:49:44 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-6f6ffb34-f084-481d-a11b-d5c28bf9d2b2 tempest-TestShelveInstance-1751178727 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_5ac2ee4b-64bc-499a-b553-ae96ba343fc0_yy1rcdtg' failed. Not Retrying. {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 10 04:49:44 devstack cinder-volume[87444]: DEBUG oslo.privsep.daemon [-] privsep: reply[248071cb-7cbd-4b60-8436-f5f2f6b43a1f]: (4, 'qcow2') {{(pid=88499) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 04:49:44 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-6f6ffb34-f084-481d-a11b-d5c28bf9d2b2 tempest-TestShelveInstance-1751178727 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_5ac2ee4b-64bc-499a-b553-ae96ba343fc0_cq9lxu8xdevstack@QuobyteHD {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:49:44 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-a8e50d69-7f14-4b16-a8cf-4ef0e1f64b77 tempest-ProjectReaderTests-820994271 None] Lock "cinder-76f1d637-d56b-463b-b122-aa2f5927d3b1-delete_volume" released by "delete_volume" :: held 3.515s {{(pid=87444) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 04:49:44 devstack sudo[102957]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_5ac2ee4b-64bc-499a-b553-ae96ba343fc0_cq9lxu8xdevstack@QuobyteHD Jul 10 04:49:44 devstack sudo[102957]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:49:44 devstack sudo[102950]: pam_unix(sudo:session): session closed for user root Jul 10 04:49:44 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-3242b1fe-7a17-4ca7-a5a7-7916483b264f tempest-VolumeAndVolumeTypeFromImageTest-382088631 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_476ea92a-bf56-4e73-a1b0-bfdd1a0c86ec_so8gl7rx" returned: 0 in 0.906s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:49:44 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-3242b1fe-7a17-4ca7-a5a7-7916483b264f tempest-VolumeAndVolumeTypeFromImageTest-382088631 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_476ea92a-bf56-4e73-a1b0-bfdd1a0c86ec_so8gl7rx {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:49:45 devstack sudo[102961]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_476ea92a-bf56-4e73-a1b0-bfdd1a0c86ec_so8gl7rx Jul 10 04:49:45 devstack sudo[102961]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:49:45 devstack sudo[102957]: pam_unix(sudo:session): session closed for user root Jul 10 04:49:45 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-6f6ffb34-f084-481d-a11b-d5c28bf9d2b2 tempest-TestShelveInstance-1751178727 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_5ac2ee4b-64bc-499a-b553-ae96ba343fc0_cq9lxu8xdevstack@QuobyteHD" returned: 0 in 0.987s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:49:45 devstack cinder-volume[87444]: DEBUG cinder.image.image_utils [None req-6f6ffb34-f084-481d-a11b-d5c28bf9d2b2 tempest-TestShelveInstance-1751178727 None] 5ac2ee4b-64bc-499a-b553-ae96ba343fc0 was qcow2, converting to raw {{(pid=87444) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1153}} Jul 10 04:49:45 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-6f6ffb34-f084-481d-a11b-d5c28bf9d2b2 tempest-TestShelveInstance-1751178727 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_5ac2ee4b-64bc-499a-b553-ae96ba343fc0_cq9lxu8xdevstack@QuobyteHD /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-42c78259-797d-4508-807c-77c3d325d344 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:49:45 devstack sudo[102955]: pam_unix(sudo:session): session closed for user root Jul 10 04:49:45 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-9a19e1be-137f-4a84-aebe-8e3d85340f8d tempest-ProjectReaderTests-820994271 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-f83f1766-39c7-4358-8741-012e839bb96f 1073741824" returned: 0 in 1.279s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:49:45 devstack sudo[102970]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_5ac2ee4b-64bc-499a-b553-ae96ba343fc0_cq9lxu8xdevstack@QuobyteHD /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-42c78259-797d-4508-807c-77c3d325d344 Jul 10 04:49:45 devstack sudo[102970]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:49:45 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-9a19e1be-137f-4a84-aebe-8e3d85340f8d tempest-ProjectReaderTests-820994271 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-f83f1766-39c7-4358-8741-012e839bb96f {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:49:45 devstack sudo[102972]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-f83f1766-39c7-4358-8741-012e839bb96f Jul 10 04:49:45 devstack sudo[102972]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:49:45 devstack sudo[102961]: pam_unix(sudo:session): session closed for user root Jul 10 04:49:45 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-3242b1fe-7a17-4ca7-a5a7-7916483b264f tempest-VolumeAndVolumeTypeFromImageTest-382088631 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_476ea92a-bf56-4e73-a1b0-bfdd1a0c86ec_so8gl7rx" returned: 1 in 0.925s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:49:45 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-3242b1fe-7a17-4ca7-a5a7-7916483b264f tempest-VolumeAndVolumeTypeFromImageTest-382088631 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_476ea92a-bf56-4e73-a1b0-bfdd1a0c86ec_so8gl7rx' failed. Not Retrying. {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 10 04:49:45 devstack cinder-volume[87444]: DEBUG oslo.privsep.daemon [-] privsep: reply[7880ae35-7d9d-4137-b0a3-e612cd4a707f]: (4, 'raw') {{(pid=88499) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 04:49:45 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-3242b1fe-7a17-4ca7-a5a7-7916483b264f tempest-VolumeAndVolumeTypeFromImageTest-382088631 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_476ea92a-bf56-4e73-a1b0-bfdd1a0c86ec_zs5cj6jzdevstack@QuobyteHD {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:49:46 devstack sudo[102976]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_476ea92a-bf56-4e73-a1b0-bfdd1a0c86ec_zs5cj6jzdevstack@QuobyteHD Jul 10 04:49:46 devstack sudo[102976]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:49:46 devstack sudo[102972]: pam_unix(sudo:session): session closed for user root Jul 10 04:49:46 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-9a19e1be-137f-4a84-aebe-8e3d85340f8d tempest-ProjectReaderTests-820994271 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-f83f1766-39c7-4358-8741-012e839bb96f" returned: 0 in 0.957s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:49:46 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-9a19e1be-137f-4a84-aebe-8e3d85340f8d tempest-ProjectReaderTests-820994271 None] <== create_volume: return (2311ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922'} {{(pid=87444) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 04:49:46 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-9a19e1be-137f-4a84-aebe-8e3d85340f8d tempest-ProjectReaderTests-820994271 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.315s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 04:49:46 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-9a19e1be-137f-4a84-aebe-8e3d85340f8d tempest-ProjectReaderTests-820994271 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2c7efd3f-8366-429c-a231-779db256dee7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f83f1766-39c7-4358-8741-012e839bb96f', 'volume_size': 1}' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:49:46 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-9a19e1be-137f-4a84-aebe-8e3d85340f8d tempest-ProjectReaderTests-820994271 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c9c5ba47-8ed0-4bf0-bdbb-0188dbd7311d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:49:46 devstack cinder-volume[87444]: INFO cinder.volume.flows.manager.create_volume [None req-9a19e1be-137f-4a84-aebe-8e3d85340f8d tempest-ProjectReaderTests-820994271 None] Volume volume-f83f1766-39c7-4358-8741-012e839bb96f (f83f1766-39c7-4358-8741-012e839bb96f): created successfully Jul 10 04:49:46 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-9a19e1be-137f-4a84-aebe-8e3d85340f8d tempest-ProjectReaderTests-820994271 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c9c5ba47-8ed0-4bf0-bdbb-0188dbd7311d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:49:46 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-9a19e1be-137f-4a84-aebe-8e3d85340f8d tempest-ProjectReaderTests-820994271 None] Flow 'volume_create_manager' (87c4a0b7-6ee4-425c-b1e2-f5f975c4f3fc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87444) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 04:49:46 devstack cinder-volume[87444]: INFO cinder.volume.manager [None req-9a19e1be-137f-4a84-aebe-8e3d85340f8d tempest-ProjectReaderTests-820994271 None] Created volume successfully. Jul 10 04:49:46 devstack sudo[102976]: pam_unix(sudo:session): session closed for user root Jul 10 04:49:46 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-3242b1fe-7a17-4ca7-a5a7-7916483b264f tempest-VolumeAndVolumeTypeFromImageTest-382088631 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_476ea92a-bf56-4e73-a1b0-bfdd1a0c86ec_zs5cj6jzdevstack@QuobyteHD" returned: 0 in 0.895s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:49:46 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-3242b1fe-7a17-4ca7-a5a7-7916483b264f tempest-VolumeAndVolumeTypeFromImageTest-382088631 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_476ea92a-bf56-4e73-a1b0-bfdd1a0c86ec_zs5cj6jzdevstack@QuobyteHD {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:49:46 devstack sudo[102993]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_476ea92a-bf56-4e73-a1b0-bfdd1a0c86ec_zs5cj6jzdevstack@QuobyteHD Jul 10 04:49:46 devstack sudo[102993]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:49:47 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-75b8b932-a69f-48ae-b233-52dbaeb869b3 tempest-ProjectReaderTests-820994271 None] Acquiring lock "cinder-f83f1766-39c7-4358-8741-012e839bb96f-delete_volume" by "delete_volume" {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 04:49:47 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-75b8b932-a69f-48ae-b233-52dbaeb869b3 tempest-ProjectReaderTests-820994271 None] Lock "cinder-f83f1766-39c7-4358-8741-012e839bb96f-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 04:49:47 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-75b8b932-a69f-48ae-b233-52dbaeb869b3 tempest-ProjectReaderTests-820994271 None] Acquiring lock "cinder-quobyte-f83f1766-39c7-4358-8741-012e839bb96f" by "delete_volume" {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 04:49:47 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-75b8b932-a69f-48ae-b233-52dbaeb869b3 tempest-ProjectReaderTests-820994271 None] Lock "cinder-quobyte-f83f1766-39c7-4358-8741-012e839bb96f" acquired by "delete_volume" :: waited 0.024s {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 04:49:47 devstack cinder-volume[87444]: DEBUG oslo.privsep.daemon [-] privsep: reply[542dac63-fb94-46f0-9f25-9de8b7a8761c]: (4, 'qcow2') {{(pid=88499) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 04:49:47 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-75b8b932-a69f-48ae-b233-52dbaeb869b3 tempest-ProjectReaderTests-820994271 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-f83f1766-39c7-4358-8741-012e839bb96f {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:49:47 devstack sudo[102996]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-f83f1766-39c7-4358-8741-012e839bb96f Jul 10 04:49:47 devstack sudo[102996]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:49:47 devstack sudo[102993]: pam_unix(sudo:session): session closed for user root Jul 10 04:49:47 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-3242b1fe-7a17-4ca7-a5a7-7916483b264f tempest-VolumeAndVolumeTypeFromImageTest-382088631 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_476ea92a-bf56-4e73-a1b0-bfdd1a0c86ec_zs5cj6jzdevstack@QuobyteHD" returned: 1 in 0.941s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:49:47 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-3242b1fe-7a17-4ca7-a5a7-7916483b264f tempest-VolumeAndVolumeTypeFromImageTest-382088631 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_476ea92a-bf56-4e73-a1b0-bfdd1a0c86ec_zs5cj6jzdevstack@QuobyteHD' failed. Not Retrying. {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 10 04:49:47 devstack cinder-volume[87444]: DEBUG cinder.image.image_utils [None req-3242b1fe-7a17-4ca7-a5a7-7916483b264f tempest-VolumeAndVolumeTypeFromImageTest-382088631 None] 476ea92a-bf56-4e73-a1b0-bfdd1a0c86ec was raw, converting to raw {{(pid=87444) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1153}} Jul 10 04:49:47 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-3242b1fe-7a17-4ca7-a5a7-7916483b264f tempest-VolumeAndVolumeTypeFromImageTest-382088631 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_476ea92a-bf56-4e73-a1b0-bfdd1a0c86ec_zs5cj6jzdevstack@QuobyteHD /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-2488f7a8-ee5c-4619-9699-35e98c194a03 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:49:47 devstack sudo[103000]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_476ea92a-bf56-4e73-a1b0-bfdd1a0c86ec_zs5cj6jzdevstack@QuobyteHD /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-2488f7a8-ee5c-4619-9699-35e98c194a03 Jul 10 04:49:47 devstack sudo[103000]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:49:48 devstack sudo[102970]: pam_unix(sudo:session): session closed for user root Jul 10 04:49:48 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-6f6ffb34-f084-481d-a11b-d5c28bf9d2b2 tempest-TestShelveInstance-1751178727 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_5ac2ee4b-64bc-499a-b553-ae96ba343fc0_cq9lxu8xdevstack@QuobyteHD /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-42c78259-797d-4508-807c-77c3d325d344" returned: 0 in 2.632s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:49:48 devstack cinder-volume[87444]: DEBUG cinder.image.image_utils [None req-6f6ffb34-f084-481d-a11b-d5c28bf9d2b2 tempest-TestShelveInstance-1751178727 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_5ac2ee4b-64bc-499a-b553-ae96ba343fc0_cq9lxu8xdevstack@QuobyteHD, size 112.00 MB, duration 2.63 sec, destination /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-42c78259-797d-4508-807c-77c3d325d344 {{(pid=87444) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:561}} Jul 10 04:49:48 devstack cinder-volume[87444]: INFO cinder.image.image_utils [None req-6f6ffb34-f084-481d-a11b-d5c28bf9d2b2 tempest-TestShelveInstance-1751178727 None] Converted 112.00 MB image at 42.53 MB/s Jul 10 04:49:48 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-6f6ffb34-f084-481d-a11b-d5c28bf9d2b2 tempest-TestShelveInstance-1751178727 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-42c78259-797d-4508-807c-77c3d325d344 1G {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:49:48 devstack sudo[103003]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-42c78259-797d-4508-807c-77c3d325d344 1G Jul 10 04:49:48 devstack sudo[103003]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:49:48 devstack sudo[103000]: pam_unix(sudo:session): session closed for user root Jul 10 04:49:48 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-3242b1fe-7a17-4ca7-a5a7-7916483b264f tempest-VolumeAndVolumeTypeFromImageTest-382088631 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_476ea92a-bf56-4e73-a1b0-bfdd1a0c86ec_zs5cj6jzdevstack@QuobyteHD /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-2488f7a8-ee5c-4619-9699-35e98c194a03" returned: 0 in 1.040s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:49:48 devstack cinder-volume[87444]: DEBUG cinder.image.image_utils [None req-3242b1fe-7a17-4ca7-a5a7-7916483b264f tempest-VolumeAndVolumeTypeFromImageTest-382088631 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_476ea92a-bf56-4e73-a1b0-bfdd1a0c86ec_zs5cj6jzdevstack@QuobyteHD, size 0.00 MB, duration 1.04 sec, destination /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-2488f7a8-ee5c-4619-9699-35e98c194a03 {{(pid=87444) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:561}} Jul 10 04:49:48 devstack cinder-volume[87444]: INFO cinder.image.image_utils [None req-3242b1fe-7a17-4ca7-a5a7-7916483b264f tempest-VolumeAndVolumeTypeFromImageTest-382088631 None] Converted 0.00 MB image at 0.00 MB/s Jul 10 04:49:48 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-3242b1fe-7a17-4ca7-a5a7-7916483b264f tempest-VolumeAndVolumeTypeFromImageTest-382088631 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-2488f7a8-ee5c-4619-9699-35e98c194a03 1G {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:49:48 devstack sudo[102996]: pam_unix(sudo:session): session closed for user root Jul 10 04:49:48 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-75b8b932-a69f-48ae-b233-52dbaeb869b3 tempest-ProjectReaderTests-820994271 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-f83f1766-39c7-4358-8741-012e839bb96f" returned: 0 in 1.225s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:49:48 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-75b8b932-a69f-48ae-b233-52dbaeb869b3 tempest-ProjectReaderTests-820994271 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-f83f1766-39c7-4358-8741-012e839bb96f {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:49:48 devstack sudo[103012]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-2488f7a8-ee5c-4619-9699-35e98c194a03 1G Jul 10 04:49:48 devstack sudo[103012]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:49:48 devstack sudo[103013]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-f83f1766-39c7-4358-8741-012e839bb96f Jul 10 04:49:48 devstack sudo[103013]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:49:49 devstack sudo[103003]: pam_unix(sudo:session): session closed for user root Jul 10 04:49:49 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-6f6ffb34-f084-481d-a11b-d5c28bf9d2b2 tempest-TestShelveInstance-1751178727 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-42c78259-797d-4508-807c-77c3d325d344 1G" returned: 0 in 1.109s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:49:49 devstack cinder-volume[87444]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7280054-b95a-4f48-b4e6-8396a5330a4a]: (4, 'raw') {{(pid=88499) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 04:49:49 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-6f6ffb34-f084-481d-a11b-d5c28bf9d2b2 tempest-TestShelveInstance-1751178727 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-42c78259-797d-4508-807c-77c3d325d344 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:49:49 devstack sudo[103019]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-42c78259-797d-4508-807c-77c3d325d344 Jul 10 04:49:49 devstack sudo[103019]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:49:49 devstack sudo[103013]: pam_unix(sudo:session): session closed for user root Jul 10 04:49:49 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-75b8b932-a69f-48ae-b233-52dbaeb869b3 tempest-ProjectReaderTests-820994271 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-f83f1766-39c7-4358-8741-012e839bb96f" returned: 0 in 0.912s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:49:49 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-75b8b932-a69f-48ae-b233-52dbaeb869b3 tempest-ProjectReaderTests-820994271 None] Lock "cinder-quobyte-f83f1766-39c7-4358-8741-012e839bb96f" released by "delete_volume" :: held 2.233s {{(pid=87444) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 04:49:49 devstack sudo[103012]: pam_unix(sudo:session): session closed for user root Jul 10 04:49:49 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-3242b1fe-7a17-4ca7-a5a7-7916483b264f tempest-VolumeAndVolumeTypeFromImageTest-382088631 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-2488f7a8-ee5c-4619-9699-35e98c194a03 1G" returned: 0 in 1.023s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:49:49 devstack cinder-volume[87444]: DEBUG cinder.quota [None req-75b8b932-a69f-48ae-b233-52dbaeb869b3 tempest-ProjectReaderTests-820994271 None] Created reservations ['89d7126c-7ea3-4b8d-817e-d7565c636dc6', '2db511ad-dd73-49bf-9cb5-c371c08007d7', 'cdda86bd-deff-4696-9f96-580b7f4e7e6a', 'ae8a19c4-357b-4589-a4cb-a15ec74067b9'] {{(pid=87444) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 04:49:49 devstack cinder-volume[87444]: DEBUG oslo.privsep.daemon [-] privsep: reply[3bcc3532-fca8-4f77-8fdf-b2d9b41a6197]: (4, 'raw') {{(pid=88499) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 04:49:49 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-3242b1fe-7a17-4ca7-a5a7-7916483b264f tempest-VolumeAndVolumeTypeFromImageTest-382088631 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-2488f7a8-ee5c-4619-9699-35e98c194a03 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:49:49 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-75b8b932-a69f-48ae-b233-52dbaeb869b3 tempest-ProjectReaderTests-820994271 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 04:49:49 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-75b8b932-a69f-48ae-b233-52dbaeb869b3 tempest-ProjectReaderTests-820994271 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 04:49:49 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-75b8b932-a69f-48ae-b233-52dbaeb869b3 tempest-ProjectReaderTests-820994271 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922': None} {{(pid=87444) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 04:49:49 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-75b8b932-a69f-48ae-b233-52dbaeb869b3 tempest-ProjectReaderTests-820994271 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922'] {{(pid=87444) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 04:49:49 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-75b8b932-a69f-48ae-b233-52dbaeb869b3 tempest-ProjectReaderTests-820994271 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 04:49:49 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-75b8b932-a69f-48ae-b233-52dbaeb869b3 tempest-ProjectReaderTests-820994271 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:49:49 devstack sudo[103026]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097 Jul 10 04:49:50 devstack sudo[103026]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:49:50 devstack sudo[103025]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-2488f7a8-ee5c-4619-9699-35e98c194a03 Jul 10 04:49:50 devstack sudo[103025]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:49:50 devstack sudo[103019]: pam_unix(sudo:session): session closed for user root Jul 10 04:49:50 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-6f6ffb34-f084-481d-a11b-d5c28bf9d2b2 tempest-TestShelveInstance-1751178727 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-42c78259-797d-4508-807c-77c3d325d344" returned: 0 in 0.986s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:49:50 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-6f6ffb34-f084-481d-a11b-d5c28bf9d2b2 tempest-TestShelveInstance-1751178727 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-42c78259-797d-4508-807c-77c3d325d344 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:49:50 devstack sudo[103031]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-42c78259-797d-4508-807c-77c3d325d344 Jul 10 04:49:50 devstack sudo[103031]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:49:50 devstack sudo[103026]: pam_unix(sudo:session): session closed for user root Jul 10 04:49:50 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-75b8b932-a69f-48ae-b233-52dbaeb869b3 tempest-ProjectReaderTests-820994271 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097" returned: 0 in 0.753s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:49:50 devstack cinder-volume[87444]: DEBUG cinder.manager [None req-75b8b932-a69f-48ae-b233-52dbaeb869b3 tempest-ProjectReaderTests-820994271 None] Notifying Schedulers of capabilities ... {{(pid=87444) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 04:49:50 devstack cinder-volume[87444]: INFO cinder.volume.manager [None req-75b8b932-a69f-48ae-b233-52dbaeb869b3 tempest-ProjectReaderTests-820994271 None] Deleted volume successfully. Jul 10 04:49:50 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-75b8b932-a69f-48ae-b233-52dbaeb869b3 tempest-ProjectReaderTests-820994271 None] Lock "cinder-f83f1766-39c7-4358-8741-012e839bb96f-delete_volume" released by "delete_volume" :: held 3.326s {{(pid=87444) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 04:49:50 devstack sudo[103025]: pam_unix(sudo:session): session closed for user root Jul 10 04:49:50 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-3242b1fe-7a17-4ca7-a5a7-7916483b264f tempest-VolumeAndVolumeTypeFromImageTest-382088631 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-2488f7a8-ee5c-4619-9699-35e98c194a03" returned: 0 in 0.963s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:49:50 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-3242b1fe-7a17-4ca7-a5a7-7916483b264f tempest-VolumeAndVolumeTypeFromImageTest-382088631 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-2488f7a8-ee5c-4619-9699-35e98c194a03 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:49:50 devstack sudo[103036]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-2488f7a8-ee5c-4619-9699-35e98c194a03 Jul 10 04:49:50 devstack sudo[103036]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:49:51 devstack sudo[103031]: pam_unix(sudo:session): session closed for user root Jul 10 04:49:51 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-6f6ffb34-f084-481d-a11b-d5c28bf9d2b2 tempest-TestShelveInstance-1751178727 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-42c78259-797d-4508-807c-77c3d325d344" returned: 1 in 0.983s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:49:51 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-6f6ffb34-f084-481d-a11b-d5c28bf9d2b2 tempest-TestShelveInstance-1751178727 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-42c78259-797d-4508-807c-77c3d325d344' failed. Not Retrying. {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 10 04:49:51 devstack cinder-volume[87444]: DEBUG cinder.volume.volume_utils [None req-6f6ffb34-f084-481d-a11b-d5c28bf9d2b2 tempest-TestShelveInstance-1751178727 None] Downloaded image 5ac2ee4b-64bc-499a-b553-ae96ba343fc0 ((None, [{'url': 'file:///opt/stack/data/glance/images/5ac2ee4b-64bc-499a-b553-ae96ba343fc0', 'metadata': {}}])) to volume 42c78259-797d-4508-807c-77c3d325d344 successfully. {{(pid=87444) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jul 10 04:49:51 devstack cinder-volume[87444]: DEBUG cinder.image.image_utils [None req-6f6ffb34-f084-481d-a11b-d5c28bf9d2b2 tempest-TestShelveInstance-1751178727 None] Temporary image 5ac2ee4b-64bc-499a-b553-ae96ba343fc0 for user df7b496a5dd145c28ae8b656a6b3d26e is deleted. {{(pid=87444) fetch /opt/stack/cinder/cinder/image/image_utils.py:1468}} Jul 10 04:49:51 devstack cinder-volume[87444]: DEBUG cinder.volume.volume_utils [None req-6f6ffb34-f084-481d-a11b-d5c28bf9d2b2 tempest-TestShelveInstance-1751178727 None] Marking volume 42c78259-797d-4508-807c-77c3d325d344 as bootable. {{(pid=87444) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jul 10 04:49:51 devstack cinder-volume[87444]: DEBUG cinder.volume.flows.manager.create_volume [None req-6f6ffb34-f084-481d-a11b-d5c28bf9d2b2 tempest-TestShelveInstance-1751178727 None] Copying metadata from image 5ac2ee4b-64bc-499a-b553-ae96ba343fc0 to 42c78259-797d-4508-807c-77c3d325d344. {{(pid=87444) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jul 10 04:49:51 devstack cinder-volume[87444]: DEBUG cinder.volume.flows.manager.create_volume [None req-6f6ffb34-f084-481d-a11b-d5c28bf9d2b2 tempest-TestShelveInstance-1751178727 None] Creating volume glance metadata for volume 42c78259-797d-4508-807c-77c3d325d344 backed by image 5ac2ee4b-64bc-499a-b553-ae96ba343fc0 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '5ac2ee4b-64bc-499a-b553-ae96ba343fc0', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=87444) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jul 10 04:49:51 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-6f6ffb34-f084-481d-a11b-d5c28bf9d2b2 tempest-TestShelveInstance-1751178727 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6778b457-3d50-48d6-b494-d544a24db415) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-42c78259-797d-4508-807c-77c3d325d344', 'volume_size': 1, 'image_id': '5ac2ee4b-64bc-499a-b553-ae96ba343fc0', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/5ac2ee4b-64bc-499a-b553-ae96ba343fc0', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'ca4bb946b593473194351a84617cf92e', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '5ac2ee4b-64bc-499a-b553-ae96ba343fc0', 'created_at': datetime.datetime(2026, 7, 10, 2, 26, 36, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 10, 2, 26, 38, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/5ac2ee4b-64bc-499a-b553-ae96ba343fc0/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:49:51 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-6f6ffb34-f084-481d-a11b-d5c28bf9d2b2 tempest-TestShelveInstance-1751178727 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7e3bf65c-be60-4b3d-b462-64705940f8cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:49:51 devstack cinder-volume[87444]: INFO cinder.volume.flows.manager.create_volume [None req-6f6ffb34-f084-481d-a11b-d5c28bf9d2b2 tempest-TestShelveInstance-1751178727 None] Volume volume-42c78259-797d-4508-807c-77c3d325d344 (42c78259-797d-4508-807c-77c3d325d344): created successfully Jul 10 04:49:51 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-6f6ffb34-f084-481d-a11b-d5c28bf9d2b2 tempest-TestShelveInstance-1751178727 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7e3bf65c-be60-4b3d-b462-64705940f8cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:49:51 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-6f6ffb34-f084-481d-a11b-d5c28bf9d2b2 tempest-TestShelveInstance-1751178727 None] Flow 'volume_create_manager' (e9bbe212-ef58-4c9f-a3db-dea8d555e053) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87444) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 04:49:51 devstack cinder-volume[87444]: INFO cinder.volume.manager [None req-6f6ffb34-f084-481d-a11b-d5c28bf9d2b2 tempest-TestShelveInstance-1751178727 None] Created volume successfully. Jul 10 04:49:51 devstack cinder-volume[87444]: DEBUG cinder.volume.flows.manager.create_volume [None req-f090f662-4ddf-4972-9c25-2472fd65160b tempest-ProjectReaderTests-820994271 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87444) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 04:49:51 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-f090f662-4ddf-4972-9c25-2472fd65160b tempest-ProjectReaderTests-820994271 None] Flow 'volume_create_manager' (b1645de7-2c7d-48c0-affb-5a4efd252423) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 04:49:51 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-f090f662-4ddf-4972-9c25-2472fd65160b tempest-ProjectReaderTests-820994271 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8c9dbdd7-3491-42fc-8db1-f2eee1a1e282) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:49:51 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-f090f662-4ddf-4972-9c25-2472fd65160b tempest-ProjectReaderTests-820994271 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8c9dbdd7-3491-42fc-8db1-f2eee1a1e282) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T02:49:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1832601826',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=448cceb8-767a-4e88-8b9c-144c454fd67e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='470e3d956a5245208bd3ef78f1cb00e6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T02:49:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T02:49:51Z,use_quota=True,user_id='f8791f162a0f41a9a4ae6f738813098e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(317e369e-1e06-434d-ae95-a335f0e6c903),volume_type_id=317e369e-1e06-434d-ae95-a335f0e6c903)' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:49:51 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-f090f662-4ddf-4972-9c25-2472fd65160b tempest-ProjectReaderTests-820994271 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b44e4a18-97a3-4fe5-a7db-aa6a8991e129) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:49:51 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-f090f662-4ddf-4972-9c25-2472fd65160b tempest-ProjectReaderTests-820994271 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b44e4a18-97a3-4fe5-a7db-aa6a8991e129) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:49:51 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-f090f662-4ddf-4972-9c25-2472fd65160b tempest-ProjectReaderTests-820994271 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ad40100e-5308-4648-8429-9a69d12efb9c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:49:51 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-f090f662-4ddf-4972-9c25-2472fd65160b tempest-ProjectReaderTests-820994271 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ad40100e-5308-4648-8429-9a69d12efb9c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '448cceb8-767a-4e88-8b9c-144c454fd67e', 'volume_name': 'volume-448cceb8-767a-4e88-8b9c-144c454fd67e', 'volume_size': 1}' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:49:51 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-f090f662-4ddf-4972-9c25-2472fd65160b tempest-ProjectReaderTests-820994271 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (56459c73-2df3-4d24-bc39-1311a12086bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:49:51 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-f090f662-4ddf-4972-9c25-2472fd65160b tempest-ProjectReaderTests-820994271 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (56459c73-2df3-4d24-bc39-1311a12086bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:49:51 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-f090f662-4ddf-4972-9c25-2472fd65160b tempest-ProjectReaderTests-820994271 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c794dee2-6d25-4f70-9056-c0b414e10af6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:49:51 devstack cinder-volume[87444]: INFO cinder.volume.flows.manager.create_volume [None req-f090f662-4ddf-4972-9c25-2472fd65160b tempest-ProjectReaderTests-820994271 None] Volume 448cceb8-767a-4e88-8b9c-144c454fd67e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-448cceb8-767a-4e88-8b9c-144c454fd67e', 'volume_size': 1} Jul 10 04:49:51 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-f090f662-4ddf-4972-9c25-2472fd65160b tempest-ProjectReaderTests-820994271 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 04:49:51 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-f090f662-4ddf-4972-9c25-2472fd65160b tempest-ProjectReaderTests-820994271 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 04:49:51 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-f090f662-4ddf-4972-9c25-2472fd65160b tempest-ProjectReaderTests-820994271 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T02:49:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1832601826',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=448cceb8-767a-4e88-8b9c-144c454fd67e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='470e3d956a5245208bd3ef78f1cb00e6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T02:49:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T02:49:51Z,use_quota=True,user_id='f8791f162a0f41a9a4ae6f738813098e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(317e369e-1e06-434d-ae95-a335f0e6c903),volume_type_id=317e369e-1e06-434d-ae95-a335f0e6c903)}" {{(pid=87444) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 04:49:51 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.remotefs [None req-f090f662-4ddf-4972-9c25-2472fd65160b tempest-ProjectReaderTests-820994271 None] Creating volume 448cceb8-767a-4e88-8b9c-144c454fd67e {{(pid=87444) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 04:49:51 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-f090f662-4ddf-4972-9c25-2472fd65160b tempest-ProjectReaderTests-820994271 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 04:49:51 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-f090f662-4ddf-4972-9c25-2472fd65160b tempest-ProjectReaderTests-820994271 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 04:49:51 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-f090f662-4ddf-4972-9c25-2472fd65160b tempest-ProjectReaderTests-820994271 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922': None} {{(pid=87444) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 04:49:51 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-f090f662-4ddf-4972-9c25-2472fd65160b tempest-ProjectReaderTests-820994271 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922'] {{(pid=87444) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 04:49:51 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-f090f662-4ddf-4972-9c25-2472fd65160b tempest-ProjectReaderTests-820994271 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 04:49:51 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-f090f662-4ddf-4972-9c25-2472fd65160b tempest-ProjectReaderTests-820994271 None] Selected osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922 as target Quobyte volume. {{(pid=87444) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 04:49:51 devstack cinder-volume[87444]: INFO cinder.volume.drivers.remotefs [None req-f090f662-4ddf-4972-9c25-2472fd65160b tempest-ProjectReaderTests-820994271 None] casted to osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922 Jul 10 04:49:51 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-f090f662-4ddf-4972-9c25-2472fd65160b tempest-ProjectReaderTests-820994271 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-448cceb8-767a-4e88-8b9c-144c454fd67e 1073741824 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:49:51 devstack sudo[103041]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-448cceb8-767a-4e88-8b9c-144c454fd67e 1073741824 Jul 10 04:49:51 devstack sudo[103041]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:49:51 devstack sudo[103036]: pam_unix(sudo:session): session closed for user root Jul 10 04:49:51 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-3242b1fe-7a17-4ca7-a5a7-7916483b264f tempest-VolumeAndVolumeTypeFromImageTest-382088631 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-2488f7a8-ee5c-4619-9699-35e98c194a03" returned: 1 in 1.037s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:49:51 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-3242b1fe-7a17-4ca7-a5a7-7916483b264f tempest-VolumeAndVolumeTypeFromImageTest-382088631 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-2488f7a8-ee5c-4619-9699-35e98c194a03' failed. Not Retrying. {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 10 04:49:51 devstack cinder-volume[87444]: DEBUG cinder.volume.volume_utils [None req-3242b1fe-7a17-4ca7-a5a7-7916483b264f tempest-VolumeAndVolumeTypeFromImageTest-382088631 None] Downloaded image 476ea92a-bf56-4e73-a1b0-bfdd1a0c86ec ((None, [{'url': 'file:///opt/stack/data/glance/images/476ea92a-bf56-4e73-a1b0-bfdd1a0c86ec', 'metadata': {}}])) to volume 2488f7a8-ee5c-4619-9699-35e98c194a03 successfully. {{(pid=87444) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jul 10 04:49:51 devstack cinder-volume[87444]: DEBUG cinder.image.image_utils [None req-3242b1fe-7a17-4ca7-a5a7-7916483b264f tempest-VolumeAndVolumeTypeFromImageTest-382088631 None] Temporary image 476ea92a-bf56-4e73-a1b0-bfdd1a0c86ec for user 69c6c5cf459648169a8761f65b88512f is deleted. {{(pid=87444) fetch /opt/stack/cinder/cinder/image/image_utils.py:1468}} Jul 10 04:49:51 devstack cinder-volume[87444]: DEBUG cinder.volume.volume_utils [None req-3242b1fe-7a17-4ca7-a5a7-7916483b264f tempest-VolumeAndVolumeTypeFromImageTest-382088631 None] Marking volume 2488f7a8-ee5c-4619-9699-35e98c194a03 as bootable. {{(pid=87444) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jul 10 04:49:51 devstack cinder-volume[87444]: DEBUG cinder.volume.flows.manager.create_volume [None req-3242b1fe-7a17-4ca7-a5a7-7916483b264f tempest-VolumeAndVolumeTypeFromImageTest-382088631 None] Copying metadata from image 476ea92a-bf56-4e73-a1b0-bfdd1a0c86ec to 2488f7a8-ee5c-4619-9699-35e98c194a03. {{(pid=87444) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jul 10 04:49:51 devstack cinder-volume[87444]: DEBUG cinder.volume.flows.manager.create_volume [None req-3242b1fe-7a17-4ca7-a5a7-7916483b264f tempest-VolumeAndVolumeTypeFromImageTest-382088631 None] Creating volume glance metadata for volume 2488f7a8-ee5c-4619-9699-35e98c194a03 backed by image 476ea92a-bf56-4e73-a1b0-bfdd1a0c86ec with: {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'image_id': '476ea92a-bf56-4e73-a1b0-bfdd1a0c86ec', 'image_name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'checksum': '80a47fa462b8e5765206371866e5910b', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=87444) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jul 10 04:49:51 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-3242b1fe-7a17-4ca7-a5a7-7916483b264f tempest-VolumeAndVolumeTypeFromImageTest-382088631 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (218a3e7f-4f6e-44f8-b8c3-bd2dbb40a336) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2488f7a8-ee5c-4619-9699-35e98c194a03', 'volume_size': 1, 'image_id': '476ea92a-bf56-4e73-a1b0-bfdd1a0c86ec', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/476ea92a-bf56-4e73-a1b0-bfdd1a0c86ec', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '80a47fa462b8e5765206371866e5910b', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '4e0dfe5ed0a649e1b0382f82c6477510', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '99ffd30e1be620ad030985581c986d69b06af921439bb7f395466f90ffd8be109df5f5738aa4ed9a1c81a71c68fdc80389c034b464fb03676cf42f72433df429', 'id': '476ea92a-bf56-4e73-a1b0-bfdd1a0c86ec', 'created_at': datetime.datetime(2026, 7, 10, 2, 49, 31, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 10, 2, 49, 33, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/476ea92a-bf56-4e73-a1b0-bfdd1a0c86ec/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:49:51 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-3242b1fe-7a17-4ca7-a5a7-7916483b264f tempest-VolumeAndVolumeTypeFromImageTest-382088631 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a4b805ae-9036-4aea-8469-62b291f18b99) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:49:52 devstack cinder-volume[87444]: INFO cinder.volume.flows.manager.create_volume [None req-3242b1fe-7a17-4ca7-a5a7-7916483b264f tempest-VolumeAndVolumeTypeFromImageTest-382088631 None] Volume volume-2488f7a8-ee5c-4619-9699-35e98c194a03 (2488f7a8-ee5c-4619-9699-35e98c194a03): created successfully Jul 10 04:49:52 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-3242b1fe-7a17-4ca7-a5a7-7916483b264f tempest-VolumeAndVolumeTypeFromImageTest-382088631 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a4b805ae-9036-4aea-8469-62b291f18b99) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:49:52 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-3242b1fe-7a17-4ca7-a5a7-7916483b264f tempest-VolumeAndVolumeTypeFromImageTest-382088631 None] Flow 'volume_create_manager' (8320762d-5df0-40f0-be56-c9456f557515) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87444) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 04:49:52 devstack cinder-volume[87444]: INFO cinder.volume.manager [None req-3242b1fe-7a17-4ca7-a5a7-7916483b264f tempest-VolumeAndVolumeTypeFromImageTest-382088631 None] Created volume successfully. Jul 10 04:49:52 devstack sudo[103041]: pam_unix(sudo:session): session closed for user root Jul 10 04:49:52 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-f090f662-4ddf-4972-9c25-2472fd65160b tempest-ProjectReaderTests-820994271 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-448cceb8-767a-4e88-8b9c-144c454fd67e 1073741824" returned: 0 in 1.044s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:49:52 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-f090f662-4ddf-4972-9c25-2472fd65160b tempest-ProjectReaderTests-820994271 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-448cceb8-767a-4e88-8b9c-144c454fd67e {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:49:52 devstack sudo[103053]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-448cceb8-767a-4e88-8b9c-144c454fd67e Jul 10 04:49:52 devstack sudo[103053]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:49:53 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-02d0e3d8-44cc-43df-95f4-12a2ff10071c tempest-VolumeAndVolumeTypeFromImageTest-382088631 None] Acquiring lock "cinder-2488f7a8-ee5c-4619-9699-35e98c194a03-delete_volume" by "delete_volume" {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 04:49:53 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-02d0e3d8-44cc-43df-95f4-12a2ff10071c tempest-VolumeAndVolumeTypeFromImageTest-382088631 None] Lock "cinder-2488f7a8-ee5c-4619-9699-35e98c194a03-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 04:49:53 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-02d0e3d8-44cc-43df-95f4-12a2ff10071c tempest-VolumeAndVolumeTypeFromImageTest-382088631 None] Acquiring lock "cinder-quobyte-2488f7a8-ee5c-4619-9699-35e98c194a03" by "delete_volume" {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 04:49:53 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-02d0e3d8-44cc-43df-95f4-12a2ff10071c tempest-VolumeAndVolumeTypeFromImageTest-382088631 None] Lock "cinder-quobyte-2488f7a8-ee5c-4619-9699-35e98c194a03" acquired by "delete_volume" :: waited 0.023s {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 04:49:53 devstack cinder-volume[87444]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ae0df99-edf3-4648-a779-8ee0d8bc0532]: (4, 'raw') {{(pid=88499) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 04:49:53 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-02d0e3d8-44cc-43df-95f4-12a2ff10071c tempest-VolumeAndVolumeTypeFromImageTest-382088631 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-2488f7a8-ee5c-4619-9699-35e98c194a03 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:49:53 devstack sudo[103055]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-2488f7a8-ee5c-4619-9699-35e98c194a03 Jul 10 04:49:53 devstack sudo[103055]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:49:53 devstack sudo[103053]: pam_unix(sudo:session): session closed for user root Jul 10 04:49:53 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-f090f662-4ddf-4972-9c25-2472fd65160b tempest-ProjectReaderTests-820994271 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-448cceb8-767a-4e88-8b9c-144c454fd67e" returned: 0 in 0.836s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:49:53 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-f090f662-4ddf-4972-9c25-2472fd65160b tempest-ProjectReaderTests-820994271 None] <== create_volume: return (1931ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922'} {{(pid=87444) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 04:49:53 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-f090f662-4ddf-4972-9c25-2472fd65160b tempest-ProjectReaderTests-820994271 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.934s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 04:49:53 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-f090f662-4ddf-4972-9c25-2472fd65160b tempest-ProjectReaderTests-820994271 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c794dee2-6d25-4f70-9056-c0b414e10af6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-448cceb8-767a-4e88-8b9c-144c454fd67e', 'volume_size': 1}' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:49:53 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-f090f662-4ddf-4972-9c25-2472fd65160b tempest-ProjectReaderTests-820994271 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d70c40a2-f890-4e50-86d3-87859c955a64) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:49:53 devstack cinder-volume[87444]: INFO cinder.volume.flows.manager.create_volume [None req-f090f662-4ddf-4972-9c25-2472fd65160b tempest-ProjectReaderTests-820994271 None] Volume volume-448cceb8-767a-4e88-8b9c-144c454fd67e (448cceb8-767a-4e88-8b9c-144c454fd67e): created successfully Jul 10 04:49:53 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-f090f662-4ddf-4972-9c25-2472fd65160b tempest-ProjectReaderTests-820994271 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d70c40a2-f890-4e50-86d3-87859c955a64) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:49:53 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-f090f662-4ddf-4972-9c25-2472fd65160b tempest-ProjectReaderTests-820994271 None] Flow 'volume_create_manager' (b1645de7-2c7d-48c0-affb-5a4efd252423) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87444) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 04:49:53 devstack cinder-volume[87444]: INFO cinder.volume.manager [None req-f090f662-4ddf-4972-9c25-2472fd65160b tempest-ProjectReaderTests-820994271 None] Created volume successfully. Jul 10 04:49:54 devstack sudo[103055]: pam_unix(sudo:session): session closed for user root Jul 10 04:49:54 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-02d0e3d8-44cc-43df-95f4-12a2ff10071c tempest-VolumeAndVolumeTypeFromImageTest-382088631 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-2488f7a8-ee5c-4619-9699-35e98c194a03" returned: 0 in 0.907s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:49:54 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-02d0e3d8-44cc-43df-95f4-12a2ff10071c tempest-VolumeAndVolumeTypeFromImageTest-382088631 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-2488f7a8-ee5c-4619-9699-35e98c194a03 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:49:54 devstack sudo[103061]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-2488f7a8-ee5c-4619-9699-35e98c194a03 Jul 10 04:49:54 devstack sudo[103061]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:49:54 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-b2372888-63a6-4f1b-a998-1b4373bb9abd tempest-ProjectReaderTests-820994271 None] Acquiring lock "cinder-448cceb8-767a-4e88-8b9c-144c454fd67e-delete_volume" by "delete_volume" {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 04:49:54 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-b2372888-63a6-4f1b-a998-1b4373bb9abd tempest-ProjectReaderTests-820994271 None] Lock "cinder-448cceb8-767a-4e88-8b9c-144c454fd67e-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 04:49:54 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-b2372888-63a6-4f1b-a998-1b4373bb9abd tempest-ProjectReaderTests-820994271 None] Acquiring lock "cinder-quobyte-448cceb8-767a-4e88-8b9c-144c454fd67e" by "delete_volume" {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 04:49:54 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-b2372888-63a6-4f1b-a998-1b4373bb9abd tempest-ProjectReaderTests-820994271 None] Lock "cinder-quobyte-448cceb8-767a-4e88-8b9c-144c454fd67e" acquired by "delete_volume" :: waited 0.017s {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 04:49:54 devstack cinder-volume[87444]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2f7f91f-69a7-425d-9c15-c3d7e240cd41]: (4, 'qcow2') {{(pid=88499) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 04:49:54 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-b2372888-63a6-4f1b-a998-1b4373bb9abd tempest-ProjectReaderTests-820994271 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-448cceb8-767a-4e88-8b9c-144c454fd67e {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:49:55 devstack sudo[103063]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-448cceb8-767a-4e88-8b9c-144c454fd67e Jul 10 04:49:55 devstack sudo[103063]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:49:55 devstack sudo[103061]: pam_unix(sudo:session): session closed for user root Jul 10 04:49:55 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-02d0e3d8-44cc-43df-95f4-12a2ff10071c tempest-VolumeAndVolumeTypeFromImageTest-382088631 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-2488f7a8-ee5c-4619-9699-35e98c194a03" returned: 1 in 0.944s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:49:55 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-02d0e3d8-44cc-43df-95f4-12a2ff10071c tempest-VolumeAndVolumeTypeFromImageTest-382088631 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-2488f7a8-ee5c-4619-9699-35e98c194a03' failed. Not Retrying. {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 10 04:49:55 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-02d0e3d8-44cc-43df-95f4-12a2ff10071c tempest-VolumeAndVolumeTypeFromImageTest-382088631 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-2488f7a8-ee5c-4619-9699-35e98c194a03 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:49:55 devstack sudo[103068]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-2488f7a8-ee5c-4619-9699-35e98c194a03 Jul 10 04:49:55 devstack sudo[103068]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:49:55 devstack sudo[103063]: pam_unix(sudo:session): session closed for user root Jul 10 04:49:55 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-b2372888-63a6-4f1b-a998-1b4373bb9abd tempest-ProjectReaderTests-820994271 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-448cceb8-767a-4e88-8b9c-144c454fd67e" returned: 0 in 1.046s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:49:55 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-b2372888-63a6-4f1b-a998-1b4373bb9abd tempest-ProjectReaderTests-820994271 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-448cceb8-767a-4e88-8b9c-144c454fd67e {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:49:55 devstack sudo[103075]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-448cceb8-767a-4e88-8b9c-144c454fd67e Jul 10 04:49:55 devstack sudo[103075]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:49:56 devstack sudo[103068]: pam_unix(sudo:session): session closed for user root Jul 10 04:49:56 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-02d0e3d8-44cc-43df-95f4-12a2ff10071c tempest-VolumeAndVolumeTypeFromImageTest-382088631 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-2488f7a8-ee5c-4619-9699-35e98c194a03" returned: 0 in 0.839s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:49:56 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-02d0e3d8-44cc-43df-95f4-12a2ff10071c tempest-VolumeAndVolumeTypeFromImageTest-382088631 None] Lock "cinder-quobyte-2488f7a8-ee5c-4619-9699-35e98c194a03" released by "delete_volume" :: held 2.800s {{(pid=87444) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 04:49:56 devstack cinder-volume[87444]: WARNING cinder.quota [None req-02d0e3d8-44cc-43df-95f4-12a2ff10071c tempest-VolumeAndVolumeTypeFromImageTest-382088631 None] Deprecated: Default quota for resource: volumes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6 is set by the default quota flag: quota_volumes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6, it is now deprecated. Please use the default quota class for default quota. Jul 10 04:49:56 devstack cinder-volume[87444]: WARNING cinder.quota [None req-02d0e3d8-44cc-43df-95f4-12a2ff10071c tempest-VolumeAndVolumeTypeFromImageTest-382088631 None] Deprecated: Default quota for resource: gigabytes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6 is set by the default quota flag: quota_gigabytes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6, it is now deprecated. Please use the default quota class for default quota. Jul 10 04:49:56 devstack cinder-volume[87444]: DEBUG cinder.quota [None req-02d0e3d8-44cc-43df-95f4-12a2ff10071c tempest-VolumeAndVolumeTypeFromImageTest-382088631 None] Created reservations ['1afc612a-a433-4e63-a4d2-091814759737', '98e3ec85-9226-45d2-bdd3-071d6d2da37e', 'd1ee8cbf-ee11-41a2-8141-5d2ec232bec7', '55ef41aa-9b5d-4508-ba12-d907cb5cdc54'] {{(pid=87444) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 04:49:56 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-02d0e3d8-44cc-43df-95f4-12a2ff10071c tempest-VolumeAndVolumeTypeFromImageTest-382088631 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 04:49:56 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-02d0e3d8-44cc-43df-95f4-12a2ff10071c tempest-VolumeAndVolumeTypeFromImageTest-382088631 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 04:49:56 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-02d0e3d8-44cc-43df-95f4-12a2ff10071c tempest-VolumeAndVolumeTypeFromImageTest-382088631 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922': None} {{(pid=87444) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 04:49:56 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-02d0e3d8-44cc-43df-95f4-12a2ff10071c tempest-VolumeAndVolumeTypeFromImageTest-382088631 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922'] {{(pid=87444) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 04:49:56 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-02d0e3d8-44cc-43df-95f4-12a2ff10071c tempest-VolumeAndVolumeTypeFromImageTest-382088631 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 04:49:56 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-02d0e3d8-44cc-43df-95f4-12a2ff10071c tempest-VolumeAndVolumeTypeFromImageTest-382088631 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:49:56 devstack sudo[103077]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097 Jul 10 04:49:56 devstack sudo[103077]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:49:56 devstack sudo[103075]: pam_unix(sudo:session): session closed for user root Jul 10 04:49:56 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-b2372888-63a6-4f1b-a998-1b4373bb9abd tempest-ProjectReaderTests-820994271 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-448cceb8-767a-4e88-8b9c-144c454fd67e" returned: 0 in 0.762s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:49:56 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-b2372888-63a6-4f1b-a998-1b4373bb9abd tempest-ProjectReaderTests-820994271 None] Lock "cinder-quobyte-448cceb8-767a-4e88-8b9c-144c454fd67e" released by "delete_volume" :: held 1.881s {{(pid=87444) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 04:49:56 devstack cinder-volume[87444]: DEBUG cinder.quota [None req-b2372888-63a6-4f1b-a998-1b4373bb9abd tempest-ProjectReaderTests-820994271 None] Created reservations ['6ed61c86-4a97-4e6a-b1a1-123473936ce5', '4bf392c2-b99b-4ad4-ba80-150ab4511a2c', '6e666b49-5fb0-49ff-8f98-33f6145d3c0b', '4149629c-46c2-4c38-a0bb-330daeabd5ba'] {{(pid=87444) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 04:49:56 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-b2372888-63a6-4f1b-a998-1b4373bb9abd tempest-ProjectReaderTests-820994271 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 04:49:56 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-b2372888-63a6-4f1b-a998-1b4373bb9abd tempest-ProjectReaderTests-820994271 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 04:49:56 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-b2372888-63a6-4f1b-a998-1b4373bb9abd tempest-ProjectReaderTests-820994271 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922': None} {{(pid=87444) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 04:49:56 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-b2372888-63a6-4f1b-a998-1b4373bb9abd tempest-ProjectReaderTests-820994271 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922'] {{(pid=87444) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 04:49:56 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-b2372888-63a6-4f1b-a998-1b4373bb9abd tempest-ProjectReaderTests-820994271 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 04:49:56 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-b2372888-63a6-4f1b-a998-1b4373bb9abd tempest-ProjectReaderTests-820994271 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:49:57 devstack sudo[103081]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097 Jul 10 04:49:57 devstack sudo[103081]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:49:57 devstack sudo[103077]: pam_unix(sudo:session): session closed for user root Jul 10 04:49:57 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-02d0e3d8-44cc-43df-95f4-12a2ff10071c tempest-VolumeAndVolumeTypeFromImageTest-382088631 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097" returned: 0 in 0.960s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:49:57 devstack cinder-volume[87444]: DEBUG cinder.manager [None req-02d0e3d8-44cc-43df-95f4-12a2ff10071c tempest-VolumeAndVolumeTypeFromImageTest-382088631 None] Notifying Schedulers of capabilities ... {{(pid=87444) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 04:49:57 devstack cinder-volume[87444]: INFO cinder.volume.manager [None req-02d0e3d8-44cc-43df-95f4-12a2ff10071c tempest-VolumeAndVolumeTypeFromImageTest-382088631 None] Deleted volume successfully. Jul 10 04:49:57 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-02d0e3d8-44cc-43df-95f4-12a2ff10071c tempest-VolumeAndVolumeTypeFromImageTest-382088631 None] Lock "cinder-2488f7a8-ee5c-4619-9699-35e98c194a03-delete_volume" released by "delete_volume" :: held 4.084s {{(pid=87444) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 04:49:57 devstack sudo[103081]: pam_unix(sudo:session): session closed for user root Jul 10 04:49:57 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-b2372888-63a6-4f1b-a998-1b4373bb9abd tempest-ProjectReaderTests-820994271 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097" returned: 0 in 1.022s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:49:57 devstack cinder-volume[87444]: DEBUG cinder.manager [None req-b2372888-63a6-4f1b-a998-1b4373bb9abd tempest-ProjectReaderTests-820994271 None] Notifying Schedulers of capabilities ... {{(pid=87444) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 04:49:57 devstack cinder-volume[87444]: INFO cinder.volume.manager [None req-b2372888-63a6-4f1b-a998-1b4373bb9abd tempest-ProjectReaderTests-820994271 None] Deleted volume successfully. Jul 10 04:49:58 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-b2372888-63a6-4f1b-a998-1b4373bb9abd tempest-ProjectReaderTests-820994271 None] Lock "cinder-448cceb8-767a-4e88-8b9c-144c454fd67e-delete_volume" released by "delete_volume" :: held 3.248s {{(pid=87444) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 04:49:59 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [req-c709dc5e-da46-47fa-9a54-1d9edd2b8674 req-4eb8e9a8-5af8-41f5-ad2a-e5c58cda7e6d tempest-TestShelveInstance-1751178727 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 04:49:59 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [req-c709dc5e-da46-47fa-9a54-1d9edd2b8674 req-4eb8e9a8-5af8-41f5-ad2a-e5c58cda7e6d tempest-TestShelveInstance-1751178727 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 04:49:59 devstack cinder-volume[87444]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6c2ea9a-fbea-448e-ac11-771d8045d127]: (4, 'raw') {{(pid=88499) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 04:49:59 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [req-c709dc5e-da46-47fa-9a54-1d9edd2b8674 req-4eb8e9a8-5af8-41f5-ad2a-e5c58cda7e6d tempest-TestShelveInstance-1751178727 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-42c78259-797d-4508-807c-77c3d325d344 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:49:59 devstack sudo[103092]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-42c78259-797d-4508-807c-77c3d325d344 Jul 10 04:49:59 devstack sudo[103092]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:50:00 devstack sudo[103092]: pam_unix(sudo:session): session closed for user root Jul 10 04:50:00 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [req-c709dc5e-da46-47fa-9a54-1d9edd2b8674 req-4eb8e9a8-5af8-41f5-ad2a-e5c58cda7e6d tempest-TestShelveInstance-1751178727 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-42c78259-797d-4508-807c-77c3d325d344" returned: 0 in 0.852s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:50:00 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [req-c709dc5e-da46-47fa-9a54-1d9edd2b8674 req-4eb8e9a8-5af8-41f5-ad2a-e5c58cda7e6d tempest-TestShelveInstance-1751178727 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-42c78259-797d-4508-807c-77c3d325d344 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:50:00 devstack sudo[103097]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-42c78259-797d-4508-807c-77c3d325d344 Jul 10 04:50:00 devstack sudo[103097]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:50:01 devstack sudo[103097]: pam_unix(sudo:session): session closed for user root Jul 10 04:50:01 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [req-c709dc5e-da46-47fa-9a54-1d9edd2b8674 req-4eb8e9a8-5af8-41f5-ad2a-e5c58cda7e6d tempest-TestShelveInstance-1751178727 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-42c78259-797d-4508-807c-77c3d325d344" returned: 1 in 0.858s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:50:01 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [req-c709dc5e-da46-47fa-9a54-1d9edd2b8674 req-4eb8e9a8-5af8-41f5-ad2a-e5c58cda7e6d tempest-TestShelveInstance-1751178727 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-42c78259-797d-4508-807c-77c3d325d344' failed. Not Retrying. {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 10 04:50:01 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [req-c709dc5e-da46-47fa-9a54-1d9edd2b8674 req-4eb8e9a8-5af8-41f5-ad2a-e5c58cda7e6d tempest-TestShelveInstance-1751178727 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.772s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 04:50:01 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [req-c709dc5e-da46-47fa-9a54-1d9edd2b8674 req-4eb8e9a8-5af8-41f5-ad2a-e5c58cda7e6d tempest-TestShelveInstance-1751178727 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922', 'name': 'volume-42c78259-797d-4508-807c-77c3d325d344', 'options': None, 'format': 'raw', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'd34c8649-5ffb-425b-92d9-a7a18ed97e34', 'enforce_multipath': True} {{(pid=87444) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 10 04:50:01 devstack cinder-volume[87444]: INFO cinder.volume.manager [req-c709dc5e-da46-47fa-9a54-1d9edd2b8674 req-4eb8e9a8-5af8-41f5-ad2a-e5c58cda7e6d tempest-TestShelveInstance-1751178727 None] attachment_update completed successfully. Jul 10 04:50:03 devstack cinder-volume[87444]: DEBUG cinder.volume.flows.manager.create_volume [None req-6a62f327-1db0-429f-90dc-d04b231b7c15 tempest-SnapshotDependencyTests-822583399 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87444) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 04:50:04 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-6a62f327-1db0-429f-90dc-d04b231b7c15 tempest-SnapshotDependencyTests-822583399 None] Flow 'volume_create_manager' (5433b65c-4be2-47df-b3b2-0fc8a39a17c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 04:50:04 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-6a62f327-1db0-429f-90dc-d04b231b7c15 tempest-SnapshotDependencyTests-822583399 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5102f8e0-9e26-4646-b89d-5619776464b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:50:04 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-6a62f327-1db0-429f-90dc-d04b231b7c15 tempest-SnapshotDependencyTests-822583399 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5102f8e0-9e26-4646-b89d-5619776464b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T02:50:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1247686694',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e6abedaf-8d01-4989-905f-8ae4b2095dee,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='97f2db4c12774c3599ec915009cc467e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T02:50:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T02:50:04Z,use_quota=True,user_id='8a13e133bbed41ce97f36d42e4fa0972',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(317e369e-1e06-434d-ae95-a335f0e6c903),volume_type_id=317e369e-1e06-434d-ae95-a335f0e6c903)' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:50:04 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-6a62f327-1db0-429f-90dc-d04b231b7c15 tempest-SnapshotDependencyTests-822583399 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (74fc3f2a-0607-4c44-978b-7a6a0f2d43f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:50:04 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-6a62f327-1db0-429f-90dc-d04b231b7c15 tempest-SnapshotDependencyTests-822583399 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (74fc3f2a-0607-4c44-978b-7a6a0f2d43f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:50:04 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-6a62f327-1db0-429f-90dc-d04b231b7c15 tempest-SnapshotDependencyTests-822583399 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (235dc7db-e27d-47f4-b772-3f516e16739e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:50:04 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-6a62f327-1db0-429f-90dc-d04b231b7c15 tempest-SnapshotDependencyTests-822583399 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (235dc7db-e27d-47f4-b772-3f516e16739e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e6abedaf-8d01-4989-905f-8ae4b2095dee', 'volume_name': 'volume-e6abedaf-8d01-4989-905f-8ae4b2095dee', 'volume_size': 1}' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:50:04 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-6a62f327-1db0-429f-90dc-d04b231b7c15 tempest-SnapshotDependencyTests-822583399 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a4beb988-1975-42cc-8cd8-86298511a128) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:50:04 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-6a62f327-1db0-429f-90dc-d04b231b7c15 tempest-SnapshotDependencyTests-822583399 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a4beb988-1975-42cc-8cd8-86298511a128) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:50:04 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-6a62f327-1db0-429f-90dc-d04b231b7c15 tempest-SnapshotDependencyTests-822583399 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a6c54c7e-b3a6-4df7-a09f-8120b201301a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:50:04 devstack cinder-volume[87444]: INFO cinder.volume.flows.manager.create_volume [None req-6a62f327-1db0-429f-90dc-d04b231b7c15 tempest-SnapshotDependencyTests-822583399 None] Volume e6abedaf-8d01-4989-905f-8ae4b2095dee: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e6abedaf-8d01-4989-905f-8ae4b2095dee', 'volume_size': 1} Jul 10 04:50:04 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-6a62f327-1db0-429f-90dc-d04b231b7c15 tempest-SnapshotDependencyTests-822583399 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 04:50:04 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-6a62f327-1db0-429f-90dc-d04b231b7c15 tempest-SnapshotDependencyTests-822583399 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 04:50:04 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-6a62f327-1db0-429f-90dc-d04b231b7c15 tempest-SnapshotDependencyTests-822583399 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T02:50:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1247686694',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e6abedaf-8d01-4989-905f-8ae4b2095dee,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='97f2db4c12774c3599ec915009cc467e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T02:50:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T02:50:04Z,use_quota=True,user_id='8a13e133bbed41ce97f36d42e4fa0972',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(317e369e-1e06-434d-ae95-a335f0e6c903),volume_type_id=317e369e-1e06-434d-ae95-a335f0e6c903)}" {{(pid=87444) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 04:50:04 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.remotefs [None req-6a62f327-1db0-429f-90dc-d04b231b7c15 tempest-SnapshotDependencyTests-822583399 None] Creating volume e6abedaf-8d01-4989-905f-8ae4b2095dee {{(pid=87444) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 04:50:04 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-6a62f327-1db0-429f-90dc-d04b231b7c15 tempest-SnapshotDependencyTests-822583399 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 04:50:04 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-6a62f327-1db0-429f-90dc-d04b231b7c15 tempest-SnapshotDependencyTests-822583399 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 04:50:04 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-6a62f327-1db0-429f-90dc-d04b231b7c15 tempest-SnapshotDependencyTests-822583399 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922': None} {{(pid=87444) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 04:50:04 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-6a62f327-1db0-429f-90dc-d04b231b7c15 tempest-SnapshotDependencyTests-822583399 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922'] {{(pid=87444) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 04:50:04 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-6a62f327-1db0-429f-90dc-d04b231b7c15 tempest-SnapshotDependencyTests-822583399 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 04:50:04 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-6a62f327-1db0-429f-90dc-d04b231b7c15 tempest-SnapshotDependencyTests-822583399 None] Selected osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922 as target Quobyte volume. {{(pid=87444) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 04:50:04 devstack cinder-volume[87444]: INFO cinder.volume.drivers.remotefs [None req-6a62f327-1db0-429f-90dc-d04b231b7c15 tempest-SnapshotDependencyTests-822583399 None] casted to osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922 Jul 10 04:50:04 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-6a62f327-1db0-429f-90dc-d04b231b7c15 tempest-SnapshotDependencyTests-822583399 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-e6abedaf-8d01-4989-905f-8ae4b2095dee 1073741824 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:50:04 devstack sudo[103108]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-e6abedaf-8d01-4989-905f-8ae4b2095dee 1073741824 Jul 10 04:50:04 devstack sudo[103108]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:50:05 devstack sudo[103108]: pam_unix(sudo:session): session closed for user root Jul 10 04:50:05 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-6a62f327-1db0-429f-90dc-d04b231b7c15 tempest-SnapshotDependencyTests-822583399 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-e6abedaf-8d01-4989-905f-8ae4b2095dee 1073741824" returned: 0 in 0.940s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:50:05 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-6a62f327-1db0-429f-90dc-d04b231b7c15 tempest-SnapshotDependencyTests-822583399 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-e6abedaf-8d01-4989-905f-8ae4b2095dee {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:50:05 devstack sudo[103113]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-e6abedaf-8d01-4989-905f-8ae4b2095dee Jul 10 04:50:05 devstack sudo[103113]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:50:05 devstack cinder-volume[87444]: DEBUG cinder.volume.flows.manager.create_volume [None req-d77f27ef-c491-4d26-b57f-7cf90a679eda tempest-VolumeDependencyTests-1582854059 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87444) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 04:50:05 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-d77f27ef-c491-4d26-b57f-7cf90a679eda tempest-VolumeDependencyTests-1582854059 None] Flow 'volume_create_manager' (74c4c54e-34da-4411-845c-76567877f5eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 04:50:05 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-d77f27ef-c491-4d26-b57f-7cf90a679eda tempest-VolumeDependencyTests-1582854059 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (12a46797-a3d3-4076-bafb-fc7f25b63d5d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:50:05 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-d77f27ef-c491-4d26-b57f-7cf90a679eda tempest-VolumeDependencyTests-1582854059 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (12a46797-a3d3-4076-bafb-fc7f25b63d5d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T02:50:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-6397681',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ddd97579-268b-4241-ad53-f3783e0e093b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ef2ca964d9da428d8b77844223c2c4b1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T02:50:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T02:50:06Z,use_quota=True,user_id='b7a9f5aad7374173b37091a90f3f289b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(317e369e-1e06-434d-ae95-a335f0e6c903),volume_type_id=317e369e-1e06-434d-ae95-a335f0e6c903)' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:50:05 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-d77f27ef-c491-4d26-b57f-7cf90a679eda tempest-VolumeDependencyTests-1582854059 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3a70e9ae-1404-4dfc-ad8f-9fc1f5900cf0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:50:05 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-d77f27ef-c491-4d26-b57f-7cf90a679eda tempest-VolumeDependencyTests-1582854059 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3a70e9ae-1404-4dfc-ad8f-9fc1f5900cf0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:50:05 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-d77f27ef-c491-4d26-b57f-7cf90a679eda tempest-VolumeDependencyTests-1582854059 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bb51657d-2cf8-47a5-a421-d35ca2175acf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:50:05 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-d77f27ef-c491-4d26-b57f-7cf90a679eda tempest-VolumeDependencyTests-1582854059 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bb51657d-2cf8-47a5-a421-d35ca2175acf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ddd97579-268b-4241-ad53-f3783e0e093b', 'volume_name': 'volume-ddd97579-268b-4241-ad53-f3783e0e093b', 'volume_size': 1}' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:50:05 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-d77f27ef-c491-4d26-b57f-7cf90a679eda tempest-VolumeDependencyTests-1582854059 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c2644494-3e8b-4bb8-bd56-c14bef7d50e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:50:05 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-d77f27ef-c491-4d26-b57f-7cf90a679eda tempest-VolumeDependencyTests-1582854059 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c2644494-3e8b-4bb8-bd56-c14bef7d50e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:50:05 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-d77f27ef-c491-4d26-b57f-7cf90a679eda tempest-VolumeDependencyTests-1582854059 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ef1257a8-c04e-4a14-92fc-6608672c83e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:50:05 devstack cinder-volume[87444]: INFO cinder.volume.flows.manager.create_volume [None req-d77f27ef-c491-4d26-b57f-7cf90a679eda tempest-VolumeDependencyTests-1582854059 None] Volume ddd97579-268b-4241-ad53-f3783e0e093b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ddd97579-268b-4241-ad53-f3783e0e093b', 'volume_size': 1} Jul 10 04:50:05 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-d77f27ef-c491-4d26-b57f-7cf90a679eda tempest-VolumeDependencyTests-1582854059 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 04:50:05 devstack sudo[103113]: pam_unix(sudo:session): session closed for user root Jul 10 04:50:05 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-6a62f327-1db0-429f-90dc-d04b231b7c15 tempest-SnapshotDependencyTests-822583399 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-e6abedaf-8d01-4989-905f-8ae4b2095dee" returned: 0 in 0.718s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:50:05 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-6a62f327-1db0-429f-90dc-d04b231b7c15 tempest-SnapshotDependencyTests-822583399 None] <== create_volume: return (1703ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922'} {{(pid=87444) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 04:50:05 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-6a62f327-1db0-429f-90dc-d04b231b7c15 tempest-SnapshotDependencyTests-822583399 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.706s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 04:50:05 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-d77f27ef-c491-4d26-b57f-7cf90a679eda tempest-VolumeDependencyTests-1582854059 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.112s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 04:50:05 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-d77f27ef-c491-4d26-b57f-7cf90a679eda tempest-VolumeDependencyTests-1582854059 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T02:50:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-6397681',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ddd97579-268b-4241-ad53-f3783e0e093b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ef2ca964d9da428d8b77844223c2c4b1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T02:50:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T02:50:06Z,use_quota=True,user_id='b7a9f5aad7374173b37091a90f3f289b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(317e369e-1e06-434d-ae95-a335f0e6c903),volume_type_id=317e369e-1e06-434d-ae95-a335f0e6c903)}" {{(pid=87444) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 04:50:05 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.remotefs [None req-d77f27ef-c491-4d26-b57f-7cf90a679eda tempest-VolumeDependencyTests-1582854059 None] Creating volume ddd97579-268b-4241-ad53-f3783e0e093b {{(pid=87444) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 04:50:05 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-d77f27ef-c491-4d26-b57f-7cf90a679eda tempest-VolumeDependencyTests-1582854059 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 04:50:05 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-d77f27ef-c491-4d26-b57f-7cf90a679eda tempest-VolumeDependencyTests-1582854059 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 04:50:05 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-d77f27ef-c491-4d26-b57f-7cf90a679eda tempest-VolumeDependencyTests-1582854059 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922': None} {{(pid=87444) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 04:50:05 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-d77f27ef-c491-4d26-b57f-7cf90a679eda tempest-VolumeDependencyTests-1582854059 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922'] {{(pid=87444) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 04:50:05 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-d77f27ef-c491-4d26-b57f-7cf90a679eda tempest-VolumeDependencyTests-1582854059 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 04:50:05 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-d77f27ef-c491-4d26-b57f-7cf90a679eda tempest-VolumeDependencyTests-1582854059 None] Selected osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922 as target Quobyte volume. {{(pid=87444) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 04:50:05 devstack cinder-volume[87444]: INFO cinder.volume.drivers.remotefs [None req-d77f27ef-c491-4d26-b57f-7cf90a679eda tempest-VolumeDependencyTests-1582854059 None] casted to osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922 Jul 10 04:50:05 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-d77f27ef-c491-4d26-b57f-7cf90a679eda tempest-VolumeDependencyTests-1582854059 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-ddd97579-268b-4241-ad53-f3783e0e093b 1073741824 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:50:05 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-6a62f327-1db0-429f-90dc-d04b231b7c15 tempest-SnapshotDependencyTests-822583399 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a6c54c7e-b3a6-4df7-a09f-8120b201301a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e6abedaf-8d01-4989-905f-8ae4b2095dee', 'volume_size': 1}' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:50:05 devstack sudo[103183]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-ddd97579-268b-4241-ad53-f3783e0e093b 1073741824 Jul 10 04:50:05 devstack sudo[103183]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:50:05 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-6a62f327-1db0-429f-90dc-d04b231b7c15 tempest-SnapshotDependencyTests-822583399 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6829f10e-d2fa-4922-b385-217fa2d3b9e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:50:05 devstack cinder-volume[87444]: INFO cinder.volume.flows.manager.create_volume [None req-6a62f327-1db0-429f-90dc-d04b231b7c15 tempest-SnapshotDependencyTests-822583399 None] Volume volume-e6abedaf-8d01-4989-905f-8ae4b2095dee (e6abedaf-8d01-4989-905f-8ae4b2095dee): created successfully Jul 10 04:50:05 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-6a62f327-1db0-429f-90dc-d04b231b7c15 tempest-SnapshotDependencyTests-822583399 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6829f10e-d2fa-4922-b385-217fa2d3b9e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:50:05 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-6a62f327-1db0-429f-90dc-d04b231b7c15 tempest-SnapshotDependencyTests-822583399 None] Flow 'volume_create_manager' (5433b65c-4be2-47df-b3b2-0fc8a39a17c9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87444) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 04:50:05 devstack cinder-volume[87444]: INFO cinder.volume.manager [None req-6a62f327-1db0-429f-90dc-d04b231b7c15 tempest-SnapshotDependencyTests-822583399 None] Created volume successfully. Jul 10 04:50:06 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-731188ef-e439-4fe6-8e4a-c36bb0f9d96b tempest-SnapshotDependencyTests-822583399 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 04:50:06 devstack sudo[103183]: pam_unix(sudo:session): session closed for user root Jul 10 04:50:06 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-d77f27ef-c491-4d26-b57f-7cf90a679eda tempest-VolumeDependencyTests-1582854059 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-ddd97579-268b-4241-ad53-f3783e0e093b 1073741824" returned: 0 in 0.907s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:50:06 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-d77f27ef-c491-4d26-b57f-7cf90a679eda tempest-VolumeDependencyTests-1582854059 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-ddd97579-268b-4241-ad53-f3783e0e093b {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:50:06 devstack sudo[103201]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-ddd97579-268b-4241-ad53-f3783e0e093b Jul 10 04:50:06 devstack sudo[103201]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:50:07 devstack sudo[103201]: pam_unix(sudo:session): session closed for user root Jul 10 04:50:07 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-d77f27ef-c491-4d26-b57f-7cf90a679eda tempest-VolumeDependencyTests-1582854059 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-ddd97579-268b-4241-ad53-f3783e0e093b" returned: 0 in 0.760s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:50:07 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-d77f27ef-c491-4d26-b57f-7cf90a679eda tempest-VolumeDependencyTests-1582854059 None] <== create_volume: return (1730ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922'} {{(pid=87444) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 04:50:07 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-d77f27ef-c491-4d26-b57f-7cf90a679eda tempest-VolumeDependencyTests-1582854059 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.732s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 04:50:07 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-731188ef-e439-4fe6-8e4a-c36bb0f9d96b tempest-SnapshotDependencyTests-822583399 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.229s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 04:50:07 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.remotefs [None req-731188ef-e439-4fe6-8e4a-c36bb0f9d96b tempest-SnapshotDependencyTests-822583399 None] Creating offline snapshot 312ffcb2-a08c-4922-81ca-68d444691040 of volume e6abedaf-8d01-4989-905f-8ae4b2095dee {{(pid=87444) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 10 04:50:07 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-d77f27ef-c491-4d26-b57f-7cf90a679eda tempest-VolumeDependencyTests-1582854059 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ef1257a8-c04e-4a14-92fc-6608672c83e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ddd97579-268b-4241-ad53-f3783e0e093b', 'volume_size': 1}' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:50:07 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-d77f27ef-c491-4d26-b57f-7cf90a679eda tempest-VolumeDependencyTests-1582854059 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a82429cb-c767-419f-91c2-488005787060) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:50:07 devstack cinder-volume[87444]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea5118b9-ba0c-4e1d-a2e2-ea69fe083f02]: (4, 'qcow2') {{(pid=88499) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 04:50:07 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-731188ef-e439-4fe6-8e4a-c36bb0f9d96b tempest-SnapshotDependencyTests-822583399 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-e6abedaf-8d01-4989-905f-8ae4b2095dee {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:50:07 devstack cinder-volume[87444]: INFO cinder.volume.flows.manager.create_volume [None req-d77f27ef-c491-4d26-b57f-7cf90a679eda tempest-VolumeDependencyTests-1582854059 None] Volume volume-ddd97579-268b-4241-ad53-f3783e0e093b (ddd97579-268b-4241-ad53-f3783e0e093b): created successfully Jul 10 04:50:07 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-d77f27ef-c491-4d26-b57f-7cf90a679eda tempest-VolumeDependencyTests-1582854059 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a82429cb-c767-419f-91c2-488005787060) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:50:07 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-d77f27ef-c491-4d26-b57f-7cf90a679eda tempest-VolumeDependencyTests-1582854059 None] Flow 'volume_create_manager' (74c4c54e-34da-4411-845c-76567877f5eb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87444) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 04:50:07 devstack cinder-volume[87444]: INFO cinder.volume.manager [None req-d77f27ef-c491-4d26-b57f-7cf90a679eda tempest-VolumeDependencyTests-1582854059 None] Created volume successfully. Jul 10 04:50:07 devstack sudo[103237]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-e6abedaf-8d01-4989-905f-8ae4b2095dee Jul 10 04:50:07 devstack sudo[103237]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:50:08 devstack sudo[103237]: pam_unix(sudo:session): session closed for user root Jul 10 04:50:08 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-731188ef-e439-4fe6-8e4a-c36bb0f9d96b tempest-SnapshotDependencyTests-822583399 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-e6abedaf-8d01-4989-905f-8ae4b2095dee" returned: 0 in 0.851s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:50:08 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-731188ef-e439-4fe6-8e4a-c36bb0f9d96b tempest-SnapshotDependencyTests-822583399 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-e6abedaf-8d01-4989-905f-8ae4b2095dee,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-e6abedaf-8d01-4989-905f-8ae4b2095dee.312ffcb2-a08c-4922-81ca-68d444691040 1G {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:50:08 devstack sudo[103564]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-e6abedaf-8d01-4989-905f-8ae4b2095dee,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-e6abedaf-8d01-4989-905f-8ae4b2095dee.312ffcb2-a08c-4922-81ca-68d444691040 1G Jul 10 04:50:08 devstack sudo[103564]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:50:09 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-b8e9fe59-f61a-4644-8bfc-80cd2124a33e tempest-VolumeDependencyTests-1582854059 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 04:50:09 devstack sudo[103564]: pam_unix(sudo:session): session closed for user root Jul 10 04:50:09 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-731188ef-e439-4fe6-8e4a-c36bb0f9d96b tempest-SnapshotDependencyTests-822583399 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-e6abedaf-8d01-4989-905f-8ae4b2095dee,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-e6abedaf-8d01-4989-905f-8ae4b2095dee.312ffcb2-a08c-4922-81ca-68d444691040 1G" returned: 0 in 0.964s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:50:09 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-731188ef-e439-4fe6-8e4a-c36bb0f9d96b tempest-SnapshotDependencyTests-822583399 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e6abedaf-8d01-4989-905f-8ae4b2095dee -F qcow2 /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-e6abedaf-8d01-4989-905f-8ae4b2095dee.312ffcb2-a08c-4922-81ca-68d444691040 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:50:09 devstack sudo[103579]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e6abedaf-8d01-4989-905f-8ae4b2095dee -F qcow2 /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-e6abedaf-8d01-4989-905f-8ae4b2095dee.312ffcb2-a08c-4922-81ca-68d444691040 Jul 10 04:50:09 devstack sudo[103579]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:50:10 devstack sudo[103579]: pam_unix(sudo:session): session closed for user root Jul 10 04:50:10 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-731188ef-e439-4fe6-8e4a-c36bb0f9d96b tempest-SnapshotDependencyTests-822583399 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e6abedaf-8d01-4989-905f-8ae4b2095dee -F qcow2 /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-e6abedaf-8d01-4989-905f-8ae4b2095dee.312ffcb2-a08c-4922-81ca-68d444691040" returned: 0 in 0.783s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:50:10 devstack cinder-volume[87444]: WARNING cinder.volume.drivers.remotefs [None req-731188ef-e439-4fe6-8e4a-c36bb0f9d96b tempest-SnapshotDependencyTests-822583399 None] /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-e6abedaf-8d01-4989-905f-8ae4b2095dee.312ffcb2-a08c-4922-81ca-68d444691040 is being set with open permissions: ugo+rw Jul 10 04:50:10 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-731188ef-e439-4fe6-8e4a-c36bb0f9d96b tempest-SnapshotDependencyTests-822583399 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-e6abedaf-8d01-4989-905f-8ae4b2095dee.312ffcb2-a08c-4922-81ca-68d444691040 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:50:10 devstack sudo[103587]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-e6abedaf-8d01-4989-905f-8ae4b2095dee.312ffcb2-a08c-4922-81ca-68d444691040 Jul 10 04:50:10 devstack sudo[103587]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:50:10 devstack sudo[103587]: pam_unix(sudo:session): session closed for user root Jul 10 04:50:10 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-731188ef-e439-4fe6-8e4a-c36bb0f9d96b tempest-SnapshotDependencyTests-822583399 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-e6abedaf-8d01-4989-905f-8ae4b2095dee.312ffcb2-a08c-4922-81ca-68d444691040" returned: 0 in 0.680s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:50:10 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-731188ef-e439-4fe6-8e4a-c36bb0f9d96b tempest-SnapshotDependencyTests-822583399 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-e6abedaf-8d01-4989-905f-8ae4b2095dee.info {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:50:10 devstack sudo[103590]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-e6abedaf-8d01-4989-905f-8ae4b2095dee.info Jul 10 04:50:10 devstack sudo[103590]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:50:11 devstack sudo[103590]: pam_unix(sudo:session): session closed for user root Jul 10 04:50:11 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-731188ef-e439-4fe6-8e4a-c36bb0f9d96b tempest-SnapshotDependencyTests-822583399 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-e6abedaf-8d01-4989-905f-8ae4b2095dee.info" returned: 0 in 0.782s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:50:11 devstack cinder-volume[87444]: WARNING cinder.volume.drivers.remotefs [None req-731188ef-e439-4fe6-8e4a-c36bb0f9d96b tempest-SnapshotDependencyTests-822583399 None] /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-e6abedaf-8d01-4989-905f-8ae4b2095dee.info is being set with open permissions: ugo+rw Jul 10 04:50:11 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-731188ef-e439-4fe6-8e4a-c36bb0f9d96b tempest-SnapshotDependencyTests-822583399 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-e6abedaf-8d01-4989-905f-8ae4b2095dee.info {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:50:11 devstack sudo[103593]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-e6abedaf-8d01-4989-905f-8ae4b2095dee.info Jul 10 04:50:11 devstack sudo[103593]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:50:12 devstack sudo[103593]: pam_unix(sudo:session): session closed for user root Jul 10 04:50:12 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-731188ef-e439-4fe6-8e4a-c36bb0f9d96b tempest-SnapshotDependencyTests-822583399 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-e6abedaf-8d01-4989-905f-8ae4b2095dee.info" returned: 0 in 0.735s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:50:12 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-731188ef-e439-4fe6-8e4a-c36bb0f9d96b tempest-SnapshotDependencyTests-822583399 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.921s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 04:50:12 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-b8e9fe59-f61a-4644-8bfc-80cd2124a33e tempest-VolumeDependencyTests-1582854059 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 3.482s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 04:50:12 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.remotefs [None req-b8e9fe59-f61a-4644-8bfc-80cd2124a33e tempest-VolumeDependencyTests-1582854059 None] Creating offline snapshot bbd96c96-7c5a-4eef-8963-4bde0d428b8d of volume ddd97579-268b-4241-ad53-f3783e0e093b {{(pid=87444) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 10 04:50:12 devstack cinder-volume[87444]: INFO cinder.volume.manager [None req-731188ef-e439-4fe6-8e4a-c36bb0f9d96b tempest-SnapshotDependencyTests-822583399 None] Create snapshot completed successfully Jul 10 04:50:12 devstack cinder-volume[87444]: DEBUG oslo.privsep.daemon [-] privsep: reply[20c8d590-e7b3-47f5-919f-6623bb80830c]: (4, 'qcow2') {{(pid=88499) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 04:50:12 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-b8e9fe59-f61a-4644-8bfc-80cd2124a33e tempest-VolumeDependencyTests-1582854059 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-ddd97579-268b-4241-ad53-f3783e0e093b {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:50:12 devstack sudo[103596]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-ddd97579-268b-4241-ad53-f3783e0e093b Jul 10 04:50:12 devstack sudo[103596]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:50:13 devstack cinder-volume[87444]: DEBUG cinder.volume.flows.manager.create_volume [None req-62282e5e-8df5-4984-9e5e-fdaaa707cbf2 tempest-SnapshotDependencyTests-822583399 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87444) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 04:50:13 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-62282e5e-8df5-4984-9e5e-fdaaa707cbf2 tempest-SnapshotDependencyTests-822583399 None] Flow 'volume_create_manager' (5a0a1188-dda2-4fdc-9624-67389fc6072f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 04:50:13 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-62282e5e-8df5-4984-9e5e-fdaaa707cbf2 tempest-SnapshotDependencyTests-822583399 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f253d7dc-f109-48cd-ba05-de28079979f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:50:13 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-62282e5e-8df5-4984-9e5e-fdaaa707cbf2 tempest-SnapshotDependencyTests-822583399 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f253d7dc-f109-48cd-ba05-de28079979f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T02:50:13Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3e720ae7-685c-4f3f-8625-c2f0b1273dbf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='97f2db4c12774c3599ec915009cc467e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T02:50:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=312ffcb2-a08c-4922-81ca-68d444691040,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T02:50:13Z,use_quota=True,user_id='8a13e133bbed41ce97f36d42e4fa0972',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(317e369e-1e06-434d-ae95-a335f0e6c903),volume_type_id=317e369e-1e06-434d-ae95-a335f0e6c903)' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:50:13 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-62282e5e-8df5-4984-9e5e-fdaaa707cbf2 tempest-SnapshotDependencyTests-822583399 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (033dcc4e-aaab-426c-8305-cee11d3bff96) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:50:13 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-62282e5e-8df5-4984-9e5e-fdaaa707cbf2 tempest-SnapshotDependencyTests-822583399 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (033dcc4e-aaab-426c-8305-cee11d3bff96) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:50:13 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-62282e5e-8df5-4984-9e5e-fdaaa707cbf2 tempest-SnapshotDependencyTests-822583399 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (94f1ac53-ef5a-4658-9a92-8e3137dab535) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:50:13 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-62282e5e-8df5-4984-9e5e-fdaaa707cbf2 tempest-SnapshotDependencyTests-822583399 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (94f1ac53-ef5a-4658-9a92-8e3137dab535) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '3e720ae7-685c-4f3f-8625-c2f0b1273dbf', 'volume_name': 'volume-3e720ae7-685c-4f3f-8625-c2f0b1273dbf', 'volume_size': 1, 'snapshot_id': '312ffcb2-a08c-4922-81ca-68d444691040'}' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:50:13 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-62282e5e-8df5-4984-9e5e-fdaaa707cbf2 tempest-SnapshotDependencyTests-822583399 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (732c6cf8-ec4e-46dd-8f58-29ec06888192) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:50:13 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-62282e5e-8df5-4984-9e5e-fdaaa707cbf2 tempest-SnapshotDependencyTests-822583399 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (732c6cf8-ec4e-46dd-8f58-29ec06888192) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:50:13 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-62282e5e-8df5-4984-9e5e-fdaaa707cbf2 tempest-SnapshotDependencyTests-822583399 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (291a34b6-5fde-41ad-bb0e-bbb9d43c7839) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:50:13 devstack cinder-volume[87444]: INFO cinder.volume.flows.manager.create_volume [None req-62282e5e-8df5-4984-9e5e-fdaaa707cbf2 tempest-SnapshotDependencyTests-822583399 None] Volume 3e720ae7-685c-4f3f-8625-c2f0b1273dbf: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-3e720ae7-685c-4f3f-8625-c2f0b1273dbf', 'volume_size': 1, 'snapshot_id': '312ffcb2-a08c-4922-81ca-68d444691040'} Jul 10 04:50:13 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-62282e5e-8df5-4984-9e5e-fdaaa707cbf2 tempest-SnapshotDependencyTests-822583399 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 04:50:13 devstack sudo[103596]: pam_unix(sudo:session): session closed for user root Jul 10 04:50:13 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-b8e9fe59-f61a-4644-8bfc-80cd2124a33e tempest-VolumeDependencyTests-1582854059 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-ddd97579-268b-4241-ad53-f3783e0e093b" returned: 0 in 1.096s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:50:13 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-b8e9fe59-f61a-4644-8bfc-80cd2124a33e tempest-VolumeDependencyTests-1582854059 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-ddd97579-268b-4241-ad53-f3783e0e093b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-ddd97579-268b-4241-ad53-f3783e0e093b.bbd96c96-7c5a-4eef-8963-4bde0d428b8d 1G {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:50:13 devstack sudo[103602]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-ddd97579-268b-4241-ad53-f3783e0e093b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-ddd97579-268b-4241-ad53-f3783e0e093b.bbd96c96-7c5a-4eef-8963-4bde0d428b8d 1G Jul 10 04:50:13 devstack sudo[103602]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:50:14 devstack sudo[103602]: pam_unix(sudo:session): session closed for user root Jul 10 04:50:14 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-b8e9fe59-f61a-4644-8bfc-80cd2124a33e tempest-VolumeDependencyTests-1582854059 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-ddd97579-268b-4241-ad53-f3783e0e093b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-ddd97579-268b-4241-ad53-f3783e0e093b.bbd96c96-7c5a-4eef-8963-4bde0d428b8d 1G" returned: 0 in 0.932s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:50:14 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-b8e9fe59-f61a-4644-8bfc-80cd2124a33e tempest-VolumeDependencyTests-1582854059 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ddd97579-268b-4241-ad53-f3783e0e093b -F qcow2 /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-ddd97579-268b-4241-ad53-f3783e0e093b.bbd96c96-7c5a-4eef-8963-4bde0d428b8d {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:50:14 devstack sudo[103610]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ddd97579-268b-4241-ad53-f3783e0e093b -F qcow2 /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-ddd97579-268b-4241-ad53-f3783e0e093b.bbd96c96-7c5a-4eef-8963-4bde0d428b8d Jul 10 04:50:14 devstack sudo[103610]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:50:15 devstack sudo[103610]: pam_unix(sudo:session): session closed for user root Jul 10 04:50:15 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-b8e9fe59-f61a-4644-8bfc-80cd2124a33e tempest-VolumeDependencyTests-1582854059 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ddd97579-268b-4241-ad53-f3783e0e093b -F qcow2 /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-ddd97579-268b-4241-ad53-f3783e0e093b.bbd96c96-7c5a-4eef-8963-4bde0d428b8d" returned: 0 in 0.761s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:50:15 devstack cinder-volume[87444]: WARNING cinder.volume.drivers.remotefs [None req-b8e9fe59-f61a-4644-8bfc-80cd2124a33e tempest-VolumeDependencyTests-1582854059 None] /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-ddd97579-268b-4241-ad53-f3783e0e093b.bbd96c96-7c5a-4eef-8963-4bde0d428b8d is being set with open permissions: ugo+rw Jul 10 04:50:15 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-b8e9fe59-f61a-4644-8bfc-80cd2124a33e tempest-VolumeDependencyTests-1582854059 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-ddd97579-268b-4241-ad53-f3783e0e093b.bbd96c96-7c5a-4eef-8963-4bde0d428b8d {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:50:15 devstack sudo[103617]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-ddd97579-268b-4241-ad53-f3783e0e093b.bbd96c96-7c5a-4eef-8963-4bde0d428b8d Jul 10 04:50:15 devstack sudo[103617]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:50:16 devstack sudo[103617]: pam_unix(sudo:session): session closed for user root Jul 10 04:50:16 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-b8e9fe59-f61a-4644-8bfc-80cd2124a33e tempest-VolumeDependencyTests-1582854059 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-ddd97579-268b-4241-ad53-f3783e0e093b.bbd96c96-7c5a-4eef-8963-4bde0d428b8d" returned: 0 in 0.677s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:50:16 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-b8e9fe59-f61a-4644-8bfc-80cd2124a33e tempest-VolumeDependencyTests-1582854059 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-ddd97579-268b-4241-ad53-f3783e0e093b.info {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:50:16 devstack sudo[103620]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-ddd97579-268b-4241-ad53-f3783e0e093b.info Jul 10 04:50:16 devstack sudo[103620]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:50:16 devstack sudo[103620]: pam_unix(sudo:session): session closed for user root Jul 10 04:50:16 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-b8e9fe59-f61a-4644-8bfc-80cd2124a33e tempest-VolumeDependencyTests-1582854059 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-ddd97579-268b-4241-ad53-f3783e0e093b.info" returned: 0 in 0.677s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:50:16 devstack cinder-volume[87444]: WARNING cinder.volume.drivers.remotefs [None req-b8e9fe59-f61a-4644-8bfc-80cd2124a33e tempest-VolumeDependencyTests-1582854059 None] /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-ddd97579-268b-4241-ad53-f3783e0e093b.info is being set with open permissions: ugo+rw Jul 10 04:50:16 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-b8e9fe59-f61a-4644-8bfc-80cd2124a33e tempest-VolumeDependencyTests-1582854059 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-ddd97579-268b-4241-ad53-f3783e0e093b.info {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:50:16 devstack sudo[103623]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-ddd97579-268b-4241-ad53-f3783e0e093b.info Jul 10 04:50:16 devstack sudo[103623]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:50:17 devstack sudo[103623]: pam_unix(sudo:session): session closed for user root Jul 10 04:50:17 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-b8e9fe59-f61a-4644-8bfc-80cd2124a33e tempest-VolumeDependencyTests-1582854059 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-ddd97579-268b-4241-ad53-f3783e0e093b.info" returned: 0 in 0.660s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:50:17 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-b8e9fe59-f61a-4644-8bfc-80cd2124a33e tempest-VolumeDependencyTests-1582854059 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.919s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 04:50:17 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-62282e5e-8df5-4984-9e5e-fdaaa707cbf2 tempest-SnapshotDependencyTests-822583399 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 3.794s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 04:50:17 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-62282e5e-8df5-4984-9e5e-fdaaa707cbf2 tempest-SnapshotDependencyTests-822583399 None] Acquiring lock "cinder-quobyte-312ffcb2-a08c-4922-81ca-68d444691040-3e720ae7-685c-4f3f-8625-c2f0b1273dbf" by "_create_volume_from_snapshot" {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 04:50:17 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-62282e5e-8df5-4984-9e5e-fdaaa707cbf2 tempest-SnapshotDependencyTests-822583399 None] Lock "cinder-quobyte-312ffcb2-a08c-4922-81ca-68d444691040-3e720ae7-685c-4f3f-8625-c2f0b1273dbf" acquired by "_create_volume_from_snapshot" :: waited 0.031s {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 04:50:17 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-62282e5e-8df5-4984-9e5e-fdaaa707cbf2 tempest-SnapshotDependencyTests-822583399 None] Creating volume 3e720ae7-685c-4f3f-8625-c2f0b1273dbf from snapshot 312ffcb2-a08c-4922-81ca-68d444691040 {{(pid=87444) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Jul 10 04:50:17 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-62282e5e-8df5-4984-9e5e-fdaaa707cbf2 tempest-SnapshotDependencyTests-822583399 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 04:50:17 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-62282e5e-8df5-4984-9e5e-fdaaa707cbf2 tempest-SnapshotDependencyTests-822583399 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 04:50:17 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-62282e5e-8df5-4984-9e5e-fdaaa707cbf2 tempest-SnapshotDependencyTests-822583399 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922': None} {{(pid=87444) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 04:50:17 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-62282e5e-8df5-4984-9e5e-fdaaa707cbf2 tempest-SnapshotDependencyTests-822583399 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922'] {{(pid=87444) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 04:50:17 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-62282e5e-8df5-4984-9e5e-fdaaa707cbf2 tempest-SnapshotDependencyTests-822583399 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 04:50:17 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-62282e5e-8df5-4984-9e5e-fdaaa707cbf2 tempest-SnapshotDependencyTests-822583399 None] Selected osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922 as target Quobyte volume. {{(pid=87444) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 04:50:17 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-62282e5e-8df5-4984-9e5e-fdaaa707cbf2 tempest-SnapshotDependencyTests-822583399 None] Acquiring lock "cinder-quobyte-3e720ae7-685c-4f3f-8625-c2f0b1273dbf" by "_copy_volume_from_snapshot" {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 04:50:17 devstack cinder-volume[87444]: INFO cinder.volume.manager [None req-b8e9fe59-f61a-4644-8bfc-80cd2124a33e tempest-VolumeDependencyTests-1582854059 None] Create snapshot completed successfully Jul 10 04:50:17 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-62282e5e-8df5-4984-9e5e-fdaaa707cbf2 tempest-SnapshotDependencyTests-822583399 None] Lock "cinder-quobyte-3e720ae7-685c-4f3f-8625-c2f0b1273dbf" acquired by "_copy_volume_from_snapshot" :: waited 0.018s {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 04:50:17 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-62282e5e-8df5-4984-9e5e-fdaaa707cbf2 tempest-SnapshotDependencyTests-822583399 None] snapshot: 312ffcb2-a08c-4922-81ca-68d444691040, volume: 3e720ae7-685c-4f3f-8625-c2f0b1273dbf, {{(pid=87444) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jul 10 04:50:17 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-62282e5e-8df5-4984-9e5e-fdaaa707cbf2 tempest-SnapshotDependencyTests-822583399 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 04:50:17 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-62282e5e-8df5-4984-9e5e-fdaaa707cbf2 tempest-SnapshotDependencyTests-822583399 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 04:50:17 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-62282e5e-8df5-4984-9e5e-fdaaa707cbf2 tempest-SnapshotDependencyTests-822583399 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922': None} {{(pid=87444) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 04:50:17 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-62282e5e-8df5-4984-9e5e-fdaaa707cbf2 tempest-SnapshotDependencyTests-822583399 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922'] {{(pid=87444) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 04:50:17 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-62282e5e-8df5-4984-9e5e-fdaaa707cbf2 tempest-SnapshotDependencyTests-822583399 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 04:50:17 devstack cinder-volume[87444]: DEBUG oslo.privsep.daemon [-] privsep: reply[803e11ac-2f4c-4b09-ac4b-245157730cbb]: (4, 'qcow2') {{(pid=88499) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 04:50:17 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-62282e5e-8df5-4984-9e5e-fdaaa707cbf2 tempest-SnapshotDependencyTests-822583399 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-e6abedaf-8d01-4989-905f-8ae4b2095dee.312ffcb2-a08c-4922-81ca-68d444691040 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:50:17 devstack sudo[103626]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-e6abedaf-8d01-4989-905f-8ae4b2095dee.312ffcb2-a08c-4922-81ca-68d444691040 Jul 10 04:50:17 devstack sudo[103626]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:50:18 devstack sudo[103626]: pam_unix(sudo:session): session closed for user root Jul 10 04:50:18 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-62282e5e-8df5-4984-9e5e-fdaaa707cbf2 tempest-SnapshotDependencyTests-822583399 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-e6abedaf-8d01-4989-905f-8ae4b2095dee.312ffcb2-a08c-4922-81ca-68d444691040" returned: 0 in 0.780s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:50:18 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.remotefs [None req-62282e5e-8df5-4984-9e5e-fdaaa707cbf2 tempest-SnapshotDependencyTests-822583399 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e6abedaf-8d01-4989-905f-8ae4b2095dee(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87444) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 10 04:50:18 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-62282e5e-8df5-4984-9e5e-fdaaa707cbf2 tempest-SnapshotDependencyTests-822583399 None] will copy from snapshot at /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-e6abedaf-8d01-4989-905f-8ae4b2095dee {{(pid=87444) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jul 10 04:50:18 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-62282e5e-8df5-4984-9e5e-fdaaa707cbf2 tempest-SnapshotDependencyTests-822583399 None] Creating direct copy from snapshot {{(pid=87444) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jul 10 04:50:18 devstack cinder-volume[87444]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a3d0292-ef56-4358-b9ed-44d94c614196]: (4, 'qcow2') {{(pid=88499) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 04:50:18 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-62282e5e-8df5-4984-9e5e-fdaaa707cbf2 tempest-SnapshotDependencyTests-822583399 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-e6abedaf-8d01-4989-905f-8ae4b2095dee {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:50:18 devstack sudo[103631]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-e6abedaf-8d01-4989-905f-8ae4b2095dee Jul 10 04:50:18 devstack sudo[103631]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:50:19 devstack cinder-volume[87444]: DEBUG cinder.volume.flows.manager.create_volume [None req-f1ad97b1-304b-43e8-b3cb-d34cb9a83793 tempest-VolumeDependencyTests-1582854059 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87444) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 04:50:19 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-f1ad97b1-304b-43e8-b3cb-d34cb9a83793 tempest-VolumeDependencyTests-1582854059 None] Flow 'volume_create_manager' (b5cfb44a-7fe1-4f7e-be94-d4bc24570d77) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 04:50:19 devstack sudo[103631]: pam_unix(sudo:session): session closed for user root Jul 10 04:50:19 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-f1ad97b1-304b-43e8-b3cb-d34cb9a83793 tempest-VolumeDependencyTests-1582854059 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (47e6594d-a6a4-4a6e-a5c6-008eba1499a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:50:19 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-62282e5e-8df5-4984-9e5e-fdaaa707cbf2 tempest-SnapshotDependencyTests-822583399 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-e6abedaf-8d01-4989-905f-8ae4b2095dee" returned: 0 in 0.825s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:50:19 devstack cinder-volume[87444]: DEBUG cinder.utils [None req-62282e5e-8df5-4984-9e5e-fdaaa707cbf2 tempest-SnapshotDependencyTests-822583399 None] Path /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-3e720ae7-685c-4f3f-8625-c2f0b1273dbf not found in is_blk_device check {{(pid=87444) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 10 04:50:19 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-62282e5e-8df5-4984-9e5e-fdaaa707cbf2 tempest-SnapshotDependencyTests-822583399 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-e6abedaf-8d01-4989-905f-8ae4b2095dee /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-3e720ae7-685c-4f3f-8625-c2f0b1273dbf {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:50:19 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-f1ad97b1-304b-43e8-b3cb-d34cb9a83793 tempest-VolumeDependencyTests-1582854059 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (47e6594d-a6a4-4a6e-a5c6-008eba1499a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T02:50:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-719775773',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=df6747e8-5098-453d-bd3b-653881e955d3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ef2ca964d9da428d8b77844223c2c4b1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T02:50:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=bbd96c96-7c5a-4eef-8963-4bde0d428b8d,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T02:50:19Z,use_quota=True,user_id='b7a9f5aad7374173b37091a90f3f289b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(317e369e-1e06-434d-ae95-a335f0e6c903),volume_type_id=317e369e-1e06-434d-ae95-a335f0e6c903)' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:50:19 devstack sudo[103637]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-e6abedaf-8d01-4989-905f-8ae4b2095dee /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-3e720ae7-685c-4f3f-8625-c2f0b1273dbf Jul 10 04:50:19 devstack sudo[103637]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:50:19 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-f1ad97b1-304b-43e8-b3cb-d34cb9a83793 tempest-VolumeDependencyTests-1582854059 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (31636ea6-a0e6-4aee-8a18-3d3b7c787352) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:50:19 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-f1ad97b1-304b-43e8-b3cb-d34cb9a83793 tempest-VolumeDependencyTests-1582854059 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (31636ea6-a0e6-4aee-8a18-3d3b7c787352) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:50:19 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-f1ad97b1-304b-43e8-b3cb-d34cb9a83793 tempest-VolumeDependencyTests-1582854059 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (07f957c1-edc6-4062-8d58-1a1640eea759) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:50:19 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-f1ad97b1-304b-43e8-b3cb-d34cb9a83793 tempest-VolumeDependencyTests-1582854059 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (07f957c1-edc6-4062-8d58-1a1640eea759) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'df6747e8-5098-453d-bd3b-653881e955d3', 'volume_name': 'volume-df6747e8-5098-453d-bd3b-653881e955d3', 'volume_size': 1, 'snapshot_id': 'bbd96c96-7c5a-4eef-8963-4bde0d428b8d'}' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:50:19 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-f1ad97b1-304b-43e8-b3cb-d34cb9a83793 tempest-VolumeDependencyTests-1582854059 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d3e3636c-d998-463c-9ac7-92834fb0f316) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:50:19 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-f1ad97b1-304b-43e8-b3cb-d34cb9a83793 tempest-VolumeDependencyTests-1582854059 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d3e3636c-d998-463c-9ac7-92834fb0f316) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:50:19 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-f1ad97b1-304b-43e8-b3cb-d34cb9a83793 tempest-VolumeDependencyTests-1582854059 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1268648b-e52b-4f72-95df-d4b448a70726) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:50:19 devstack cinder-volume[87444]: INFO cinder.volume.flows.manager.create_volume [None req-f1ad97b1-304b-43e8-b3cb-d34cb9a83793 tempest-VolumeDependencyTests-1582854059 None] Volume df6747e8-5098-453d-bd3b-653881e955d3: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-df6747e8-5098-453d-bd3b-653881e955d3', 'volume_size': 1, 'snapshot_id': 'bbd96c96-7c5a-4eef-8963-4bde0d428b8d'} Jul 10 04:50:19 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-f1ad97b1-304b-43e8-b3cb-d34cb9a83793 tempest-VolumeDependencyTests-1582854059 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 04:50:24 devstack sudo[103637]: pam_unix(sudo:session): session closed for user root Jul 10 04:50:24 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-62282e5e-8df5-4984-9e5e-fdaaa707cbf2 tempest-SnapshotDependencyTests-822583399 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-e6abedaf-8d01-4989-905f-8ae4b2095dee /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-3e720ae7-685c-4f3f-8625-c2f0b1273dbf" returned: 0 in 4.948s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:50:24 devstack cinder-volume[87444]: DEBUG oslo.privsep.daemon [-] privsep: reply[6425ae4d-488d-43da-80c2-dd007720a0e4]: (4, 'qcow2') {{(pid=88499) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 04:50:24 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-62282e5e-8df5-4984-9e5e-fdaaa707cbf2 tempest-SnapshotDependencyTests-822583399 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-e6abedaf-8d01-4989-905f-8ae4b2095dee {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:50:24 devstack sudo[103651]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-e6abedaf-8d01-4989-905f-8ae4b2095dee Jul 10 04:50:24 devstack sudo[103651]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:50:25 devstack sudo[103651]: pam_unix(sudo:session): session closed for user root Jul 10 04:50:25 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-62282e5e-8df5-4984-9e5e-fdaaa707cbf2 tempest-SnapshotDependencyTests-822583399 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-e6abedaf-8d01-4989-905f-8ae4b2095dee" returned: 0 in 0.968s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:50:25 devstack cinder-volume[87444]: DEBUG cinder.image.image_utils [None req-62282e5e-8df5-4984-9e5e-fdaaa707cbf2 tempest-SnapshotDependencyTests-822583399 None] Image conversion details: src /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-e6abedaf-8d01-4989-905f-8ae4b2095dee, size 1024.00 MB, duration 4.95 sec, destination /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-3e720ae7-685c-4f3f-8625-c2f0b1273dbf {{(pid=87444) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:561}} Jul 10 04:50:25 devstack cinder-volume[87444]: INFO cinder.image.image_utils [None req-62282e5e-8df5-4984-9e5e-fdaaa707cbf2 tempest-SnapshotDependencyTests-822583399 None] Converted 1024.00 MB image at 206.90 MB/s Jul 10 04:50:25 devstack cinder-volume[87444]: WARNING cinder.volume.drivers.remotefs [None req-62282e5e-8df5-4984-9e5e-fdaaa707cbf2 tempest-SnapshotDependencyTests-822583399 None] /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-3e720ae7-685c-4f3f-8625-c2f0b1273dbf is being set with open permissions: ugo+rw Jul 10 04:50:25 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-62282e5e-8df5-4984-9e5e-fdaaa707cbf2 tempest-SnapshotDependencyTests-822583399 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-3e720ae7-685c-4f3f-8625-c2f0b1273dbf {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:50:25 devstack sudo[103656]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-3e720ae7-685c-4f3f-8625-c2f0b1273dbf Jul 10 04:50:25 devstack sudo[103656]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:50:25 devstack sudo[103656]: pam_unix(sudo:session): session closed for user root Jul 10 04:50:25 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-62282e5e-8df5-4984-9e5e-fdaaa707cbf2 tempest-SnapshotDependencyTests-822583399 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-3e720ae7-685c-4f3f-8625-c2f0b1273dbf" returned: 0 in 0.663s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:50:25 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-62282e5e-8df5-4984-9e5e-fdaaa707cbf2 tempest-SnapshotDependencyTests-822583399 None] Lock "cinder-quobyte-3e720ae7-685c-4f3f-8625-c2f0b1273dbf" released by "_copy_volume_from_snapshot" :: held 8.278s {{(pid=87444) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 04:50:25 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-62282e5e-8df5-4984-9e5e-fdaaa707cbf2 tempest-SnapshotDependencyTests-822583399 None] Lock "cinder-quobyte-312ffcb2-a08c-4922-81ca-68d444691040-3e720ae7-685c-4f3f-8625-c2f0b1273dbf" released by "_create_volume_from_snapshot" :: held 8.314s {{(pid=87444) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 04:50:25 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-62282e5e-8df5-4984-9e5e-fdaaa707cbf2 tempest-SnapshotDependencyTests-822583399 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 8.347s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 04:50:25 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-f1ad97b1-304b-43e8-b3cb-d34cb9a83793 tempest-VolumeDependencyTests-1582854059 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 6.541s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 04:50:25 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-f1ad97b1-304b-43e8-b3cb-d34cb9a83793 tempest-VolumeDependencyTests-1582854059 None] Acquiring lock "cinder-quobyte-bbd96c96-7c5a-4eef-8963-4bde0d428b8d-df6747e8-5098-453d-bd3b-653881e955d3" by "_create_volume_from_snapshot" {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 04:50:25 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-f1ad97b1-304b-43e8-b3cb-d34cb9a83793 tempest-VolumeDependencyTests-1582854059 None] Lock "cinder-quobyte-bbd96c96-7c5a-4eef-8963-4bde0d428b8d-df6747e8-5098-453d-bd3b-653881e955d3" acquired by "_create_volume_from_snapshot" :: waited 0.024s {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 04:50:25 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-f1ad97b1-304b-43e8-b3cb-d34cb9a83793 tempest-VolumeDependencyTests-1582854059 None] Creating volume df6747e8-5098-453d-bd3b-653881e955d3 from snapshot bbd96c96-7c5a-4eef-8963-4bde0d428b8d {{(pid=87444) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Jul 10 04:50:25 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-f1ad97b1-304b-43e8-b3cb-d34cb9a83793 tempest-VolumeDependencyTests-1582854059 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 04:50:25 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-f1ad97b1-304b-43e8-b3cb-d34cb9a83793 tempest-VolumeDependencyTests-1582854059 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 04:50:25 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-f1ad97b1-304b-43e8-b3cb-d34cb9a83793 tempest-VolumeDependencyTests-1582854059 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922': None} {{(pid=87444) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 04:50:25 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-f1ad97b1-304b-43e8-b3cb-d34cb9a83793 tempest-VolumeDependencyTests-1582854059 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922'] {{(pid=87444) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 04:50:25 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-f1ad97b1-304b-43e8-b3cb-d34cb9a83793 tempest-VolumeDependencyTests-1582854059 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 04:50:25 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-f1ad97b1-304b-43e8-b3cb-d34cb9a83793 tempest-VolumeDependencyTests-1582854059 None] Selected osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922 as target Quobyte volume. {{(pid=87444) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 04:50:25 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-f1ad97b1-304b-43e8-b3cb-d34cb9a83793 tempest-VolumeDependencyTests-1582854059 None] Acquiring lock "cinder-quobyte-df6747e8-5098-453d-bd3b-653881e955d3" by "_copy_volume_from_snapshot" {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 04:50:25 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-62282e5e-8df5-4984-9e5e-fdaaa707cbf2 tempest-SnapshotDependencyTests-822583399 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (291a34b6-5fde-41ad-bb0e-bbb9d43c7839) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3e720ae7-685c-4f3f-8625-c2f0b1273dbf', 'volume_size': 1, 'snapshot_id': '312ffcb2-a08c-4922-81ca-68d444691040'}' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:50:25 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-62282e5e-8df5-4984-9e5e-fdaaa707cbf2 tempest-SnapshotDependencyTests-822583399 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (025c2028-b5d4-4c87-b39f-158e32e50946) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:50:25 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-f1ad97b1-304b-43e8-b3cb-d34cb9a83793 tempest-VolumeDependencyTests-1582854059 None] Lock "cinder-quobyte-df6747e8-5098-453d-bd3b-653881e955d3" acquired by "_copy_volume_from_snapshot" :: waited 0.032s {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 04:50:25 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-f1ad97b1-304b-43e8-b3cb-d34cb9a83793 tempest-VolumeDependencyTests-1582854059 None] snapshot: bbd96c96-7c5a-4eef-8963-4bde0d428b8d, volume: df6747e8-5098-453d-bd3b-653881e955d3, {{(pid=87444) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jul 10 04:50:25 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-f1ad97b1-304b-43e8-b3cb-d34cb9a83793 tempest-VolumeDependencyTests-1582854059 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 04:50:25 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-f1ad97b1-304b-43e8-b3cb-d34cb9a83793 tempest-VolumeDependencyTests-1582854059 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 04:50:25 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-f1ad97b1-304b-43e8-b3cb-d34cb9a83793 tempest-VolumeDependencyTests-1582854059 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922': None} {{(pid=87444) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 04:50:25 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-f1ad97b1-304b-43e8-b3cb-d34cb9a83793 tempest-VolumeDependencyTests-1582854059 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922'] {{(pid=87444) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 04:50:25 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-f1ad97b1-304b-43e8-b3cb-d34cb9a83793 tempest-VolumeDependencyTests-1582854059 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 04:50:25 devstack cinder-volume[87444]: INFO cinder.volume.flows.manager.create_volume [None req-62282e5e-8df5-4984-9e5e-fdaaa707cbf2 tempest-SnapshotDependencyTests-822583399 None] Volume volume-3e720ae7-685c-4f3f-8625-c2f0b1273dbf (3e720ae7-685c-4f3f-8625-c2f0b1273dbf): created successfully Jul 10 04:50:25 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-62282e5e-8df5-4984-9e5e-fdaaa707cbf2 tempest-SnapshotDependencyTests-822583399 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (025c2028-b5d4-4c87-b39f-158e32e50946) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:50:25 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-62282e5e-8df5-4984-9e5e-fdaaa707cbf2 tempest-SnapshotDependencyTests-822583399 None] Flow 'volume_create_manager' (5a0a1188-dda2-4fdc-9624-67389fc6072f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87444) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 04:50:25 devstack cinder-volume[87444]: DEBUG oslo.privsep.daemon [-] privsep: reply[32f41274-87a2-4089-8ea0-2620e87d1fab]: (4, 'qcow2') {{(pid=88499) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 04:50:25 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-f1ad97b1-304b-43e8-b3cb-d34cb9a83793 tempest-VolumeDependencyTests-1582854059 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-ddd97579-268b-4241-ad53-f3783e0e093b.bbd96c96-7c5a-4eef-8963-4bde0d428b8d {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:50:25 devstack cinder-volume[87444]: INFO cinder.volume.manager [None req-62282e5e-8df5-4984-9e5e-fdaaa707cbf2 tempest-SnapshotDependencyTests-822583399 None] Created volume successfully. Jul 10 04:50:26 devstack sudo[103763]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-ddd97579-268b-4241-ad53-f3783e0e093b.bbd96c96-7c5a-4eef-8963-4bde0d428b8d Jul 10 04:50:26 devstack sudo[103763]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:50:26 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-4582762d-d8ec-4915-b659-21576ddb00f2 tempest-SnapshotDependencyTests-822583399 None] Acquiring lock "cinder-312ffcb2-a08c-4922-81ca-68d444691040-delete_snapshot" by "delete_snapshot" {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 04:50:26 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-4582762d-d8ec-4915-b659-21576ddb00f2 tempest-SnapshotDependencyTests-822583399 None] Lock "cinder-312ffcb2-a08c-4922-81ca-68d444691040-delete_snapshot" acquired by "delete_snapshot" :: waited 0.022s {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 04:50:26 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-4582762d-d8ec-4915-b659-21576ddb00f2 tempest-SnapshotDependencyTests-822583399 None] Acquiring lock "cinder-quobyte-e6abedaf-8d01-4989-905f-8ae4b2095dee" by "delete_snapshot" {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 04:50:26 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-4582762d-d8ec-4915-b659-21576ddb00f2 tempest-SnapshotDependencyTests-822583399 None] Lock "cinder-quobyte-e6abedaf-8d01-4989-905f-8ae4b2095dee" acquired by "delete_snapshot" :: waited 0.022s {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 04:50:26 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-4582762d-d8ec-4915-b659-21576ddb00f2 tempest-SnapshotDependencyTests-822583399 None] Acquiring lock "cinder-quobyte-312ffcb2-a08c-4922-81ca-68d444691040" by "_delete_snapshot" {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 04:50:26 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-4582762d-d8ec-4915-b659-21576ddb00f2 tempest-SnapshotDependencyTests-822583399 None] Lock "cinder-quobyte-312ffcb2-a08c-4922-81ca-68d444691040" acquired by "_delete_snapshot" :: waited 0.026s {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 04:50:26 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.remotefs [None req-4582762d-d8ec-4915-b659-21576ddb00f2 tempest-SnapshotDependencyTests-822583399 None] Deleting offline snapshot 312ffcb2-a08c-4922-81ca-68d444691040 of volume e6abedaf-8d01-4989-905f-8ae4b2095dee {{(pid=87444) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 10 04:50:26 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.remotefs [None req-4582762d-d8ec-4915-b659-21576ddb00f2 tempest-SnapshotDependencyTests-822583399 None] snapshot_file for this snap is: volume-e6abedaf-8d01-4989-905f-8ae4b2095dee.312ffcb2-a08c-4922-81ca-68d444691040 {{(pid=87444) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 10 04:50:26 devstack cinder-volume[87444]: DEBUG oslo.privsep.daemon [-] privsep: reply[14fb5373-4461-4692-a5e0-9f51c284fb1d]: (4, 'qcow2') {{(pid=88499) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 04:50:26 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-4582762d-d8ec-4915-b659-21576ddb00f2 tempest-SnapshotDependencyTests-822583399 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-e6abedaf-8d01-4989-905f-8ae4b2095dee.312ffcb2-a08c-4922-81ca-68d444691040 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:50:26 devstack sudo[103763]: pam_unix(sudo:session): session closed for user root Jul 10 04:50:26 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-f1ad97b1-304b-43e8-b3cb-d34cb9a83793 tempest-VolumeDependencyTests-1582854059 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-ddd97579-268b-4241-ad53-f3783e0e093b.bbd96c96-7c5a-4eef-8963-4bde0d428b8d" returned: 0 in 0.868s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:50:26 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.remotefs [None req-f1ad97b1-304b-43e8-b3cb-d34cb9a83793 tempest-VolumeDependencyTests-1582854059 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ddd97579-268b-4241-ad53-f3783e0e093b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87444) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 10 04:50:26 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-f1ad97b1-304b-43e8-b3cb-d34cb9a83793 tempest-VolumeDependencyTests-1582854059 None] will copy from snapshot at /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-ddd97579-268b-4241-ad53-f3783e0e093b {{(pid=87444) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jul 10 04:50:26 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-f1ad97b1-304b-43e8-b3cb-d34cb9a83793 tempest-VolumeDependencyTests-1582854059 None] Creating direct copy from snapshot {{(pid=87444) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jul 10 04:50:26 devstack cinder-volume[87444]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e2a1401-ba04-4dad-a6d7-676a17818841]: (4, 'qcow2') {{(pid=88499) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 04:50:26 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-f1ad97b1-304b-43e8-b3cb-d34cb9a83793 tempest-VolumeDependencyTests-1582854059 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-ddd97579-268b-4241-ad53-f3783e0e093b {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:50:26 devstack sudo[103768]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-e6abedaf-8d01-4989-905f-8ae4b2095dee.312ffcb2-a08c-4922-81ca-68d444691040 Jul 10 04:50:26 devstack sudo[103768]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:50:26 devstack sudo[103769]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-ddd97579-268b-4241-ad53-f3783e0e093b Jul 10 04:50:26 devstack sudo[103769]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:50:27 devstack sudo[103768]: pam_unix(sudo:session): session closed for user root Jul 10 04:50:27 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-4582762d-d8ec-4915-b659-21576ddb00f2 tempest-SnapshotDependencyTests-822583399 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-e6abedaf-8d01-4989-905f-8ae4b2095dee.312ffcb2-a08c-4922-81ca-68d444691040" returned: 0 in 0.804s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:50:27 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.remotefs [None req-4582762d-d8ec-4915-b659-21576ddb00f2 tempest-SnapshotDependencyTests-822583399 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e6abedaf-8d01-4989-905f-8ae4b2095dee(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87444) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 10 04:50:27 devstack cinder-volume[87444]: DEBUG oslo.privsep.daemon [-] privsep: reply[49bc1014-7260-4e1b-9d0b-879079374349]: (4, 'qcow2') {{(pid=88499) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 04:50:27 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-4582762d-d8ec-4915-b659-21576ddb00f2 tempest-SnapshotDependencyTests-822583399 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-e6abedaf-8d01-4989-905f-8ae4b2095dee {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:50:27 devstack sudo[103769]: pam_unix(sudo:session): session closed for user root Jul 10 04:50:27 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-f1ad97b1-304b-43e8-b3cb-d34cb9a83793 tempest-VolumeDependencyTests-1582854059 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-ddd97579-268b-4241-ad53-f3783e0e093b" returned: 0 in 0.773s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:50:27 devstack cinder-volume[87444]: DEBUG cinder.utils [None req-f1ad97b1-304b-43e8-b3cb-d34cb9a83793 tempest-VolumeDependencyTests-1582854059 None] Path /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-df6747e8-5098-453d-bd3b-653881e955d3 not found in is_blk_device check {{(pid=87444) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 10 04:50:27 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-f1ad97b1-304b-43e8-b3cb-d34cb9a83793 tempest-VolumeDependencyTests-1582854059 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-ddd97579-268b-4241-ad53-f3783e0e093b /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-df6747e8-5098-453d-bd3b-653881e955d3 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:50:27 devstack sudo[103779]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-ddd97579-268b-4241-ad53-f3783e0e093b /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-df6747e8-5098-453d-bd3b-653881e955d3 Jul 10 04:50:27 devstack sudo[103779]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:50:27 devstack sudo[103778]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-e6abedaf-8d01-4989-905f-8ae4b2095dee Jul 10 04:50:27 devstack sudo[103778]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:50:28 devstack sudo[103778]: pam_unix(sudo:session): session closed for user root Jul 10 04:50:28 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-4582762d-d8ec-4915-b659-21576ddb00f2 tempest-SnapshotDependencyTests-822583399 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-e6abedaf-8d01-4989-905f-8ae4b2095dee" returned: 0 in 0.759s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:50:28 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-4582762d-d8ec-4915-b659-21576ddb00f2 tempest-SnapshotDependencyTests-822583399 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-e6abedaf-8d01-4989-905f-8ae4b2095dee.312ffcb2-a08c-4922-81ca-68d444691040 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:50:28 devstack sudo[103788]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-e6abedaf-8d01-4989-905f-8ae4b2095dee.312ffcb2-a08c-4922-81ca-68d444691040 Jul 10 04:50:28 devstack sudo[103788]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:50:29 devstack sudo[103788]: pam_unix(sudo:session): session closed for user root Jul 10 04:50:29 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-4582762d-d8ec-4915-b659-21576ddb00f2 tempest-SnapshotDependencyTests-822583399 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-e6abedaf-8d01-4989-905f-8ae4b2095dee.312ffcb2-a08c-4922-81ca-68d444691040" returned: 0 in 1.374s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:50:29 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-4582762d-d8ec-4915-b659-21576ddb00f2 tempest-SnapshotDependencyTests-822583399 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-e6abedaf-8d01-4989-905f-8ae4b2095dee.312ffcb2-a08c-4922-81ca-68d444691040 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:50:29 devstack sudo[103800]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-e6abedaf-8d01-4989-905f-8ae4b2095dee.312ffcb2-a08c-4922-81ca-68d444691040 Jul 10 04:50:29 devstack sudo[103800]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:50:31 devstack sudo[103800]: pam_unix(sudo:session): session closed for user root Jul 10 04:50:31 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-4582762d-d8ec-4915-b659-21576ddb00f2 tempest-SnapshotDependencyTests-822583399 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-e6abedaf-8d01-4989-905f-8ae4b2095dee.312ffcb2-a08c-4922-81ca-68d444691040" returned: 0 in 1.410s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:50:31 devstack cinder-volume[87444]: DEBUG dbcounter [-] [87444] Writing DB stats cinder:SELECT=70,cinder:UPDATE=72,cinder:INSERT=28,cinder:DELETE=9 {{(pid=87444) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 10 04:50:31 devstack cinder-volume[87444]: DEBUG dbcounter [-] [87444] Writing DB stats cinder:UPDATE=77,cinder:SELECT=76,cinder:INSERT=25,cinder:DELETE=7 {{(pid=87444) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 10 04:50:31 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-4582762d-d8ec-4915-b659-21576ddb00f2 tempest-SnapshotDependencyTests-822583399 None] Lock "cinder-quobyte-312ffcb2-a08c-4922-81ca-68d444691040" released by "_delete_snapshot" :: held 4.508s {{(pid=87444) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 04:50:31 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-4582762d-d8ec-4915-b659-21576ddb00f2 tempest-SnapshotDependencyTests-822583399 None] Lock "cinder-quobyte-e6abedaf-8d01-4989-905f-8ae4b2095dee" released by "delete_snapshot" :: held 4.555s {{(pid=87444) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 04:50:31 devstack cinder-volume[87444]: DEBUG cinder.quota [None req-4582762d-d8ec-4915-b659-21576ddb00f2 tempest-SnapshotDependencyTests-822583399 None] Created reservations ['a16f2dd8-83e2-4332-a662-c0f2067e746c', '93790e1d-8cb6-42d4-b339-cccbf3714572', '116d86e5-3bd0-4d2d-8052-688715f1c368', '5fd5a0bb-316d-458a-aa9c-e699175cd928'] {{(pid=87444) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 04:50:31 devstack cinder-volume[87444]: INFO cinder.volume.manager [None req-4582762d-d8ec-4915-b659-21576ddb00f2 tempest-SnapshotDependencyTests-822583399 None] Delete snapshot completed successfully. Jul 10 04:50:31 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-4582762d-d8ec-4915-b659-21576ddb00f2 tempest-SnapshotDependencyTests-822583399 None] Lock "cinder-312ffcb2-a08c-4922-81ca-68d444691040-delete_snapshot" released by "delete_snapshot" :: held 4.905s {{(pid=87444) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 04:50:32 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-bd788c49-8f07-4480-a668-f8fd2392b618 tempest-SnapshotDependencyTests-822583399 None] Acquiring lock "cinder-e6abedaf-8d01-4989-905f-8ae4b2095dee-delete_volume" by "delete_volume" {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 04:50:32 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-bd788c49-8f07-4480-a668-f8fd2392b618 tempest-SnapshotDependencyTests-822583399 None] Lock "cinder-e6abedaf-8d01-4989-905f-8ae4b2095dee-delete_volume" acquired by "delete_volume" :: waited 0.049s {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 04:50:32 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-bd788c49-8f07-4480-a668-f8fd2392b618 tempest-SnapshotDependencyTests-822583399 None] Acquiring lock "cinder-quobyte-e6abedaf-8d01-4989-905f-8ae4b2095dee" by "delete_volume" {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 04:50:32 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-bd788c49-8f07-4480-a668-f8fd2392b618 tempest-SnapshotDependencyTests-822583399 None] Lock "cinder-quobyte-e6abedaf-8d01-4989-905f-8ae4b2095dee" acquired by "delete_volume" :: waited 0.021s {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 04:50:32 devstack cinder-volume[87444]: DEBUG oslo.privsep.daemon [-] privsep: reply[af47f731-16ee-430d-9159-ad48496e6f0a]: (4, 'qcow2') {{(pid=88499) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 04:50:32 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-bd788c49-8f07-4480-a668-f8fd2392b618 tempest-SnapshotDependencyTests-822583399 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-e6abedaf-8d01-4989-905f-8ae4b2095dee {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:50:32 devstack sudo[103804]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-e6abedaf-8d01-4989-905f-8ae4b2095dee Jul 10 04:50:32 devstack sudo[103804]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:50:32 devstack sudo[103779]: pam_unix(sudo:session): session closed for user root Jul 10 04:50:32 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-f1ad97b1-304b-43e8-b3cb-d34cb9a83793 tempest-VolumeDependencyTests-1582854059 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-ddd97579-268b-4241-ad53-f3783e0e093b /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-df6747e8-5098-453d-bd3b-653881e955d3" returned: 0 in 4.949s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:50:32 devstack cinder-volume[87444]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb1fa0a8-4381-477c-a8a8-127ede3c9075]: (4, 'qcow2') {{(pid=88499) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 04:50:32 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-f1ad97b1-304b-43e8-b3cb-d34cb9a83793 tempest-VolumeDependencyTests-1582854059 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-ddd97579-268b-4241-ad53-f3783e0e093b {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:50:32 devstack sudo[103806]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-ddd97579-268b-4241-ad53-f3783e0e093b Jul 10 04:50:32 devstack sudo[103806]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:50:33 devstack cinder-volume[87444]: DEBUG oslo_service.periodic_task [None req-01f0ce3e-6850-4e14-881d-e40d3c4ad6e5 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87444) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 10 04:50:33 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-01f0ce3e-6850-4e14-881d-e40d3c4ad6e5 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 04:50:33 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-01f0ce3e-6850-4e14-881d-e40d3c4ad6e5 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 04:50:33 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-01f0ce3e-6850-4e14-881d-e40d3c4ad6e5 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922': None} {{(pid=87444) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 04:50:33 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-01f0ce3e-6850-4e14-881d-e40d3c4ad6e5 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922'] {{(pid=87444) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 04:50:33 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-01f0ce3e-6850-4e14-881d-e40d3c4ad6e5 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 04:50:33 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-01f0ce3e-6850-4e14-881d-e40d3c4ad6e5 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:50:33 devstack sudo[103810]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097 Jul 10 04:50:33 devstack sudo[103810]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:50:33 devstack sudo[103804]: pam_unix(sudo:session): session closed for user root Jul 10 04:50:33 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-bd788c49-8f07-4480-a668-f8fd2392b618 tempest-SnapshotDependencyTests-822583399 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-e6abedaf-8d01-4989-905f-8ae4b2095dee" returned: 0 in 0.806s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:50:33 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-bd788c49-8f07-4480-a668-f8fd2392b618 tempest-SnapshotDependencyTests-822583399 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-e6abedaf-8d01-4989-905f-8ae4b2095dee {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:50:33 devstack sudo[103814]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-e6abedaf-8d01-4989-905f-8ae4b2095dee Jul 10 04:50:33 devstack sudo[103814]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:50:33 devstack sudo[103806]: pam_unix(sudo:session): session closed for user root Jul 10 04:50:33 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-f1ad97b1-304b-43e8-b3cb-d34cb9a83793 tempest-VolumeDependencyTests-1582854059 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-ddd97579-268b-4241-ad53-f3783e0e093b" returned: 0 in 1.095s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:50:33 devstack cinder-volume[87444]: DEBUG cinder.image.image_utils [None req-f1ad97b1-304b-43e8-b3cb-d34cb9a83793 tempest-VolumeDependencyTests-1582854059 None] Image conversion details: src /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-ddd97579-268b-4241-ad53-f3783e0e093b, size 1024.00 MB, duration 4.95 sec, destination /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-df6747e8-5098-453d-bd3b-653881e955d3 {{(pid=87444) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:561}} Jul 10 04:50:33 devstack cinder-volume[87444]: INFO cinder.image.image_utils [None req-f1ad97b1-304b-43e8-b3cb-d34cb9a83793 tempest-VolumeDependencyTests-1582854059 None] Converted 1024.00 MB image at 206.85 MB/s Jul 10 04:50:33 devstack cinder-volume[87444]: WARNING cinder.volume.drivers.remotefs [None req-f1ad97b1-304b-43e8-b3cb-d34cb9a83793 tempest-VolumeDependencyTests-1582854059 None] /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-df6747e8-5098-453d-bd3b-653881e955d3 is being set with open permissions: ugo+rw Jul 10 04:50:33 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-f1ad97b1-304b-43e8-b3cb-d34cb9a83793 tempest-VolumeDependencyTests-1582854059 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-df6747e8-5098-453d-bd3b-653881e955d3 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:50:33 devstack sudo[103819]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-df6747e8-5098-453d-bd3b-653881e955d3 Jul 10 04:50:33 devstack sudo[103819]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:50:33 devstack sudo[103810]: pam_unix(sudo:session): session closed for user root Jul 10 04:50:33 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-01f0ce3e-6850-4e14-881d-e40d3c4ad6e5 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097" returned: 0 in 0.817s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:50:33 devstack cinder-volume[87444]: DEBUG cinder.manager [None req-01f0ce3e-6850-4e14-881d-e40d3c4ad6e5 None None] Notifying Schedulers of capabilities ... {{(pid=87444) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 04:50:33 devstack cinder-volume[87444]: DEBUG oslo_service.periodic_task [None req-01f0ce3e-6850-4e14-881d-e40d3c4ad6e5 None None] Running periodic task VolumeManager._thread_info {{(pid=87444) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 10 04:50:33 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-01f0ce3e-6850-4e14-881d-e40d3c4ad6e5 None None] thread count: 28 {{(pid=87444) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 10 04:50:33 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-01f0ce3e-6850-4e14-881d-e40d3c4ad6e5 None None] thread info: [<_MainThread(MainThread, started 126839257915520)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87444) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 10 04:50:33 devstack sudo[103814]: pam_unix(sudo:session): session closed for user root Jul 10 04:50:33 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-bd788c49-8f07-4480-a668-f8fd2392b618 tempest-SnapshotDependencyTests-822583399 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-e6abedaf-8d01-4989-905f-8ae4b2095dee" returned: 0 in 0.749s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:50:33 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-bd788c49-8f07-4480-a668-f8fd2392b618 tempest-SnapshotDependencyTests-822583399 None] Lock "cinder-quobyte-e6abedaf-8d01-4989-905f-8ae4b2095dee" released by "delete_volume" :: held 1.681s {{(pid=87444) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 04:50:33 devstack cinder-volume[87444]: DEBUG cinder.quota [None req-bd788c49-8f07-4480-a668-f8fd2392b618 tempest-SnapshotDependencyTests-822583399 None] Created reservations ['9a0be66e-68f6-499a-956c-98a0a3232706', '6b1cefef-acbd-43d6-b5e9-721bf9031ec1', 'ebe85d38-ea40-43ee-8530-343b5b03cbfc', '8dd8dc08-ca99-491d-9d04-787bc817c84e'] {{(pid=87444) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 04:50:34 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-bd788c49-8f07-4480-a668-f8fd2392b618 tempest-SnapshotDependencyTests-822583399 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 04:50:34 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-bd788c49-8f07-4480-a668-f8fd2392b618 tempest-SnapshotDependencyTests-822583399 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 04:50:34 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-bd788c49-8f07-4480-a668-f8fd2392b618 tempest-SnapshotDependencyTests-822583399 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922': None} {{(pid=87444) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 04:50:34 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-bd788c49-8f07-4480-a668-f8fd2392b618 tempest-SnapshotDependencyTests-822583399 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922'] {{(pid=87444) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 04:50:34 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-bd788c49-8f07-4480-a668-f8fd2392b618 tempest-SnapshotDependencyTests-822583399 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 04:50:34 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-bd788c49-8f07-4480-a668-f8fd2392b618 tempest-SnapshotDependencyTests-822583399 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:50:34 devstack sudo[103823]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097 Jul 10 04:50:34 devstack sudo[103823]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:50:34 devstack sudo[103819]: pam_unix(sudo:session): session closed for user root Jul 10 04:50:34 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-f1ad97b1-304b-43e8-b3cb-d34cb9a83793 tempest-VolumeDependencyTests-1582854059 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-df6747e8-5098-453d-bd3b-653881e955d3" returned: 0 in 0.765s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:50:34 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-f1ad97b1-304b-43e8-b3cb-d34cb9a83793 tempest-VolumeDependencyTests-1582854059 None] Lock "cinder-quobyte-df6747e8-5098-453d-bd3b-653881e955d3" released by "_copy_volume_from_snapshot" :: held 8.575s {{(pid=87444) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 04:50:34 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-f1ad97b1-304b-43e8-b3cb-d34cb9a83793 tempest-VolumeDependencyTests-1582854059 None] Lock "cinder-quobyte-bbd96c96-7c5a-4eef-8963-4bde0d428b8d-df6747e8-5098-453d-bd3b-653881e955d3" released by "_create_volume_from_snapshot" :: held 8.626s {{(pid=87444) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 04:50:34 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-f1ad97b1-304b-43e8-b3cb-d34cb9a83793 tempest-VolumeDependencyTests-1582854059 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 8.651s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 04:50:34 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-8363df7e-de73-4c9e-9761-14b4f97fa35f tempest-SnapshotDependencyTests-822583399 None] Acquiring lock "cinder-3e720ae7-685c-4f3f-8625-c2f0b1273dbf-delete_volume" by "delete_volume" {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 04:50:34 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-f1ad97b1-304b-43e8-b3cb-d34cb9a83793 tempest-VolumeDependencyTests-1582854059 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1268648b-e52b-4f72-95df-d4b448a70726) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-df6747e8-5098-453d-bd3b-653881e955d3', 'volume_size': 1, 'snapshot_id': 'bbd96c96-7c5a-4eef-8963-4bde0d428b8d'}' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:50:34 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-f1ad97b1-304b-43e8-b3cb-d34cb9a83793 tempest-VolumeDependencyTests-1582854059 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (34bda02c-2c06-4574-8bc4-cf94e4b2b3a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:50:34 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-8363df7e-de73-4c9e-9761-14b4f97fa35f tempest-SnapshotDependencyTests-822583399 None] Lock "cinder-3e720ae7-685c-4f3f-8625-c2f0b1273dbf-delete_volume" acquired by "delete_volume" :: waited 0.046s {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 04:50:34 devstack cinder-volume[87444]: INFO cinder.volume.flows.manager.create_volume [None req-f1ad97b1-304b-43e8-b3cb-d34cb9a83793 tempest-VolumeDependencyTests-1582854059 None] Volume volume-df6747e8-5098-453d-bd3b-653881e955d3 (df6747e8-5098-453d-bd3b-653881e955d3): created successfully Jul 10 04:50:34 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-f1ad97b1-304b-43e8-b3cb-d34cb9a83793 tempest-VolumeDependencyTests-1582854059 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (34bda02c-2c06-4574-8bc4-cf94e4b2b3a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:50:34 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-f1ad97b1-304b-43e8-b3cb-d34cb9a83793 tempest-VolumeDependencyTests-1582854059 None] Flow 'volume_create_manager' (b5cfb44a-7fe1-4f7e-be94-d4bc24570d77) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87444) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 04:50:34 devstack cinder-volume[87444]: INFO cinder.volume.manager [None req-f1ad97b1-304b-43e8-b3cb-d34cb9a83793 tempest-VolumeDependencyTests-1582854059 None] Created volume successfully. Jul 10 04:50:34 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-8363df7e-de73-4c9e-9761-14b4f97fa35f tempest-SnapshotDependencyTests-822583399 None] Acquiring lock "cinder-quobyte-3e720ae7-685c-4f3f-8625-c2f0b1273dbf" by "delete_volume" {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 04:50:34 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-8363df7e-de73-4c9e-9761-14b4f97fa35f tempest-SnapshotDependencyTests-822583399 None] Lock "cinder-quobyte-3e720ae7-685c-4f3f-8625-c2f0b1273dbf" acquired by "delete_volume" :: waited 0.020s {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 04:50:34 devstack cinder-volume[87444]: DEBUG oslo.privsep.daemon [-] privsep: reply[560a241c-9262-406d-8ea8-5a7c92f32552]: (4, 'qcow2') {{(pid=88499) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 04:50:34 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-8363df7e-de73-4c9e-9761-14b4f97fa35f tempest-SnapshotDependencyTests-822583399 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-3e720ae7-685c-4f3f-8625-c2f0b1273dbf {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:50:34 devstack sudo[103826]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-3e720ae7-685c-4f3f-8625-c2f0b1273dbf Jul 10 04:50:34 devstack sudo[103826]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:50:34 devstack sudo[103823]: pam_unix(sudo:session): session closed for user root Jul 10 04:50:34 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-bd788c49-8f07-4480-a668-f8fd2392b618 tempest-SnapshotDependencyTests-822583399 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097" returned: 0 in 0.776s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:50:34 devstack cinder-volume[87444]: DEBUG cinder.manager [None req-bd788c49-8f07-4480-a668-f8fd2392b618 tempest-SnapshotDependencyTests-822583399 None] Notifying Schedulers of capabilities ... {{(pid=87444) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 04:50:34 devstack cinder-volume[87444]: INFO cinder.volume.manager [None req-bd788c49-8f07-4480-a668-f8fd2392b618 tempest-SnapshotDependencyTests-822583399 None] Deleted volume successfully. Jul 10 04:50:34 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-bd788c49-8f07-4480-a668-f8fd2392b618 tempest-SnapshotDependencyTests-822583399 None] Lock "cinder-e6abedaf-8d01-4989-905f-8ae4b2095dee-delete_volume" released by "delete_volume" :: held 2.731s {{(pid=87444) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 04:50:35 devstack sudo[103826]: pam_unix(sudo:session): session closed for user root Jul 10 04:50:35 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-8363df7e-de73-4c9e-9761-14b4f97fa35f tempest-SnapshotDependencyTests-822583399 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-3e720ae7-685c-4f3f-8625-c2f0b1273dbf" returned: 0 in 0.793s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:50:35 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-8363df7e-de73-4c9e-9761-14b4f97fa35f tempest-SnapshotDependencyTests-822583399 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-3e720ae7-685c-4f3f-8625-c2f0b1273dbf {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:50:35 devstack sudo[103832]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-3e720ae7-685c-4f3f-8625-c2f0b1273dbf Jul 10 04:50:35 devstack sudo[103832]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:50:35 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-7aeea44f-9070-45f9-985b-c82d4e1d187b tempest-VolumeDependencyTests-1582854059 None] Acquiring lock "cinder-bbd96c96-7c5a-4eef-8963-4bde0d428b8d-delete_snapshot" by "delete_snapshot" {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 04:50:35 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-7aeea44f-9070-45f9-985b-c82d4e1d187b tempest-VolumeDependencyTests-1582854059 None] Lock "cinder-bbd96c96-7c5a-4eef-8963-4bde0d428b8d-delete_snapshot" acquired by "delete_snapshot" :: waited 0.023s {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 04:50:35 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-7aeea44f-9070-45f9-985b-c82d4e1d187b tempest-VolumeDependencyTests-1582854059 None] Acquiring lock "cinder-quobyte-ddd97579-268b-4241-ad53-f3783e0e093b" by "delete_snapshot" {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 04:50:35 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-7aeea44f-9070-45f9-985b-c82d4e1d187b tempest-VolumeDependencyTests-1582854059 None] Lock "cinder-quobyte-ddd97579-268b-4241-ad53-f3783e0e093b" acquired by "delete_snapshot" :: waited 0.018s {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 04:50:35 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-7aeea44f-9070-45f9-985b-c82d4e1d187b tempest-VolumeDependencyTests-1582854059 None] Acquiring lock "cinder-quobyte-bbd96c96-7c5a-4eef-8963-4bde0d428b8d" by "_delete_snapshot" {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 04:50:35 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-7aeea44f-9070-45f9-985b-c82d4e1d187b tempest-VolumeDependencyTests-1582854059 None] Lock "cinder-quobyte-bbd96c96-7c5a-4eef-8963-4bde0d428b8d" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 04:50:35 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.remotefs [None req-7aeea44f-9070-45f9-985b-c82d4e1d187b tempest-VolumeDependencyTests-1582854059 None] Deleting offline snapshot bbd96c96-7c5a-4eef-8963-4bde0d428b8d of volume ddd97579-268b-4241-ad53-f3783e0e093b {{(pid=87444) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 10 04:50:35 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.remotefs [None req-7aeea44f-9070-45f9-985b-c82d4e1d187b tempest-VolumeDependencyTests-1582854059 None] snapshot_file for this snap is: volume-ddd97579-268b-4241-ad53-f3783e0e093b.bbd96c96-7c5a-4eef-8963-4bde0d428b8d {{(pid=87444) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 10 04:50:35 devstack cinder-volume[87444]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a7faeab-7ba5-4199-b334-a7aeae2548e7]: (4, 'qcow2') {{(pid=88499) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 04:50:35 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-7aeea44f-9070-45f9-985b-c82d4e1d187b tempest-VolumeDependencyTests-1582854059 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-ddd97579-268b-4241-ad53-f3783e0e093b.bbd96c96-7c5a-4eef-8963-4bde0d428b8d {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:50:35 devstack sudo[103834]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-ddd97579-268b-4241-ad53-f3783e0e093b.bbd96c96-7c5a-4eef-8963-4bde0d428b8d Jul 10 04:50:35 devstack sudo[103834]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:50:36 devstack sudo[103832]: pam_unix(sudo:session): session closed for user root Jul 10 04:50:36 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-8363df7e-de73-4c9e-9761-14b4f97fa35f tempest-SnapshotDependencyTests-822583399 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-3e720ae7-685c-4f3f-8625-c2f0b1273dbf" returned: 0 in 0.669s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:50:36 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-8363df7e-de73-4c9e-9761-14b4f97fa35f tempest-SnapshotDependencyTests-822583399 None] Lock "cinder-quobyte-3e720ae7-685c-4f3f-8625-c2f0b1273dbf" released by "delete_volume" :: held 1.507s {{(pid=87444) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 04:50:36 devstack cinder-volume[87444]: DEBUG cinder.quota [None req-8363df7e-de73-4c9e-9761-14b4f97fa35f tempest-SnapshotDependencyTests-822583399 None] Created reservations ['a3ab2b83-ce9b-4a08-b881-2010a361e28b', 'a9c2e7eb-33c1-497f-8f81-bf287e3c110e', 'f528a66e-4bd9-4b67-88c8-47aa46e60ca7', 'ca6609f9-7459-49e9-9c06-a4a9069c2401'] {{(pid=87444) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 04:50:36 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-8363df7e-de73-4c9e-9761-14b4f97fa35f tempest-SnapshotDependencyTests-822583399 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 04:50:36 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-8363df7e-de73-4c9e-9761-14b4f97fa35f tempest-SnapshotDependencyTests-822583399 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 04:50:36 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-8363df7e-de73-4c9e-9761-14b4f97fa35f tempest-SnapshotDependencyTests-822583399 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922': None} {{(pid=87444) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 04:50:36 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-8363df7e-de73-4c9e-9761-14b4f97fa35f tempest-SnapshotDependencyTests-822583399 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922'] {{(pid=87444) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 04:50:36 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-8363df7e-de73-4c9e-9761-14b4f97fa35f tempest-SnapshotDependencyTests-822583399 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 04:50:36 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-8363df7e-de73-4c9e-9761-14b4f97fa35f tempest-SnapshotDependencyTests-822583399 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:50:36 devstack sudo[103837]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097 Jul 10 04:50:36 devstack sudo[103837]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:50:36 devstack sudo[103834]: pam_unix(sudo:session): session closed for user root Jul 10 04:50:36 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-7aeea44f-9070-45f9-985b-c82d4e1d187b tempest-VolumeDependencyTests-1582854059 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-ddd97579-268b-4241-ad53-f3783e0e093b.bbd96c96-7c5a-4eef-8963-4bde0d428b8d" returned: 0 in 0.788s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:50:36 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.remotefs [None req-7aeea44f-9070-45f9-985b-c82d4e1d187b tempest-VolumeDependencyTests-1582854059 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ddd97579-268b-4241-ad53-f3783e0e093b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87444) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 10 04:50:36 devstack cinder-volume[87444]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca80002e-8de9-45b5-8d33-baf98906ead9]: (4, 'qcow2') {{(pid=88499) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 04:50:36 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-7aeea44f-9070-45f9-985b-c82d4e1d187b tempest-VolumeDependencyTests-1582854059 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-ddd97579-268b-4241-ad53-f3783e0e093b {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:50:36 devstack sudo[103846]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-ddd97579-268b-4241-ad53-f3783e0e093b Jul 10 04:50:36 devstack sudo[103846]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:50:36 devstack sudo[103837]: pam_unix(sudo:session): session closed for user root Jul 10 04:50:36 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-8363df7e-de73-4c9e-9761-14b4f97fa35f tempest-SnapshotDependencyTests-822583399 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097" returned: 0 in 0.718s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:50:36 devstack cinder-volume[87444]: DEBUG cinder.manager [None req-8363df7e-de73-4c9e-9761-14b4f97fa35f tempest-SnapshotDependencyTests-822583399 None] Notifying Schedulers of capabilities ... {{(pid=87444) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 04:50:36 devstack cinder-volume[87444]: INFO cinder.volume.manager [None req-8363df7e-de73-4c9e-9761-14b4f97fa35f tempest-SnapshotDependencyTests-822583399 None] Deleted volume successfully. Jul 10 04:50:37 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-8363df7e-de73-4c9e-9761-14b4f97fa35f tempest-SnapshotDependencyTests-822583399 None] Lock "cinder-3e720ae7-685c-4f3f-8625-c2f0b1273dbf-delete_volume" released by "delete_volume" :: held 2.515s {{(pid=87444) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 04:50:37 devstack sudo[103846]: pam_unix(sudo:session): session closed for user root Jul 10 04:50:37 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-7aeea44f-9070-45f9-985b-c82d4e1d187b tempest-VolumeDependencyTests-1582854059 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-ddd97579-268b-4241-ad53-f3783e0e093b" returned: 0 in 0.910s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:50:37 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-7aeea44f-9070-45f9-985b-c82d4e1d187b tempest-VolumeDependencyTests-1582854059 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-ddd97579-268b-4241-ad53-f3783e0e093b.bbd96c96-7c5a-4eef-8963-4bde0d428b8d {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:50:37 devstack sudo[103856]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-ddd97579-268b-4241-ad53-f3783e0e093b.bbd96c96-7c5a-4eef-8963-4bde0d428b8d Jul 10 04:50:37 devstack sudo[103856]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:50:38 devstack sudo[103856]: pam_unix(sudo:session): session closed for user root Jul 10 04:50:38 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-7aeea44f-9070-45f9-985b-c82d4e1d187b tempest-VolumeDependencyTests-1582854059 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-ddd97579-268b-4241-ad53-f3783e0e093b.bbd96c96-7c5a-4eef-8963-4bde0d428b8d" returned: 0 in 0.795s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:50:38 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-7aeea44f-9070-45f9-985b-c82d4e1d187b tempest-VolumeDependencyTests-1582854059 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-ddd97579-268b-4241-ad53-f3783e0e093b.bbd96c96-7c5a-4eef-8963-4bde0d428b8d {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:50:38 devstack sudo[103864]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-ddd97579-268b-4241-ad53-f3783e0e093b.bbd96c96-7c5a-4eef-8963-4bde0d428b8d Jul 10 04:50:38 devstack sudo[103864]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:50:39 devstack sudo[103864]: pam_unix(sudo:session): session closed for user root Jul 10 04:50:39 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-7aeea44f-9070-45f9-985b-c82d4e1d187b tempest-VolumeDependencyTests-1582854059 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-ddd97579-268b-4241-ad53-f3783e0e093b.bbd96c96-7c5a-4eef-8963-4bde0d428b8d" returned: 0 in 0.747s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:50:39 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-7aeea44f-9070-45f9-985b-c82d4e1d187b tempest-VolumeDependencyTests-1582854059 None] Lock "cinder-quobyte-bbd96c96-7c5a-4eef-8963-4bde0d428b8d" released by "_delete_snapshot" :: held 3.372s {{(pid=87444) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 04:50:39 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-7aeea44f-9070-45f9-985b-c82d4e1d187b tempest-VolumeDependencyTests-1582854059 None] Lock "cinder-quobyte-ddd97579-268b-4241-ad53-f3783e0e093b" released by "delete_snapshot" :: held 3.399s {{(pid=87444) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 04:50:39 devstack cinder-volume[87444]: DEBUG cinder.quota [None req-7aeea44f-9070-45f9-985b-c82d4e1d187b tempest-VolumeDependencyTests-1582854059 None] Created reservations ['d947c80e-39f9-4c85-bbc9-2ff3ac931452', 'f2dcc4ee-8bae-42a4-938c-6c4caf6e5cca', 'b916339e-6581-4061-aa3f-62d9249af26b', 'e427788f-db1a-4917-8424-a4cccb138059'] {{(pid=87444) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 04:50:39 devstack cinder-volume[87444]: INFO cinder.volume.manager [None req-7aeea44f-9070-45f9-985b-c82d4e1d187b tempest-VolumeDependencyTests-1582854059 None] Delete snapshot completed successfully. Jul 10 04:50:39 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-7aeea44f-9070-45f9-985b-c82d4e1d187b tempest-VolumeDependencyTests-1582854059 None] Lock "cinder-bbd96c96-7c5a-4eef-8963-4bde0d428b8d-delete_snapshot" released by "delete_snapshot" :: held 3.558s {{(pid=87444) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 04:50:40 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-ec83ab31-3b52-42b4-b809-c9415ddd3e23 tempest-VolumeDependencyTests-1582854059 None] Acquiring lock "cinder-ddd97579-268b-4241-ad53-f3783e0e093b-delete_volume" by "delete_volume" {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 04:50:40 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-ec83ab31-3b52-42b4-b809-c9415ddd3e23 tempest-VolumeDependencyTests-1582854059 None] Lock "cinder-ddd97579-268b-4241-ad53-f3783e0e093b-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 04:50:40 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-ec83ab31-3b52-42b4-b809-c9415ddd3e23 tempest-VolumeDependencyTests-1582854059 None] Acquiring lock "cinder-quobyte-ddd97579-268b-4241-ad53-f3783e0e093b" by "delete_volume" {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 04:50:40 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-ec83ab31-3b52-42b4-b809-c9415ddd3e23 tempest-VolumeDependencyTests-1582854059 None] Lock "cinder-quobyte-ddd97579-268b-4241-ad53-f3783e0e093b" acquired by "delete_volume" :: waited 0.017s {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 04:50:40 devstack cinder-volume[87444]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e88034e-04aa-4228-aee1-7139e8debc6b]: (4, 'qcow2') {{(pid=88499) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 04:50:40 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-ec83ab31-3b52-42b4-b809-c9415ddd3e23 tempest-VolumeDependencyTests-1582854059 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-ddd97579-268b-4241-ad53-f3783e0e093b {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:50:40 devstack sudo[103907]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-ddd97579-268b-4241-ad53-f3783e0e093b Jul 10 04:50:40 devstack sudo[103907]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:50:41 devstack sudo[103907]: pam_unix(sudo:session): session closed for user root Jul 10 04:50:41 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-ec83ab31-3b52-42b4-b809-c9415ddd3e23 tempest-VolumeDependencyTests-1582854059 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-ddd97579-268b-4241-ad53-f3783e0e093b" returned: 0 in 0.889s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:50:41 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-ec83ab31-3b52-42b4-b809-c9415ddd3e23 tempest-VolumeDependencyTests-1582854059 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-ddd97579-268b-4241-ad53-f3783e0e093b {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:50:41 devstack sudo[103914]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-ddd97579-268b-4241-ad53-f3783e0e093b Jul 10 04:50:41 devstack sudo[103914]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:50:41 devstack sudo[103914]: pam_unix(sudo:session): session closed for user root Jul 10 04:50:41 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-ec83ab31-3b52-42b4-b809-c9415ddd3e23 tempest-VolumeDependencyTests-1582854059 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-ddd97579-268b-4241-ad53-f3783e0e093b" returned: 0 in 0.798s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:50:41 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-ec83ab31-3b52-42b4-b809-c9415ddd3e23 tempest-VolumeDependencyTests-1582854059 None] Lock "cinder-quobyte-ddd97579-268b-4241-ad53-f3783e0e093b" released by "delete_volume" :: held 1.780s {{(pid=87444) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 04:50:41 devstack cinder-volume[87444]: DEBUG cinder.quota [None req-ec83ab31-3b52-42b4-b809-c9415ddd3e23 tempest-VolumeDependencyTests-1582854059 None] Created reservations ['f68a6530-806e-4877-8398-87f3718b8986', '742f10de-de8f-4d32-b6c0-177f3be55163', 'f2e0ead3-bb5b-463c-b634-5bdbe7e6b030', 'c40551c6-c660-439a-b82b-65ed15059962'] {{(pid=87444) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 04:50:42 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-ec83ab31-3b52-42b4-b809-c9415ddd3e23 tempest-VolumeDependencyTests-1582854059 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 04:50:42 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-ec83ab31-3b52-42b4-b809-c9415ddd3e23 tempest-VolumeDependencyTests-1582854059 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 04:50:42 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-ec83ab31-3b52-42b4-b809-c9415ddd3e23 tempest-VolumeDependencyTests-1582854059 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922': None} {{(pid=87444) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 04:50:42 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-ec83ab31-3b52-42b4-b809-c9415ddd3e23 tempest-VolumeDependencyTests-1582854059 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922'] {{(pid=87444) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 04:50:42 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-ec83ab31-3b52-42b4-b809-c9415ddd3e23 tempest-VolumeDependencyTests-1582854059 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 04:50:42 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-ec83ab31-3b52-42b4-b809-c9415ddd3e23 tempest-VolumeDependencyTests-1582854059 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:50:42 devstack sudo[103922]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097 Jul 10 04:50:42 devstack sudo[103922]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:50:42 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-954f17ac-b74c-4ee8-89ee-03b7b3885f9f tempest-VolumeDependencyTests-1582854059 None] Acquiring lock "cinder-df6747e8-5098-453d-bd3b-653881e955d3-delete_volume" by "delete_volume" {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 04:50:42 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-954f17ac-b74c-4ee8-89ee-03b7b3885f9f tempest-VolumeDependencyTests-1582854059 None] Lock "cinder-df6747e8-5098-453d-bd3b-653881e955d3-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 04:50:42 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-954f17ac-b74c-4ee8-89ee-03b7b3885f9f tempest-VolumeDependencyTests-1582854059 None] Acquiring lock "cinder-quobyte-df6747e8-5098-453d-bd3b-653881e955d3" by "delete_volume" {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 04:50:42 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-954f17ac-b74c-4ee8-89ee-03b7b3885f9f tempest-VolumeDependencyTests-1582854059 None] Lock "cinder-quobyte-df6747e8-5098-453d-bd3b-653881e955d3" acquired by "delete_volume" :: waited 0.026s {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 04:50:42 devstack cinder-volume[87444]: DEBUG oslo.privsep.daemon [-] privsep: reply[677b7462-028f-49c9-9170-e6ab85e7105a]: (4, 'qcow2') {{(pid=88499) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 04:50:42 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-954f17ac-b74c-4ee8-89ee-03b7b3885f9f tempest-VolumeDependencyTests-1582854059 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-df6747e8-5098-453d-bd3b-653881e955d3 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:50:42 devstack sudo[103924]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-df6747e8-5098-453d-bd3b-653881e955d3 Jul 10 04:50:42 devstack sudo[103924]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:50:42 devstack sudo[103922]: pam_unix(sudo:session): session closed for user root Jul 10 04:50:42 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-ec83ab31-3b52-42b4-b809-c9415ddd3e23 tempest-VolumeDependencyTests-1582854059 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097" returned: 0 in 0.909s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:50:42 devstack cinder-volume[87444]: DEBUG cinder.manager [None req-ec83ab31-3b52-42b4-b809-c9415ddd3e23 tempest-VolumeDependencyTests-1582854059 None] Notifying Schedulers of capabilities ... {{(pid=87444) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 04:50:42 devstack cinder-volume[87444]: INFO cinder.volume.manager [None req-ec83ab31-3b52-42b4-b809-c9415ddd3e23 tempest-VolumeDependencyTests-1582854059 None] Deleted volume successfully. Jul 10 04:50:43 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-ec83ab31-3b52-42b4-b809-c9415ddd3e23 tempest-VolumeDependencyTests-1582854059 None] Lock "cinder-ddd97579-268b-4241-ad53-f3783e0e093b-delete_volume" released by "delete_volume" :: held 2.957s {{(pid=87444) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 04:50:43 devstack cinder-volume[87444]: INFO cinder.volume.manager [req-4d775913-5876-438e-805a-f6db0d83b9d3 req-a90f5216-4ff0-42a3-97e0-87fa946bbc2e tempest-TestShelveInstance-1751178727 None] Terminate volume connection completed successfully. Jul 10 04:50:43 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [req-4d775913-5876-438e-805a-f6db0d83b9d3 req-a90f5216-4ff0-42a3-97e0-87fa946bbc2e tempest-TestShelveInstance-1751178727 None] Deleting attachment d34c8649-5ffb-425b-92d9-a7a18ed97e34. {{(pid=87444) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 10 04:50:43 devstack sudo[103924]: pam_unix(sudo:session): session closed for user root Jul 10 04:50:43 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-954f17ac-b74c-4ee8-89ee-03b7b3885f9f tempest-VolumeDependencyTests-1582854059 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-df6747e8-5098-453d-bd3b-653881e955d3" returned: 0 in 1.102s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:50:43 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-954f17ac-b74c-4ee8-89ee-03b7b3885f9f tempest-VolumeDependencyTests-1582854059 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-df6747e8-5098-453d-bd3b-653881e955d3 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:50:43 devstack sudo[103948]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-df6747e8-5098-453d-bd3b-653881e955d3 Jul 10 04:50:43 devstack sudo[103948]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:50:44 devstack sudo[103948]: pam_unix(sudo:session): session closed for user root Jul 10 04:50:44 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-954f17ac-b74c-4ee8-89ee-03b7b3885f9f tempest-VolumeDependencyTests-1582854059 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-df6747e8-5098-453d-bd3b-653881e955d3" returned: 0 in 0.764s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:50:44 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-954f17ac-b74c-4ee8-89ee-03b7b3885f9f tempest-VolumeDependencyTests-1582854059 None] Lock "cinder-quobyte-df6747e8-5098-453d-bd3b-653881e955d3" released by "delete_volume" :: held 1.924s {{(pid=87444) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 04:50:44 devstack cinder-volume[87444]: DEBUG cinder.quota [None req-954f17ac-b74c-4ee8-89ee-03b7b3885f9f tempest-VolumeDependencyTests-1582854059 None] Created reservations ['f88223bd-07df-44ac-be50-98161771e4d5', '179fe2fd-61bc-4501-ae01-ba5da2fd50fb', '12e609ff-ad5b-4f7f-bcef-8668636da06d', '4f1649a8-e0d6-47c8-998a-698cd0a679f9'] {{(pid=87444) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 04:50:44 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-954f17ac-b74c-4ee8-89ee-03b7b3885f9f tempest-VolumeDependencyTests-1582854059 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 04:50:44 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-954f17ac-b74c-4ee8-89ee-03b7b3885f9f tempest-VolumeDependencyTests-1582854059 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 04:50:44 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-954f17ac-b74c-4ee8-89ee-03b7b3885f9f tempest-VolumeDependencyTests-1582854059 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922': None} {{(pid=87444) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 04:50:44 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-954f17ac-b74c-4ee8-89ee-03b7b3885f9f tempest-VolumeDependencyTests-1582854059 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922'] {{(pid=87444) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 04:50:44 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-954f17ac-b74c-4ee8-89ee-03b7b3885f9f tempest-VolumeDependencyTests-1582854059 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 04:50:44 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-954f17ac-b74c-4ee8-89ee-03b7b3885f9f tempest-VolumeDependencyTests-1582854059 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:50:44 devstack sudo[103952]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097 Jul 10 04:50:44 devstack sudo[103952]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:50:45 devstack sudo[103952]: pam_unix(sudo:session): session closed for user root Jul 10 04:50:45 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-954f17ac-b74c-4ee8-89ee-03b7b3885f9f tempest-VolumeDependencyTests-1582854059 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097" returned: 0 in 0.858s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:50:45 devstack cinder-volume[87444]: DEBUG cinder.manager [None req-954f17ac-b74c-4ee8-89ee-03b7b3885f9f tempest-VolumeDependencyTests-1582854059 None] Notifying Schedulers of capabilities ... {{(pid=87444) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 04:50:45 devstack cinder-volume[87444]: INFO cinder.volume.manager [None req-954f17ac-b74c-4ee8-89ee-03b7b3885f9f tempest-VolumeDependencyTests-1582854059 None] Deleted volume successfully. Jul 10 04:50:45 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-954f17ac-b74c-4ee8-89ee-03b7b3885f9f tempest-VolumeDependencyTests-1582854059 None] Lock "cinder-df6747e8-5098-453d-bd3b-653881e955d3-delete_volume" released by "delete_volume" :: held 3.032s {{(pid=87444) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 04:50:48 devstack cinder-volume[87444]: DEBUG cinder.volume.flows.manager.create_volume [None req-9ed5edfa-4cff-4a34-b28f-892cab998dcb tempest-CinderUnicodeTest-2082279261 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87444) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 04:50:48 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-9ed5edfa-4cff-4a34-b28f-892cab998dcb tempest-CinderUnicodeTest-2082279261 None] Flow 'volume_create_manager' (858eb114-b625-4079-a597-2978ad4e3956) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 04:50:48 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-9ed5edfa-4cff-4a34-b28f-892cab998dcb tempest-CinderUnicodeTest-2082279261 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a5a107c1-62f2-42de-ae98-c863c6bef337) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:50:48 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-9ed5edfa-4cff-4a34-b28f-892cab998dcb tempest-CinderUnicodeTest-2082279261 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a5a107c1-62f2-42de-ae98-c863c6bef337) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T02:50:48Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a947b231-b671-4113-ac02-d3dce5fdd05e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fe9c49bbd7aa4a8286537ec0d21926ad',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T02:50:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T02:50:48Z,use_quota=True,user_id='00df0e3ee7504af28fc52b523d3c082f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(317e369e-1e06-434d-ae95-a335f0e6c903),volume_type_id=317e369e-1e06-434d-ae95-a335f0e6c903)' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:50:48 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-9ed5edfa-4cff-4a34-b28f-892cab998dcb tempest-CinderUnicodeTest-2082279261 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dfa70928-6744-4552-bfaf-c478fa0a550f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:50:48 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-9ed5edfa-4cff-4a34-b28f-892cab998dcb tempest-CinderUnicodeTest-2082279261 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dfa70928-6744-4552-bfaf-c478fa0a550f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:50:48 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-9ed5edfa-4cff-4a34-b28f-892cab998dcb tempest-CinderUnicodeTest-2082279261 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1742c28a-ada8-4264-86d5-f3bb44b83668) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:50:48 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-9ed5edfa-4cff-4a34-b28f-892cab998dcb tempest-CinderUnicodeTest-2082279261 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1742c28a-ada8-4264-86d5-f3bb44b83668) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a947b231-b671-4113-ac02-d3dce5fdd05e', 'volume_name': 'volume-a947b231-b671-4113-ac02-d3dce5fdd05e', 'volume_size': 1}' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:50:48 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-9ed5edfa-4cff-4a34-b28f-892cab998dcb tempest-CinderUnicodeTest-2082279261 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1e1e1552-6ec1-4f4c-bad4-a94cbd30a3e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:50:48 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-9ed5edfa-4cff-4a34-b28f-892cab998dcb tempest-CinderUnicodeTest-2082279261 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1e1e1552-6ec1-4f4c-bad4-a94cbd30a3e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:50:48 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-9ed5edfa-4cff-4a34-b28f-892cab998dcb tempest-CinderUnicodeTest-2082279261 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (da6023c6-6f90-4ae2-82a0-250e102f017f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:50:48 devstack cinder-volume[87444]: INFO cinder.volume.flows.manager.create_volume [None req-9ed5edfa-4cff-4a34-b28f-892cab998dcb tempest-CinderUnicodeTest-2082279261 None] Volume a947b231-b671-4113-ac02-d3dce5fdd05e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a947b231-b671-4113-ac02-d3dce5fdd05e', 'volume_size': 1} Jul 10 04:50:48 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-9ed5edfa-4cff-4a34-b28f-892cab998dcb tempest-CinderUnicodeTest-2082279261 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 04:50:48 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-9ed5edfa-4cff-4a34-b28f-892cab998dcb tempest-CinderUnicodeTest-2082279261 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 04:50:48 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-9ed5edfa-4cff-4a34-b28f-892cab998dcb tempest-CinderUnicodeTest-2082279261 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T02:50:48Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a947b231-b671-4113-ac02-d3dce5fdd05e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fe9c49bbd7aa4a8286537ec0d21926ad',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T02:50:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T02:50:48Z,use_quota=True,user_id='00df0e3ee7504af28fc52b523d3c082f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(317e369e-1e06-434d-ae95-a335f0e6c903),volume_type_id=317e369e-1e06-434d-ae95-a335f0e6c903)}" {{(pid=87444) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 04:50:48 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.remotefs [None req-9ed5edfa-4cff-4a34-b28f-892cab998dcb tempest-CinderUnicodeTest-2082279261 None] Creating volume a947b231-b671-4113-ac02-d3dce5fdd05e {{(pid=87444) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 04:50:48 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-9ed5edfa-4cff-4a34-b28f-892cab998dcb tempest-CinderUnicodeTest-2082279261 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 04:50:48 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-9ed5edfa-4cff-4a34-b28f-892cab998dcb tempest-CinderUnicodeTest-2082279261 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 04:50:48 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-9ed5edfa-4cff-4a34-b28f-892cab998dcb tempest-CinderUnicodeTest-2082279261 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922': None} {{(pid=87444) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 04:50:48 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-9ed5edfa-4cff-4a34-b28f-892cab998dcb tempest-CinderUnicodeTest-2082279261 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922'] {{(pid=87444) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 04:50:48 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-9ed5edfa-4cff-4a34-b28f-892cab998dcb tempest-CinderUnicodeTest-2082279261 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 04:50:48 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-9ed5edfa-4cff-4a34-b28f-892cab998dcb tempest-CinderUnicodeTest-2082279261 None] Selected osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922 as target Quobyte volume. {{(pid=87444) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 04:50:48 devstack cinder-volume[87444]: INFO cinder.volume.drivers.remotefs [None req-9ed5edfa-4cff-4a34-b28f-892cab998dcb tempest-CinderUnicodeTest-2082279261 None] casted to osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922 Jul 10 04:50:48 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-9ed5edfa-4cff-4a34-b28f-892cab998dcb tempest-CinderUnicodeTest-2082279261 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-a947b231-b671-4113-ac02-d3dce5fdd05e 1073741824 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:50:48 devstack sudo[103965]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-a947b231-b671-4113-ac02-d3dce5fdd05e 1073741824 Jul 10 04:50:48 devstack sudo[103965]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:50:49 devstack sudo[103965]: pam_unix(sudo:session): session closed for user root Jul 10 04:50:49 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-9ed5edfa-4cff-4a34-b28f-892cab998dcb tempest-CinderUnicodeTest-2082279261 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-a947b231-b671-4113-ac02-d3dce5fdd05e 1073741824" returned: 0 in 0.833s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:50:49 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-9ed5edfa-4cff-4a34-b28f-892cab998dcb tempest-CinderUnicodeTest-2082279261 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-a947b231-b671-4113-ac02-d3dce5fdd05e {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:50:49 devstack sudo[103971]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-a947b231-b671-4113-ac02-d3dce5fdd05e Jul 10 04:50:49 devstack sudo[103971]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:50:49 devstack sudo[103971]: pam_unix(sudo:session): session closed for user root Jul 10 04:50:49 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-9ed5edfa-4cff-4a34-b28f-892cab998dcb tempest-CinderUnicodeTest-2082279261 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-a947b231-b671-4113-ac02-d3dce5fdd05e" returned: 0 in 0.633s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:50:49 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-9ed5edfa-4cff-4a34-b28f-892cab998dcb tempest-CinderUnicodeTest-2082279261 None] <== create_volume: return (1514ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922'} {{(pid=87444) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 04:50:49 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-9ed5edfa-4cff-4a34-b28f-892cab998dcb tempest-CinderUnicodeTest-2082279261 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.517s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 04:50:49 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-9ed5edfa-4cff-4a34-b28f-892cab998dcb tempest-CinderUnicodeTest-2082279261 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (da6023c6-6f90-4ae2-82a0-250e102f017f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a947b231-b671-4113-ac02-d3dce5fdd05e', 'volume_size': 1}' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:50:49 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-9ed5edfa-4cff-4a34-b28f-892cab998dcb tempest-CinderUnicodeTest-2082279261 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7d41f155-e0b4-4662-8279-470b2027d992) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:50:49 devstack cinder-volume[87444]: INFO cinder.volume.flows.manager.create_volume [None req-9ed5edfa-4cff-4a34-b28f-892cab998dcb tempest-CinderUnicodeTest-2082279261 None] Volume volume-a947b231-b671-4113-ac02-d3dce5fdd05e (a947b231-b671-4113-ac02-d3dce5fdd05e): created successfully Jul 10 04:50:49 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-9ed5edfa-4cff-4a34-b28f-892cab998dcb tempest-CinderUnicodeTest-2082279261 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7d41f155-e0b4-4662-8279-470b2027d992) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:50:49 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-9ed5edfa-4cff-4a34-b28f-892cab998dcb tempest-CinderUnicodeTest-2082279261 None] Flow 'volume_create_manager' (858eb114-b625-4079-a597-2978ad4e3956) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87444) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 04:50:49 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [req-6c3a7e07-64f0-4710-8052-b8e6187e1ee5 req-de3ed8d9-7f74-422b-ae5e-5ee43d4e28d7 tempest-TestShelveInstance-1751178727 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 04:50:49 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [req-6c3a7e07-64f0-4710-8052-b8e6187e1ee5 req-de3ed8d9-7f74-422b-ae5e-5ee43d4e28d7 tempest-TestShelveInstance-1751178727 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 04:50:49 devstack cinder-volume[87444]: INFO cinder.volume.manager [None req-9ed5edfa-4cff-4a34-b28f-892cab998dcb tempest-CinderUnicodeTest-2082279261 None] Created volume successfully. Jul 10 04:50:49 devstack cinder-volume[87444]: DEBUG oslo.privsep.daemon [-] privsep: reply[b39838da-11d5-4f2f-9bdc-edbc484ba372]: (4, 'raw') {{(pid=88499) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 04:50:49 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [req-6c3a7e07-64f0-4710-8052-b8e6187e1ee5 req-de3ed8d9-7f74-422b-ae5e-5ee43d4e28d7 tempest-TestShelveInstance-1751178727 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-42c78259-797d-4508-807c-77c3d325d344 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:50:50 devstack sudo[103982]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-42c78259-797d-4508-807c-77c3d325d344 Jul 10 04:50:50 devstack sudo[103982]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:50:50 devstack sudo[103982]: pam_unix(sudo:session): session closed for user root Jul 10 04:50:50 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [req-6c3a7e07-64f0-4710-8052-b8e6187e1ee5 req-de3ed8d9-7f74-422b-ae5e-5ee43d4e28d7 tempest-TestShelveInstance-1751178727 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-42c78259-797d-4508-807c-77c3d325d344" returned: 0 in 0.744s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:50:50 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [req-6c3a7e07-64f0-4710-8052-b8e6187e1ee5 req-de3ed8d9-7f74-422b-ae5e-5ee43d4e28d7 tempest-TestShelveInstance-1751178727 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-42c78259-797d-4508-807c-77c3d325d344 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:50:50 devstack sudo[103986]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-42c78259-797d-4508-807c-77c3d325d344 Jul 10 04:50:50 devstack sudo[103986]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:50:50 devstack cinder-volume[87444]: DEBUG cinder.volume.flows.manager.create_volume [None req-6271fa04-7c72-4905-a6fa-dbeb81c658a8 tempest-CinderUnicodeTest-2082279261 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87444) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 04:50:50 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-6271fa04-7c72-4905-a6fa-dbeb81c658a8 tempest-CinderUnicodeTest-2082279261 None] Flow 'volume_create_manager' (fb8dc3cc-8042-4e56-9d81-0c6fdbedb1bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 04:50:50 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-6271fa04-7c72-4905-a6fa-dbeb81c658a8 tempest-CinderUnicodeTest-2082279261 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2127c459-2d05-4e5c-93f2-83a1a2c7958a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:50:50 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-6271fa04-7c72-4905-a6fa-dbeb81c658a8 tempest-CinderUnicodeTest-2082279261 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2127c459-2d05-4e5c-93f2-83a1a2c7958a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T02:50:51Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-664386904',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=760bfb57-33cd-462d-aa96-8a54747196f9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fe9c49bbd7aa4a8286537ec0d21926ad',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T02:50:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T02:50:51Z,use_quota=True,user_id='00df0e3ee7504af28fc52b523d3c082f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(317e369e-1e06-434d-ae95-a335f0e6c903),volume_type_id=317e369e-1e06-434d-ae95-a335f0e6c903)' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:50:50 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-6271fa04-7c72-4905-a6fa-dbeb81c658a8 tempest-CinderUnicodeTest-2082279261 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5e088ecf-661a-4a48-bba7-5af0ece5737b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:50:50 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-6271fa04-7c72-4905-a6fa-dbeb81c658a8 tempest-CinderUnicodeTest-2082279261 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5e088ecf-661a-4a48-bba7-5af0ece5737b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:50:50 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-6271fa04-7c72-4905-a6fa-dbeb81c658a8 tempest-CinderUnicodeTest-2082279261 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3860eec1-8df6-44a3-9338-ae7261b43524) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:50:50 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-6271fa04-7c72-4905-a6fa-dbeb81c658a8 tempest-CinderUnicodeTest-2082279261 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3860eec1-8df6-44a3-9338-ae7261b43524) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '760bfb57-33cd-462d-aa96-8a54747196f9', 'volume_name': 'volume-760bfb57-33cd-462d-aa96-8a54747196f9', 'volume_size': 1}' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:50:50 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-6271fa04-7c72-4905-a6fa-dbeb81c658a8 tempest-CinderUnicodeTest-2082279261 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dfd1fe8a-a7b5-4dda-8634-bda1fa93d47e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:50:50 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-6271fa04-7c72-4905-a6fa-dbeb81c658a8 tempest-CinderUnicodeTest-2082279261 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dfd1fe8a-a7b5-4dda-8634-bda1fa93d47e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:50:50 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-6271fa04-7c72-4905-a6fa-dbeb81c658a8 tempest-CinderUnicodeTest-2082279261 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (84fb0ec3-3206-429c-b328-c5285159825e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:50:50 devstack cinder-volume[87444]: INFO cinder.volume.flows.manager.create_volume [None req-6271fa04-7c72-4905-a6fa-dbeb81c658a8 tempest-CinderUnicodeTest-2082279261 None] Volume 760bfb57-33cd-462d-aa96-8a54747196f9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-760bfb57-33cd-462d-aa96-8a54747196f9', 'volume_size': 1} Jul 10 04:50:50 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-6271fa04-7c72-4905-a6fa-dbeb81c658a8 tempest-CinderUnicodeTest-2082279261 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 04:50:51 devstack sudo[103986]: pam_unix(sudo:session): session closed for user root Jul 10 04:50:51 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [req-6c3a7e07-64f0-4710-8052-b8e6187e1ee5 req-de3ed8d9-7f74-422b-ae5e-5ee43d4e28d7 tempest-TestShelveInstance-1751178727 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-42c78259-797d-4508-807c-77c3d325d344" returned: 1 in 0.749s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:50:51 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [req-6c3a7e07-64f0-4710-8052-b8e6187e1ee5 req-de3ed8d9-7f74-422b-ae5e-5ee43d4e28d7 tempest-TestShelveInstance-1751178727 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-42c78259-797d-4508-807c-77c3d325d344' failed. Not Retrying. {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 10 04:50:51 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [req-6c3a7e07-64f0-4710-8052-b8e6187e1ee5 req-de3ed8d9-7f74-422b-ae5e-5ee43d4e28d7 tempest-TestShelveInstance-1751178727 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.531s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 04:50:51 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-6271fa04-7c72-4905-a6fa-dbeb81c658a8 tempest-CinderUnicodeTest-2082279261 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.536s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 04:50:51 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-6271fa04-7c72-4905-a6fa-dbeb81c658a8 tempest-CinderUnicodeTest-2082279261 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T02:50:51Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-664386904',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=760bfb57-33cd-462d-aa96-8a54747196f9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fe9c49bbd7aa4a8286537ec0d21926ad',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T02:50:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T02:50:51Z,use_quota=True,user_id='00df0e3ee7504af28fc52b523d3c082f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(317e369e-1e06-434d-ae95-a335f0e6c903),volume_type_id=317e369e-1e06-434d-ae95-a335f0e6c903)}" {{(pid=87444) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 04:50:51 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.remotefs [None req-6271fa04-7c72-4905-a6fa-dbeb81c658a8 tempest-CinderUnicodeTest-2082279261 None] Creating volume 760bfb57-33cd-462d-aa96-8a54747196f9 {{(pid=87444) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 04:50:51 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-6271fa04-7c72-4905-a6fa-dbeb81c658a8 tempest-CinderUnicodeTest-2082279261 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 04:50:51 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-6271fa04-7c72-4905-a6fa-dbeb81c658a8 tempest-CinderUnicodeTest-2082279261 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 04:50:51 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-6271fa04-7c72-4905-a6fa-dbeb81c658a8 tempest-CinderUnicodeTest-2082279261 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922': None} {{(pid=87444) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 04:50:51 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-6271fa04-7c72-4905-a6fa-dbeb81c658a8 tempest-CinderUnicodeTest-2082279261 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922'] {{(pid=87444) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 04:50:51 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-6271fa04-7c72-4905-a6fa-dbeb81c658a8 tempest-CinderUnicodeTest-2082279261 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 04:50:51 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-6271fa04-7c72-4905-a6fa-dbeb81c658a8 tempest-CinderUnicodeTest-2082279261 None] Selected osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922 as target Quobyte volume. {{(pid=87444) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 04:50:51 devstack cinder-volume[87444]: INFO cinder.volume.drivers.remotefs [None req-6271fa04-7c72-4905-a6fa-dbeb81c658a8 tempest-CinderUnicodeTest-2082279261 None] casted to osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922 Jul 10 04:50:51 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-6271fa04-7c72-4905-a6fa-dbeb81c658a8 tempest-CinderUnicodeTest-2082279261 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-760bfb57-33cd-462d-aa96-8a54747196f9 1073741824 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:50:51 devstack sudo[103991]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-760bfb57-33cd-462d-aa96-8a54747196f9 1073741824 Jul 10 04:50:51 devstack sudo[103991]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:50:51 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [req-6c3a7e07-64f0-4710-8052-b8e6187e1ee5 req-de3ed8d9-7f74-422b-ae5e-5ee43d4e28d7 tempest-TestShelveInstance-1751178727 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922', 'name': 'volume-42c78259-797d-4508-807c-77c3d325d344', 'options': None, 'format': 'raw', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '5fa02eeb-b771-4541-9264-4c9cf8ffc5e5', 'enforce_multipath': True} {{(pid=87444) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 10 04:50:51 devstack cinder-volume[87444]: INFO cinder.volume.manager [req-6c3a7e07-64f0-4710-8052-b8e6187e1ee5 req-de3ed8d9-7f74-422b-ae5e-5ee43d4e28d7 tempest-TestShelveInstance-1751178727 None] attachment_update completed successfully. Jul 10 04:50:52 devstack sudo[103991]: pam_unix(sudo:session): session closed for user root Jul 10 04:50:52 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-6271fa04-7c72-4905-a6fa-dbeb81c658a8 tempest-CinderUnicodeTest-2082279261 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-760bfb57-33cd-462d-aa96-8a54747196f9 1073741824" returned: 0 in 0.833s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:50:52 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-6271fa04-7c72-4905-a6fa-dbeb81c658a8 tempest-CinderUnicodeTest-2082279261 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-760bfb57-33cd-462d-aa96-8a54747196f9 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:50:52 devstack sudo[103997]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-760bfb57-33cd-462d-aa96-8a54747196f9 Jul 10 04:50:52 devstack sudo[103997]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:50:52 devstack sudo[103997]: pam_unix(sudo:session): session closed for user root Jul 10 04:50:52 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-6271fa04-7c72-4905-a6fa-dbeb81c658a8 tempest-CinderUnicodeTest-2082279261 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-760bfb57-33cd-462d-aa96-8a54747196f9" returned: 0 in 0.671s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:50:52 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-6271fa04-7c72-4905-a6fa-dbeb81c658a8 tempest-CinderUnicodeTest-2082279261 None] <== create_volume: return (1539ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922'} {{(pid=87444) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 04:50:52 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-6271fa04-7c72-4905-a6fa-dbeb81c658a8 tempest-CinderUnicodeTest-2082279261 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.543s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 04:50:52 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-6271fa04-7c72-4905-a6fa-dbeb81c658a8 tempest-CinderUnicodeTest-2082279261 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (84fb0ec3-3206-429c-b328-c5285159825e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-760bfb57-33cd-462d-aa96-8a54747196f9', 'volume_size': 1}' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:50:52 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-6271fa04-7c72-4905-a6fa-dbeb81c658a8 tempest-CinderUnicodeTest-2082279261 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (215e1f8a-7b5c-42b8-baba-e9daada11b6c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:50:53 devstack cinder-volume[87444]: INFO cinder.volume.flows.manager.create_volume [None req-6271fa04-7c72-4905-a6fa-dbeb81c658a8 tempest-CinderUnicodeTest-2082279261 None] Volume volume-760bfb57-33cd-462d-aa96-8a54747196f9 (760bfb57-33cd-462d-aa96-8a54747196f9): created successfully Jul 10 04:50:53 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-6271fa04-7c72-4905-a6fa-dbeb81c658a8 tempest-CinderUnicodeTest-2082279261 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (215e1f8a-7b5c-42b8-baba-e9daada11b6c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:50:53 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-6271fa04-7c72-4905-a6fa-dbeb81c658a8 tempest-CinderUnicodeTest-2082279261 None] Flow 'volume_create_manager' (fb8dc3cc-8042-4e56-9d81-0c6fdbedb1bd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87444) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 04:50:53 devstack cinder-volume[87444]: INFO cinder.volume.manager [None req-6271fa04-7c72-4905-a6fa-dbeb81c658a8 tempest-CinderUnicodeTest-2082279261 None] Created volume successfully. Jul 10 04:50:54 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-d5d21c75-df73-40b4-abc1-fe83d4e242bc tempest-CinderUnicodeTest-2082279261 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 04:50:54 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-d5d21c75-df73-40b4-abc1-fe83d4e242bc tempest-CinderUnicodeTest-2082279261 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 04:50:54 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.remotefs [None req-d5d21c75-df73-40b4-abc1-fe83d4e242bc tempest-CinderUnicodeTest-2082279261 None] Creating offline snapshot 3ea9c9e2-13ac-4b62-a36d-4b68ee68d2db of volume 760bfb57-33cd-462d-aa96-8a54747196f9 {{(pid=87444) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 10 04:50:54 devstack cinder-volume[87444]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc414dc0-8b78-42c5-b652-71ca49b5606d]: (4, 'qcow2') {{(pid=88499) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 04:50:54 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-d5d21c75-df73-40b4-abc1-fe83d4e242bc tempest-CinderUnicodeTest-2082279261 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-760bfb57-33cd-462d-aa96-8a54747196f9 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:50:54 devstack sudo[104001]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-760bfb57-33cd-462d-aa96-8a54747196f9 Jul 10 04:50:54 devstack sudo[104001]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:50:54 devstack sudo[104001]: pam_unix(sudo:session): session closed for user root Jul 10 04:50:54 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-d5d21c75-df73-40b4-abc1-fe83d4e242bc tempest-CinderUnicodeTest-2082279261 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-760bfb57-33cd-462d-aa96-8a54747196f9" returned: 0 in 0.745s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:50:54 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-d5d21c75-df73-40b4-abc1-fe83d4e242bc tempest-CinderUnicodeTest-2082279261 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-760bfb57-33cd-462d-aa96-8a54747196f9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-760bfb57-33cd-462d-aa96-8a54747196f9.3ea9c9e2-13ac-4b62-a36d-4b68ee68d2db 1G {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:50:54 devstack sudo[104006]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-760bfb57-33cd-462d-aa96-8a54747196f9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-760bfb57-33cd-462d-aa96-8a54747196f9.3ea9c9e2-13ac-4b62-a36d-4b68ee68d2db 1G Jul 10 04:50:54 devstack sudo[104006]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:50:55 devstack sudo[104006]: pam_unix(sudo:session): session closed for user root Jul 10 04:50:55 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-d5d21c75-df73-40b4-abc1-fe83d4e242bc tempest-CinderUnicodeTest-2082279261 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-760bfb57-33cd-462d-aa96-8a54747196f9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-760bfb57-33cd-462d-aa96-8a54747196f9.3ea9c9e2-13ac-4b62-a36d-4b68ee68d2db 1G" returned: 0 in 0.796s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:50:55 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-d5d21c75-df73-40b4-abc1-fe83d4e242bc tempest-CinderUnicodeTest-2082279261 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-760bfb57-33cd-462d-aa96-8a54747196f9 -F qcow2 /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-760bfb57-33cd-462d-aa96-8a54747196f9.3ea9c9e2-13ac-4b62-a36d-4b68ee68d2db {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:50:55 devstack sudo[104011]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-760bfb57-33cd-462d-aa96-8a54747196f9 -F qcow2 /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-760bfb57-33cd-462d-aa96-8a54747196f9.3ea9c9e2-13ac-4b62-a36d-4b68ee68d2db Jul 10 04:50:55 devstack sudo[104011]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:50:56 devstack sudo[104011]: pam_unix(sudo:session): session closed for user root Jul 10 04:50:56 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-d5d21c75-df73-40b4-abc1-fe83d4e242bc tempest-CinderUnicodeTest-2082279261 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-760bfb57-33cd-462d-aa96-8a54747196f9 -F qcow2 /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-760bfb57-33cd-462d-aa96-8a54747196f9.3ea9c9e2-13ac-4b62-a36d-4b68ee68d2db" returned: 0 in 0.719s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:50:56 devstack cinder-volume[87444]: WARNING cinder.volume.drivers.remotefs [None req-d5d21c75-df73-40b4-abc1-fe83d4e242bc tempest-CinderUnicodeTest-2082279261 None] /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-760bfb57-33cd-462d-aa96-8a54747196f9.3ea9c9e2-13ac-4b62-a36d-4b68ee68d2db is being set with open permissions: ugo+rw Jul 10 04:50:56 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-d5d21c75-df73-40b4-abc1-fe83d4e242bc tempest-CinderUnicodeTest-2082279261 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-760bfb57-33cd-462d-aa96-8a54747196f9.3ea9c9e2-13ac-4b62-a36d-4b68ee68d2db {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:50:56 devstack sudo[104016]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-760bfb57-33cd-462d-aa96-8a54747196f9.3ea9c9e2-13ac-4b62-a36d-4b68ee68d2db Jul 10 04:50:56 devstack sudo[104016]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:50:57 devstack sudo[104016]: pam_unix(sudo:session): session closed for user root Jul 10 04:50:57 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-d5d21c75-df73-40b4-abc1-fe83d4e242bc tempest-CinderUnicodeTest-2082279261 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-760bfb57-33cd-462d-aa96-8a54747196f9.3ea9c9e2-13ac-4b62-a36d-4b68ee68d2db" returned: 0 in 0.663s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:50:57 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-d5d21c75-df73-40b4-abc1-fe83d4e242bc tempest-CinderUnicodeTest-2082279261 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-760bfb57-33cd-462d-aa96-8a54747196f9.info {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:50:57 devstack sudo[104020]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-760bfb57-33cd-462d-aa96-8a54747196f9.info Jul 10 04:50:57 devstack sudo[104020]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:50:57 devstack sudo[104020]: pam_unix(sudo:session): session closed for user root Jul 10 04:50:57 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-d5d21c75-df73-40b4-abc1-fe83d4e242bc tempest-CinderUnicodeTest-2082279261 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-760bfb57-33cd-462d-aa96-8a54747196f9.info" returned: 0 in 0.712s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:50:57 devstack cinder-volume[87444]: WARNING cinder.volume.drivers.remotefs [None req-d5d21c75-df73-40b4-abc1-fe83d4e242bc tempest-CinderUnicodeTest-2082279261 None] /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-760bfb57-33cd-462d-aa96-8a54747196f9.info is being set with open permissions: ugo+rw Jul 10 04:50:57 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-d5d21c75-df73-40b4-abc1-fe83d4e242bc tempest-CinderUnicodeTest-2082279261 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-760bfb57-33cd-462d-aa96-8a54747196f9.info {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:50:57 devstack sudo[104023]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-760bfb57-33cd-462d-aa96-8a54747196f9.info Jul 10 04:50:57 devstack sudo[104023]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:50:58 devstack sudo[104023]: pam_unix(sudo:session): session closed for user root Jul 10 04:50:58 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-d5d21c75-df73-40b4-abc1-fe83d4e242bc tempest-CinderUnicodeTest-2082279261 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-760bfb57-33cd-462d-aa96-8a54747196f9.info" returned: 0 in 0.660s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:50:58 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-d5d21c75-df73-40b4-abc1-fe83d4e242bc tempest-CinderUnicodeTest-2082279261 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.391s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 04:50:58 devstack cinder-volume[87444]: INFO cinder.volume.manager [None req-d5d21c75-df73-40b4-abc1-fe83d4e242bc tempest-CinderUnicodeTest-2082279261 None] Create snapshot completed successfully Jul 10 04:50:59 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-27e3823c-2046-403a-b720-7b7a366f68bc tempest-CinderUnicodeTest-2082279261 None] Acquiring lock "cinder-3ea9c9e2-13ac-4b62-a36d-4b68ee68d2db-delete_snapshot" by "delete_snapshot" {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 04:50:59 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-27e3823c-2046-403a-b720-7b7a366f68bc tempest-CinderUnicodeTest-2082279261 None] Lock "cinder-3ea9c9e2-13ac-4b62-a36d-4b68ee68d2db-delete_snapshot" acquired by "delete_snapshot" :: waited 0.020s {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 04:50:59 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-27e3823c-2046-403a-b720-7b7a366f68bc tempest-CinderUnicodeTest-2082279261 None] Acquiring lock "cinder-quobyte-760bfb57-33cd-462d-aa96-8a54747196f9" by "delete_snapshot" {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 04:50:59 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-27e3823c-2046-403a-b720-7b7a366f68bc tempest-CinderUnicodeTest-2082279261 None] Lock "cinder-quobyte-760bfb57-33cd-462d-aa96-8a54747196f9" acquired by "delete_snapshot" :: waited 0.013s {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 04:50:59 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-27e3823c-2046-403a-b720-7b7a366f68bc tempest-CinderUnicodeTest-2082279261 None] Acquiring lock "cinder-quobyte-3ea9c9e2-13ac-4b62-a36d-4b68ee68d2db" by "_delete_snapshot" {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 04:50:59 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-27e3823c-2046-403a-b720-7b7a366f68bc tempest-CinderUnicodeTest-2082279261 None] Lock "cinder-quobyte-3ea9c9e2-13ac-4b62-a36d-4b68ee68d2db" acquired by "_delete_snapshot" :: waited 0.022s {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 04:50:59 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.remotefs [None req-27e3823c-2046-403a-b720-7b7a366f68bc tempest-CinderUnicodeTest-2082279261 None] Deleting offline snapshot 3ea9c9e2-13ac-4b62-a36d-4b68ee68d2db of volume 760bfb57-33cd-462d-aa96-8a54747196f9 {{(pid=87444) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 10 04:50:59 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.remotefs [None req-27e3823c-2046-403a-b720-7b7a366f68bc tempest-CinderUnicodeTest-2082279261 None] snapshot_file for this snap is: volume-760bfb57-33cd-462d-aa96-8a54747196f9.3ea9c9e2-13ac-4b62-a36d-4b68ee68d2db {{(pid=87444) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 10 04:50:59 devstack cinder-volume[87444]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5caaf53-15d8-4663-8815-96f408d21567]: (4, 'qcow2') {{(pid=88499) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 04:50:59 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-27e3823c-2046-403a-b720-7b7a366f68bc tempest-CinderUnicodeTest-2082279261 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-760bfb57-33cd-462d-aa96-8a54747196f9.3ea9c9e2-13ac-4b62-a36d-4b68ee68d2db {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:50:59 devstack sudo[104093]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-760bfb57-33cd-462d-aa96-8a54747196f9.3ea9c9e2-13ac-4b62-a36d-4b68ee68d2db Jul 10 04:50:59 devstack sudo[104093]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:51:00 devstack sudo[104093]: pam_unix(sudo:session): session closed for user root Jul 10 04:51:00 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-27e3823c-2046-403a-b720-7b7a366f68bc tempest-CinderUnicodeTest-2082279261 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-760bfb57-33cd-462d-aa96-8a54747196f9.3ea9c9e2-13ac-4b62-a36d-4b68ee68d2db" returned: 0 in 0.746s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:51:00 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.remotefs [None req-27e3823c-2046-403a-b720-7b7a366f68bc tempest-CinderUnicodeTest-2082279261 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-760bfb57-33cd-462d-aa96-8a54747196f9(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87444) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 10 04:51:00 devstack cinder-volume[87444]: DEBUG oslo.privsep.daemon [-] privsep: reply[a59ee816-d582-40ee-93da-610bd9d50fad]: (4, 'qcow2') {{(pid=88499) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 04:51:00 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-27e3823c-2046-403a-b720-7b7a366f68bc tempest-CinderUnicodeTest-2082279261 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-760bfb57-33cd-462d-aa96-8a54747196f9 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:51:00 devstack sudo[104099]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-760bfb57-33cd-462d-aa96-8a54747196f9 Jul 10 04:51:00 devstack sudo[104099]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:51:01 devstack sudo[104099]: pam_unix(sudo:session): session closed for user root Jul 10 04:51:01 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-27e3823c-2046-403a-b720-7b7a366f68bc tempest-CinderUnicodeTest-2082279261 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-760bfb57-33cd-462d-aa96-8a54747196f9" returned: 0 in 1.040s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:51:01 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-27e3823c-2046-403a-b720-7b7a366f68bc tempest-CinderUnicodeTest-2082279261 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-760bfb57-33cd-462d-aa96-8a54747196f9.3ea9c9e2-13ac-4b62-a36d-4b68ee68d2db {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:51:01 devstack sudo[104150]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-760bfb57-33cd-462d-aa96-8a54747196f9.3ea9c9e2-13ac-4b62-a36d-4b68ee68d2db Jul 10 04:51:01 devstack sudo[104150]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:51:02 devstack sudo[104150]: pam_unix(sudo:session): session closed for user root Jul 10 04:51:02 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-27e3823c-2046-403a-b720-7b7a366f68bc tempest-CinderUnicodeTest-2082279261 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-760bfb57-33cd-462d-aa96-8a54747196f9.3ea9c9e2-13ac-4b62-a36d-4b68ee68d2db" returned: 0 in 0.754s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:51:02 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-27e3823c-2046-403a-b720-7b7a366f68bc tempest-CinderUnicodeTest-2082279261 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-760bfb57-33cd-462d-aa96-8a54747196f9.3ea9c9e2-13ac-4b62-a36d-4b68ee68d2db {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:51:02 devstack sudo[104162]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-760bfb57-33cd-462d-aa96-8a54747196f9.3ea9c9e2-13ac-4b62-a36d-4b68ee68d2db Jul 10 04:51:02 devstack sudo[104162]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:51:02 devstack sudo[104162]: pam_unix(sudo:session): session closed for user root Jul 10 04:51:02 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-27e3823c-2046-403a-b720-7b7a366f68bc tempest-CinderUnicodeTest-2082279261 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-760bfb57-33cd-462d-aa96-8a54747196f9.3ea9c9e2-13ac-4b62-a36d-4b68ee68d2db" returned: 0 in 0.686s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:51:02 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-27e3823c-2046-403a-b720-7b7a366f68bc tempest-CinderUnicodeTest-2082279261 None] Lock "cinder-quobyte-3ea9c9e2-13ac-4b62-a36d-4b68ee68d2db" released by "_delete_snapshot" :: held 3.334s {{(pid=87444) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 04:51:02 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-27e3823c-2046-403a-b720-7b7a366f68bc tempest-CinderUnicodeTest-2082279261 None] Lock "cinder-quobyte-760bfb57-33cd-462d-aa96-8a54747196f9" released by "delete_snapshot" :: held 3.365s {{(pid=87444) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 04:51:02 devstack cinder-volume[87444]: DEBUG cinder.quota [None req-27e3823c-2046-403a-b720-7b7a366f68bc tempest-CinderUnicodeTest-2082279261 None] Created reservations ['1b2db92d-f098-4f31-8f24-94906f20564e', '1b6711a9-1aa9-4bfa-b910-5a1458453b27', 'a9fc93e6-cb8f-4219-b946-40e9fc56d6ed', '776ad4a0-489e-46a6-9266-3ea5f9b4c2c9'] {{(pid=87444) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 04:51:02 devstack cinder-volume[87444]: INFO cinder.volume.manager [None req-27e3823c-2046-403a-b720-7b7a366f68bc tempest-CinderUnicodeTest-2082279261 None] Delete snapshot completed successfully. Jul 10 04:51:02 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-27e3823c-2046-403a-b720-7b7a366f68bc tempest-CinderUnicodeTest-2082279261 None] Lock "cinder-3ea9c9e2-13ac-4b62-a36d-4b68ee68d2db-delete_snapshot" released by "delete_snapshot" :: held 3.509s {{(pid=87444) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 04:51:03 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-aa5c0fce-12e0-4e01-9f98-a65af4dc8730 tempest-CinderUnicodeTest-2082279261 None] Acquiring lock "cinder-760bfb57-33cd-462d-aa96-8a54747196f9-delete_volume" by "delete_volume" {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 04:51:03 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-aa5c0fce-12e0-4e01-9f98-a65af4dc8730 tempest-CinderUnicodeTest-2082279261 None] Lock "cinder-760bfb57-33cd-462d-aa96-8a54747196f9-delete_volume" acquired by "delete_volume" :: waited 0.049s {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 04:51:03 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-aa5c0fce-12e0-4e01-9f98-a65af4dc8730 tempest-CinderUnicodeTest-2082279261 None] Acquiring lock "cinder-quobyte-760bfb57-33cd-462d-aa96-8a54747196f9" by "delete_volume" {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 04:51:03 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-aa5c0fce-12e0-4e01-9f98-a65af4dc8730 tempest-CinderUnicodeTest-2082279261 None] Lock "cinder-quobyte-760bfb57-33cd-462d-aa96-8a54747196f9" acquired by "delete_volume" :: waited 0.021s {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 04:51:03 devstack cinder-volume[87444]: DEBUG oslo.privsep.daemon [-] privsep: reply[099f6f96-cc5b-42d9-8446-c8adb15644d6]: (4, 'qcow2') {{(pid=88499) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 04:51:03 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-aa5c0fce-12e0-4e01-9f98-a65af4dc8730 tempest-CinderUnicodeTest-2082279261 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-760bfb57-33cd-462d-aa96-8a54747196f9 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:51:04 devstack sudo[104493]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-760bfb57-33cd-462d-aa96-8a54747196f9 Jul 10 04:51:04 devstack sudo[104493]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:51:04 devstack sudo[104493]: pam_unix(sudo:session): session closed for user root Jul 10 04:51:04 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-aa5c0fce-12e0-4e01-9f98-a65af4dc8730 tempest-CinderUnicodeTest-2082279261 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-760bfb57-33cd-462d-aa96-8a54747196f9" returned: 0 in 0.825s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:51:04 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-aa5c0fce-12e0-4e01-9f98-a65af4dc8730 tempest-CinderUnicodeTest-2082279261 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-760bfb57-33cd-462d-aa96-8a54747196f9 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:51:04 devstack sudo[104498]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-760bfb57-33cd-462d-aa96-8a54747196f9 Jul 10 04:51:04 devstack sudo[104498]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:51:05 devstack sudo[104498]: pam_unix(sudo:session): session closed for user root Jul 10 04:51:05 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-aa5c0fce-12e0-4e01-9f98-a65af4dc8730 tempest-CinderUnicodeTest-2082279261 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-760bfb57-33cd-462d-aa96-8a54747196f9" returned: 0 in 0.686s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:51:05 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-aa5c0fce-12e0-4e01-9f98-a65af4dc8730 tempest-CinderUnicodeTest-2082279261 None] Lock "cinder-quobyte-760bfb57-33cd-462d-aa96-8a54747196f9" released by "delete_volume" :: held 1.593s {{(pid=87444) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 04:51:05 devstack cinder-volume[87444]: DEBUG cinder.quota [None req-aa5c0fce-12e0-4e01-9f98-a65af4dc8730 tempest-CinderUnicodeTest-2082279261 None] Created reservations ['c0974ab8-552f-4f91-a319-8fb3f385dfaa', 'f79a814c-c095-419f-ae42-ff9934ae10ad', '4d2b283b-1ba7-404d-b549-46f081debf7e', 'dc7b5502-0f31-4cf3-9736-79158acb2ce7'] {{(pid=87444) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 04:51:05 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-aa5c0fce-12e0-4e01-9f98-a65af4dc8730 tempest-CinderUnicodeTest-2082279261 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 04:51:05 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-aa5c0fce-12e0-4e01-9f98-a65af4dc8730 tempest-CinderUnicodeTest-2082279261 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 04:51:05 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-aa5c0fce-12e0-4e01-9f98-a65af4dc8730 tempest-CinderUnicodeTest-2082279261 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922': None} {{(pid=87444) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 04:51:05 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-aa5c0fce-12e0-4e01-9f98-a65af4dc8730 tempest-CinderUnicodeTest-2082279261 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922'] {{(pid=87444) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 04:51:05 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-aa5c0fce-12e0-4e01-9f98-a65af4dc8730 tempest-CinderUnicodeTest-2082279261 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 04:51:05 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-aa5c0fce-12e0-4e01-9f98-a65af4dc8730 tempest-CinderUnicodeTest-2082279261 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:51:05 devstack sudo[104501]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097 Jul 10 04:51:05 devstack sudo[104501]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:51:06 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-e6c42f60-0ab3-474f-9805-529d1b3754cb tempest-CinderUnicodeTest-2082279261 None] Acquiring lock "cinder-a947b231-b671-4113-ac02-d3dce5fdd05e-delete_volume" by "delete_volume" {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 04:51:06 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-e6c42f60-0ab3-474f-9805-529d1b3754cb tempest-CinderUnicodeTest-2082279261 None] Lock "cinder-a947b231-b671-4113-ac02-d3dce5fdd05e-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 04:51:06 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-e6c42f60-0ab3-474f-9805-529d1b3754cb tempest-CinderUnicodeTest-2082279261 None] Acquiring lock "cinder-quobyte-a947b231-b671-4113-ac02-d3dce5fdd05e" by "delete_volume" {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 04:51:06 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-e6c42f60-0ab3-474f-9805-529d1b3754cb tempest-CinderUnicodeTest-2082279261 None] Lock "cinder-quobyte-a947b231-b671-4113-ac02-d3dce5fdd05e" acquired by "delete_volume" :: waited 0.026s {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 04:51:06 devstack cinder-volume[87444]: DEBUG oslo.privsep.daemon [-] privsep: reply[8866e771-c82f-47f4-ae50-a1cecd2a2868]: (4, 'qcow2') {{(pid=88499) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 04:51:06 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-e6c42f60-0ab3-474f-9805-529d1b3754cb tempest-CinderUnicodeTest-2082279261 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-a947b231-b671-4113-ac02-d3dce5fdd05e {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:51:06 devstack sudo[104501]: pam_unix(sudo:session): session closed for user root Jul 10 04:51:06 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-aa5c0fce-12e0-4e01-9f98-a65af4dc8730 tempest-CinderUnicodeTest-2082279261 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097" returned: 0 in 0.731s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:51:06 devstack cinder-volume[87444]: DEBUG cinder.manager [None req-aa5c0fce-12e0-4e01-9f98-a65af4dc8730 tempest-CinderUnicodeTest-2082279261 None] Notifying Schedulers of capabilities ... {{(pid=87444) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 04:51:06 devstack cinder-volume[87444]: INFO cinder.volume.manager [None req-aa5c0fce-12e0-4e01-9f98-a65af4dc8730 tempest-CinderUnicodeTest-2082279261 None] Deleted volume successfully. Jul 10 04:51:06 devstack sudo[104504]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-a947b231-b671-4113-ac02-d3dce5fdd05e Jul 10 04:51:06 devstack sudo[104504]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:51:06 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-aa5c0fce-12e0-4e01-9f98-a65af4dc8730 tempest-CinderUnicodeTest-2082279261 None] Lock "cinder-760bfb57-33cd-462d-aa96-8a54747196f9-delete_volume" released by "delete_volume" :: held 2.586s {{(pid=87444) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 04:51:07 devstack sudo[104504]: pam_unix(sudo:session): session closed for user root Jul 10 04:51:07 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-e6c42f60-0ab3-474f-9805-529d1b3754cb tempest-CinderUnicodeTest-2082279261 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-a947b231-b671-4113-ac02-d3dce5fdd05e" returned: 0 in 0.844s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:51:07 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-e6c42f60-0ab3-474f-9805-529d1b3754cb tempest-CinderUnicodeTest-2082279261 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-a947b231-b671-4113-ac02-d3dce5fdd05e {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:51:07 devstack sudo[104509]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-a947b231-b671-4113-ac02-d3dce5fdd05e Jul 10 04:51:07 devstack sudo[104509]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:51:07 devstack sudo[104509]: pam_unix(sudo:session): session closed for user root Jul 10 04:51:07 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-e6c42f60-0ab3-474f-9805-529d1b3754cb tempest-CinderUnicodeTest-2082279261 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-a947b231-b671-4113-ac02-d3dce5fdd05e" returned: 0 in 0.690s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:51:07 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-e6c42f60-0ab3-474f-9805-529d1b3754cb tempest-CinderUnicodeTest-2082279261 None] Lock "cinder-quobyte-a947b231-b671-4113-ac02-d3dce5fdd05e" released by "delete_volume" :: held 1.588s {{(pid=87444) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 04:51:07 devstack cinder-volume[87444]: DEBUG cinder.quota [None req-e6c42f60-0ab3-474f-9805-529d1b3754cb tempest-CinderUnicodeTest-2082279261 None] Created reservations ['eff0a313-e936-4363-94fb-2967e7c0b3ac', 'fcdfc216-7d83-4c03-b27e-ba2cc96dc277', '8b428d91-2d8b-4484-b3c8-11bb352a6baf', '487f0831-18ec-4b4a-887b-6594664e9952'] {{(pid=87444) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 04:51:07 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-e6c42f60-0ab3-474f-9805-529d1b3754cb tempest-CinderUnicodeTest-2082279261 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 04:51:07 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-e6c42f60-0ab3-474f-9805-529d1b3754cb tempest-CinderUnicodeTest-2082279261 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 04:51:07 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-e6c42f60-0ab3-474f-9805-529d1b3754cb tempest-CinderUnicodeTest-2082279261 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922': None} {{(pid=87444) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 04:51:07 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-e6c42f60-0ab3-474f-9805-529d1b3754cb tempest-CinderUnicodeTest-2082279261 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922'] {{(pid=87444) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 04:51:07 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-e6c42f60-0ab3-474f-9805-529d1b3754cb tempest-CinderUnicodeTest-2082279261 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 04:51:07 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-e6c42f60-0ab3-474f-9805-529d1b3754cb tempest-CinderUnicodeTest-2082279261 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:51:07 devstack sudo[104512]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097 Jul 10 04:51:07 devstack sudo[104512]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:51:08 devstack sudo[104512]: pam_unix(sudo:session): session closed for user root Jul 10 04:51:08 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-e6c42f60-0ab3-474f-9805-529d1b3754cb tempest-CinderUnicodeTest-2082279261 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097" returned: 0 in 0.653s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:51:08 devstack cinder-volume[87444]: DEBUG cinder.manager [None req-e6c42f60-0ab3-474f-9805-529d1b3754cb tempest-CinderUnicodeTest-2082279261 None] Notifying Schedulers of capabilities ... {{(pid=87444) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 04:51:08 devstack cinder-volume[87444]: INFO cinder.volume.manager [None req-e6c42f60-0ab3-474f-9805-529d1b3754cb tempest-CinderUnicodeTest-2082279261 None] Deleted volume successfully. Jul 10 04:51:08 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-e6c42f60-0ab3-474f-9805-529d1b3754cb tempest-CinderUnicodeTest-2082279261 None] Lock "cinder-a947b231-b671-4113-ac02-d3dce5fdd05e-delete_volume" released by "delete_volume" :: held 2.480s {{(pid=87444) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 04:51:17 devstack cinder-volume[87444]: DEBUG dbcounter [-] [87444] Writing DB stats cinder:SELECT=57,cinder:INSERT=22,cinder:UPDATE=80,cinder:DELETE=3 {{(pid=87444) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 10 04:51:18 devstack cinder-volume[87444]: DEBUG dbcounter [-] [87444] Writing DB stats cinder:SELECT=63,cinder:INSERT=17,cinder:UPDATE=70,cinder:DELETE=7 {{(pid=87444) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 10 04:51:30 devstack cinder-volume[87444]: INFO cinder.volume.manager [req-d70c1deb-5718-4064-825c-17718282e114 req-577fe7ec-a3d0-4283-9352-f02f207eef90 tempest-TestShelveInstance-1751178727 None] Terminate volume connection completed successfully. Jul 10 04:51:30 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [req-d70c1deb-5718-4064-825c-17718282e114 req-577fe7ec-a3d0-4283-9352-f02f207eef90 tempest-TestShelveInstance-1751178727 None] Deleting attachment 5fa02eeb-b771-4541-9264-4c9cf8ffc5e5. {{(pid=87444) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 10 04:51:31 devstack cinder-volume[87444]: DEBUG cinder.coordination [req-d70c1deb-5718-4064-825c-17718282e114 req-88709519-73e3-4e67-a03c-4bbcba029192 tempest-TestShelveInstance-1751178727 None] Acquiring lock "cinder-42c78259-797d-4508-807c-77c3d325d344-delete_volume" by "delete_volume" {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 04:51:31 devstack cinder-volume[87444]: DEBUG cinder.coordination [req-d70c1deb-5718-4064-825c-17718282e114 req-88709519-73e3-4e67-a03c-4bbcba029192 tempest-TestShelveInstance-1751178727 None] Lock "cinder-42c78259-797d-4508-807c-77c3d325d344-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 04:51:31 devstack cinder-volume[87444]: DEBUG cinder.coordination [req-d70c1deb-5718-4064-825c-17718282e114 req-88709519-73e3-4e67-a03c-4bbcba029192 tempest-TestShelveInstance-1751178727 None] Acquiring lock "cinder-quobyte-42c78259-797d-4508-807c-77c3d325d344" by "delete_volume" {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 04:51:31 devstack cinder-volume[87444]: DEBUG cinder.coordination [req-d70c1deb-5718-4064-825c-17718282e114 req-88709519-73e3-4e67-a03c-4bbcba029192 tempest-TestShelveInstance-1751178727 None] Lock "cinder-quobyte-42c78259-797d-4508-807c-77c3d325d344" acquired by "delete_volume" :: waited 0.016s {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 04:51:31 devstack cinder-volume[87444]: DEBUG oslo.privsep.daemon [-] privsep: reply[d90c6142-633b-49cc-a1ea-5c08ece82b75]: (4, 'raw') {{(pid=88499) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 04:51:31 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [req-d70c1deb-5718-4064-825c-17718282e114 req-88709519-73e3-4e67-a03c-4bbcba029192 tempest-TestShelveInstance-1751178727 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-42c78259-797d-4508-807c-77c3d325d344 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:51:31 devstack sudo[104581]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-42c78259-797d-4508-807c-77c3d325d344 Jul 10 04:51:31 devstack sudo[104581]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:51:32 devstack sudo[104581]: pam_unix(sudo:session): session closed for user root Jul 10 04:51:32 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [req-d70c1deb-5718-4064-825c-17718282e114 req-88709519-73e3-4e67-a03c-4bbcba029192 tempest-TestShelveInstance-1751178727 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-42c78259-797d-4508-807c-77c3d325d344" returned: 0 in 0.755s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:51:32 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [req-d70c1deb-5718-4064-825c-17718282e114 req-88709519-73e3-4e67-a03c-4bbcba029192 tempest-TestShelveInstance-1751178727 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-42c78259-797d-4508-807c-77c3d325d344 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:51:32 devstack sudo[104585]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-42c78259-797d-4508-807c-77c3d325d344 Jul 10 04:51:32 devstack sudo[104585]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:51:32 devstack sudo[104585]: pam_unix(sudo:session): session closed for user root Jul 10 04:51:32 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [req-d70c1deb-5718-4064-825c-17718282e114 req-88709519-73e3-4e67-a03c-4bbcba029192 tempest-TestShelveInstance-1751178727 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-42c78259-797d-4508-807c-77c3d325d344" returned: 1 in 0.767s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:51:32 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [req-d70c1deb-5718-4064-825c-17718282e114 req-88709519-73e3-4e67-a03c-4bbcba029192 tempest-TestShelveInstance-1751178727 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-42c78259-797d-4508-807c-77c3d325d344' failed. Not Retrying. {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 10 04:51:32 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [req-d70c1deb-5718-4064-825c-17718282e114 req-88709519-73e3-4e67-a03c-4bbcba029192 tempest-TestShelveInstance-1751178727 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-42c78259-797d-4508-807c-77c3d325d344 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:51:32 devstack sudo[104590]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-42c78259-797d-4508-807c-77c3d325d344 Jul 10 04:51:32 devstack sudo[104590]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:51:33 devstack cinder-volume[87444]: DEBUG oslo_service.periodic_task [None req-01f0ce3e-6850-4e14-881d-e40d3c4ad6e5 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87444) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 10 04:51:33 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-01f0ce3e-6850-4e14-881d-e40d3c4ad6e5 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 04:51:33 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-01f0ce3e-6850-4e14-881d-e40d3c4ad6e5 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 04:51:33 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-01f0ce3e-6850-4e14-881d-e40d3c4ad6e5 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922': None} {{(pid=87444) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 04:51:33 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-01f0ce3e-6850-4e14-881d-e40d3c4ad6e5 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922'] {{(pid=87444) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 04:51:33 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-01f0ce3e-6850-4e14-881d-e40d3c4ad6e5 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 04:51:33 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-01f0ce3e-6850-4e14-881d-e40d3c4ad6e5 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:51:33 devstack sudo[104592]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097 Jul 10 04:51:33 devstack sudo[104592]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:51:33 devstack sudo[104590]: pam_unix(sudo:session): session closed for user root Jul 10 04:51:33 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [req-d70c1deb-5718-4064-825c-17718282e114 req-88709519-73e3-4e67-a03c-4bbcba029192 tempest-TestShelveInstance-1751178727 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-42c78259-797d-4508-807c-77c3d325d344" returned: 0 in 0.661s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:51:33 devstack cinder-volume[87444]: DEBUG cinder.coordination [req-d70c1deb-5718-4064-825c-17718282e114 req-88709519-73e3-4e67-a03c-4bbcba029192 tempest-TestShelveInstance-1751178727 None] Lock "cinder-quobyte-42c78259-797d-4508-807c-77c3d325d344" released by "delete_volume" :: held 2.252s {{(pid=87444) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 04:51:33 devstack cinder-volume[87444]: DEBUG cinder.quota [req-d70c1deb-5718-4064-825c-17718282e114 req-88709519-73e3-4e67-a03c-4bbcba029192 tempest-TestShelveInstance-1751178727 None] Created reservations ['233888db-685a-44b1-bb86-8fa4e813be1f', '75958a49-601b-47a8-b1cd-911cfbc9a4f9', '63934b69-abe8-4d5c-888b-85fa7d61d242', 'a97b4886-f2fa-4251-93de-66ac5ece407b'] {{(pid=87444) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 04:51:33 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [req-d70c1deb-5718-4064-825c-17718282e114 req-88709519-73e3-4e67-a03c-4bbcba029192 tempest-TestShelveInstance-1751178727 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 04:51:33 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [req-d70c1deb-5718-4064-825c-17718282e114 req-88709519-73e3-4e67-a03c-4bbcba029192 tempest-TestShelveInstance-1751178727 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 04:51:33 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [req-d70c1deb-5718-4064-825c-17718282e114 req-88709519-73e3-4e67-a03c-4bbcba029192 tempest-TestShelveInstance-1751178727 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922': None} {{(pid=87444) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 04:51:33 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [req-d70c1deb-5718-4064-825c-17718282e114 req-88709519-73e3-4e67-a03c-4bbcba029192 tempest-TestShelveInstance-1751178727 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922'] {{(pid=87444) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 04:51:33 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [req-d70c1deb-5718-4064-825c-17718282e114 req-88709519-73e3-4e67-a03c-4bbcba029192 tempest-TestShelveInstance-1751178727 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 04:51:33 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [req-d70c1deb-5718-4064-825c-17718282e114 req-88709519-73e3-4e67-a03c-4bbcba029192 tempest-TestShelveInstance-1751178727 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:51:33 devstack sudo[104592]: pam_unix(sudo:session): session closed for user root Jul 10 04:51:33 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-01f0ce3e-6850-4e14-881d-e40d3c4ad6e5 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097" returned: 0 in 0.662s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:51:33 devstack cinder-volume[87444]: DEBUG cinder.manager [None req-01f0ce3e-6850-4e14-881d-e40d3c4ad6e5 None None] Notifying Schedulers of capabilities ... {{(pid=87444) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 04:51:33 devstack sudo[104597]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097 Jul 10 04:51:33 devstack cinder-volume[87444]: DEBUG oslo_service.periodic_task [None req-01f0ce3e-6850-4e14-881d-e40d3c4ad6e5 None None] Running periodic task VolumeManager._thread_info {{(pid=87444) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 10 04:51:33 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-01f0ce3e-6850-4e14-881d-e40d3c4ad6e5 None None] thread count: 28 {{(pid=87444) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 10 04:51:33 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-01f0ce3e-6850-4e14-881d-e40d3c4ad6e5 None None] thread info: [<_MainThread(MainThread, started 126839257915520)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87444) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 10 04:51:33 devstack sudo[104597]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:51:34 devstack sudo[104597]: pam_unix(sudo:session): session closed for user root Jul 10 04:51:34 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [req-d70c1deb-5718-4064-825c-17718282e114 req-88709519-73e3-4e67-a03c-4bbcba029192 tempest-TestShelveInstance-1751178727 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097" returned: 0 in 0.693s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:51:34 devstack cinder-volume[87444]: DEBUG cinder.manager [req-d70c1deb-5718-4064-825c-17718282e114 req-88709519-73e3-4e67-a03c-4bbcba029192 tempest-TestShelveInstance-1751178727 None] Notifying Schedulers of capabilities ... {{(pid=87444) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 04:51:34 devstack cinder-volume[87444]: INFO cinder.volume.manager [req-d70c1deb-5718-4064-825c-17718282e114 req-88709519-73e3-4e67-a03c-4bbcba029192 tempest-TestShelveInstance-1751178727 None] Deleted volume successfully. Jul 10 04:51:34 devstack cinder-volume[87444]: DEBUG cinder.coordination [req-d70c1deb-5718-4064-825c-17718282e114 req-88709519-73e3-4e67-a03c-4bbcba029192 tempest-TestShelveInstance-1751178727 None] Lock "cinder-42c78259-797d-4508-807c-77c3d325d344-delete_volume" released by "delete_volume" :: held 3.150s {{(pid=87444) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 04:51:43 devstack cinder-volume[87444]: DEBUG dbcounter [-] [87444] Writing DB stats cinder:UPDATE=10,cinder:SELECT=8,cinder:INSERT=1 {{(pid=87444) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 10 04:51:44 devstack cinder-volume[87444]: DEBUG dbcounter [-] [87444] Writing DB stats cinder:SELECT=5,cinder:UPDATE=7,cinder:INSERT=3,cinder:DELETE=1 {{(pid=87444) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 10 04:51:44 devstack cinder-volume[87444]: DEBUG cinder.volume.flows.manager.create_volume [None req-4c7773bb-05c1-49a2-affa-1391c8994f80 tempest-CreateVolumesFromSnapshotTest-29601553 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87444) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 04:51:44 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-4c7773bb-05c1-49a2-affa-1391c8994f80 tempest-CreateVolumesFromSnapshotTest-29601553 None] Flow 'volume_create_manager' (2d9c45da-676a-4a55-ad25-a1267d1fb132) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 04:51:44 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-4c7773bb-05c1-49a2-affa-1391c8994f80 tempest-CreateVolumesFromSnapshotTest-29601553 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b01ddcfc-ac02-4bc3-aab6-d1601e51f40e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:51:44 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-4c7773bb-05c1-49a2-affa-1391c8994f80 tempest-CreateVolumesFromSnapshotTest-29601553 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b01ddcfc-ac02-4bc3-aab6-d1601e51f40e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T02:51:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-163465396',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=04377320-4f68-4c05-a1a0-72e5780b5d4f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0e34648741d242d5ac7083ede3cc3e62',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T02:51:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T02:51:45Z,use_quota=True,user_id='a702863dcd374b2dafef51c49fd75c7b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(317e369e-1e06-434d-ae95-a335f0e6c903),volume_type_id=317e369e-1e06-434d-ae95-a335f0e6c903)' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:51:44 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-4c7773bb-05c1-49a2-affa-1391c8994f80 tempest-CreateVolumesFromSnapshotTest-29601553 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b8dde98e-93f8-441e-901b-0ffa2c5d92f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:51:44 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-4c7773bb-05c1-49a2-affa-1391c8994f80 tempest-CreateVolumesFromSnapshotTest-29601553 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b8dde98e-93f8-441e-901b-0ffa2c5d92f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:51:44 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-4c7773bb-05c1-49a2-affa-1391c8994f80 tempest-CreateVolumesFromSnapshotTest-29601553 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0076798e-2aac-431f-8202-99ca7676c4a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:51:44 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-4c7773bb-05c1-49a2-affa-1391c8994f80 tempest-CreateVolumesFromSnapshotTest-29601553 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0076798e-2aac-431f-8202-99ca7676c4a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '04377320-4f68-4c05-a1a0-72e5780b5d4f', 'volume_name': 'volume-04377320-4f68-4c05-a1a0-72e5780b5d4f', 'volume_size': 1}' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:51:44 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-4c7773bb-05c1-49a2-affa-1391c8994f80 tempest-CreateVolumesFromSnapshotTest-29601553 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1da15fbf-f427-4b52-b86a-c413354898fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:51:44 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-4c7773bb-05c1-49a2-affa-1391c8994f80 tempest-CreateVolumesFromSnapshotTest-29601553 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1da15fbf-f427-4b52-b86a-c413354898fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:51:44 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-4c7773bb-05c1-49a2-affa-1391c8994f80 tempest-CreateVolumesFromSnapshotTest-29601553 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8a6a60b0-3d39-411e-a169-04ddb841e004) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:51:44 devstack cinder-volume[87444]: INFO cinder.volume.flows.manager.create_volume [None req-4c7773bb-05c1-49a2-affa-1391c8994f80 tempest-CreateVolumesFromSnapshotTest-29601553 None] Volume 04377320-4f68-4c05-a1a0-72e5780b5d4f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-04377320-4f68-4c05-a1a0-72e5780b5d4f', 'volume_size': 1} Jul 10 04:51:44 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-4c7773bb-05c1-49a2-affa-1391c8994f80 tempest-CreateVolumesFromSnapshotTest-29601553 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 04:51:44 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-4c7773bb-05c1-49a2-affa-1391c8994f80 tempest-CreateVolumesFromSnapshotTest-29601553 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 04:51:44 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-4c7773bb-05c1-49a2-affa-1391c8994f80 tempest-CreateVolumesFromSnapshotTest-29601553 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T02:51:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-163465396',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=04377320-4f68-4c05-a1a0-72e5780b5d4f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0e34648741d242d5ac7083ede3cc3e62',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T02:51:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T02:51:45Z,use_quota=True,user_id='a702863dcd374b2dafef51c49fd75c7b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(317e369e-1e06-434d-ae95-a335f0e6c903),volume_type_id=317e369e-1e06-434d-ae95-a335f0e6c903)}" {{(pid=87444) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 04:51:44 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.remotefs [None req-4c7773bb-05c1-49a2-affa-1391c8994f80 tempest-CreateVolumesFromSnapshotTest-29601553 None] Creating volume 04377320-4f68-4c05-a1a0-72e5780b5d4f {{(pid=87444) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 04:51:44 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-4c7773bb-05c1-49a2-affa-1391c8994f80 tempest-CreateVolumesFromSnapshotTest-29601553 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 04:51:44 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-4c7773bb-05c1-49a2-affa-1391c8994f80 tempest-CreateVolumesFromSnapshotTest-29601553 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 04:51:44 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-4c7773bb-05c1-49a2-affa-1391c8994f80 tempest-CreateVolumesFromSnapshotTest-29601553 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922': None} {{(pid=87444) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 04:51:44 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-4c7773bb-05c1-49a2-affa-1391c8994f80 tempest-CreateVolumesFromSnapshotTest-29601553 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922'] {{(pid=87444) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 04:51:44 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-4c7773bb-05c1-49a2-affa-1391c8994f80 tempest-CreateVolumesFromSnapshotTest-29601553 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 04:51:44 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-4c7773bb-05c1-49a2-affa-1391c8994f80 tempest-CreateVolumesFromSnapshotTest-29601553 None] Selected osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922 as target Quobyte volume. {{(pid=87444) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 04:51:44 devstack cinder-volume[87444]: INFO cinder.volume.drivers.remotefs [None req-4c7773bb-05c1-49a2-affa-1391c8994f80 tempest-CreateVolumesFromSnapshotTest-29601553 None] casted to osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922 Jul 10 04:51:44 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-4c7773bb-05c1-49a2-affa-1391c8994f80 tempest-CreateVolumesFromSnapshotTest-29601553 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-04377320-4f68-4c05-a1a0-72e5780b5d4f 1073741824 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:51:44 devstack sudo[104644]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-04377320-4f68-4c05-a1a0-72e5780b5d4f 1073741824 Jul 10 04:51:44 devstack sudo[104644]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:51:45 devstack sudo[104644]: pam_unix(sudo:session): session closed for user root Jul 10 04:51:45 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-4c7773bb-05c1-49a2-affa-1391c8994f80 tempest-CreateVolumesFromSnapshotTest-29601553 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-04377320-4f68-4c05-a1a0-72e5780b5d4f 1073741824" returned: 0 in 0.806s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:51:45 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-4c7773bb-05c1-49a2-affa-1391c8994f80 tempest-CreateVolumesFromSnapshotTest-29601553 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-04377320-4f68-4c05-a1a0-72e5780b5d4f {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:51:45 devstack sudo[104649]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-04377320-4f68-4c05-a1a0-72e5780b5d4f Jul 10 04:51:45 devstack sudo[104649]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:51:46 devstack sudo[104649]: pam_unix(sudo:session): session closed for user root Jul 10 04:51:46 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-4c7773bb-05c1-49a2-affa-1391c8994f80 tempest-CreateVolumesFromSnapshotTest-29601553 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-04377320-4f68-4c05-a1a0-72e5780b5d4f" returned: 0 in 0.630s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:51:46 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-4c7773bb-05c1-49a2-affa-1391c8994f80 tempest-CreateVolumesFromSnapshotTest-29601553 None] <== create_volume: return (1485ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922'} {{(pid=87444) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 04:51:46 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-4c7773bb-05c1-49a2-affa-1391c8994f80 tempest-CreateVolumesFromSnapshotTest-29601553 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.487s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 04:51:46 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-4c7773bb-05c1-49a2-affa-1391c8994f80 tempest-CreateVolumesFromSnapshotTest-29601553 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8a6a60b0-3d39-411e-a169-04ddb841e004) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-04377320-4f68-4c05-a1a0-72e5780b5d4f', 'volume_size': 1}' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:51:46 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-4c7773bb-05c1-49a2-affa-1391c8994f80 tempest-CreateVolumesFromSnapshotTest-29601553 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c4fb46a9-6fc2-468c-953e-1d701f3d2c7b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:51:46 devstack cinder-volume[87444]: INFO cinder.volume.flows.manager.create_volume [None req-4c7773bb-05c1-49a2-affa-1391c8994f80 tempest-CreateVolumesFromSnapshotTest-29601553 None] Volume volume-04377320-4f68-4c05-a1a0-72e5780b5d4f (04377320-4f68-4c05-a1a0-72e5780b5d4f): created successfully Jul 10 04:51:46 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-4c7773bb-05c1-49a2-affa-1391c8994f80 tempest-CreateVolumesFromSnapshotTest-29601553 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c4fb46a9-6fc2-468c-953e-1d701f3d2c7b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:51:46 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-4c7773bb-05c1-49a2-affa-1391c8994f80 tempest-CreateVolumesFromSnapshotTest-29601553 None] Flow 'volume_create_manager' (2d9c45da-676a-4a55-ad25-a1267d1fb132) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87444) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 04:51:46 devstack cinder-volume[87444]: INFO cinder.volume.manager [None req-4c7773bb-05c1-49a2-affa-1391c8994f80 tempest-CreateVolumesFromSnapshotTest-29601553 None] Created volume successfully. Jul 10 04:51:46 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-dc035831-4c7b-489a-b1de-7dce6d58e7a2 tempest-CreateVolumesFromSnapshotTest-29601553 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 04:51:46 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-dc035831-4c7b-489a-b1de-7dce6d58e7a2 tempest-CreateVolumesFromSnapshotTest-29601553 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 04:51:46 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.remotefs [None req-dc035831-4c7b-489a-b1de-7dce6d58e7a2 tempest-CreateVolumesFromSnapshotTest-29601553 None] Creating offline snapshot 67079d4a-09f3-477a-9236-425228d95772 of volume 04377320-4f68-4c05-a1a0-72e5780b5d4f {{(pid=87444) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 10 04:51:46 devstack cinder-volume[87444]: DEBUG oslo.privsep.daemon [-] privsep: reply[005fb516-6e10-4f4c-b75b-743bb24e404e]: (4, 'qcow2') {{(pid=88499) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 04:51:46 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-dc035831-4c7b-489a-b1de-7dce6d58e7a2 tempest-CreateVolumesFromSnapshotTest-29601553 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-04377320-4f68-4c05-a1a0-72e5780b5d4f {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:51:46 devstack sudo[104658]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-04377320-4f68-4c05-a1a0-72e5780b5d4f Jul 10 04:51:46 devstack sudo[104658]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:51:47 devstack sudo[104658]: pam_unix(sudo:session): session closed for user root Jul 10 04:51:47 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-dc035831-4c7b-489a-b1de-7dce6d58e7a2 tempest-CreateVolumesFromSnapshotTest-29601553 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-04377320-4f68-4c05-a1a0-72e5780b5d4f" returned: 0 in 0.742s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:51:47 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-dc035831-4c7b-489a-b1de-7dce6d58e7a2 tempest-CreateVolumesFromSnapshotTest-29601553 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-04377320-4f68-4c05-a1a0-72e5780b5d4f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-04377320-4f68-4c05-a1a0-72e5780b5d4f.67079d4a-09f3-477a-9236-425228d95772 1G {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:51:47 devstack sudo[104663]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-04377320-4f68-4c05-a1a0-72e5780b5d4f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-04377320-4f68-4c05-a1a0-72e5780b5d4f.67079d4a-09f3-477a-9236-425228d95772 1G Jul 10 04:51:47 devstack sudo[104663]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:51:48 devstack sudo[104663]: pam_unix(sudo:session): session closed for user root Jul 10 04:51:48 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-dc035831-4c7b-489a-b1de-7dce6d58e7a2 tempest-CreateVolumesFromSnapshotTest-29601553 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-04377320-4f68-4c05-a1a0-72e5780b5d4f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-04377320-4f68-4c05-a1a0-72e5780b5d4f.67079d4a-09f3-477a-9236-425228d95772 1G" returned: 0 in 0.766s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:51:48 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-dc035831-4c7b-489a-b1de-7dce6d58e7a2 tempest-CreateVolumesFromSnapshotTest-29601553 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-04377320-4f68-4c05-a1a0-72e5780b5d4f -F qcow2 /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-04377320-4f68-4c05-a1a0-72e5780b5d4f.67079d4a-09f3-477a-9236-425228d95772 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:51:48 devstack sudo[104669]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-04377320-4f68-4c05-a1a0-72e5780b5d4f -F qcow2 /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-04377320-4f68-4c05-a1a0-72e5780b5d4f.67079d4a-09f3-477a-9236-425228d95772 Jul 10 04:51:48 devstack sudo[104669]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:51:49 devstack sudo[104669]: pam_unix(sudo:session): session closed for user root Jul 10 04:51:49 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-dc035831-4c7b-489a-b1de-7dce6d58e7a2 tempest-CreateVolumesFromSnapshotTest-29601553 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-04377320-4f68-4c05-a1a0-72e5780b5d4f -F qcow2 /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-04377320-4f68-4c05-a1a0-72e5780b5d4f.67079d4a-09f3-477a-9236-425228d95772" returned: 0 in 0.672s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:51:49 devstack cinder-volume[87444]: WARNING cinder.volume.drivers.remotefs [None req-dc035831-4c7b-489a-b1de-7dce6d58e7a2 tempest-CreateVolumesFromSnapshotTest-29601553 None] /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-04377320-4f68-4c05-a1a0-72e5780b5d4f.67079d4a-09f3-477a-9236-425228d95772 is being set with open permissions: ugo+rw Jul 10 04:51:49 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-dc035831-4c7b-489a-b1de-7dce6d58e7a2 tempest-CreateVolumesFromSnapshotTest-29601553 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-04377320-4f68-4c05-a1a0-72e5780b5d4f.67079d4a-09f3-477a-9236-425228d95772 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:51:49 devstack sudo[104674]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-04377320-4f68-4c05-a1a0-72e5780b5d4f.67079d4a-09f3-477a-9236-425228d95772 Jul 10 04:51:49 devstack sudo[104674]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:51:49 devstack sudo[104674]: pam_unix(sudo:session): session closed for user root Jul 10 04:51:49 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-dc035831-4c7b-489a-b1de-7dce6d58e7a2 tempest-CreateVolumesFromSnapshotTest-29601553 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-04377320-4f68-4c05-a1a0-72e5780b5d4f.67079d4a-09f3-477a-9236-425228d95772" returned: 0 in 0.650s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:51:49 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-dc035831-4c7b-489a-b1de-7dce6d58e7a2 tempest-CreateVolumesFromSnapshotTest-29601553 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-04377320-4f68-4c05-a1a0-72e5780b5d4f.info {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:51:49 devstack sudo[104677]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-04377320-4f68-4c05-a1a0-72e5780b5d4f.info Jul 10 04:51:49 devstack sudo[104677]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:51:50 devstack sudo[104677]: pam_unix(sudo:session): session closed for user root Jul 10 04:51:50 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-dc035831-4c7b-489a-b1de-7dce6d58e7a2 tempest-CreateVolumesFromSnapshotTest-29601553 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-04377320-4f68-4c05-a1a0-72e5780b5d4f.info" returned: 0 in 0.636s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:51:50 devstack cinder-volume[87444]: WARNING cinder.volume.drivers.remotefs [None req-dc035831-4c7b-489a-b1de-7dce6d58e7a2 tempest-CreateVolumesFromSnapshotTest-29601553 None] /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-04377320-4f68-4c05-a1a0-72e5780b5d4f.info is being set with open permissions: ugo+rw Jul 10 04:51:50 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-dc035831-4c7b-489a-b1de-7dce6d58e7a2 tempest-CreateVolumesFromSnapshotTest-29601553 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-04377320-4f68-4c05-a1a0-72e5780b5d4f.info {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:51:50 devstack sudo[104680]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-04377320-4f68-4c05-a1a0-72e5780b5d4f.info Jul 10 04:51:50 devstack sudo[104680]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:51:50 devstack sudo[104680]: pam_unix(sudo:session): session closed for user root Jul 10 04:51:50 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-dc035831-4c7b-489a-b1de-7dce6d58e7a2 tempest-CreateVolumesFromSnapshotTest-29601553 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-04377320-4f68-4c05-a1a0-72e5780b5d4f.info" returned: 0 in 0.629s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:51:51 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-dc035831-4c7b-489a-b1de-7dce6d58e7a2 tempest-CreateVolumesFromSnapshotTest-29601553 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.176s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 04:51:51 devstack cinder-volume[87444]: INFO cinder.volume.manager [None req-dc035831-4c7b-489a-b1de-7dce6d58e7a2 tempest-CreateVolumesFromSnapshotTest-29601553 None] Create snapshot completed successfully Jul 10 04:51:52 devstack cinder-volume[87444]: DEBUG cinder.volume.flows.manager.create_volume [None req-7e41ec82-ffe1-4a65-a2ce-f054b01efcd9 tempest-CreateVolumesFromSnapshotTest-29601553 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87444) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 04:51:52 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-7e41ec82-ffe1-4a65-a2ce-f054b01efcd9 tempest-CreateVolumesFromSnapshotTest-29601553 None] Flow 'volume_create_manager' (2c10567f-3ec3-409d-afc6-4c0a0eb1dc49) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 04:51:52 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-7e41ec82-ffe1-4a65-a2ce-f054b01efcd9 tempest-CreateVolumesFromSnapshotTest-29601553 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (03dc86ca-c2f5-44d3-8ab1-73c4d5cd984f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:51:52 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-7e41ec82-ffe1-4a65-a2ce-f054b01efcd9 tempest-CreateVolumesFromSnapshotTest-29601553 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (03dc86ca-c2f5-44d3-8ab1-73c4d5cd984f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T02:51:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1398878316',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4bfcc834-9e06-40c4-9150-b505ea4b2b40,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0e34648741d242d5ac7083ede3cc3e62',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T02:51:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T02:51:52Z,use_quota=True,user_id='a702863dcd374b2dafef51c49fd75c7b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(317e369e-1e06-434d-ae95-a335f0e6c903),volume_type_id=317e369e-1e06-434d-ae95-a335f0e6c903)' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:51:52 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-7e41ec82-ffe1-4a65-a2ce-f054b01efcd9 tempest-CreateVolumesFromSnapshotTest-29601553 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5cacfd97-7c00-4bc4-b48d-bcdf9bcb18e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:51:52 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-7e41ec82-ffe1-4a65-a2ce-f054b01efcd9 tempest-CreateVolumesFromSnapshotTest-29601553 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5cacfd97-7c00-4bc4-b48d-bcdf9bcb18e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:51:52 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-7e41ec82-ffe1-4a65-a2ce-f054b01efcd9 tempest-CreateVolumesFromSnapshotTest-29601553 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (141250a7-f40a-4d43-bc1d-f0d4329401ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:51:52 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-7e41ec82-ffe1-4a65-a2ce-f054b01efcd9 tempest-CreateVolumesFromSnapshotTest-29601553 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (141250a7-f40a-4d43-bc1d-f0d4329401ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4bfcc834-9e06-40c4-9150-b505ea4b2b40', 'volume_name': 'volume-4bfcc834-9e06-40c4-9150-b505ea4b2b40', 'volume_size': 1}' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:51:52 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-7e41ec82-ffe1-4a65-a2ce-f054b01efcd9 tempest-CreateVolumesFromSnapshotTest-29601553 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ed04ca30-0256-4549-a213-d1e9801e3891) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:51:52 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-7e41ec82-ffe1-4a65-a2ce-f054b01efcd9 tempest-CreateVolumesFromSnapshotTest-29601553 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ed04ca30-0256-4549-a213-d1e9801e3891) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:51:52 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-7e41ec82-ffe1-4a65-a2ce-f054b01efcd9 tempest-CreateVolumesFromSnapshotTest-29601553 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a3f4c49f-46ab-4125-b9fd-67ecf0d42b05) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:51:52 devstack cinder-volume[87444]: INFO cinder.volume.flows.manager.create_volume [None req-7e41ec82-ffe1-4a65-a2ce-f054b01efcd9 tempest-CreateVolumesFromSnapshotTest-29601553 None] Volume 4bfcc834-9e06-40c4-9150-b505ea4b2b40: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4bfcc834-9e06-40c4-9150-b505ea4b2b40', 'volume_size': 1} Jul 10 04:51:52 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-7e41ec82-ffe1-4a65-a2ce-f054b01efcd9 tempest-CreateVolumesFromSnapshotTest-29601553 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 04:51:52 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-7e41ec82-ffe1-4a65-a2ce-f054b01efcd9 tempest-CreateVolumesFromSnapshotTest-29601553 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 04:51:52 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-7e41ec82-ffe1-4a65-a2ce-f054b01efcd9 tempest-CreateVolumesFromSnapshotTest-29601553 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T02:51:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1398878316',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4bfcc834-9e06-40c4-9150-b505ea4b2b40,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0e34648741d242d5ac7083ede3cc3e62',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T02:51:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T02:51:52Z,use_quota=True,user_id='a702863dcd374b2dafef51c49fd75c7b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(317e369e-1e06-434d-ae95-a335f0e6c903),volume_type_id=317e369e-1e06-434d-ae95-a335f0e6c903)}" {{(pid=87444) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 04:51:52 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.remotefs [None req-7e41ec82-ffe1-4a65-a2ce-f054b01efcd9 tempest-CreateVolumesFromSnapshotTest-29601553 None] Creating volume 4bfcc834-9e06-40c4-9150-b505ea4b2b40 {{(pid=87444) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 04:51:52 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-7e41ec82-ffe1-4a65-a2ce-f054b01efcd9 tempest-CreateVolumesFromSnapshotTest-29601553 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 04:51:52 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-7e41ec82-ffe1-4a65-a2ce-f054b01efcd9 tempest-CreateVolumesFromSnapshotTest-29601553 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 04:51:52 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-7e41ec82-ffe1-4a65-a2ce-f054b01efcd9 tempest-CreateVolumesFromSnapshotTest-29601553 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922': None} {{(pid=87444) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 04:51:52 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-7e41ec82-ffe1-4a65-a2ce-f054b01efcd9 tempest-CreateVolumesFromSnapshotTest-29601553 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922'] {{(pid=87444) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 04:51:52 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-7e41ec82-ffe1-4a65-a2ce-f054b01efcd9 tempest-CreateVolumesFromSnapshotTest-29601553 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 04:51:52 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-7e41ec82-ffe1-4a65-a2ce-f054b01efcd9 tempest-CreateVolumesFromSnapshotTest-29601553 None] Selected osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922 as target Quobyte volume. {{(pid=87444) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 04:51:52 devstack cinder-volume[87444]: INFO cinder.volume.drivers.remotefs [None req-7e41ec82-ffe1-4a65-a2ce-f054b01efcd9 tempest-CreateVolumesFromSnapshotTest-29601553 None] casted to osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922 Jul 10 04:51:52 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-7e41ec82-ffe1-4a65-a2ce-f054b01efcd9 tempest-CreateVolumesFromSnapshotTest-29601553 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-4bfcc834-9e06-40c4-9150-b505ea4b2b40 1073741824 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:51:52 devstack sudo[104683]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-4bfcc834-9e06-40c4-9150-b505ea4b2b40 1073741824 Jul 10 04:51:52 devstack sudo[104683]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:51:52 devstack cinder-volume[87444]: DEBUG cinder.volume.flows.manager.create_volume [None req-1c157a8e-fade-4637-a3f0-104be49d69a7 tempest-CreateVolumesFromSnapshotTest-29601553 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87444) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 04:51:52 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-1c157a8e-fade-4637-a3f0-104be49d69a7 tempest-CreateVolumesFromSnapshotTest-29601553 None] Flow 'volume_create_manager' (c467d8eb-2fc4-44b2-9474-0b42cd009676) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 04:51:52 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-1c157a8e-fade-4637-a3f0-104be49d69a7 tempest-CreateVolumesFromSnapshotTest-29601553 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bc0374ca-64e1-486f-aaa3-e14ede15589a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:51:52 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-1c157a8e-fade-4637-a3f0-104be49d69a7 tempest-CreateVolumesFromSnapshotTest-29601553 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bc0374ca-64e1-486f-aaa3-e14ede15589a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T02:51:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1709117267',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=41f82cf8-8e87-4e59-ab02-7c55e1ee544a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0e34648741d242d5ac7083ede3cc3e62',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T02:51:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T02:51:53Z,use_quota=True,user_id='a702863dcd374b2dafef51c49fd75c7b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(317e369e-1e06-434d-ae95-a335f0e6c903),volume_type_id=317e369e-1e06-434d-ae95-a335f0e6c903)' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:51:52 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-1c157a8e-fade-4637-a3f0-104be49d69a7 tempest-CreateVolumesFromSnapshotTest-29601553 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c6d234fd-8265-43e4-8b3b-a6f67f756b45) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:51:52 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-1c157a8e-fade-4637-a3f0-104be49d69a7 tempest-CreateVolumesFromSnapshotTest-29601553 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c6d234fd-8265-43e4-8b3b-a6f67f756b45) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:51:52 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-1c157a8e-fade-4637-a3f0-104be49d69a7 tempest-CreateVolumesFromSnapshotTest-29601553 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cfe21466-4514-4415-80a0-46ee645628b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:51:52 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-1c157a8e-fade-4637-a3f0-104be49d69a7 tempest-CreateVolumesFromSnapshotTest-29601553 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cfe21466-4514-4415-80a0-46ee645628b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '41f82cf8-8e87-4e59-ab02-7c55e1ee544a', 'volume_name': 'volume-41f82cf8-8e87-4e59-ab02-7c55e1ee544a', 'volume_size': 1}' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:51:52 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-1c157a8e-fade-4637-a3f0-104be49d69a7 tempest-CreateVolumesFromSnapshotTest-29601553 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (335e50b3-7cb6-4013-ab28-17e74a31e07d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:51:52 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-1c157a8e-fade-4637-a3f0-104be49d69a7 tempest-CreateVolumesFromSnapshotTest-29601553 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (335e50b3-7cb6-4013-ab28-17e74a31e07d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:51:52 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-1c157a8e-fade-4637-a3f0-104be49d69a7 tempest-CreateVolumesFromSnapshotTest-29601553 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (609cdb0a-8134-4772-8a7c-b65d11b8e467) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:51:52 devstack cinder-volume[87444]: INFO cinder.volume.flows.manager.create_volume [None req-1c157a8e-fade-4637-a3f0-104be49d69a7 tempest-CreateVolumesFromSnapshotTest-29601553 None] Volume 41f82cf8-8e87-4e59-ab02-7c55e1ee544a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-41f82cf8-8e87-4e59-ab02-7c55e1ee544a', 'volume_size': 1} Jul 10 04:51:52 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-1c157a8e-fade-4637-a3f0-104be49d69a7 tempest-CreateVolumesFromSnapshotTest-29601553 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 04:51:53 devstack cinder-volume[87444]: DEBUG cinder.volume.flows.manager.create_volume [None req-f04875c2-ca2e-4db3-b5a9-38bffd1992ea tempest-CreateVolumesFromSnapshotTest-29601553 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87444) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 04:51:53 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-f04875c2-ca2e-4db3-b5a9-38bffd1992ea tempest-CreateVolumesFromSnapshotTest-29601553 None] Flow 'volume_create_manager' (88a291f2-be81-40e1-98f3-02c56345fe3a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 04:51:53 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-f04875c2-ca2e-4db3-b5a9-38bffd1992ea tempest-CreateVolumesFromSnapshotTest-29601553 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2e28803e-b0f5-4819-819e-d79392cb2a08) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:51:53 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-f04875c2-ca2e-4db3-b5a9-38bffd1992ea tempest-CreateVolumesFromSnapshotTest-29601553 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2e28803e-b0f5-4819-819e-d79392cb2a08) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T02:51:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1364337408',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c473cb76-8e12-4162-aa51-cb4b87ac2079,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0e34648741d242d5ac7083ede3cc3e62',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T02:51:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T02:51:53Z,use_quota=True,user_id='a702863dcd374b2dafef51c49fd75c7b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(317e369e-1e06-434d-ae95-a335f0e6c903),volume_type_id=317e369e-1e06-434d-ae95-a335f0e6c903)' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:51:53 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-f04875c2-ca2e-4db3-b5a9-38bffd1992ea tempest-CreateVolumesFromSnapshotTest-29601553 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (61d96a41-93fc-4969-ba9d-60e045f71fca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:51:53 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-f04875c2-ca2e-4db3-b5a9-38bffd1992ea tempest-CreateVolumesFromSnapshotTest-29601553 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (61d96a41-93fc-4969-ba9d-60e045f71fca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:51:53 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-f04875c2-ca2e-4db3-b5a9-38bffd1992ea tempest-CreateVolumesFromSnapshotTest-29601553 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (76f9e2c6-2df8-4a5c-b62a-86024c09d083) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:51:53 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-f04875c2-ca2e-4db3-b5a9-38bffd1992ea tempest-CreateVolumesFromSnapshotTest-29601553 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (76f9e2c6-2df8-4a5c-b62a-86024c09d083) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c473cb76-8e12-4162-aa51-cb4b87ac2079', 'volume_name': 'volume-c473cb76-8e12-4162-aa51-cb4b87ac2079', 'volume_size': 1}' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:51:53 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-f04875c2-ca2e-4db3-b5a9-38bffd1992ea tempest-CreateVolumesFromSnapshotTest-29601553 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (19f59653-1a40-4010-ab0c-29140f6c8312) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:51:53 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-f04875c2-ca2e-4db3-b5a9-38bffd1992ea tempest-CreateVolumesFromSnapshotTest-29601553 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (19f59653-1a40-4010-ab0c-29140f6c8312) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:51:53 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-f04875c2-ca2e-4db3-b5a9-38bffd1992ea tempest-CreateVolumesFromSnapshotTest-29601553 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (31c2021e-f005-4a3f-ac75-a30e8d985563) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:51:53 devstack cinder-volume[87444]: INFO cinder.volume.flows.manager.create_volume [None req-f04875c2-ca2e-4db3-b5a9-38bffd1992ea tempest-CreateVolumesFromSnapshotTest-29601553 None] Volume c473cb76-8e12-4162-aa51-cb4b87ac2079: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c473cb76-8e12-4162-aa51-cb4b87ac2079', 'volume_size': 1} Jul 10 04:51:53 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-f04875c2-ca2e-4db3-b5a9-38bffd1992ea tempest-CreateVolumesFromSnapshotTest-29601553 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 04:51:53 devstack sudo[104683]: pam_unix(sudo:session): session closed for user root Jul 10 04:51:53 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-7e41ec82-ffe1-4a65-a2ce-f054b01efcd9 tempest-CreateVolumesFromSnapshotTest-29601553 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-4bfcc834-9e06-40c4-9150-b505ea4b2b40 1073741824" returned: 0 in 0.900s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:51:53 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-7e41ec82-ffe1-4a65-a2ce-f054b01efcd9 tempest-CreateVolumesFromSnapshotTest-29601553 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-4bfcc834-9e06-40c4-9150-b505ea4b2b40 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:51:53 devstack cinder-volume[87444]: DEBUG cinder.volume.flows.manager.create_volume [None req-2d23bb10-dd5e-4111-8fa0-ccd0ace9aa9c tempest-CreateVolumesFromSnapshotTest-29601553 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87444) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 04:51:53 devstack sudo[104689]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-4bfcc834-9e06-40c4-9150-b505ea4b2b40 Jul 10 04:51:53 devstack sudo[104689]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:51:53 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-2d23bb10-dd5e-4111-8fa0-ccd0ace9aa9c tempest-CreateVolumesFromSnapshotTest-29601553 None] Flow 'volume_create_manager' (fc7224df-1c7c-4995-a474-c15439074b24) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 04:51:53 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-2d23bb10-dd5e-4111-8fa0-ccd0ace9aa9c tempest-CreateVolumesFromSnapshotTest-29601553 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (50b4d354-44dc-4ad6-8bfd-45b178a7667b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:51:53 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-2d23bb10-dd5e-4111-8fa0-ccd0ace9aa9c tempest-CreateVolumesFromSnapshotTest-29601553 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (50b4d354-44dc-4ad6-8bfd-45b178a7667b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T02:51:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1824681123',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9c1b693f-282c-472f-8a4b-9450766c4089,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0e34648741d242d5ac7083ede3cc3e62',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T02:51:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T02:51:53Z,use_quota=True,user_id='a702863dcd374b2dafef51c49fd75c7b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(317e369e-1e06-434d-ae95-a335f0e6c903),volume_type_id=317e369e-1e06-434d-ae95-a335f0e6c903)' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:51:53 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-2d23bb10-dd5e-4111-8fa0-ccd0ace9aa9c tempest-CreateVolumesFromSnapshotTest-29601553 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c676e28a-f5bf-4344-8896-452b7f3394b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:51:53 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-2d23bb10-dd5e-4111-8fa0-ccd0ace9aa9c tempest-CreateVolumesFromSnapshotTest-29601553 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c676e28a-f5bf-4344-8896-452b7f3394b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:51:53 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-2d23bb10-dd5e-4111-8fa0-ccd0ace9aa9c tempest-CreateVolumesFromSnapshotTest-29601553 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0f721d11-e92b-4563-a3d6-5649209db4fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:51:53 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-2d23bb10-dd5e-4111-8fa0-ccd0ace9aa9c tempest-CreateVolumesFromSnapshotTest-29601553 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0f721d11-e92b-4563-a3d6-5649209db4fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9c1b693f-282c-472f-8a4b-9450766c4089', 'volume_name': 'volume-9c1b693f-282c-472f-8a4b-9450766c4089', 'volume_size': 1}' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:51:53 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-2d23bb10-dd5e-4111-8fa0-ccd0ace9aa9c tempest-CreateVolumesFromSnapshotTest-29601553 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (856276ed-8a92-44cc-93cd-e9efb9b677c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:51:53 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-2d23bb10-dd5e-4111-8fa0-ccd0ace9aa9c tempest-CreateVolumesFromSnapshotTest-29601553 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (856276ed-8a92-44cc-93cd-e9efb9b677c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:51:53 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-2d23bb10-dd5e-4111-8fa0-ccd0ace9aa9c tempest-CreateVolumesFromSnapshotTest-29601553 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (10a551a6-94b1-4a27-b737-91db725e8b55) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:51:53 devstack cinder-volume[87444]: INFO cinder.volume.flows.manager.create_volume [None req-2d23bb10-dd5e-4111-8fa0-ccd0ace9aa9c tempest-CreateVolumesFromSnapshotTest-29601553 None] Volume 9c1b693f-282c-472f-8a4b-9450766c4089: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9c1b693f-282c-472f-8a4b-9450766c4089', 'volume_size': 1} Jul 10 04:51:53 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-2d23bb10-dd5e-4111-8fa0-ccd0ace9aa9c tempest-CreateVolumesFromSnapshotTest-29601553 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 04:51:53 devstack cinder-volume[87444]: DEBUG cinder.volume.flows.manager.create_volume [None req-4e6bc65c-0843-47f2-8db1-b07f3090cdce tempest-CreateVolumesFromSnapshotTest-29601553 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87444) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 04:51:53 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-4e6bc65c-0843-47f2-8db1-b07f3090cdce tempest-CreateVolumesFromSnapshotTest-29601553 None] Flow 'volume_create_manager' (d5591174-0551-4f5a-949a-3b79142fddc9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 04:51:53 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-4e6bc65c-0843-47f2-8db1-b07f3090cdce tempest-CreateVolumesFromSnapshotTest-29601553 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c110d2bc-c86f-423f-8054-3857e4a1a2d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:51:53 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-4e6bc65c-0843-47f2-8db1-b07f3090cdce tempest-CreateVolumesFromSnapshotTest-29601553 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c110d2bc-c86f-423f-8054-3857e4a1a2d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T02:51:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1313736765',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5e735d86-ae09-42c1-afc5-3a31ad0d219e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0e34648741d242d5ac7083ede3cc3e62',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T02:51:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T02:51:54Z,use_quota=True,user_id='a702863dcd374b2dafef51c49fd75c7b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(317e369e-1e06-434d-ae95-a335f0e6c903),volume_type_id=317e369e-1e06-434d-ae95-a335f0e6c903)' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:51:53 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-4e6bc65c-0843-47f2-8db1-b07f3090cdce tempest-CreateVolumesFromSnapshotTest-29601553 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (15de0951-bb1f-4b8a-a112-5ec909324600) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:51:53 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-4e6bc65c-0843-47f2-8db1-b07f3090cdce tempest-CreateVolumesFromSnapshotTest-29601553 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (15de0951-bb1f-4b8a-a112-5ec909324600) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:51:53 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-4e6bc65c-0843-47f2-8db1-b07f3090cdce tempest-CreateVolumesFromSnapshotTest-29601553 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (136741b4-b299-49b1-ba43-7ae26357cfba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:51:53 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-4e6bc65c-0843-47f2-8db1-b07f3090cdce tempest-CreateVolumesFromSnapshotTest-29601553 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (136741b4-b299-49b1-ba43-7ae26357cfba) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5e735d86-ae09-42c1-afc5-3a31ad0d219e', 'volume_name': 'volume-5e735d86-ae09-42c1-afc5-3a31ad0d219e', 'volume_size': 1}' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:51:53 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-4e6bc65c-0843-47f2-8db1-b07f3090cdce tempest-CreateVolumesFromSnapshotTest-29601553 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (638175f9-a8e4-4c48-8259-f2f0b935701e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:51:53 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-4e6bc65c-0843-47f2-8db1-b07f3090cdce tempest-CreateVolumesFromSnapshotTest-29601553 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (638175f9-a8e4-4c48-8259-f2f0b935701e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:51:53 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-4e6bc65c-0843-47f2-8db1-b07f3090cdce tempest-CreateVolumesFromSnapshotTest-29601553 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (66bcfb4a-ea0a-4986-bc69-128fc38adc13) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:51:53 devstack cinder-volume[87444]: INFO cinder.volume.flows.manager.create_volume [None req-4e6bc65c-0843-47f2-8db1-b07f3090cdce tempest-CreateVolumesFromSnapshotTest-29601553 None] Volume 5e735d86-ae09-42c1-afc5-3a31ad0d219e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5e735d86-ae09-42c1-afc5-3a31ad0d219e', 'volume_size': 1} Jul 10 04:51:53 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-4e6bc65c-0843-47f2-8db1-b07f3090cdce tempest-CreateVolumesFromSnapshotTest-29601553 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 04:51:54 devstack sudo[104689]: pam_unix(sudo:session): session closed for user root Jul 10 04:51:54 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-7e41ec82-ffe1-4a65-a2ce-f054b01efcd9 tempest-CreateVolumesFromSnapshotTest-29601553 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-4bfcc834-9e06-40c4-9150-b505ea4b2b40" returned: 0 in 0.663s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:51:54 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-7e41ec82-ffe1-4a65-a2ce-f054b01efcd9 tempest-CreateVolumesFromSnapshotTest-29601553 None] <== create_volume: return (1627ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922'} {{(pid=87444) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 04:51:54 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-7e41ec82-ffe1-4a65-a2ce-f054b01efcd9 tempest-CreateVolumesFromSnapshotTest-29601553 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.630s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 04:51:54 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-1c157a8e-fade-4637-a3f0-104be49d69a7 tempest-CreateVolumesFromSnapshotTest-29601553 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.285s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 04:51:54 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-1c157a8e-fade-4637-a3f0-104be49d69a7 tempest-CreateVolumesFromSnapshotTest-29601553 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T02:51:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1709117267',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=41f82cf8-8e87-4e59-ab02-7c55e1ee544a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0e34648741d242d5ac7083ede3cc3e62',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T02:51:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T02:51:53Z,use_quota=True,user_id='a702863dcd374b2dafef51c49fd75c7b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(317e369e-1e06-434d-ae95-a335f0e6c903),volume_type_id=317e369e-1e06-434d-ae95-a335f0e6c903)}" {{(pid=87444) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 04:51:54 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.remotefs [None req-1c157a8e-fade-4637-a3f0-104be49d69a7 tempest-CreateVolumesFromSnapshotTest-29601553 None] Creating volume 41f82cf8-8e87-4e59-ab02-7c55e1ee544a {{(pid=87444) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 04:51:54 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-1c157a8e-fade-4637-a3f0-104be49d69a7 tempest-CreateVolumesFromSnapshotTest-29601553 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 04:51:54 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-1c157a8e-fade-4637-a3f0-104be49d69a7 tempest-CreateVolumesFromSnapshotTest-29601553 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 04:51:54 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-1c157a8e-fade-4637-a3f0-104be49d69a7 tempest-CreateVolumesFromSnapshotTest-29601553 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922': None} {{(pid=87444) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 04:51:54 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-1c157a8e-fade-4637-a3f0-104be49d69a7 tempest-CreateVolumesFromSnapshotTest-29601553 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922'] {{(pid=87444) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 04:51:54 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-1c157a8e-fade-4637-a3f0-104be49d69a7 tempest-CreateVolumesFromSnapshotTest-29601553 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 04:51:54 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-1c157a8e-fade-4637-a3f0-104be49d69a7 tempest-CreateVolumesFromSnapshotTest-29601553 None] Selected osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922 as target Quobyte volume. {{(pid=87444) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 04:51:54 devstack cinder-volume[87444]: INFO cinder.volume.drivers.remotefs [None req-1c157a8e-fade-4637-a3f0-104be49d69a7 tempest-CreateVolumesFromSnapshotTest-29601553 None] casted to osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922 Jul 10 04:51:54 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-1c157a8e-fade-4637-a3f0-104be49d69a7 tempest-CreateVolumesFromSnapshotTest-29601553 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-41f82cf8-8e87-4e59-ab02-7c55e1ee544a 1073741824 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:51:54 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-7e41ec82-ffe1-4a65-a2ce-f054b01efcd9 tempest-CreateVolumesFromSnapshotTest-29601553 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a3f4c49f-46ab-4125-b9fd-67ecf0d42b05) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4bfcc834-9e06-40c4-9150-b505ea4b2b40', 'volume_size': 1}' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:51:54 devstack sudo[104692]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-41f82cf8-8e87-4e59-ab02-7c55e1ee544a 1073741824 Jul 10 04:51:54 devstack sudo[104692]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:51:54 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-7e41ec82-ffe1-4a65-a2ce-f054b01efcd9 tempest-CreateVolumesFromSnapshotTest-29601553 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0b87b4a1-a7d1-4b2d-abfe-44b149eaefab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:51:54 devstack cinder-volume[87444]: INFO cinder.volume.flows.manager.create_volume [None req-7e41ec82-ffe1-4a65-a2ce-f054b01efcd9 tempest-CreateVolumesFromSnapshotTest-29601553 None] Volume volume-4bfcc834-9e06-40c4-9150-b505ea4b2b40 (4bfcc834-9e06-40c4-9150-b505ea4b2b40): created successfully Jul 10 04:51:54 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-7e41ec82-ffe1-4a65-a2ce-f054b01efcd9 tempest-CreateVolumesFromSnapshotTest-29601553 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0b87b4a1-a7d1-4b2d-abfe-44b149eaefab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:51:54 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-7e41ec82-ffe1-4a65-a2ce-f054b01efcd9 tempest-CreateVolumesFromSnapshotTest-29601553 None] Flow 'volume_create_manager' (2c10567f-3ec3-409d-afc6-4c0a0eb1dc49) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87444) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 04:51:54 devstack cinder-volume[87444]: INFO cinder.volume.manager [None req-7e41ec82-ffe1-4a65-a2ce-f054b01efcd9 tempest-CreateVolumesFromSnapshotTest-29601553 None] Created volume successfully. Jul 10 04:51:54 devstack sudo[104692]: pam_unix(sudo:session): session closed for user root Jul 10 04:51:54 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-1c157a8e-fade-4637-a3f0-104be49d69a7 tempest-CreateVolumesFromSnapshotTest-29601553 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-41f82cf8-8e87-4e59-ab02-7c55e1ee544a 1073741824" returned: 0 in 0.802s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:51:55 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-1c157a8e-fade-4637-a3f0-104be49d69a7 tempest-CreateVolumesFromSnapshotTest-29601553 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-41f82cf8-8e87-4e59-ab02-7c55e1ee544a {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:51:55 devstack sudo[104698]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-41f82cf8-8e87-4e59-ab02-7c55e1ee544a Jul 10 04:51:55 devstack sudo[104698]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:51:55 devstack sudo[104698]: pam_unix(sudo:session): session closed for user root Jul 10 04:51:55 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-1c157a8e-fade-4637-a3f0-104be49d69a7 tempest-CreateVolumesFromSnapshotTest-29601553 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-41f82cf8-8e87-4e59-ab02-7c55e1ee544a" returned: 0 in 0.658s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:51:55 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-1c157a8e-fade-4637-a3f0-104be49d69a7 tempest-CreateVolumesFromSnapshotTest-29601553 None] <== create_volume: return (1497ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922'} {{(pid=87444) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 04:51:55 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-1c157a8e-fade-4637-a3f0-104be49d69a7 tempest-CreateVolumesFromSnapshotTest-29601553 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.500s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 04:51:55 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-f04875c2-ca2e-4db3-b5a9-38bffd1992ea tempest-CreateVolumesFromSnapshotTest-29601553 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.402s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 04:51:55 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-f04875c2-ca2e-4db3-b5a9-38bffd1992ea tempest-CreateVolumesFromSnapshotTest-29601553 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T02:51:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1364337408',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c473cb76-8e12-4162-aa51-cb4b87ac2079,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0e34648741d242d5ac7083ede3cc3e62',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T02:51:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T02:51:53Z,use_quota=True,user_id='a702863dcd374b2dafef51c49fd75c7b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(317e369e-1e06-434d-ae95-a335f0e6c903),volume_type_id=317e369e-1e06-434d-ae95-a335f0e6c903)}" {{(pid=87444) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 04:51:55 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.remotefs [None req-f04875c2-ca2e-4db3-b5a9-38bffd1992ea tempest-CreateVolumesFromSnapshotTest-29601553 None] Creating volume c473cb76-8e12-4162-aa51-cb4b87ac2079 {{(pid=87444) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 04:51:55 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-f04875c2-ca2e-4db3-b5a9-38bffd1992ea tempest-CreateVolumesFromSnapshotTest-29601553 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 04:51:55 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-f04875c2-ca2e-4db3-b5a9-38bffd1992ea tempest-CreateVolumesFromSnapshotTest-29601553 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 04:51:55 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-f04875c2-ca2e-4db3-b5a9-38bffd1992ea tempest-CreateVolumesFromSnapshotTest-29601553 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922': None} {{(pid=87444) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 04:51:55 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-f04875c2-ca2e-4db3-b5a9-38bffd1992ea tempest-CreateVolumesFromSnapshotTest-29601553 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922'] {{(pid=87444) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 04:51:55 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-f04875c2-ca2e-4db3-b5a9-38bffd1992ea tempest-CreateVolumesFromSnapshotTest-29601553 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 04:51:55 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-f04875c2-ca2e-4db3-b5a9-38bffd1992ea tempest-CreateVolumesFromSnapshotTest-29601553 None] Selected osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922 as target Quobyte volume. {{(pid=87444) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 04:51:55 devstack cinder-volume[87444]: INFO cinder.volume.drivers.remotefs [None req-f04875c2-ca2e-4db3-b5a9-38bffd1992ea tempest-CreateVolumesFromSnapshotTest-29601553 None] casted to osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922 Jul 10 04:51:55 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-f04875c2-ca2e-4db3-b5a9-38bffd1992ea tempest-CreateVolumesFromSnapshotTest-29601553 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-c473cb76-8e12-4162-aa51-cb4b87ac2079 1073741824 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:51:55 devstack sudo[104701]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-c473cb76-8e12-4162-aa51-cb4b87ac2079 1073741824 Jul 10 04:51:55 devstack sudo[104701]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:51:55 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-1c157a8e-fade-4637-a3f0-104be49d69a7 tempest-CreateVolumesFromSnapshotTest-29601553 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (609cdb0a-8134-4772-8a7c-b65d11b8e467) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-41f82cf8-8e87-4e59-ab02-7c55e1ee544a', 'volume_size': 1}' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:51:55 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-1c157a8e-fade-4637-a3f0-104be49d69a7 tempest-CreateVolumesFromSnapshotTest-29601553 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (929218d6-98ce-4bd0-bf52-da917c31dbd2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:51:55 devstack cinder-volume[87444]: INFO cinder.volume.flows.manager.create_volume [None req-1c157a8e-fade-4637-a3f0-104be49d69a7 tempest-CreateVolumesFromSnapshotTest-29601553 None] Volume volume-41f82cf8-8e87-4e59-ab02-7c55e1ee544a (41f82cf8-8e87-4e59-ab02-7c55e1ee544a): created successfully Jul 10 04:51:55 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-1c157a8e-fade-4637-a3f0-104be49d69a7 tempest-CreateVolumesFromSnapshotTest-29601553 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (929218d6-98ce-4bd0-bf52-da917c31dbd2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:51:55 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-1c157a8e-fade-4637-a3f0-104be49d69a7 tempest-CreateVolumesFromSnapshotTest-29601553 None] Flow 'volume_create_manager' (c467d8eb-2fc4-44b2-9474-0b42cd009676) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87444) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 04:51:55 devstack cinder-volume[87444]: INFO cinder.volume.manager [None req-1c157a8e-fade-4637-a3f0-104be49d69a7 tempest-CreateVolumesFromSnapshotTest-29601553 None] Created volume successfully. Jul 10 04:51:56 devstack sudo[104701]: pam_unix(sudo:session): session closed for user root Jul 10 04:51:56 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-f04875c2-ca2e-4db3-b5a9-38bffd1992ea tempest-CreateVolumesFromSnapshotTest-29601553 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-c473cb76-8e12-4162-aa51-cb4b87ac2079 1073741824" returned: 0 in 0.817s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:51:56 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-f04875c2-ca2e-4db3-b5a9-38bffd1992ea tempest-CreateVolumesFromSnapshotTest-29601553 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-c473cb76-8e12-4162-aa51-cb4b87ac2079 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:51:56 devstack sudo[104706]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-c473cb76-8e12-4162-aa51-cb4b87ac2079 Jul 10 04:51:56 devstack sudo[104706]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:51:57 devstack sudo[104706]: pam_unix(sudo:session): session closed for user root Jul 10 04:51:57 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-f04875c2-ca2e-4db3-b5a9-38bffd1992ea tempest-CreateVolumesFromSnapshotTest-29601553 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-c473cb76-8e12-4162-aa51-cb4b87ac2079" returned: 0 in 0.647s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:51:57 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-f04875c2-ca2e-4db3-b5a9-38bffd1992ea tempest-CreateVolumesFromSnapshotTest-29601553 None] <== create_volume: return (1502ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922'} {{(pid=87444) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 04:51:57 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-f04875c2-ca2e-4db3-b5a9-38bffd1992ea tempest-CreateVolumesFromSnapshotTest-29601553 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.504s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 04:51:57 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-2d23bb10-dd5e-4111-8fa0-ccd0ace9aa9c tempest-CreateVolumesFromSnapshotTest-29601553 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.564s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 04:51:57 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-2d23bb10-dd5e-4111-8fa0-ccd0ace9aa9c tempest-CreateVolumesFromSnapshotTest-29601553 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T02:51:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1824681123',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9c1b693f-282c-472f-8a4b-9450766c4089,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0e34648741d242d5ac7083ede3cc3e62',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T02:51:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T02:51:53Z,use_quota=True,user_id='a702863dcd374b2dafef51c49fd75c7b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(317e369e-1e06-434d-ae95-a335f0e6c903),volume_type_id=317e369e-1e06-434d-ae95-a335f0e6c903)}" {{(pid=87444) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 04:51:57 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.remotefs [None req-2d23bb10-dd5e-4111-8fa0-ccd0ace9aa9c tempest-CreateVolumesFromSnapshotTest-29601553 None] Creating volume 9c1b693f-282c-472f-8a4b-9450766c4089 {{(pid=87444) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 04:51:57 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-2d23bb10-dd5e-4111-8fa0-ccd0ace9aa9c tempest-CreateVolumesFromSnapshotTest-29601553 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 04:51:57 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-2d23bb10-dd5e-4111-8fa0-ccd0ace9aa9c tempest-CreateVolumesFromSnapshotTest-29601553 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 04:51:57 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-2d23bb10-dd5e-4111-8fa0-ccd0ace9aa9c tempest-CreateVolumesFromSnapshotTest-29601553 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922': None} {{(pid=87444) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 04:51:57 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-2d23bb10-dd5e-4111-8fa0-ccd0ace9aa9c tempest-CreateVolumesFromSnapshotTest-29601553 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922'] {{(pid=87444) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 04:51:57 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-2d23bb10-dd5e-4111-8fa0-ccd0ace9aa9c tempest-CreateVolumesFromSnapshotTest-29601553 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 04:51:57 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-2d23bb10-dd5e-4111-8fa0-ccd0ace9aa9c tempest-CreateVolumesFromSnapshotTest-29601553 None] Selected osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922 as target Quobyte volume. {{(pid=87444) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 04:51:57 devstack cinder-volume[87444]: INFO cinder.volume.drivers.remotefs [None req-2d23bb10-dd5e-4111-8fa0-ccd0ace9aa9c tempest-CreateVolumesFromSnapshotTest-29601553 None] casted to osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922 Jul 10 04:51:57 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-2d23bb10-dd5e-4111-8fa0-ccd0ace9aa9c tempest-CreateVolumesFromSnapshotTest-29601553 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-9c1b693f-282c-472f-8a4b-9450766c4089 1073741824 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:51:57 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-f04875c2-ca2e-4db3-b5a9-38bffd1992ea tempest-CreateVolumesFromSnapshotTest-29601553 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (31c2021e-f005-4a3f-ac75-a30e8d985563) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c473cb76-8e12-4162-aa51-cb4b87ac2079', 'volume_size': 1}' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:51:57 devstack sudo[104709]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-9c1b693f-282c-472f-8a4b-9450766c4089 1073741824 Jul 10 04:51:57 devstack sudo[104709]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:51:57 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-f04875c2-ca2e-4db3-b5a9-38bffd1992ea tempest-CreateVolumesFromSnapshotTest-29601553 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ac3b1b76-38af-47b2-9203-61953c32c870) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:51:57 devstack cinder-volume[87444]: INFO cinder.volume.flows.manager.create_volume [None req-f04875c2-ca2e-4db3-b5a9-38bffd1992ea tempest-CreateVolumesFromSnapshotTest-29601553 None] Volume volume-c473cb76-8e12-4162-aa51-cb4b87ac2079 (c473cb76-8e12-4162-aa51-cb4b87ac2079): created successfully Jul 10 04:51:57 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-f04875c2-ca2e-4db3-b5a9-38bffd1992ea tempest-CreateVolumesFromSnapshotTest-29601553 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ac3b1b76-38af-47b2-9203-61953c32c870) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:51:57 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-f04875c2-ca2e-4db3-b5a9-38bffd1992ea tempest-CreateVolumesFromSnapshotTest-29601553 None] Flow 'volume_create_manager' (88a291f2-be81-40e1-98f3-02c56345fe3a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87444) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 04:51:57 devstack cinder-volume[87444]: INFO cinder.volume.manager [None req-f04875c2-ca2e-4db3-b5a9-38bffd1992ea tempest-CreateVolumesFromSnapshotTest-29601553 None] Created volume successfully. Jul 10 04:51:57 devstack sudo[104709]: pam_unix(sudo:session): session closed for user root Jul 10 04:51:57 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-2d23bb10-dd5e-4111-8fa0-ccd0ace9aa9c tempest-CreateVolumesFromSnapshotTest-29601553 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-9c1b693f-282c-472f-8a4b-9450766c4089 1073741824" returned: 0 in 0.795s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:51:58 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-2d23bb10-dd5e-4111-8fa0-ccd0ace9aa9c tempest-CreateVolumesFromSnapshotTest-29601553 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-9c1b693f-282c-472f-8a4b-9450766c4089 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:51:58 devstack sudo[104714]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-9c1b693f-282c-472f-8a4b-9450766c4089 Jul 10 04:51:58 devstack sudo[104714]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:51:58 devstack sudo[104714]: pam_unix(sudo:session): session closed for user root Jul 10 04:51:58 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-2d23bb10-dd5e-4111-8fa0-ccd0ace9aa9c tempest-CreateVolumesFromSnapshotTest-29601553 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-9c1b693f-282c-472f-8a4b-9450766c4089" returned: 0 in 0.641s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:51:58 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-2d23bb10-dd5e-4111-8fa0-ccd0ace9aa9c tempest-CreateVolumesFromSnapshotTest-29601553 None] <== create_volume: return (1475ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922'} {{(pid=87444) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 04:51:58 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-2d23bb10-dd5e-4111-8fa0-ccd0ace9aa9c tempest-CreateVolumesFromSnapshotTest-29601553 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.478s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 04:51:58 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-4e6bc65c-0843-47f2-8db1-b07f3090cdce tempest-CreateVolumesFromSnapshotTest-29601553 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.720s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 04:51:58 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-4e6bc65c-0843-47f2-8db1-b07f3090cdce tempest-CreateVolumesFromSnapshotTest-29601553 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T02:51:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1313736765',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5e735d86-ae09-42c1-afc5-3a31ad0d219e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0e34648741d242d5ac7083ede3cc3e62',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T02:51:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T02:51:54Z,use_quota=True,user_id='a702863dcd374b2dafef51c49fd75c7b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(317e369e-1e06-434d-ae95-a335f0e6c903),volume_type_id=317e369e-1e06-434d-ae95-a335f0e6c903)}" {{(pid=87444) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 04:51:58 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.remotefs [None req-4e6bc65c-0843-47f2-8db1-b07f3090cdce tempest-CreateVolumesFromSnapshotTest-29601553 None] Creating volume 5e735d86-ae09-42c1-afc5-3a31ad0d219e {{(pid=87444) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 04:51:58 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-4e6bc65c-0843-47f2-8db1-b07f3090cdce tempest-CreateVolumesFromSnapshotTest-29601553 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 04:51:58 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-4e6bc65c-0843-47f2-8db1-b07f3090cdce tempest-CreateVolumesFromSnapshotTest-29601553 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 04:51:58 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-4e6bc65c-0843-47f2-8db1-b07f3090cdce tempest-CreateVolumesFromSnapshotTest-29601553 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922': None} {{(pid=87444) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 04:51:58 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-4e6bc65c-0843-47f2-8db1-b07f3090cdce tempest-CreateVolumesFromSnapshotTest-29601553 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922'] {{(pid=87444) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 04:51:58 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-4e6bc65c-0843-47f2-8db1-b07f3090cdce tempest-CreateVolumesFromSnapshotTest-29601553 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 04:51:58 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-4e6bc65c-0843-47f2-8db1-b07f3090cdce tempest-CreateVolumesFromSnapshotTest-29601553 None] Selected osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922 as target Quobyte volume. {{(pid=87444) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 04:51:58 devstack cinder-volume[87444]: INFO cinder.volume.drivers.remotefs [None req-4e6bc65c-0843-47f2-8db1-b07f3090cdce tempest-CreateVolumesFromSnapshotTest-29601553 None] casted to osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922 Jul 10 04:51:58 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-4e6bc65c-0843-47f2-8db1-b07f3090cdce tempest-CreateVolumesFromSnapshotTest-29601553 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-5e735d86-ae09-42c1-afc5-3a31ad0d219e 1073741824 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:51:58 devstack sudo[104717]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-5e735d86-ae09-42c1-afc5-3a31ad0d219e 1073741824 Jul 10 04:51:58 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-2d23bb10-dd5e-4111-8fa0-ccd0ace9aa9c tempest-CreateVolumesFromSnapshotTest-29601553 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (10a551a6-94b1-4a27-b737-91db725e8b55) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9c1b693f-282c-472f-8a4b-9450766c4089', 'volume_size': 1}' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:51:58 devstack sudo[104717]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:51:58 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-2d23bb10-dd5e-4111-8fa0-ccd0ace9aa9c tempest-CreateVolumesFromSnapshotTest-29601553 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a1aab368-87bc-438a-9b0d-8d01bfaf6c96) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:51:58 devstack cinder-volume[87444]: INFO cinder.volume.flows.manager.create_volume [None req-2d23bb10-dd5e-4111-8fa0-ccd0ace9aa9c tempest-CreateVolumesFromSnapshotTest-29601553 None] Volume volume-9c1b693f-282c-472f-8a4b-9450766c4089 (9c1b693f-282c-472f-8a4b-9450766c4089): created successfully Jul 10 04:51:58 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-2d23bb10-dd5e-4111-8fa0-ccd0ace9aa9c tempest-CreateVolumesFromSnapshotTest-29601553 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a1aab368-87bc-438a-9b0d-8d01bfaf6c96) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:51:58 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-2d23bb10-dd5e-4111-8fa0-ccd0ace9aa9c tempest-CreateVolumesFromSnapshotTest-29601553 None] Flow 'volume_create_manager' (fc7224df-1c7c-4995-a474-c15439074b24) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87444) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 04:51:58 devstack cinder-volume[87444]: INFO cinder.volume.manager [None req-2d23bb10-dd5e-4111-8fa0-ccd0ace9aa9c tempest-CreateVolumesFromSnapshotTest-29601553 None] Created volume successfully. Jul 10 04:51:59 devstack sudo[104717]: pam_unix(sudo:session): session closed for user root Jul 10 04:51:59 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-4e6bc65c-0843-47f2-8db1-b07f3090cdce tempest-CreateVolumesFromSnapshotTest-29601553 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-5e735d86-ae09-42c1-afc5-3a31ad0d219e 1073741824" returned: 0 in 0.825s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:51:59 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-4e6bc65c-0843-47f2-8db1-b07f3090cdce tempest-CreateVolumesFromSnapshotTest-29601553 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-5e735d86-ae09-42c1-afc5-3a31ad0d219e {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:51:59 devstack sudo[104722]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-5e735d86-ae09-42c1-afc5-3a31ad0d219e Jul 10 04:51:59 devstack sudo[104722]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:52:00 devstack sudo[104722]: pam_unix(sudo:session): session closed for user root Jul 10 04:52:00 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-4e6bc65c-0843-47f2-8db1-b07f3090cdce tempest-CreateVolumesFromSnapshotTest-29601553 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-5e735d86-ae09-42c1-afc5-3a31ad0d219e" returned: 0 in 0.637s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:52:00 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-4e6bc65c-0843-47f2-8db1-b07f3090cdce tempest-CreateVolumesFromSnapshotTest-29601553 None] <== create_volume: return (1500ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922'} {{(pid=87444) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 04:52:00 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-4e6bc65c-0843-47f2-8db1-b07f3090cdce tempest-CreateVolumesFromSnapshotTest-29601553 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.503s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 04:52:00 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-4e6bc65c-0843-47f2-8db1-b07f3090cdce tempest-CreateVolumesFromSnapshotTest-29601553 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (66bcfb4a-ea0a-4986-bc69-128fc38adc13) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5e735d86-ae09-42c1-afc5-3a31ad0d219e', 'volume_size': 1}' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:52:00 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-4e6bc65c-0843-47f2-8db1-b07f3090cdce tempest-CreateVolumesFromSnapshotTest-29601553 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3d23b0c1-4774-4975-b328-be9a617d14f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:52:00 devstack cinder-volume[87444]: INFO cinder.volume.flows.manager.create_volume [None req-4e6bc65c-0843-47f2-8db1-b07f3090cdce tempest-CreateVolumesFromSnapshotTest-29601553 None] Volume volume-5e735d86-ae09-42c1-afc5-3a31ad0d219e (5e735d86-ae09-42c1-afc5-3a31ad0d219e): created successfully Jul 10 04:52:00 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-4e6bc65c-0843-47f2-8db1-b07f3090cdce tempest-CreateVolumesFromSnapshotTest-29601553 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3d23b0c1-4774-4975-b328-be9a617d14f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:52:00 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-4e6bc65c-0843-47f2-8db1-b07f3090cdce tempest-CreateVolumesFromSnapshotTest-29601553 None] Flow 'volume_create_manager' (d5591174-0551-4f5a-949a-3b79142fddc9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87444) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 04:52:00 devstack cinder-volume[87444]: INFO cinder.volume.manager [None req-4e6bc65c-0843-47f2-8db1-b07f3090cdce tempest-CreateVolumesFromSnapshotTest-29601553 None] Created volume successfully. Jul 10 04:52:00 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-7fd928a1-9461-4170-8e10-560d8efc6061 tempest-CreateVolumesFromSnapshotTest-29601553 None] Acquiring lock "cinder-5e735d86-ae09-42c1-afc5-3a31ad0d219e-delete_volume" by "delete_volume" {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 04:52:00 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-7fd928a1-9461-4170-8e10-560d8efc6061 tempest-CreateVolumesFromSnapshotTest-29601553 None] Lock "cinder-5e735d86-ae09-42c1-afc5-3a31ad0d219e-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 04:52:00 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-7fd928a1-9461-4170-8e10-560d8efc6061 tempest-CreateVolumesFromSnapshotTest-29601553 None] Acquiring lock "cinder-quobyte-5e735d86-ae09-42c1-afc5-3a31ad0d219e" by "delete_volume" {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 04:52:00 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-7fd928a1-9461-4170-8e10-560d8efc6061 tempest-CreateVolumesFromSnapshotTest-29601553 None] Lock "cinder-quobyte-5e735d86-ae09-42c1-afc5-3a31ad0d219e" acquired by "delete_volume" :: waited 0.014s {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 04:52:00 devstack cinder-volume[87444]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c883482-e763-4f44-99b7-0ed0e6bfe989]: (4, 'qcow2') {{(pid=88499) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 04:52:00 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-7fd928a1-9461-4170-8e10-560d8efc6061 tempest-CreateVolumesFromSnapshotTest-29601553 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-5e735d86-ae09-42c1-afc5-3a31ad0d219e {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:52:00 devstack sudo[104726]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-5e735d86-ae09-42c1-afc5-3a31ad0d219e Jul 10 04:52:00 devstack sudo[104726]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:52:01 devstack sudo[104726]: pam_unix(sudo:session): session closed for user root Jul 10 04:52:01 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-7fd928a1-9461-4170-8e10-560d8efc6061 tempest-CreateVolumesFromSnapshotTest-29601553 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-5e735d86-ae09-42c1-afc5-3a31ad0d219e" returned: 0 in 0.752s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:52:01 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-7fd928a1-9461-4170-8e10-560d8efc6061 tempest-CreateVolumesFromSnapshotTest-29601553 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-5e735d86-ae09-42c1-afc5-3a31ad0d219e {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:52:01 devstack sudo[104731]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-5e735d86-ae09-42c1-afc5-3a31ad0d219e Jul 10 04:52:01 devstack sudo[104731]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:52:01 devstack sudo[104731]: pam_unix(sudo:session): session closed for user root Jul 10 04:52:01 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-7fd928a1-9461-4170-8e10-560d8efc6061 tempest-CreateVolumesFromSnapshotTest-29601553 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-5e735d86-ae09-42c1-afc5-3a31ad0d219e" returned: 0 in 0.651s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:52:01 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-7fd928a1-9461-4170-8e10-560d8efc6061 tempest-CreateVolumesFromSnapshotTest-29601553 None] Lock "cinder-quobyte-5e735d86-ae09-42c1-afc5-3a31ad0d219e" released by "delete_volume" :: held 1.442s {{(pid=87444) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 04:52:01 devstack cinder-volume[87444]: DEBUG cinder.quota [None req-7fd928a1-9461-4170-8e10-560d8efc6061 tempest-CreateVolumesFromSnapshotTest-29601553 None] Created reservations ['91288aeb-1d6b-4a52-b801-bc4dbe90f07b', '92d204ea-fbc0-49fa-bb20-170177121bee', '3c6bc409-d6e8-4a65-acdb-3f90608a6992', '731c10d2-e961-46ca-aae6-ae15ed8cee1f'] {{(pid=87444) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 04:52:02 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-7fd928a1-9461-4170-8e10-560d8efc6061 tempest-CreateVolumesFromSnapshotTest-29601553 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 04:52:02 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-7fd928a1-9461-4170-8e10-560d8efc6061 tempest-CreateVolumesFromSnapshotTest-29601553 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 04:52:02 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-7fd928a1-9461-4170-8e10-560d8efc6061 tempest-CreateVolumesFromSnapshotTest-29601553 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922': None} {{(pid=87444) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 04:52:02 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-7fd928a1-9461-4170-8e10-560d8efc6061 tempest-CreateVolumesFromSnapshotTest-29601553 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922'] {{(pid=87444) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 04:52:02 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-7fd928a1-9461-4170-8e10-560d8efc6061 tempest-CreateVolumesFromSnapshotTest-29601553 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 04:52:02 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-7fd928a1-9461-4170-8e10-560d8efc6061 tempest-CreateVolumesFromSnapshotTest-29601553 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:52:02 devstack sudo[104734]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097 Jul 10 04:52:02 devstack sudo[104734]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:52:02 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-4b16fda2-b1e4-48f2-9252-ab2d709e41f7 tempest-CreateVolumesFromSnapshotTest-29601553 None] Acquiring lock "cinder-9c1b693f-282c-472f-8a4b-9450766c4089-delete_volume" by "delete_volume" {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 04:52:02 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-4b16fda2-b1e4-48f2-9252-ab2d709e41f7 tempest-CreateVolumesFromSnapshotTest-29601553 None] Lock "cinder-9c1b693f-282c-472f-8a4b-9450766c4089-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 04:52:02 devstack sudo[104734]: pam_unix(sudo:session): session closed for user root Jul 10 04:52:02 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-4b16fda2-b1e4-48f2-9252-ab2d709e41f7 tempest-CreateVolumesFromSnapshotTest-29601553 None] Acquiring lock "cinder-quobyte-9c1b693f-282c-472f-8a4b-9450766c4089" by "delete_volume" {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 04:52:02 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-7fd928a1-9461-4170-8e10-560d8efc6061 tempest-CreateVolumesFromSnapshotTest-29601553 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097" returned: 0 in 0.670s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:52:02 devstack cinder-volume[87444]: DEBUG cinder.manager [None req-7fd928a1-9461-4170-8e10-560d8efc6061 tempest-CreateVolumesFromSnapshotTest-29601553 None] Notifying Schedulers of capabilities ... {{(pid=87444) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 04:52:02 devstack cinder-volume[87444]: INFO cinder.volume.manager [None req-7fd928a1-9461-4170-8e10-560d8efc6061 tempest-CreateVolumesFromSnapshotTest-29601553 None] Deleted volume successfully. Jul 10 04:52:02 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-4b16fda2-b1e4-48f2-9252-ab2d709e41f7 tempest-CreateVolumesFromSnapshotTest-29601553 None] Lock "cinder-quobyte-9c1b693f-282c-472f-8a4b-9450766c4089" acquired by "delete_volume" :: waited 0.023s {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 04:52:02 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-7fd928a1-9461-4170-8e10-560d8efc6061 tempest-CreateVolumesFromSnapshotTest-29601553 None] Lock "cinder-5e735d86-ae09-42c1-afc5-3a31ad0d219e-delete_volume" released by "delete_volume" :: held 2.314s {{(pid=87444) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 04:52:02 devstack cinder-volume[87444]: DEBUG oslo.privsep.daemon [-] privsep: reply[f42c0aef-5445-4c5d-9322-3cdd81436f3a]: (4, 'qcow2') {{(pid=88499) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 04:52:02 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-4b16fda2-b1e4-48f2-9252-ab2d709e41f7 tempest-CreateVolumesFromSnapshotTest-29601553 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-9c1b693f-282c-472f-8a4b-9450766c4089 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:52:02 devstack sudo[104739]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-9c1b693f-282c-472f-8a4b-9450766c4089 Jul 10 04:52:02 devstack sudo[104739]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:52:03 devstack sudo[104739]: pam_unix(sudo:session): session closed for user root Jul 10 04:52:03 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-4b16fda2-b1e4-48f2-9252-ab2d709e41f7 tempest-CreateVolumesFromSnapshotTest-29601553 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-9c1b693f-282c-472f-8a4b-9450766c4089" returned: 0 in 0.760s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:52:03 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-4b16fda2-b1e4-48f2-9252-ab2d709e41f7 tempest-CreateVolumesFromSnapshotTest-29601553 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-9c1b693f-282c-472f-8a4b-9450766c4089 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:52:03 devstack sudo[104745]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-9c1b693f-282c-472f-8a4b-9450766c4089 Jul 10 04:52:03 devstack sudo[104745]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:52:04 devstack sudo[104745]: pam_unix(sudo:session): session closed for user root Jul 10 04:52:04 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-4b16fda2-b1e4-48f2-9252-ab2d709e41f7 tempest-CreateVolumesFromSnapshotTest-29601553 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-9c1b693f-282c-472f-8a4b-9450766c4089" returned: 0 in 0.681s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:52:04 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-4b16fda2-b1e4-48f2-9252-ab2d709e41f7 tempest-CreateVolumesFromSnapshotTest-29601553 None] Lock "cinder-quobyte-9c1b693f-282c-472f-8a4b-9450766c4089" released by "delete_volume" :: held 1.485s {{(pid=87444) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 04:52:04 devstack cinder-volume[87444]: DEBUG cinder.quota [None req-4b16fda2-b1e4-48f2-9252-ab2d709e41f7 tempest-CreateVolumesFromSnapshotTest-29601553 None] Created reservations ['88463718-87e1-466b-9c32-b6724eba3445', 'f4638124-c7a1-4162-8adf-055c193cd100', '74de4ee4-b46a-4439-8584-62ae9cf3799e', '796305fd-e92f-4734-b00c-4011e8570fc0'] {{(pid=87444) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 04:52:04 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-4b16fda2-b1e4-48f2-9252-ab2d709e41f7 tempest-CreateVolumesFromSnapshotTest-29601553 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 04:52:04 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-4b16fda2-b1e4-48f2-9252-ab2d709e41f7 tempest-CreateVolumesFromSnapshotTest-29601553 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 04:52:04 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-4b16fda2-b1e4-48f2-9252-ab2d709e41f7 tempest-CreateVolumesFromSnapshotTest-29601553 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922': None} {{(pid=87444) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 04:52:04 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-4b16fda2-b1e4-48f2-9252-ab2d709e41f7 tempest-CreateVolumesFromSnapshotTest-29601553 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922'] {{(pid=87444) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 04:52:04 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-4b16fda2-b1e4-48f2-9252-ab2d709e41f7 tempest-CreateVolumesFromSnapshotTest-29601553 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 04:52:04 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-4b16fda2-b1e4-48f2-9252-ab2d709e41f7 tempest-CreateVolumesFromSnapshotTest-29601553 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:52:04 devstack sudo[104748]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097 Jul 10 04:52:04 devstack sudo[104748]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:52:04 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-9ff67e16-d29b-4f73-a6bc-df696d283d80 tempest-CreateVolumesFromSnapshotTest-29601553 None] Acquiring lock "cinder-c473cb76-8e12-4162-aa51-cb4b87ac2079-delete_volume" by "delete_volume" {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 04:52:04 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-9ff67e16-d29b-4f73-a6bc-df696d283d80 tempest-CreateVolumesFromSnapshotTest-29601553 None] Lock "cinder-c473cb76-8e12-4162-aa51-cb4b87ac2079-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 04:52:04 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-9ff67e16-d29b-4f73-a6bc-df696d283d80 tempest-CreateVolumesFromSnapshotTest-29601553 None] Acquiring lock "cinder-quobyte-c473cb76-8e12-4162-aa51-cb4b87ac2079" by "delete_volume" {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 04:52:04 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-9ff67e16-d29b-4f73-a6bc-df696d283d80 tempest-CreateVolumesFromSnapshotTest-29601553 None] Lock "cinder-quobyte-c473cb76-8e12-4162-aa51-cb4b87ac2079" acquired by "delete_volume" :: waited 0.016s {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 04:52:04 devstack sudo[104748]: pam_unix(sudo:session): session closed for user root Jul 10 04:52:04 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-4b16fda2-b1e4-48f2-9252-ab2d709e41f7 tempest-CreateVolumesFromSnapshotTest-29601553 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097" returned: 0 in 0.657s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:52:04 devstack cinder-volume[87444]: DEBUG cinder.manager [None req-4b16fda2-b1e4-48f2-9252-ab2d709e41f7 tempest-CreateVolumesFromSnapshotTest-29601553 None] Notifying Schedulers of capabilities ... {{(pid=87444) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 04:52:04 devstack cinder-volume[87444]: INFO cinder.volume.manager [None req-4b16fda2-b1e4-48f2-9252-ab2d709e41f7 tempest-CreateVolumesFromSnapshotTest-29601553 None] Deleted volume successfully. Jul 10 04:52:04 devstack cinder-volume[87444]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a3d7994-aae5-4cb1-a297-9877e7f0d8da]: (4, 'qcow2') {{(pid=88499) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 04:52:04 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-9ff67e16-d29b-4f73-a6bc-df696d283d80 tempest-CreateVolumesFromSnapshotTest-29601553 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-c473cb76-8e12-4162-aa51-cb4b87ac2079 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:52:05 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-4b16fda2-b1e4-48f2-9252-ab2d709e41f7 tempest-CreateVolumesFromSnapshotTest-29601553 None] Lock "cinder-9c1b693f-282c-472f-8a4b-9450766c4089-delete_volume" released by "delete_volume" :: held 2.355s {{(pid=87444) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 04:52:05 devstack sudo[104751]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-c473cb76-8e12-4162-aa51-cb4b87ac2079 Jul 10 04:52:05 devstack sudo[104751]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:52:05 devstack sudo[104751]: pam_unix(sudo:session): session closed for user root Jul 10 04:52:05 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-9ff67e16-d29b-4f73-a6bc-df696d283d80 tempest-CreateVolumesFromSnapshotTest-29601553 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-c473cb76-8e12-4162-aa51-cb4b87ac2079" returned: 0 in 0.751s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:52:05 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-9ff67e16-d29b-4f73-a6bc-df696d283d80 tempest-CreateVolumesFromSnapshotTest-29601553 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-c473cb76-8e12-4162-aa51-cb4b87ac2079 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:52:05 devstack sudo[104756]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-c473cb76-8e12-4162-aa51-cb4b87ac2079 Jul 10 04:52:05 devstack sudo[104756]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:52:06 devstack sudo[104756]: pam_unix(sudo:session): session closed for user root Jul 10 04:52:06 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-9ff67e16-d29b-4f73-a6bc-df696d283d80 tempest-CreateVolumesFromSnapshotTest-29601553 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-c473cb76-8e12-4162-aa51-cb4b87ac2079" returned: 0 in 0.679s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:52:06 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-9ff67e16-d29b-4f73-a6bc-df696d283d80 tempest-CreateVolumesFromSnapshotTest-29601553 None] Lock "cinder-quobyte-c473cb76-8e12-4162-aa51-cb4b87ac2079" released by "delete_volume" :: held 1.482s {{(pid=87444) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 04:52:06 devstack cinder-volume[87444]: DEBUG cinder.quota [None req-9ff67e16-d29b-4f73-a6bc-df696d283d80 tempest-CreateVolumesFromSnapshotTest-29601553 None] Created reservations ['5eb3f63e-246a-48a4-8708-0455593b15b8', '71fce129-912e-4625-ab8c-1b810898d8c5', 'b45ab986-4512-4dbd-acec-e93c34aa68e4', '36cbcdbc-746b-4fe9-bd02-f07be3d160bf'] {{(pid=87444) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 04:52:06 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-9ff67e16-d29b-4f73-a6bc-df696d283d80 tempest-CreateVolumesFromSnapshotTest-29601553 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 04:52:06 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-9ff67e16-d29b-4f73-a6bc-df696d283d80 tempest-CreateVolumesFromSnapshotTest-29601553 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 04:52:06 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-9ff67e16-d29b-4f73-a6bc-df696d283d80 tempest-CreateVolumesFromSnapshotTest-29601553 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922': None} {{(pid=87444) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 04:52:06 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-9ff67e16-d29b-4f73-a6bc-df696d283d80 tempest-CreateVolumesFromSnapshotTest-29601553 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922'] {{(pid=87444) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 04:52:06 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-9ff67e16-d29b-4f73-a6bc-df696d283d80 tempest-CreateVolumesFromSnapshotTest-29601553 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 04:52:06 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-9ff67e16-d29b-4f73-a6bc-df696d283d80 tempest-CreateVolumesFromSnapshotTest-29601553 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:52:06 devstack sudo[104759]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097 Jul 10 04:52:06 devstack sudo[104759]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:52:07 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-572dde88-ba80-4ef9-b936-1d0f56977725 tempest-CreateVolumesFromSnapshotTest-29601553 None] Acquiring lock "cinder-41f82cf8-8e87-4e59-ab02-7c55e1ee544a-delete_volume" by "delete_volume" {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 04:52:07 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-572dde88-ba80-4ef9-b936-1d0f56977725 tempest-CreateVolumesFromSnapshotTest-29601553 None] Lock "cinder-41f82cf8-8e87-4e59-ab02-7c55e1ee544a-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 04:52:07 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-572dde88-ba80-4ef9-b936-1d0f56977725 tempest-CreateVolumesFromSnapshotTest-29601553 None] Acquiring lock "cinder-quobyte-41f82cf8-8e87-4e59-ab02-7c55e1ee544a" by "delete_volume" {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 04:52:07 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-572dde88-ba80-4ef9-b936-1d0f56977725 tempest-CreateVolumesFromSnapshotTest-29601553 None] Lock "cinder-quobyte-41f82cf8-8e87-4e59-ab02-7c55e1ee544a" acquired by "delete_volume" :: waited 0.021s {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 04:52:07 devstack cinder-volume[87444]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1bc777a-1daf-42c0-b361-31c57dbbd9ad]: (4, 'qcow2') {{(pid=88499) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 04:52:07 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-572dde88-ba80-4ef9-b936-1d0f56977725 tempest-CreateVolumesFromSnapshotTest-29601553 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-41f82cf8-8e87-4e59-ab02-7c55e1ee544a {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:52:07 devstack sudo[104759]: pam_unix(sudo:session): session closed for user root Jul 10 04:52:07 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-9ff67e16-d29b-4f73-a6bc-df696d283d80 tempest-CreateVolumesFromSnapshotTest-29601553 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097" returned: 0 in 0.657s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:52:07 devstack cinder-volume[87444]: DEBUG cinder.manager [None req-9ff67e16-d29b-4f73-a6bc-df696d283d80 tempest-CreateVolumesFromSnapshotTest-29601553 None] Notifying Schedulers of capabilities ... {{(pid=87444) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 04:52:07 devstack cinder-volume[87444]: INFO cinder.volume.manager [None req-9ff67e16-d29b-4f73-a6bc-df696d283d80 tempest-CreateVolumesFromSnapshotTest-29601553 None] Deleted volume successfully. Jul 10 04:52:07 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-9ff67e16-d29b-4f73-a6bc-df696d283d80 tempest-CreateVolumesFromSnapshotTest-29601553 None] Lock "cinder-c473cb76-8e12-4162-aa51-cb4b87ac2079-delete_volume" released by "delete_volume" :: held 2.342s {{(pid=87444) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 04:52:07 devstack sudo[104762]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-41f82cf8-8e87-4e59-ab02-7c55e1ee544a Jul 10 04:52:07 devstack sudo[104762]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:52:07 devstack sudo[104762]: pam_unix(sudo:session): session closed for user root Jul 10 04:52:07 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-572dde88-ba80-4ef9-b936-1d0f56977725 tempest-CreateVolumesFromSnapshotTest-29601553 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-41f82cf8-8e87-4e59-ab02-7c55e1ee544a" returned: 0 in 0.753s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:52:07 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-572dde88-ba80-4ef9-b936-1d0f56977725 tempest-CreateVolumesFromSnapshotTest-29601553 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-41f82cf8-8e87-4e59-ab02-7c55e1ee544a {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:52:07 devstack sudo[104767]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-41f82cf8-8e87-4e59-ab02-7c55e1ee544a Jul 10 04:52:07 devstack sudo[104767]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:52:08 devstack sudo[104767]: pam_unix(sudo:session): session closed for user root Jul 10 04:52:08 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-572dde88-ba80-4ef9-b936-1d0f56977725 tempest-CreateVolumesFromSnapshotTest-29601553 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-41f82cf8-8e87-4e59-ab02-7c55e1ee544a" returned: 0 in 0.654s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:52:08 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-572dde88-ba80-4ef9-b936-1d0f56977725 tempest-CreateVolumesFromSnapshotTest-29601553 None] Lock "cinder-quobyte-41f82cf8-8e87-4e59-ab02-7c55e1ee544a" released by "delete_volume" :: held 1.453s {{(pid=87444) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 04:52:08 devstack cinder-volume[87444]: DEBUG cinder.quota [None req-572dde88-ba80-4ef9-b936-1d0f56977725 tempest-CreateVolumesFromSnapshotTest-29601553 None] Created reservations ['d60fb638-20b7-4b88-a3b3-f355f9b44268', '48d445b3-e1c5-4f92-b683-4e6abcdcde96', 'bf796ed7-daca-46cf-bc4b-aef392eca22c', '246150d3-46c7-406c-a8b7-f1d82ed264c1'] {{(pid=87444) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 04:52:08 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-572dde88-ba80-4ef9-b936-1d0f56977725 tempest-CreateVolumesFromSnapshotTest-29601553 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 04:52:08 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-572dde88-ba80-4ef9-b936-1d0f56977725 tempest-CreateVolumesFromSnapshotTest-29601553 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 04:52:08 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-572dde88-ba80-4ef9-b936-1d0f56977725 tempest-CreateVolumesFromSnapshotTest-29601553 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922': None} {{(pid=87444) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 04:52:08 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-572dde88-ba80-4ef9-b936-1d0f56977725 tempest-CreateVolumesFromSnapshotTest-29601553 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922'] {{(pid=87444) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 04:52:08 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-572dde88-ba80-4ef9-b936-1d0f56977725 tempest-CreateVolumesFromSnapshotTest-29601553 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 04:52:08 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-572dde88-ba80-4ef9-b936-1d0f56977725 tempest-CreateVolumesFromSnapshotTest-29601553 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:52:08 devstack sudo[104770]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097 Jul 10 04:52:08 devstack sudo[104770]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:52:09 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-536399a1-8071-47dd-b384-c8f7e0bc13ae tempest-CreateVolumesFromSnapshotTest-29601553 None] Acquiring lock "cinder-4bfcc834-9e06-40c4-9150-b505ea4b2b40-delete_volume" by "delete_volume" {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 04:52:09 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-536399a1-8071-47dd-b384-c8f7e0bc13ae tempest-CreateVolumesFromSnapshotTest-29601553 None] Lock "cinder-4bfcc834-9e06-40c4-9150-b505ea4b2b40-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 04:52:09 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-536399a1-8071-47dd-b384-c8f7e0bc13ae tempest-CreateVolumesFromSnapshotTest-29601553 None] Acquiring lock "cinder-quobyte-4bfcc834-9e06-40c4-9150-b505ea4b2b40" by "delete_volume" {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 04:52:09 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-536399a1-8071-47dd-b384-c8f7e0bc13ae tempest-CreateVolumesFromSnapshotTest-29601553 None] Lock "cinder-quobyte-4bfcc834-9e06-40c4-9150-b505ea4b2b40" acquired by "delete_volume" :: waited 0.016s {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 04:52:09 devstack sudo[104770]: pam_unix(sudo:session): session closed for user root Jul 10 04:52:09 devstack cinder-volume[87444]: DEBUG oslo.privsep.daemon [-] privsep: reply[bdae3458-35c5-4ee1-aa57-d62b3a947ccd]: (4, 'qcow2') {{(pid=88499) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 04:52:09 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-536399a1-8071-47dd-b384-c8f7e0bc13ae tempest-CreateVolumesFromSnapshotTest-29601553 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-4bfcc834-9e06-40c4-9150-b505ea4b2b40 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:52:09 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-572dde88-ba80-4ef9-b936-1d0f56977725 tempest-CreateVolumesFromSnapshotTest-29601553 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097" returned: 0 in 0.669s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:52:09 devstack cinder-volume[87444]: DEBUG cinder.manager [None req-572dde88-ba80-4ef9-b936-1d0f56977725 tempest-CreateVolumesFromSnapshotTest-29601553 None] Notifying Schedulers of capabilities ... {{(pid=87444) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 04:52:09 devstack cinder-volume[87444]: INFO cinder.volume.manager [None req-572dde88-ba80-4ef9-b936-1d0f56977725 tempest-CreateVolumesFromSnapshotTest-29601553 None] Deleted volume successfully. Jul 10 04:52:09 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-572dde88-ba80-4ef9-b936-1d0f56977725 tempest-CreateVolumesFromSnapshotTest-29601553 None] Lock "cinder-41f82cf8-8e87-4e59-ab02-7c55e1ee544a-delete_volume" released by "delete_volume" :: held 2.335s {{(pid=87444) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 04:52:09 devstack sudo[104773]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-4bfcc834-9e06-40c4-9150-b505ea4b2b40 Jul 10 04:52:09 devstack sudo[104773]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:52:10 devstack sudo[104773]: pam_unix(sudo:session): session closed for user root Jul 10 04:52:10 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-536399a1-8071-47dd-b384-c8f7e0bc13ae tempest-CreateVolumesFromSnapshotTest-29601553 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-4bfcc834-9e06-40c4-9150-b505ea4b2b40" returned: 0 in 0.748s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:52:10 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-536399a1-8071-47dd-b384-c8f7e0bc13ae tempest-CreateVolumesFromSnapshotTest-29601553 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-4bfcc834-9e06-40c4-9150-b505ea4b2b40 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:52:10 devstack sudo[104778]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-4bfcc834-9e06-40c4-9150-b505ea4b2b40 Jul 10 04:52:10 devstack sudo[104778]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:52:10 devstack sudo[104778]: pam_unix(sudo:session): session closed for user root Jul 10 04:52:10 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-536399a1-8071-47dd-b384-c8f7e0bc13ae tempest-CreateVolumesFromSnapshotTest-29601553 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-4bfcc834-9e06-40c4-9150-b505ea4b2b40" returned: 0 in 0.638s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:52:10 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-536399a1-8071-47dd-b384-c8f7e0bc13ae tempest-CreateVolumesFromSnapshotTest-29601553 None] Lock "cinder-quobyte-4bfcc834-9e06-40c4-9150-b505ea4b2b40" released by "delete_volume" :: held 1.424s {{(pid=87444) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 04:52:10 devstack cinder-volume[87444]: DEBUG cinder.quota [None req-536399a1-8071-47dd-b384-c8f7e0bc13ae tempest-CreateVolumesFromSnapshotTest-29601553 None] Created reservations ['7ae08a1c-958b-4c62-afca-c76b583b155b', '6294d7ff-45b3-499f-b2b1-1658fbd1b42a', 'd004ad53-a2eb-4f46-b1a2-a07fe0d5a87e', 'c269bd57-e9c3-448c-9673-8e2ffd0eeacf'] {{(pid=87444) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 04:52:10 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-536399a1-8071-47dd-b384-c8f7e0bc13ae tempest-CreateVolumesFromSnapshotTest-29601553 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 04:52:10 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-536399a1-8071-47dd-b384-c8f7e0bc13ae tempest-CreateVolumesFromSnapshotTest-29601553 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 04:52:10 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-536399a1-8071-47dd-b384-c8f7e0bc13ae tempest-CreateVolumesFromSnapshotTest-29601553 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922': None} {{(pid=87444) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 04:52:10 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-536399a1-8071-47dd-b384-c8f7e0bc13ae tempest-CreateVolumesFromSnapshotTest-29601553 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922'] {{(pid=87444) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 04:52:10 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-536399a1-8071-47dd-b384-c8f7e0bc13ae tempest-CreateVolumesFromSnapshotTest-29601553 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 04:52:10 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-536399a1-8071-47dd-b384-c8f7e0bc13ae tempest-CreateVolumesFromSnapshotTest-29601553 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:52:10 devstack sudo[104781]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097 Jul 10 04:52:10 devstack sudo[104781]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:52:11 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-e642efd0-ad2c-40ef-aa35-75c4276ed76a tempest-CreateVolumesFromSnapshotTest-29601553 None] Acquiring lock "cinder-67079d4a-09f3-477a-9236-425228d95772-delete_snapshot" by "delete_snapshot" {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 04:52:11 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-e642efd0-ad2c-40ef-aa35-75c4276ed76a tempest-CreateVolumesFromSnapshotTest-29601553 None] Lock "cinder-67079d4a-09f3-477a-9236-425228d95772-delete_snapshot" acquired by "delete_snapshot" :: waited 0.022s {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 04:52:11 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-e642efd0-ad2c-40ef-aa35-75c4276ed76a tempest-CreateVolumesFromSnapshotTest-29601553 None] Acquiring lock "cinder-quobyte-04377320-4f68-4c05-a1a0-72e5780b5d4f" by "delete_snapshot" {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 04:52:11 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-e642efd0-ad2c-40ef-aa35-75c4276ed76a tempest-CreateVolumesFromSnapshotTest-29601553 None] Lock "cinder-quobyte-04377320-4f68-4c05-a1a0-72e5780b5d4f" acquired by "delete_snapshot" :: waited 0.015s {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 04:52:11 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-e642efd0-ad2c-40ef-aa35-75c4276ed76a tempest-CreateVolumesFromSnapshotTest-29601553 None] Acquiring lock "cinder-quobyte-67079d4a-09f3-477a-9236-425228d95772" by "_delete_snapshot" {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 04:52:11 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-e642efd0-ad2c-40ef-aa35-75c4276ed76a tempest-CreateVolumesFromSnapshotTest-29601553 None] Lock "cinder-quobyte-67079d4a-09f3-477a-9236-425228d95772" acquired by "_delete_snapshot" :: waited 0.012s {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 04:52:11 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.remotefs [None req-e642efd0-ad2c-40ef-aa35-75c4276ed76a tempest-CreateVolumesFromSnapshotTest-29601553 None] Deleting offline snapshot 67079d4a-09f3-477a-9236-425228d95772 of volume 04377320-4f68-4c05-a1a0-72e5780b5d4f {{(pid=87444) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 10 04:52:11 devstack sudo[104781]: pam_unix(sudo:session): session closed for user root Jul 10 04:52:11 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.remotefs [None req-e642efd0-ad2c-40ef-aa35-75c4276ed76a tempest-CreateVolumesFromSnapshotTest-29601553 None] snapshot_file for this snap is: volume-04377320-4f68-4c05-a1a0-72e5780b5d4f.67079d4a-09f3-477a-9236-425228d95772 {{(pid=87444) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 10 04:52:11 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-536399a1-8071-47dd-b384-c8f7e0bc13ae tempest-CreateVolumesFromSnapshotTest-29601553 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097" returned: 0 in 0.686s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:52:11 devstack cinder-volume[87444]: DEBUG cinder.manager [None req-536399a1-8071-47dd-b384-c8f7e0bc13ae tempest-CreateVolumesFromSnapshotTest-29601553 None] Notifying Schedulers of capabilities ... {{(pid=87444) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 04:52:11 devstack cinder-volume[87444]: INFO cinder.volume.manager [None req-536399a1-8071-47dd-b384-c8f7e0bc13ae tempest-CreateVolumesFromSnapshotTest-29601553 None] Deleted volume successfully. Jul 10 04:52:11 devstack cinder-volume[87444]: DEBUG oslo.privsep.daemon [-] privsep: reply[995a1678-f9db-46ae-a21e-1f0307eebd4c]: (4, 'qcow2') {{(pid=88499) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 04:52:11 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-e642efd0-ad2c-40ef-aa35-75c4276ed76a tempest-CreateVolumesFromSnapshotTest-29601553 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-04377320-4f68-4c05-a1a0-72e5780b5d4f.67079d4a-09f3-477a-9236-425228d95772 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:52:11 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-536399a1-8071-47dd-b384-c8f7e0bc13ae tempest-CreateVolumesFromSnapshotTest-29601553 None] Lock "cinder-4bfcc834-9e06-40c4-9150-b505ea4b2b40-delete_volume" released by "delete_volume" :: held 2.309s {{(pid=87444) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 04:52:11 devstack sudo[104784]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-04377320-4f68-4c05-a1a0-72e5780b5d4f.67079d4a-09f3-477a-9236-425228d95772 Jul 10 04:52:11 devstack sudo[104784]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:52:12 devstack sudo[104784]: pam_unix(sudo:session): session closed for user root Jul 10 04:52:12 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-e642efd0-ad2c-40ef-aa35-75c4276ed76a tempest-CreateVolumesFromSnapshotTest-29601553 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-04377320-4f68-4c05-a1a0-72e5780b5d4f.67079d4a-09f3-477a-9236-425228d95772" returned: 0 in 0.750s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:52:12 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.remotefs [None req-e642efd0-ad2c-40ef-aa35-75c4276ed76a tempest-CreateVolumesFromSnapshotTest-29601553 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-04377320-4f68-4c05-a1a0-72e5780b5d4f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87444) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 10 04:52:12 devstack cinder-volume[87444]: DEBUG oslo.privsep.daemon [-] privsep: reply[41f32278-290c-431e-8809-284ac44db6a8]: (4, 'qcow2') {{(pid=88499) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 04:52:12 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-e642efd0-ad2c-40ef-aa35-75c4276ed76a tempest-CreateVolumesFromSnapshotTest-29601553 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-04377320-4f68-4c05-a1a0-72e5780b5d4f {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:52:12 devstack sudo[104789]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-04377320-4f68-4c05-a1a0-72e5780b5d4f Jul 10 04:52:12 devstack sudo[104789]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:52:13 devstack sudo[104789]: pam_unix(sudo:session): session closed for user root Jul 10 04:52:13 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-e642efd0-ad2c-40ef-aa35-75c4276ed76a tempest-CreateVolumesFromSnapshotTest-29601553 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-04377320-4f68-4c05-a1a0-72e5780b5d4f" returned: 0 in 0.750s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:52:13 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-e642efd0-ad2c-40ef-aa35-75c4276ed76a tempest-CreateVolumesFromSnapshotTest-29601553 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-04377320-4f68-4c05-a1a0-72e5780b5d4f.67079d4a-09f3-477a-9236-425228d95772 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:52:13 devstack sudo[104794]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-04377320-4f68-4c05-a1a0-72e5780b5d4f.67079d4a-09f3-477a-9236-425228d95772 Jul 10 04:52:13 devstack sudo[104794]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:52:13 devstack sudo[104794]: pam_unix(sudo:session): session closed for user root Jul 10 04:52:13 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-e642efd0-ad2c-40ef-aa35-75c4276ed76a tempest-CreateVolumesFromSnapshotTest-29601553 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-04377320-4f68-4c05-a1a0-72e5780b5d4f.67079d4a-09f3-477a-9236-425228d95772" returned: 0 in 0.726s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:52:13 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-e642efd0-ad2c-40ef-aa35-75c4276ed76a tempest-CreateVolumesFromSnapshotTest-29601553 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-04377320-4f68-4c05-a1a0-72e5780b5d4f.67079d4a-09f3-477a-9236-425228d95772 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:52:13 devstack sudo[104800]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-04377320-4f68-4c05-a1a0-72e5780b5d4f.67079d4a-09f3-477a-9236-425228d95772 Jul 10 04:52:13 devstack sudo[104800]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:52:14 devstack sudo[104800]: pam_unix(sudo:session): session closed for user root Jul 10 04:52:14 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-e642efd0-ad2c-40ef-aa35-75c4276ed76a tempest-CreateVolumesFromSnapshotTest-29601553 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-04377320-4f68-4c05-a1a0-72e5780b5d4f.67079d4a-09f3-477a-9236-425228d95772" returned: 0 in 0.649s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:52:14 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-e642efd0-ad2c-40ef-aa35-75c4276ed76a tempest-CreateVolumesFromSnapshotTest-29601553 None] Lock "cinder-quobyte-67079d4a-09f3-477a-9236-425228d95772" released by "_delete_snapshot" :: held 2.980s {{(pid=87444) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 04:52:14 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-e642efd0-ad2c-40ef-aa35-75c4276ed76a tempest-CreateVolumesFromSnapshotTest-29601553 None] Lock "cinder-quobyte-04377320-4f68-4c05-a1a0-72e5780b5d4f" released by "delete_snapshot" :: held 2.999s {{(pid=87444) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 04:52:14 devstack cinder-volume[87444]: DEBUG cinder.quota [None req-e642efd0-ad2c-40ef-aa35-75c4276ed76a tempest-CreateVolumesFromSnapshotTest-29601553 None] Created reservations ['806a17c5-a1f6-44a0-92c5-73e7d992c764', 'aab8bce8-dfa3-44ff-8f39-bfdf2bbfe41c', '45fc9db0-c074-4c73-9921-5e4e9cb10605', 'ea1e930a-f359-4fe7-afea-7842fdb1246d'] {{(pid=87444) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 04:52:14 devstack cinder-volume[87444]: INFO cinder.volume.manager [None req-e642efd0-ad2c-40ef-aa35-75c4276ed76a tempest-CreateVolumesFromSnapshotTest-29601553 None] Delete snapshot completed successfully. Jul 10 04:52:14 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-e642efd0-ad2c-40ef-aa35-75c4276ed76a tempest-CreateVolumesFromSnapshotTest-29601553 None] Lock "cinder-67079d4a-09f3-477a-9236-425228d95772-delete_snapshot" released by "delete_snapshot" :: held 3.139s {{(pid=87444) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 04:52:15 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-ad6ae405-aad1-4ded-acab-e3bfebf51fd4 tempest-CreateVolumesFromSnapshotTest-29601553 None] Acquiring lock "cinder-04377320-4f68-4c05-a1a0-72e5780b5d4f-delete_volume" by "delete_volume" {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 04:52:15 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-ad6ae405-aad1-4ded-acab-e3bfebf51fd4 tempest-CreateVolumesFromSnapshotTest-29601553 None] Lock "cinder-04377320-4f68-4c05-a1a0-72e5780b5d4f-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 04:52:15 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-ad6ae405-aad1-4ded-acab-e3bfebf51fd4 tempest-CreateVolumesFromSnapshotTest-29601553 None] Acquiring lock "cinder-quobyte-04377320-4f68-4c05-a1a0-72e5780b5d4f" by "delete_volume" {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 04:52:15 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-ad6ae405-aad1-4ded-acab-e3bfebf51fd4 tempest-CreateVolumesFromSnapshotTest-29601553 None] Lock "cinder-quobyte-04377320-4f68-4c05-a1a0-72e5780b5d4f" acquired by "delete_volume" :: waited 0.014s {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 04:52:15 devstack cinder-volume[87444]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5fb1b61-51df-4eef-b5fc-2e549febab8c]: (4, 'qcow2') {{(pid=88499) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 04:52:15 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-ad6ae405-aad1-4ded-acab-e3bfebf51fd4 tempest-CreateVolumesFromSnapshotTest-29601553 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-04377320-4f68-4c05-a1a0-72e5780b5d4f {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:52:15 devstack sudo[104803]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-04377320-4f68-4c05-a1a0-72e5780b5d4f Jul 10 04:52:15 devstack sudo[104803]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:52:16 devstack sudo[104803]: pam_unix(sudo:session): session closed for user root Jul 10 04:52:16 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-ad6ae405-aad1-4ded-acab-e3bfebf51fd4 tempest-CreateVolumesFromSnapshotTest-29601553 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-04377320-4f68-4c05-a1a0-72e5780b5d4f" returned: 0 in 0.758s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:52:16 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-ad6ae405-aad1-4ded-acab-e3bfebf51fd4 tempest-CreateVolumesFromSnapshotTest-29601553 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-04377320-4f68-4c05-a1a0-72e5780b5d4f {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:52:16 devstack sudo[104808]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-04377320-4f68-4c05-a1a0-72e5780b5d4f Jul 10 04:52:16 devstack sudo[104808]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:52:17 devstack sudo[104808]: pam_unix(sudo:session): session closed for user root Jul 10 04:52:17 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-ad6ae405-aad1-4ded-acab-e3bfebf51fd4 tempest-CreateVolumesFromSnapshotTest-29601553 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-04377320-4f68-4c05-a1a0-72e5780b5d4f" returned: 0 in 0.646s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:52:17 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-ad6ae405-aad1-4ded-acab-e3bfebf51fd4 tempest-CreateVolumesFromSnapshotTest-29601553 None] Lock "cinder-quobyte-04377320-4f68-4c05-a1a0-72e5780b5d4f" released by "delete_volume" :: held 1.462s {{(pid=87444) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 04:52:17 devstack cinder-volume[87444]: DEBUG cinder.quota [None req-ad6ae405-aad1-4ded-acab-e3bfebf51fd4 tempest-CreateVolumesFromSnapshotTest-29601553 None] Created reservations ['f12e4aad-76b3-4a75-9318-63fa79d2ac25', 'ec426850-d310-4fb4-ae1e-3d04ed571266', 'b1266ed1-c196-4ec7-b047-32047264d671', 'ba61d6eb-ae97-4f11-bb04-a7893b036f91'] {{(pid=87444) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 04:52:17 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-ad6ae405-aad1-4ded-acab-e3bfebf51fd4 tempest-CreateVolumesFromSnapshotTest-29601553 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 04:52:17 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-ad6ae405-aad1-4ded-acab-e3bfebf51fd4 tempest-CreateVolumesFromSnapshotTest-29601553 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 04:52:17 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-ad6ae405-aad1-4ded-acab-e3bfebf51fd4 tempest-CreateVolumesFromSnapshotTest-29601553 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922': None} {{(pid=87444) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 04:52:17 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-ad6ae405-aad1-4ded-acab-e3bfebf51fd4 tempest-CreateVolumesFromSnapshotTest-29601553 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922'] {{(pid=87444) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 04:52:17 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-ad6ae405-aad1-4ded-acab-e3bfebf51fd4 tempest-CreateVolumesFromSnapshotTest-29601553 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 04:52:17 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-ad6ae405-aad1-4ded-acab-e3bfebf51fd4 tempest-CreateVolumesFromSnapshotTest-29601553 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:52:17 devstack sudo[104811]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097 Jul 10 04:52:17 devstack sudo[104811]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:52:17 devstack sudo[104811]: pam_unix(sudo:session): session closed for user root Jul 10 04:52:17 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-ad6ae405-aad1-4ded-acab-e3bfebf51fd4 tempest-CreateVolumesFromSnapshotTest-29601553 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097" returned: 0 in 0.649s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:52:17 devstack cinder-volume[87444]: DEBUG cinder.manager [None req-ad6ae405-aad1-4ded-acab-e3bfebf51fd4 tempest-CreateVolumesFromSnapshotTest-29601553 None] Notifying Schedulers of capabilities ... {{(pid=87444) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 04:52:18 devstack cinder-volume[87444]: INFO cinder.volume.manager [None req-ad6ae405-aad1-4ded-acab-e3bfebf51fd4 tempest-CreateVolumesFromSnapshotTest-29601553 None] Deleted volume successfully. Jul 10 04:52:18 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-ad6ae405-aad1-4ded-acab-e3bfebf51fd4 tempest-CreateVolumesFromSnapshotTest-29601553 None] Lock "cinder-04377320-4f68-4c05-a1a0-72e5780b5d4f-delete_volume" released by "delete_volume" :: held 2.304s {{(pid=87444) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 04:52:22 devstack cinder-volume[87444]: DEBUG cinder.volume.flows.manager.create_volume [None req-b5ffdf47-8e79-4a1c-b339-5541f9005578 tempest-VolumeImageDependencyTests-1550932924 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87444) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 04:52:22 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-b5ffdf47-8e79-4a1c-b339-5541f9005578 tempest-VolumeImageDependencyTests-1550932924 None] Flow 'volume_create_manager' (44034ad4-4b8d-466e-a9dc-6d37bfe33a86) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 04:52:22 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-b5ffdf47-8e79-4a1c-b339-5541f9005578 tempest-VolumeImageDependencyTests-1550932924 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (feb1421a-ff93-487a-bfdb-cddd0333db87) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:52:22 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-b5ffdf47-8e79-4a1c-b339-5541f9005578 tempest-VolumeImageDependencyTests-1550932924 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (feb1421a-ff93-487a-bfdb-cddd0333db87) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T02:52:22Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=14525950-aab5-4e88-8250-7d770fb72c8d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b4f18a6228af44bca12ab58d661df8f7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T02:52:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T02:52:23Z,use_quota=True,user_id='afafd446e1714d92b6cd0438edf9da91',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(317e369e-1e06-434d-ae95-a335f0e6c903),volume_type_id=317e369e-1e06-434d-ae95-a335f0e6c903)' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:52:22 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-b5ffdf47-8e79-4a1c-b339-5541f9005578 tempest-VolumeImageDependencyTests-1550932924 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8373cbe3-3e17-4f13-b7a9-f463f0a32a6b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:52:22 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-b5ffdf47-8e79-4a1c-b339-5541f9005578 tempest-VolumeImageDependencyTests-1550932924 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8373cbe3-3e17-4f13-b7a9-f463f0a32a6b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:52:22 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-b5ffdf47-8e79-4a1c-b339-5541f9005578 tempest-VolumeImageDependencyTests-1550932924 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (56a3d32f-b5ba-4f32-a7bd-3c219f6f8bfa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:52:22 devstack cinder-volume[87444]: DEBUG cinder.image.glance [None req-b5ffdf47-8e79-4a1c-b339-5541f9005578 tempest-VolumeImageDependencyTests-1550932924 None] Creating Keystone auth plugin from conf {{(pid=87444) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jul 10 04:52:22 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-b5ffdf47-8e79-4a1c-b339-5541f9005578 tempest-VolumeImageDependencyTests-1550932924 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (56a3d32f-b5ba-4f32-a7bd-3c219f6f8bfa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '14525950-aab5-4e88-8250-7d770fb72c8d', 'volume_name': 'volume-14525950-aab5-4e88-8250-7d770fb72c8d', 'volume_size': 1, 'image_id': '2a23c552-be6f-4c65-8f41-c3ff5a820185', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/2a23c552-be6f-4c65-8f41-c3ff5a820185', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'b6210116ae3c24d9b3204ade2837ec48', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'b4f18a6228af44bca12ab58d661df8f7', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '08757d182a43d9c3fba93db9a071a2ae230b209006d16d4f5f0a420fc4fd026c883c364a55352fac592b9bec06ac00d8bc6d7d7011235211bed2542563f6ae93', 'id': '2a23c552-be6f-4c65-8f41-c3ff5a820185', 'created_at': datetime.datetime(2026, 7, 10, 2, 52, 21, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 10, 2, 52, 22, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/2a23c552-be6f-4c65-8f41-c3ff5a820185/file', 'properties': {}}, 'image_service': }' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:52:22 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-b5ffdf47-8e79-4a1c-b339-5541f9005578 tempest-VolumeImageDependencyTests-1550932924 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f0cbe04d-297f-4b70-a2a6-7b691af7a6a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:52:22 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-b5ffdf47-8e79-4a1c-b339-5541f9005578 tempest-VolumeImageDependencyTests-1550932924 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f0cbe04d-297f-4b70-a2a6-7b691af7a6a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:52:22 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-b5ffdf47-8e79-4a1c-b339-5541f9005578 tempest-VolumeImageDependencyTests-1550932924 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3a504090-9a31-4c29-a51e-1918f4ade5e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:52:22 devstack cinder-volume[87444]: INFO cinder.volume.flows.manager.create_volume [None req-b5ffdf47-8e79-4a1c-b339-5541f9005578 tempest-VolumeImageDependencyTests-1550932924 None] Volume 14525950-aab5-4e88-8250-7d770fb72c8d: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-14525950-aab5-4e88-8250-7d770fb72c8d', 'volume_size': 1, 'image_id': '2a23c552-be6f-4c65-8f41-c3ff5a820185', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/2a23c552-be6f-4c65-8f41-c3ff5a820185', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'b6210116ae3c24d9b3204ade2837ec48', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'b4f18a6228af44bca12ab58d661df8f7', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '08757d182a43d9c3fba93db9a071a2ae230b209006d16d4f5f0a420fc4fd026c883c364a55352fac592b9bec06ac00d8bc6d7d7011235211bed2542563f6ae93', 'id': '2a23c552-be6f-4c65-8f41-c3ff5a820185', 'created_at': datetime.datetime(2026, 7, 10, 2, 52, 21, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 10, 2, 52, 22, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/2a23c552-be6f-4c65-8f41-c3ff5a820185/file', 'properties': {}}, 'image_service': } Jul 10 04:52:22 devstack cinder-volume[87444]: DEBUG cinder.volume.flows.manager.create_volume [None req-b5ffdf47-8e79-4a1c-b339-5541f9005578 tempest-VolumeImageDependencyTests-1550932924 None] Trying to clone 14525950-aab5-4e88-8250-7d770fb72c8d from image 2a23c552-be6f-4c65-8f41-c3ff5a820185 at location (None, [{'url': 'file:///opt/stack/data/glance/images/2a23c552-be6f-4c65-8f41-c3ff5a820185', 'metadata': {}}]). {{(pid=87444) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jul 10 04:52:22 devstack cinder-volume[87444]: DEBUG cinder.image.image_utils [None req-b5ffdf47-8e79-4a1c-b339-5541f9005578 tempest-VolumeImageDependencyTests-1550932924 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_2a23c552-be6f-4c65-8f41-c3ff5a820185_rwnjjvxgdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=87444) fetch /opt/stack/cinder/cinder/image/image_utils.py:765}} Jul 10 04:52:22 devstack cinder-volume[87444]: INFO cinder.image.image_utils [None req-b5ffdf47-8e79-4a1c-b339-5541f9005578 tempest-VolumeImageDependencyTests-1550932924 None] Image download 0.00 MB at 0.00 MB/s Jul 10 04:52:22 devstack cinder-volume[87444]: DEBUG oslo.privsep.daemon [-] privsep: reply[23271c01-7075-4f71-8b81-e90925898350]: (4, 'raw') {{(pid=88499) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 04:52:22 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-b5ffdf47-8e79-4a1c-b339-5541f9005578 tempest-VolumeImageDependencyTests-1550932924 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_2a23c552-be6f-4c65-8f41-c3ff5a820185_rwnjjvxgdevstack@QuobyteHD {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:52:23 devstack sudo[104815]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_2a23c552-be6f-4c65-8f41-c3ff5a820185_rwnjjvxgdevstack@QuobyteHD Jul 10 04:52:23 devstack sudo[104815]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:52:23 devstack sudo[104815]: pam_unix(sudo:session): session closed for user root Jul 10 04:52:23 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-b5ffdf47-8e79-4a1c-b339-5541f9005578 tempest-VolumeImageDependencyTests-1550932924 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_2a23c552-be6f-4c65-8f41-c3ff5a820185_rwnjjvxgdevstack@QuobyteHD" returned: 0 in 0.720s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:52:23 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-b5ffdf47-8e79-4a1c-b339-5541f9005578 tempest-VolumeImageDependencyTests-1550932924 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_2a23c552-be6f-4c65-8f41-c3ff5a820185_rwnjjvxgdevstack@QuobyteHD {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:52:23 devstack sudo[104820]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_2a23c552-be6f-4c65-8f41-c3ff5a820185_rwnjjvxgdevstack@QuobyteHD Jul 10 04:52:23 devstack sudo[104820]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:52:24 devstack sudo[104820]: pam_unix(sudo:session): session closed for user root Jul 10 04:52:24 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-b5ffdf47-8e79-4a1c-b339-5541f9005578 tempest-VolumeImageDependencyTests-1550932924 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_2a23c552-be6f-4c65-8f41-c3ff5a820185_rwnjjvxgdevstack@QuobyteHD" returned: 1 in 0.731s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:52:24 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-b5ffdf47-8e79-4a1c-b339-5541f9005578 tempest-VolumeImageDependencyTests-1550932924 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_2a23c552-be6f-4c65-8f41-c3ff5a820185_rwnjjvxgdevstack@QuobyteHD' failed. Not Retrying. {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 10 04:52:24 devstack cinder-volume[87444]: DEBUG cinder.image.image_utils [None req-b5ffdf47-8e79-4a1c-b339-5541f9005578 tempest-VolumeImageDependencyTests-1550932924 None] Temporary image 2a23c552-be6f-4c65-8f41-c3ff5a820185 is fetched for user afafd446e1714d92b6cd0438edf9da91. {{(pid=87444) fetch /opt/stack/cinder/cinder/image/image_utils.py:1464}} Jul 10 04:52:24 devstack cinder-volume[87444]: DEBUG oslo.privsep.daemon [-] privsep: reply[3881045c-7cbb-48eb-8b3a-177df8c2648f]: (4, 'raw') {{(pid=88499) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 04:52:24 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-b5ffdf47-8e79-4a1c-b339-5541f9005578 tempest-VolumeImageDependencyTests-1550932924 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_2a23c552-be6f-4c65-8f41-c3ff5a820185_rwnjjvxgdevstack@QuobyteHD {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:52:24 devstack sudo[104825]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_2a23c552-be6f-4c65-8f41-c3ff5a820185_rwnjjvxgdevstack@QuobyteHD Jul 10 04:52:24 devstack sudo[104825]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:52:25 devstack sudo[104825]: pam_unix(sudo:session): session closed for user root Jul 10 04:52:25 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-b5ffdf47-8e79-4a1c-b339-5541f9005578 tempest-VolumeImageDependencyTests-1550932924 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_2a23c552-be6f-4c65-8f41-c3ff5a820185_rwnjjvxgdevstack@QuobyteHD" returned: 0 in 0.703s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:52:25 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-b5ffdf47-8e79-4a1c-b339-5541f9005578 tempest-VolumeImageDependencyTests-1550932924 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_2a23c552-be6f-4c65-8f41-c3ff5a820185_rwnjjvxgdevstack@QuobyteHD {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:52:25 devstack sudo[104829]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_2a23c552-be6f-4c65-8f41-c3ff5a820185_rwnjjvxgdevstack@QuobyteHD Jul 10 04:52:25 devstack sudo[104829]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:52:25 devstack sudo[104829]: pam_unix(sudo:session): session closed for user root Jul 10 04:52:25 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-b5ffdf47-8e79-4a1c-b339-5541f9005578 tempest-VolumeImageDependencyTests-1550932924 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_2a23c552-be6f-4c65-8f41-c3ff5a820185_rwnjjvxgdevstack@QuobyteHD" returned: 1 in 0.722s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:52:25 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-b5ffdf47-8e79-4a1c-b339-5541f9005578 tempest-VolumeImageDependencyTests-1550932924 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_2a23c552-be6f-4c65-8f41-c3ff5a820185_rwnjjvxgdevstack@QuobyteHD' failed. Not Retrying. {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 10 04:52:25 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-b5ffdf47-8e79-4a1c-b339-5541f9005578 tempest-VolumeImageDependencyTests-1550932924 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 04:52:25 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-b5ffdf47-8e79-4a1c-b339-5541f9005578 tempest-VolumeImageDependencyTests-1550932924 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 04:52:25 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-b5ffdf47-8e79-4a1c-b339-5541f9005578 tempest-VolumeImageDependencyTests-1550932924 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T02:52:22Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=14525950-aab5-4e88-8250-7d770fb72c8d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b4f18a6228af44bca12ab58d661df8f7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T02:52:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T02:52:23Z,use_quota=True,user_id='afafd446e1714d92b6cd0438edf9da91',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(317e369e-1e06-434d-ae95-a335f0e6c903),volume_type_id=317e369e-1e06-434d-ae95-a335f0e6c903)}" {{(pid=87444) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 04:52:25 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.remotefs [None req-b5ffdf47-8e79-4a1c-b339-5541f9005578 tempest-VolumeImageDependencyTests-1550932924 None] Creating volume 14525950-aab5-4e88-8250-7d770fb72c8d {{(pid=87444) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 04:52:25 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-b5ffdf47-8e79-4a1c-b339-5541f9005578 tempest-VolumeImageDependencyTests-1550932924 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 04:52:25 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-b5ffdf47-8e79-4a1c-b339-5541f9005578 tempest-VolumeImageDependencyTests-1550932924 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 04:52:25 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-b5ffdf47-8e79-4a1c-b339-5541f9005578 tempest-VolumeImageDependencyTests-1550932924 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922': None} {{(pid=87444) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 04:52:25 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-b5ffdf47-8e79-4a1c-b339-5541f9005578 tempest-VolumeImageDependencyTests-1550932924 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922'] {{(pid=87444) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 04:52:25 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-b5ffdf47-8e79-4a1c-b339-5541f9005578 tempest-VolumeImageDependencyTests-1550932924 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 04:52:25 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-b5ffdf47-8e79-4a1c-b339-5541f9005578 tempest-VolumeImageDependencyTests-1550932924 None] Selected osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922 as target Quobyte volume. {{(pid=87444) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 04:52:25 devstack cinder-volume[87444]: INFO cinder.volume.drivers.remotefs [None req-b5ffdf47-8e79-4a1c-b339-5541f9005578 tempest-VolumeImageDependencyTests-1550932924 None] casted to osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922 Jul 10 04:52:25 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-b5ffdf47-8e79-4a1c-b339-5541f9005578 tempest-VolumeImageDependencyTests-1550932924 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-14525950-aab5-4e88-8250-7d770fb72c8d 1073741824 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:52:25 devstack sudo[104834]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-14525950-aab5-4e88-8250-7d770fb72c8d 1073741824 Jul 10 04:52:25 devstack sudo[104834]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:52:26 devstack sudo[104834]: pam_unix(sudo:session): session closed for user root Jul 10 04:52:26 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-b5ffdf47-8e79-4a1c-b339-5541f9005578 tempest-VolumeImageDependencyTests-1550932924 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-14525950-aab5-4e88-8250-7d770fb72c8d 1073741824" returned: 0 in 0.806s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:52:26 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-b5ffdf47-8e79-4a1c-b339-5541f9005578 tempest-VolumeImageDependencyTests-1550932924 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-14525950-aab5-4e88-8250-7d770fb72c8d {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:52:26 devstack sudo[104840]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-14525950-aab5-4e88-8250-7d770fb72c8d Jul 10 04:52:26 devstack sudo[104840]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:52:27 devstack sudo[104840]: pam_unix(sudo:session): session closed for user root Jul 10 04:52:27 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-b5ffdf47-8e79-4a1c-b339-5541f9005578 tempest-VolumeImageDependencyTests-1550932924 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-14525950-aab5-4e88-8250-7d770fb72c8d" returned: 0 in 0.651s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:52:27 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-b5ffdf47-8e79-4a1c-b339-5541f9005578 tempest-VolumeImageDependencyTests-1550932924 None] <== create_volume: return (1496ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922'} {{(pid=87444) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 04:52:27 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-b5ffdf47-8e79-4a1c-b339-5541f9005578 tempest-VolumeImageDependencyTests-1550932924 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.499s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 04:52:27 devstack cinder-volume[87444]: DEBUG cinder.volume.volume_utils [None req-b5ffdf47-8e79-4a1c-b339-5541f9005578 tempest-VolumeImageDependencyTests-1550932924 None] Attempting download of 2a23c552-be6f-4c65-8f41-c3ff5a820185 ((None, [{'url': 'file:///opt/stack/data/glance/images/2a23c552-be6f-4c65-8f41-c3ff5a820185', 'metadata': {}}])) to volume 14525950-aab5-4e88-8250-7d770fb72c8d. {{(pid=87444) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jul 10 04:52:27 devstack cinder-volume[87444]: DEBUG oslo.privsep.daemon [-] privsep: reply[09c69f04-05bf-4120-8d3a-4c45bde69bdf]: (4, 'raw') {{(pid=88499) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 04:52:27 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-b5ffdf47-8e79-4a1c-b339-5541f9005578 tempest-VolumeImageDependencyTests-1550932924 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_2a23c552-be6f-4c65-8f41-c3ff5a820185_evhk3s0p {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:52:27 devstack sudo[104843]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_2a23c552-be6f-4c65-8f41-c3ff5a820185_evhk3s0p Jul 10 04:52:27 devstack sudo[104843]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:52:28 devstack sudo[104843]: pam_unix(sudo:session): session closed for user root Jul 10 04:52:28 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-b5ffdf47-8e79-4a1c-b339-5541f9005578 tempest-VolumeImageDependencyTests-1550932924 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_2a23c552-be6f-4c65-8f41-c3ff5a820185_evhk3s0p" returned: 0 in 0.703s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:52:28 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-b5ffdf47-8e79-4a1c-b339-5541f9005578 tempest-VolumeImageDependencyTests-1550932924 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_2a23c552-be6f-4c65-8f41-c3ff5a820185_evhk3s0p {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:52:28 devstack sudo[104847]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_2a23c552-be6f-4c65-8f41-c3ff5a820185_evhk3s0p Jul 10 04:52:28 devstack sudo[104847]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:52:28 devstack sudo[104847]: pam_unix(sudo:session): session closed for user root Jul 10 04:52:28 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-b5ffdf47-8e79-4a1c-b339-5541f9005578 tempest-VolumeImageDependencyTests-1550932924 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_2a23c552-be6f-4c65-8f41-c3ff5a820185_evhk3s0p" returned: 1 in 0.737s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:52:28 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-b5ffdf47-8e79-4a1c-b339-5541f9005578 tempest-VolumeImageDependencyTests-1550932924 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_2a23c552-be6f-4c65-8f41-c3ff5a820185_evhk3s0p' failed. Not Retrying. {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 10 04:52:28 devstack cinder-volume[87444]: DEBUG oslo.privsep.daemon [-] privsep: reply[ffc59a26-8f91-4f04-818b-6636d9d0b1e3]: (4, 'raw') {{(pid=88499) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 04:52:28 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-b5ffdf47-8e79-4a1c-b339-5541f9005578 tempest-VolumeImageDependencyTests-1550932924 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_2a23c552-be6f-4c65-8f41-c3ff5a820185_rwnjjvxgdevstack@QuobyteHD {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:52:29 devstack sudo[104851]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_2a23c552-be6f-4c65-8f41-c3ff5a820185_rwnjjvxgdevstack@QuobyteHD Jul 10 04:52:29 devstack sudo[104851]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:52:29 devstack sudo[104851]: pam_unix(sudo:session): session closed for user root Jul 10 04:52:29 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-b5ffdf47-8e79-4a1c-b339-5541f9005578 tempest-VolumeImageDependencyTests-1550932924 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_2a23c552-be6f-4c65-8f41-c3ff5a820185_rwnjjvxgdevstack@QuobyteHD" returned: 0 in 0.724s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:52:29 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-b5ffdf47-8e79-4a1c-b339-5541f9005578 tempest-VolumeImageDependencyTests-1550932924 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_2a23c552-be6f-4c65-8f41-c3ff5a820185_rwnjjvxgdevstack@QuobyteHD {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:52:29 devstack sudo[104855]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_2a23c552-be6f-4c65-8f41-c3ff5a820185_rwnjjvxgdevstack@QuobyteHD Jul 10 04:52:29 devstack sudo[104855]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:52:30 devstack sudo[104855]: pam_unix(sudo:session): session closed for user root Jul 10 04:52:30 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-b5ffdf47-8e79-4a1c-b339-5541f9005578 tempest-VolumeImageDependencyTests-1550932924 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_2a23c552-be6f-4c65-8f41-c3ff5a820185_rwnjjvxgdevstack@QuobyteHD" returned: 1 in 0.737s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:52:30 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-b5ffdf47-8e79-4a1c-b339-5541f9005578 tempest-VolumeImageDependencyTests-1550932924 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_2a23c552-be6f-4c65-8f41-c3ff5a820185_rwnjjvxgdevstack@QuobyteHD' failed. Not Retrying. {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 10 04:52:30 devstack cinder-volume[87444]: DEBUG cinder.image.image_utils [None req-b5ffdf47-8e79-4a1c-b339-5541f9005578 tempest-VolumeImageDependencyTests-1550932924 None] 2a23c552-be6f-4c65-8f41-c3ff5a820185 was raw, converting to raw {{(pid=87444) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1153}} Jul 10 04:52:30 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-b5ffdf47-8e79-4a1c-b339-5541f9005578 tempest-VolumeImageDependencyTests-1550932924 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_2a23c552-be6f-4c65-8f41-c3ff5a820185_rwnjjvxgdevstack@QuobyteHD /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-14525950-aab5-4e88-8250-7d770fb72c8d {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:52:30 devstack sudo[104860]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_2a23c552-be6f-4c65-8f41-c3ff5a820185_rwnjjvxgdevstack@QuobyteHD /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-14525950-aab5-4e88-8250-7d770fb72c8d Jul 10 04:52:30 devstack sudo[104860]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:52:31 devstack sudo[104860]: pam_unix(sudo:session): session closed for user root Jul 10 04:52:31 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-b5ffdf47-8e79-4a1c-b339-5541f9005578 tempest-VolumeImageDependencyTests-1550932924 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_2a23c552-be6f-4c65-8f41-c3ff5a820185_rwnjjvxgdevstack@QuobyteHD /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-14525950-aab5-4e88-8250-7d770fb72c8d" returned: 0 in 0.716s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:52:31 devstack cinder-volume[87444]: DEBUG cinder.image.image_utils [None req-b5ffdf47-8e79-4a1c-b339-5541f9005578 tempest-VolumeImageDependencyTests-1550932924 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_2a23c552-be6f-4c65-8f41-c3ff5a820185_rwnjjvxgdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-14525950-aab5-4e88-8250-7d770fb72c8d {{(pid=87444) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:561}} Jul 10 04:52:31 devstack cinder-volume[87444]: INFO cinder.image.image_utils [None req-b5ffdf47-8e79-4a1c-b339-5541f9005578 tempest-VolumeImageDependencyTests-1550932924 None] Converted 0.00 MB image at 0.00 MB/s Jul 10 04:52:31 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-b5ffdf47-8e79-4a1c-b339-5541f9005578 tempest-VolumeImageDependencyTests-1550932924 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-14525950-aab5-4e88-8250-7d770fb72c8d 1G {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:52:31 devstack sudo[104865]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-14525950-aab5-4e88-8250-7d770fb72c8d 1G Jul 10 04:52:31 devstack sudo[104865]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:52:31 devstack sudo[104865]: pam_unix(sudo:session): session closed for user root Jul 10 04:52:31 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-b5ffdf47-8e79-4a1c-b339-5541f9005578 tempest-VolumeImageDependencyTests-1550932924 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-14525950-aab5-4e88-8250-7d770fb72c8d 1G" returned: 0 in 0.677s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:52:31 devstack cinder-volume[87444]: DEBUG oslo.privsep.daemon [-] privsep: reply[36b2661a-1fe2-4a2c-802c-d2dce340396e]: (4, 'raw') {{(pid=88499) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 04:52:31 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-b5ffdf47-8e79-4a1c-b339-5541f9005578 tempest-VolumeImageDependencyTests-1550932924 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-14525950-aab5-4e88-8250-7d770fb72c8d {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:52:31 devstack sudo[104870]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-14525950-aab5-4e88-8250-7d770fb72c8d Jul 10 04:52:31 devstack sudo[104870]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:52:32 devstack sudo[104870]: pam_unix(sudo:session): session closed for user root Jul 10 04:52:32 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-b5ffdf47-8e79-4a1c-b339-5541f9005578 tempest-VolumeImageDependencyTests-1550932924 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-14525950-aab5-4e88-8250-7d770fb72c8d" returned: 0 in 0.738s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:52:32 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-b5ffdf47-8e79-4a1c-b339-5541f9005578 tempest-VolumeImageDependencyTests-1550932924 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-14525950-aab5-4e88-8250-7d770fb72c8d {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:52:32 devstack sudo[104874]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-14525950-aab5-4e88-8250-7d770fb72c8d Jul 10 04:52:32 devstack sudo[104874]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:52:33 devstack cinder-volume[87444]: DEBUG oslo_service.periodic_task [None req-01f0ce3e-6850-4e14-881d-e40d3c4ad6e5 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87444) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 10 04:52:33 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-01f0ce3e-6850-4e14-881d-e40d3c4ad6e5 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 04:52:33 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-01f0ce3e-6850-4e14-881d-e40d3c4ad6e5 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 04:52:33 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-01f0ce3e-6850-4e14-881d-e40d3c4ad6e5 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922': None} {{(pid=87444) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 04:52:33 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-01f0ce3e-6850-4e14-881d-e40d3c4ad6e5 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922'] {{(pid=87444) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 04:52:33 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-01f0ce3e-6850-4e14-881d-e40d3c4ad6e5 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 04:52:33 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-01f0ce3e-6850-4e14-881d-e40d3c4ad6e5 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:52:33 devstack sudo[104876]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097 Jul 10 04:52:33 devstack sudo[104876]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:52:33 devstack sudo[104874]: pam_unix(sudo:session): session closed for user root Jul 10 04:52:33 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-b5ffdf47-8e79-4a1c-b339-5541f9005578 tempest-VolumeImageDependencyTests-1550932924 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-14525950-aab5-4e88-8250-7d770fb72c8d" returned: 1 in 0.732s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:52:33 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-b5ffdf47-8e79-4a1c-b339-5541f9005578 tempest-VolumeImageDependencyTests-1550932924 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-14525950-aab5-4e88-8250-7d770fb72c8d' failed. Not Retrying. {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 10 04:52:33 devstack cinder-volume[87444]: DEBUG cinder.volume.volume_utils [None req-b5ffdf47-8e79-4a1c-b339-5541f9005578 tempest-VolumeImageDependencyTests-1550932924 None] Downloaded image 2a23c552-be6f-4c65-8f41-c3ff5a820185 ((None, [{'url': 'file:///opt/stack/data/glance/images/2a23c552-be6f-4c65-8f41-c3ff5a820185', 'metadata': {}}])) to volume 14525950-aab5-4e88-8250-7d770fb72c8d successfully. {{(pid=87444) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jul 10 04:52:33 devstack cinder-volume[87444]: DEBUG cinder.image.image_utils [None req-b5ffdf47-8e79-4a1c-b339-5541f9005578 tempest-VolumeImageDependencyTests-1550932924 None] Temporary image 2a23c552-be6f-4c65-8f41-c3ff5a820185 for user afafd446e1714d92b6cd0438edf9da91 is deleted. {{(pid=87444) fetch /opt/stack/cinder/cinder/image/image_utils.py:1468}} Jul 10 04:52:33 devstack cinder-volume[87444]: DEBUG cinder.volume.volume_utils [None req-b5ffdf47-8e79-4a1c-b339-5541f9005578 tempest-VolumeImageDependencyTests-1550932924 None] Marking volume 14525950-aab5-4e88-8250-7d770fb72c8d as bootable. {{(pid=87444) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jul 10 04:52:33 devstack cinder-volume[87444]: DEBUG cinder.volume.flows.manager.create_volume [None req-b5ffdf47-8e79-4a1c-b339-5541f9005578 tempest-VolumeImageDependencyTests-1550932924 None] Copying metadata from image 2a23c552-be6f-4c65-8f41-c3ff5a820185 to 14525950-aab5-4e88-8250-7d770fb72c8d. {{(pid=87444) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jul 10 04:52:33 devstack cinder-volume[87444]: DEBUG cinder.volume.flows.manager.create_volume [None req-b5ffdf47-8e79-4a1c-b339-5541f9005578 tempest-VolumeImageDependencyTests-1550932924 None] Creating volume glance metadata for volume 14525950-aab5-4e88-8250-7d770fb72c8d backed by image 2a23c552-be6f-4c65-8f41-c3ff5a820185 with: {'image_id': '2a23c552-be6f-4c65-8f41-c3ff5a820185', 'image_name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'checksum': 'b6210116ae3c24d9b3204ade2837ec48', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=87444) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jul 10 04:52:33 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-b5ffdf47-8e79-4a1c-b339-5541f9005578 tempest-VolumeImageDependencyTests-1550932924 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3a504090-9a31-4c29-a51e-1918f4ade5e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-14525950-aab5-4e88-8250-7d770fb72c8d', 'volume_size': 1, 'image_id': '2a23c552-be6f-4c65-8f41-c3ff5a820185', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/2a23c552-be6f-4c65-8f41-c3ff5a820185', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'b6210116ae3c24d9b3204ade2837ec48', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'b4f18a6228af44bca12ab58d661df8f7', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '08757d182a43d9c3fba93db9a071a2ae230b209006d16d4f5f0a420fc4fd026c883c364a55352fac592b9bec06ac00d8bc6d7d7011235211bed2542563f6ae93', 'id': '2a23c552-be6f-4c65-8f41-c3ff5a820185', 'created_at': datetime.datetime(2026, 7, 10, 2, 52, 21, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 10, 2, 52, 22, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/2a23c552-be6f-4c65-8f41-c3ff5a820185/file', 'properties': {}}, 'image_service': }' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:52:33 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-b5ffdf47-8e79-4a1c-b339-5541f9005578 tempest-VolumeImageDependencyTests-1550932924 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (407369a1-b9e8-471c-8837-7ed5d96c2c48) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:52:33 devstack cinder-volume[87444]: INFO cinder.volume.flows.manager.create_volume [None req-b5ffdf47-8e79-4a1c-b339-5541f9005578 tempest-VolumeImageDependencyTests-1550932924 None] Volume volume-14525950-aab5-4e88-8250-7d770fb72c8d (14525950-aab5-4e88-8250-7d770fb72c8d): created successfully Jul 10 04:52:33 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-b5ffdf47-8e79-4a1c-b339-5541f9005578 tempest-VolumeImageDependencyTests-1550932924 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (407369a1-b9e8-471c-8837-7ed5d96c2c48) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:52:33 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-b5ffdf47-8e79-4a1c-b339-5541f9005578 tempest-VolumeImageDependencyTests-1550932924 None] Flow 'volume_create_manager' (44034ad4-4b8d-466e-a9dc-6d37bfe33a86) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87444) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 04:52:33 devstack cinder-volume[87444]: INFO cinder.volume.manager [None req-b5ffdf47-8e79-4a1c-b339-5541f9005578 tempest-VolumeImageDependencyTests-1550932924 None] Created volume successfully. Jul 10 04:52:33 devstack sudo[104876]: pam_unix(sudo:session): session closed for user root Jul 10 04:52:33 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-01f0ce3e-6850-4e14-881d-e40d3c4ad6e5 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097" returned: 0 in 0.664s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:52:33 devstack cinder-volume[87444]: DEBUG cinder.manager [None req-01f0ce3e-6850-4e14-881d-e40d3c4ad6e5 None None] Notifying Schedulers of capabilities ... {{(pid=87444) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 04:52:33 devstack cinder-volume[87444]: DEBUG oslo_service.periodic_task [None req-01f0ce3e-6850-4e14-881d-e40d3c4ad6e5 None None] Running periodic task VolumeManager._thread_info {{(pid=87444) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 10 04:52:33 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-01f0ce3e-6850-4e14-881d-e40d3c4ad6e5 None None] thread count: 28 {{(pid=87444) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 10 04:52:33 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-01f0ce3e-6850-4e14-881d-e40d3c4ad6e5 None None] thread info: [<_MainThread(MainThread, started 126839257915520)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87444) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 10 04:52:34 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-530520bd-e035-4e35-9546-c623670fd48a tempest-VolumeImageDependencyTests-1550932924 None] Acquiring lock "cinder-14525950-aab5-4e88-8250-7d770fb72c8d-delete_volume" by "delete_volume" {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 04:52:34 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-530520bd-e035-4e35-9546-c623670fd48a tempest-VolumeImageDependencyTests-1550932924 None] Lock "cinder-14525950-aab5-4e88-8250-7d770fb72c8d-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 04:52:34 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-530520bd-e035-4e35-9546-c623670fd48a tempest-VolumeImageDependencyTests-1550932924 None] Acquiring lock "cinder-quobyte-14525950-aab5-4e88-8250-7d770fb72c8d" by "delete_volume" {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 04:52:34 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-530520bd-e035-4e35-9546-c623670fd48a tempest-VolumeImageDependencyTests-1550932924 None] Lock "cinder-quobyte-14525950-aab5-4e88-8250-7d770fb72c8d" acquired by "delete_volume" :: waited 0.016s {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 04:52:34 devstack cinder-volume[87444]: DEBUG oslo.privsep.daemon [-] privsep: reply[004409cb-d858-4279-a1f9-c17b8314059c]: (4, 'raw') {{(pid=88499) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 04:52:34 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-530520bd-e035-4e35-9546-c623670fd48a tempest-VolumeImageDependencyTests-1550932924 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-14525950-aab5-4e88-8250-7d770fb72c8d {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:52:34 devstack sudo[104883]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-14525950-aab5-4e88-8250-7d770fb72c8d Jul 10 04:52:34 devstack sudo[104883]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:52:35 devstack sudo[104883]: pam_unix(sudo:session): session closed for user root Jul 10 04:52:35 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-530520bd-e035-4e35-9546-c623670fd48a tempest-VolumeImageDependencyTests-1550932924 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-14525950-aab5-4e88-8250-7d770fb72c8d" returned: 0 in 0.728s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:52:35 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-530520bd-e035-4e35-9546-c623670fd48a tempest-VolumeImageDependencyTests-1550932924 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-14525950-aab5-4e88-8250-7d770fb72c8d {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:52:35 devstack sudo[104887]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-14525950-aab5-4e88-8250-7d770fb72c8d Jul 10 04:52:35 devstack sudo[104887]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:52:35 devstack sudo[104887]: pam_unix(sudo:session): session closed for user root Jul 10 04:52:35 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-530520bd-e035-4e35-9546-c623670fd48a tempest-VolumeImageDependencyTests-1550932924 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-14525950-aab5-4e88-8250-7d770fb72c8d" returned: 1 in 0.726s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:52:35 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-530520bd-e035-4e35-9546-c623670fd48a tempest-VolumeImageDependencyTests-1550932924 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-14525950-aab5-4e88-8250-7d770fb72c8d' failed. Not Retrying. {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 10 04:52:35 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-530520bd-e035-4e35-9546-c623670fd48a tempest-VolumeImageDependencyTests-1550932924 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-14525950-aab5-4e88-8250-7d770fb72c8d {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:52:35 devstack sudo[104892]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-14525950-aab5-4e88-8250-7d770fb72c8d Jul 10 04:52:35 devstack sudo[104892]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:52:36 devstack sudo[104892]: pam_unix(sudo:session): session closed for user root Jul 10 04:52:36 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-530520bd-e035-4e35-9546-c623670fd48a tempest-VolumeImageDependencyTests-1550932924 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-14525950-aab5-4e88-8250-7d770fb72c8d" returned: 0 in 0.630s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:52:36 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-530520bd-e035-4e35-9546-c623670fd48a tempest-VolumeImageDependencyTests-1550932924 None] Lock "cinder-quobyte-14525950-aab5-4e88-8250-7d770fb72c8d" released by "delete_volume" :: held 2.140s {{(pid=87444) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 04:52:36 devstack cinder-volume[87444]: DEBUG cinder.quota [None req-530520bd-e035-4e35-9546-c623670fd48a tempest-VolumeImageDependencyTests-1550932924 None] Created reservations ['35eae7a2-1c36-4e8d-b4c3-ac37bb7c68bf', 'e638a41c-eb05-4bd0-93ae-4f3a69369749', '8928c8c2-d668-4b7b-a1b1-44508c931b04', 'ba2adda5-bed7-48e2-bbba-80e7654377be'] {{(pid=87444) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 04:52:36 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-530520bd-e035-4e35-9546-c623670fd48a tempest-VolumeImageDependencyTests-1550932924 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 04:52:36 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-530520bd-e035-4e35-9546-c623670fd48a tempest-VolumeImageDependencyTests-1550932924 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 04:52:36 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-530520bd-e035-4e35-9546-c623670fd48a tempest-VolumeImageDependencyTests-1550932924 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922': None} {{(pid=87444) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 04:52:36 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-530520bd-e035-4e35-9546-c623670fd48a tempest-VolumeImageDependencyTests-1550932924 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922'] {{(pid=87444) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 04:52:36 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-530520bd-e035-4e35-9546-c623670fd48a tempest-VolumeImageDependencyTests-1550932924 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 04:52:36 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-530520bd-e035-4e35-9546-c623670fd48a tempest-VolumeImageDependencyTests-1550932924 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:52:36 devstack sudo[104895]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097 Jul 10 04:52:36 devstack sudo[104895]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:52:37 devstack sudo[104895]: pam_unix(sudo:session): session closed for user root Jul 10 04:52:37 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-530520bd-e035-4e35-9546-c623670fd48a tempest-VolumeImageDependencyTests-1550932924 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097" returned: 0 in 0.626s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:52:37 devstack cinder-volume[87444]: DEBUG cinder.manager [None req-530520bd-e035-4e35-9546-c623670fd48a tempest-VolumeImageDependencyTests-1550932924 None] Notifying Schedulers of capabilities ... {{(pid=87444) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 04:52:37 devstack cinder-volume[87444]: INFO cinder.volume.manager [None req-530520bd-e035-4e35-9546-c623670fd48a tempest-VolumeImageDependencyTests-1550932924 None] Deleted volume successfully. Jul 10 04:52:37 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-530520bd-e035-4e35-9546-c623670fd48a tempest-VolumeImageDependencyTests-1550932924 None] Lock "cinder-14525950-aab5-4e88-8250-7d770fb72c8d-delete_volume" released by "delete_volume" :: held 2.960s {{(pid=87444) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 04:52:40 devstack cinder-volume[87444]: DEBUG cinder.volume.flows.manager.create_volume [None req-aedd8d5a-a28d-435b-83bb-93513635c496 tempest-ProjectReaderTests-565908593 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87444) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 04:52:40 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-aedd8d5a-a28d-435b-83bb-93513635c496 tempest-ProjectReaderTests-565908593 None] Flow 'volume_create_manager' (566f049e-0c43-47b5-bb96-9b3fe50d22ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 04:52:40 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-aedd8d5a-a28d-435b-83bb-93513635c496 tempest-ProjectReaderTests-565908593 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (acb9d1e8-57dc-4a4d-9fb0-93645c8dcc0c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:52:40 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-aedd8d5a-a28d-435b-83bb-93513635c496 tempest-ProjectReaderTests-565908593 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (acb9d1e8-57dc-4a4d-9fb0-93645c8dcc0c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T02:52:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1326373507',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=56d36f36-61bb-4582-9a6a-f64728f0729c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='66a9d00c4b114acda7ea5957fbe4f7aa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T02:52:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T02:52:41Z,use_quota=True,user_id='be866b07a7ac4ce8ae747205205d9917',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(317e369e-1e06-434d-ae95-a335f0e6c903),volume_type_id=317e369e-1e06-434d-ae95-a335f0e6c903)' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:52:40 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-aedd8d5a-a28d-435b-83bb-93513635c496 tempest-ProjectReaderTests-565908593 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ef239276-1fa9-4175-a094-f19a43c1e93c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:52:40 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-aedd8d5a-a28d-435b-83bb-93513635c496 tempest-ProjectReaderTests-565908593 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ef239276-1fa9-4175-a094-f19a43c1e93c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:52:40 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-aedd8d5a-a28d-435b-83bb-93513635c496 tempest-ProjectReaderTests-565908593 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (38286f86-f37e-4a4f-9f9a-c3048801711d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:52:40 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-aedd8d5a-a28d-435b-83bb-93513635c496 tempest-ProjectReaderTests-565908593 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (38286f86-f37e-4a4f-9f9a-c3048801711d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '56d36f36-61bb-4582-9a6a-f64728f0729c', 'volume_name': 'volume-56d36f36-61bb-4582-9a6a-f64728f0729c', 'volume_size': 1}' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:52:40 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-aedd8d5a-a28d-435b-83bb-93513635c496 tempest-ProjectReaderTests-565908593 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dea410dc-b7fc-438b-9191-23ee45a2bf70) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:52:40 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-aedd8d5a-a28d-435b-83bb-93513635c496 tempest-ProjectReaderTests-565908593 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dea410dc-b7fc-438b-9191-23ee45a2bf70) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:52:40 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-aedd8d5a-a28d-435b-83bb-93513635c496 tempest-ProjectReaderTests-565908593 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7b83b1f5-cf0a-44f5-a056-07cf79672d0f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:52:40 devstack cinder-volume[87444]: INFO cinder.volume.flows.manager.create_volume [None req-aedd8d5a-a28d-435b-83bb-93513635c496 tempest-ProjectReaderTests-565908593 None] Volume 56d36f36-61bb-4582-9a6a-f64728f0729c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-56d36f36-61bb-4582-9a6a-f64728f0729c', 'volume_size': 1} Jul 10 04:52:40 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-aedd8d5a-a28d-435b-83bb-93513635c496 tempest-ProjectReaderTests-565908593 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 04:52:40 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-aedd8d5a-a28d-435b-83bb-93513635c496 tempest-ProjectReaderTests-565908593 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 04:52:40 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-aedd8d5a-a28d-435b-83bb-93513635c496 tempest-ProjectReaderTests-565908593 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T02:52:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1326373507',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=56d36f36-61bb-4582-9a6a-f64728f0729c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='66a9d00c4b114acda7ea5957fbe4f7aa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T02:52:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T02:52:41Z,use_quota=True,user_id='be866b07a7ac4ce8ae747205205d9917',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(317e369e-1e06-434d-ae95-a335f0e6c903),volume_type_id=317e369e-1e06-434d-ae95-a335f0e6c903)}" {{(pid=87444) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 04:52:40 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.remotefs [None req-aedd8d5a-a28d-435b-83bb-93513635c496 tempest-ProjectReaderTests-565908593 None] Creating volume 56d36f36-61bb-4582-9a6a-f64728f0729c {{(pid=87444) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 04:52:40 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-aedd8d5a-a28d-435b-83bb-93513635c496 tempest-ProjectReaderTests-565908593 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 04:52:40 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-aedd8d5a-a28d-435b-83bb-93513635c496 tempest-ProjectReaderTests-565908593 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 04:52:40 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-aedd8d5a-a28d-435b-83bb-93513635c496 tempest-ProjectReaderTests-565908593 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922': None} {{(pid=87444) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 04:52:40 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-aedd8d5a-a28d-435b-83bb-93513635c496 tempest-ProjectReaderTests-565908593 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922'] {{(pid=87444) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 04:52:40 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-aedd8d5a-a28d-435b-83bb-93513635c496 tempest-ProjectReaderTests-565908593 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 04:52:40 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-aedd8d5a-a28d-435b-83bb-93513635c496 tempest-ProjectReaderTests-565908593 None] Selected osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922 as target Quobyte volume. {{(pid=87444) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 04:52:40 devstack cinder-volume[87444]: INFO cinder.volume.drivers.remotefs [None req-aedd8d5a-a28d-435b-83bb-93513635c496 tempest-ProjectReaderTests-565908593 None] casted to osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922 Jul 10 04:52:40 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-aedd8d5a-a28d-435b-83bb-93513635c496 tempest-ProjectReaderTests-565908593 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-56d36f36-61bb-4582-9a6a-f64728f0729c 1073741824 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:52:40 devstack sudo[104934]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-56d36f36-61bb-4582-9a6a-f64728f0729c 1073741824 Jul 10 04:52:40 devstack sudo[104934]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:52:41 devstack sudo[104934]: pam_unix(sudo:session): session closed for user root Jul 10 04:52:41 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-aedd8d5a-a28d-435b-83bb-93513635c496 tempest-ProjectReaderTests-565908593 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-56d36f36-61bb-4582-9a6a-f64728f0729c 1073741824" returned: 0 in 0.853s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:52:41 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-aedd8d5a-a28d-435b-83bb-93513635c496 tempest-ProjectReaderTests-565908593 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-56d36f36-61bb-4582-9a6a-f64728f0729c {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:52:41 devstack sudo[104940]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-56d36f36-61bb-4582-9a6a-f64728f0729c Jul 10 04:52:41 devstack sudo[104940]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:52:42 devstack sudo[104940]: pam_unix(sudo:session): session closed for user root Jul 10 04:52:42 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-aedd8d5a-a28d-435b-83bb-93513635c496 tempest-ProjectReaderTests-565908593 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-56d36f36-61bb-4582-9a6a-f64728f0729c" returned: 0 in 0.638s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:52:42 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-aedd8d5a-a28d-435b-83bb-93513635c496 tempest-ProjectReaderTests-565908593 None] <== create_volume: return (1531ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922'} {{(pid=87444) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 04:52:42 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-aedd8d5a-a28d-435b-83bb-93513635c496 tempest-ProjectReaderTests-565908593 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.534s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 04:52:42 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-aedd8d5a-a28d-435b-83bb-93513635c496 tempest-ProjectReaderTests-565908593 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7b83b1f5-cf0a-44f5-a056-07cf79672d0f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-56d36f36-61bb-4582-9a6a-f64728f0729c', 'volume_size': 1}' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:52:42 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-aedd8d5a-a28d-435b-83bb-93513635c496 tempest-ProjectReaderTests-565908593 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aede0feb-2555-4f71-a10c-3cedd21ec61e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:52:42 devstack cinder-volume[87444]: INFO cinder.volume.flows.manager.create_volume [None req-aedd8d5a-a28d-435b-83bb-93513635c496 tempest-ProjectReaderTests-565908593 None] Volume volume-56d36f36-61bb-4582-9a6a-f64728f0729c (56d36f36-61bb-4582-9a6a-f64728f0729c): created successfully Jul 10 04:52:42 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-aedd8d5a-a28d-435b-83bb-93513635c496 tempest-ProjectReaderTests-565908593 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aede0feb-2555-4f71-a10c-3cedd21ec61e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:52:42 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-aedd8d5a-a28d-435b-83bb-93513635c496 tempest-ProjectReaderTests-565908593 None] Flow 'volume_create_manager' (566f049e-0c43-47b5-bb96-9b3fe50d22ea) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87444) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 04:52:42 devstack cinder-volume[87444]: INFO cinder.volume.manager [None req-aedd8d5a-a28d-435b-83bb-93513635c496 tempest-ProjectReaderTests-565908593 None] Created volume successfully. Jul 10 04:52:43 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-044ebb30-f183-4015-b471-6286e249ae1e tempest-ProjectReaderTests-565908593 None] Acquiring lock "cinder-56d36f36-61bb-4582-9a6a-f64728f0729c-delete_volume" by "delete_volume" {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 04:52:43 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-044ebb30-f183-4015-b471-6286e249ae1e tempest-ProjectReaderTests-565908593 None] Lock "cinder-56d36f36-61bb-4582-9a6a-f64728f0729c-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 04:52:43 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-044ebb30-f183-4015-b471-6286e249ae1e tempest-ProjectReaderTests-565908593 None] Acquiring lock "cinder-quobyte-56d36f36-61bb-4582-9a6a-f64728f0729c" by "delete_volume" {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 04:52:43 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-044ebb30-f183-4015-b471-6286e249ae1e tempest-ProjectReaderTests-565908593 None] Lock "cinder-quobyte-56d36f36-61bb-4582-9a6a-f64728f0729c" acquired by "delete_volume" :: waited 0.020s {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 04:52:43 devstack cinder-volume[87444]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c20ce66-ef3a-4f9b-a8aa-9fa2972c45a0]: (4, 'qcow2') {{(pid=88499) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 04:52:43 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-044ebb30-f183-4015-b471-6286e249ae1e tempest-ProjectReaderTests-565908593 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-56d36f36-61bb-4582-9a6a-f64728f0729c {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:52:43 devstack sudo[104943]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-56d36f36-61bb-4582-9a6a-f64728f0729c Jul 10 04:52:43 devstack sudo[104943]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:52:43 devstack sudo[104943]: pam_unix(sudo:session): session closed for user root Jul 10 04:52:43 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-044ebb30-f183-4015-b471-6286e249ae1e tempest-ProjectReaderTests-565908593 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-56d36f36-61bb-4582-9a6a-f64728f0729c" returned: 0 in 0.765s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:52:43 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-044ebb30-f183-4015-b471-6286e249ae1e tempest-ProjectReaderTests-565908593 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-56d36f36-61bb-4582-9a6a-f64728f0729c {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:52:43 devstack sudo[104950]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-56d36f36-61bb-4582-9a6a-f64728f0729c Jul 10 04:52:43 devstack sudo[104950]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:52:44 devstack sudo[104950]: pam_unix(sudo:session): session closed for user root Jul 10 04:52:44 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-044ebb30-f183-4015-b471-6286e249ae1e tempest-ProjectReaderTests-565908593 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-56d36f36-61bb-4582-9a6a-f64728f0729c" returned: 0 in 0.647s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:52:44 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-044ebb30-f183-4015-b471-6286e249ae1e tempest-ProjectReaderTests-565908593 None] Lock "cinder-quobyte-56d36f36-61bb-4582-9a6a-f64728f0729c" released by "delete_volume" :: held 1.456s {{(pid=87444) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 04:52:44 devstack cinder-volume[87444]: DEBUG dbcounter [-] [87444] Writing DB stats cinder:UPDATE=95,cinder:INSERT=24,cinder:DELETE=7,cinder:SELECT=61 {{(pid=87444) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 10 04:52:44 devstack cinder-volume[87444]: DEBUG dbcounter [-] [87444] Writing DB stats cinder:SELECT=74,cinder:UPDATE=83,cinder:INSERT=26,cinder:DELETE=9 {{(pid=87444) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 10 04:52:44 devstack cinder-volume[87444]: DEBUG cinder.quota [None req-044ebb30-f183-4015-b471-6286e249ae1e tempest-ProjectReaderTests-565908593 None] Created reservations ['5352a43c-5e5c-49e2-b7b6-c1a6c9adaf98', '1437f14f-0f84-4da6-ae85-5f91c83e5479', '71e8ddaf-213b-47a2-8f8f-28f5090a7882', '6c1d4461-f5f8-4c0f-84b7-5bb678d0e5b9'] {{(pid=87444) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 04:52:44 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-044ebb30-f183-4015-b471-6286e249ae1e tempest-ProjectReaderTests-565908593 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 04:52:44 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-044ebb30-f183-4015-b471-6286e249ae1e tempest-ProjectReaderTests-565908593 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 04:52:44 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-044ebb30-f183-4015-b471-6286e249ae1e tempest-ProjectReaderTests-565908593 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922': None} {{(pid=87444) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 04:52:44 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-044ebb30-f183-4015-b471-6286e249ae1e tempest-ProjectReaderTests-565908593 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922'] {{(pid=87444) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 04:52:44 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-044ebb30-f183-4015-b471-6286e249ae1e tempest-ProjectReaderTests-565908593 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 04:52:44 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-044ebb30-f183-4015-b471-6286e249ae1e tempest-ProjectReaderTests-565908593 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:52:44 devstack sudo[104953]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097 Jul 10 04:52:44 devstack sudo[104953]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:52:45 devstack sudo[104953]: pam_unix(sudo:session): session closed for user root Jul 10 04:52:45 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-044ebb30-f183-4015-b471-6286e249ae1e tempest-ProjectReaderTests-565908593 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097" returned: 0 in 0.652s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:52:45 devstack cinder-volume[87444]: DEBUG cinder.manager [None req-044ebb30-f183-4015-b471-6286e249ae1e tempest-ProjectReaderTests-565908593 None] Notifying Schedulers of capabilities ... {{(pid=87444) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 04:52:45 devstack cinder-volume[87444]: INFO cinder.volume.manager [None req-044ebb30-f183-4015-b471-6286e249ae1e tempest-ProjectReaderTests-565908593 None] Deleted volume successfully. Jul 10 04:52:45 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-044ebb30-f183-4015-b471-6286e249ae1e tempest-ProjectReaderTests-565908593 None] Lock "cinder-56d36f36-61bb-4582-9a6a-f64728f0729c-delete_volume" released by "delete_volume" :: held 2.313s {{(pid=87444) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 04:52:45 devstack cinder-volume[87444]: DEBUG cinder.volume.flows.manager.create_volume [None req-250f7b3d-f90d-427c-bb04-017c51b44add tempest-ProjectReaderTests-565908593 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87444) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 04:52:45 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-250f7b3d-f90d-427c-bb04-017c51b44add tempest-ProjectReaderTests-565908593 None] Flow 'volume_create_manager' (857c8692-2062-4e9a-8793-b83c95910176) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 04:52:45 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-250f7b3d-f90d-427c-bb04-017c51b44add tempest-ProjectReaderTests-565908593 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3f122c06-976b-42c1-afbb-1c8afc2f4f40) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:52:45 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-250f7b3d-f90d-427c-bb04-017c51b44add tempest-ProjectReaderTests-565908593 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3f122c06-976b-42c1-afbb-1c8afc2f4f40) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T02:52:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1278945244',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bdf2cb09-016f-451d-b2ce-c897565ad4b7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='66a9d00c4b114acda7ea5957fbe4f7aa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T02:52:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T02:52:46Z,use_quota=True,user_id='be866b07a7ac4ce8ae747205205d9917',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(317e369e-1e06-434d-ae95-a335f0e6c903),volume_type_id=317e369e-1e06-434d-ae95-a335f0e6c903)' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:52:45 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-250f7b3d-f90d-427c-bb04-017c51b44add tempest-ProjectReaderTests-565908593 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (757e7dd5-8394-4f7e-b68b-9474220f52a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:52:45 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-250f7b3d-f90d-427c-bb04-017c51b44add tempest-ProjectReaderTests-565908593 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (757e7dd5-8394-4f7e-b68b-9474220f52a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:52:45 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-250f7b3d-f90d-427c-bb04-017c51b44add tempest-ProjectReaderTests-565908593 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eacb463a-8128-4c07-9477-604b28cd3b83) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:52:45 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-250f7b3d-f90d-427c-bb04-017c51b44add tempest-ProjectReaderTests-565908593 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eacb463a-8128-4c07-9477-604b28cd3b83) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bdf2cb09-016f-451d-b2ce-c897565ad4b7', 'volume_name': 'volume-bdf2cb09-016f-451d-b2ce-c897565ad4b7', 'volume_size': 1}' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:52:45 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-250f7b3d-f90d-427c-bb04-017c51b44add tempest-ProjectReaderTests-565908593 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (776c10b6-3506-4cd8-b89b-bd906becd395) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:52:45 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-250f7b3d-f90d-427c-bb04-017c51b44add tempest-ProjectReaderTests-565908593 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (776c10b6-3506-4cd8-b89b-bd906becd395) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:52:45 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-250f7b3d-f90d-427c-bb04-017c51b44add tempest-ProjectReaderTests-565908593 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5c29662f-4ee4-4ad0-b190-041c9619591b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:52:45 devstack cinder-volume[87444]: INFO cinder.volume.flows.manager.create_volume [None req-250f7b3d-f90d-427c-bb04-017c51b44add tempest-ProjectReaderTests-565908593 None] Volume bdf2cb09-016f-451d-b2ce-c897565ad4b7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bdf2cb09-016f-451d-b2ce-c897565ad4b7', 'volume_size': 1} Jul 10 04:52:45 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-250f7b3d-f90d-427c-bb04-017c51b44add tempest-ProjectReaderTests-565908593 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 04:52:45 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-250f7b3d-f90d-427c-bb04-017c51b44add tempest-ProjectReaderTests-565908593 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 04:52:45 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-250f7b3d-f90d-427c-bb04-017c51b44add tempest-ProjectReaderTests-565908593 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T02:52:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1278945244',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bdf2cb09-016f-451d-b2ce-c897565ad4b7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='66a9d00c4b114acda7ea5957fbe4f7aa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T02:52:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T02:52:46Z,use_quota=True,user_id='be866b07a7ac4ce8ae747205205d9917',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(317e369e-1e06-434d-ae95-a335f0e6c903),volume_type_id=317e369e-1e06-434d-ae95-a335f0e6c903)}" {{(pid=87444) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 04:52:45 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.remotefs [None req-250f7b3d-f90d-427c-bb04-017c51b44add tempest-ProjectReaderTests-565908593 None] Creating volume bdf2cb09-016f-451d-b2ce-c897565ad4b7 {{(pid=87444) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 04:52:45 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-250f7b3d-f90d-427c-bb04-017c51b44add tempest-ProjectReaderTests-565908593 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 04:52:45 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-250f7b3d-f90d-427c-bb04-017c51b44add tempest-ProjectReaderTests-565908593 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 04:52:45 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-250f7b3d-f90d-427c-bb04-017c51b44add tempest-ProjectReaderTests-565908593 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922': None} {{(pid=87444) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 04:52:45 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-250f7b3d-f90d-427c-bb04-017c51b44add tempest-ProjectReaderTests-565908593 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922'] {{(pid=87444) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 04:52:45 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-250f7b3d-f90d-427c-bb04-017c51b44add tempest-ProjectReaderTests-565908593 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 04:52:45 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-250f7b3d-f90d-427c-bb04-017c51b44add tempest-ProjectReaderTests-565908593 None] Selected osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922 as target Quobyte volume. {{(pid=87444) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 04:52:45 devstack cinder-volume[87444]: INFO cinder.volume.drivers.remotefs [None req-250f7b3d-f90d-427c-bb04-017c51b44add tempest-ProjectReaderTests-565908593 None] casted to osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922 Jul 10 04:52:45 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-250f7b3d-f90d-427c-bb04-017c51b44add tempest-ProjectReaderTests-565908593 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-bdf2cb09-016f-451d-b2ce-c897565ad4b7 1073741824 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:52:45 devstack sudo[104956]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-bdf2cb09-016f-451d-b2ce-c897565ad4b7 1073741824 Jul 10 04:52:45 devstack sudo[104956]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:52:46 devstack sudo[104956]: pam_unix(sudo:session): session closed for user root Jul 10 04:52:46 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-250f7b3d-f90d-427c-bb04-017c51b44add tempest-ProjectReaderTests-565908593 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-bdf2cb09-016f-451d-b2ce-c897565ad4b7 1073741824" returned: 0 in 0.813s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:52:46 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-250f7b3d-f90d-427c-bb04-017c51b44add tempest-ProjectReaderTests-565908593 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-bdf2cb09-016f-451d-b2ce-c897565ad4b7 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:52:46 devstack sudo[104968]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-bdf2cb09-016f-451d-b2ce-c897565ad4b7 Jul 10 04:52:46 devstack sudo[104968]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:52:47 devstack sudo[104968]: pam_unix(sudo:session): session closed for user root Jul 10 04:52:47 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-250f7b3d-f90d-427c-bb04-017c51b44add tempest-ProjectReaderTests-565908593 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-bdf2cb09-016f-451d-b2ce-c897565ad4b7" returned: 0 in 0.646s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:52:47 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-250f7b3d-f90d-427c-bb04-017c51b44add tempest-ProjectReaderTests-565908593 None] <== create_volume: return (1500ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922'} {{(pid=87444) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 04:52:47 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-250f7b3d-f90d-427c-bb04-017c51b44add tempest-ProjectReaderTests-565908593 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.502s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 04:52:47 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-250f7b3d-f90d-427c-bb04-017c51b44add tempest-ProjectReaderTests-565908593 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5c29662f-4ee4-4ad0-b190-041c9619591b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bdf2cb09-016f-451d-b2ce-c897565ad4b7', 'volume_size': 1}' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:52:47 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-250f7b3d-f90d-427c-bb04-017c51b44add tempest-ProjectReaderTests-565908593 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3279e9e2-5ac3-4a20-9bbc-108c57e0b276) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:52:47 devstack cinder-volume[87444]: INFO cinder.volume.flows.manager.create_volume [None req-250f7b3d-f90d-427c-bb04-017c51b44add tempest-ProjectReaderTests-565908593 None] Volume volume-bdf2cb09-016f-451d-b2ce-c897565ad4b7 (bdf2cb09-016f-451d-b2ce-c897565ad4b7): created successfully Jul 10 04:52:47 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-250f7b3d-f90d-427c-bb04-017c51b44add tempest-ProjectReaderTests-565908593 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3279e9e2-5ac3-4a20-9bbc-108c57e0b276) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:52:47 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-250f7b3d-f90d-427c-bb04-017c51b44add tempest-ProjectReaderTests-565908593 None] Flow 'volume_create_manager' (857c8692-2062-4e9a-8793-b83c95910176) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87444) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 04:52:47 devstack cinder-volume[87444]: INFO cinder.volume.manager [None req-250f7b3d-f90d-427c-bb04-017c51b44add tempest-ProjectReaderTests-565908593 None] Created volume successfully. Jul 10 04:52:47 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-d0b5ea36-9511-40ce-93d1-b130a6dfc755 tempest-ProjectReaderTests-565908593 None] Acquiring lock "cinder-bdf2cb09-016f-451d-b2ce-c897565ad4b7-delete_volume" by "delete_volume" {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 04:52:47 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-d0b5ea36-9511-40ce-93d1-b130a6dfc755 tempest-ProjectReaderTests-565908593 None] Lock "cinder-bdf2cb09-016f-451d-b2ce-c897565ad4b7-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 04:52:47 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-d0b5ea36-9511-40ce-93d1-b130a6dfc755 tempest-ProjectReaderTests-565908593 None] Acquiring lock "cinder-quobyte-bdf2cb09-016f-451d-b2ce-c897565ad4b7" by "delete_volume" {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 04:52:47 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-d0b5ea36-9511-40ce-93d1-b130a6dfc755 tempest-ProjectReaderTests-565908593 None] Lock "cinder-quobyte-bdf2cb09-016f-451d-b2ce-c897565ad4b7" acquired by "delete_volume" :: waited 0.016s {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 04:52:47 devstack cinder-volume[87444]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f1f6a90-6dc0-4e1c-b3a2-0deeb000a3f6]: (4, 'qcow2') {{(pid=88499) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 04:52:47 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-d0b5ea36-9511-40ce-93d1-b130a6dfc755 tempest-ProjectReaderTests-565908593 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-bdf2cb09-016f-451d-b2ce-c897565ad4b7 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:52:48 devstack sudo[104971]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-bdf2cb09-016f-451d-b2ce-c897565ad4b7 Jul 10 04:52:48 devstack sudo[104971]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:52:48 devstack sudo[104971]: pam_unix(sudo:session): session closed for user root Jul 10 04:52:48 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-d0b5ea36-9511-40ce-93d1-b130a6dfc755 tempest-ProjectReaderTests-565908593 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-bdf2cb09-016f-451d-b2ce-c897565ad4b7" returned: 0 in 0.735s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:52:48 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-d0b5ea36-9511-40ce-93d1-b130a6dfc755 tempest-ProjectReaderTests-565908593 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-bdf2cb09-016f-451d-b2ce-c897565ad4b7 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:52:48 devstack sudo[104977]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-bdf2cb09-016f-451d-b2ce-c897565ad4b7 Jul 10 04:52:48 devstack sudo[104977]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:52:49 devstack sudo[104977]: pam_unix(sudo:session): session closed for user root Jul 10 04:52:49 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-d0b5ea36-9511-40ce-93d1-b130a6dfc755 tempest-ProjectReaderTests-565908593 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-bdf2cb09-016f-451d-b2ce-c897565ad4b7" returned: 0 in 0.633s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:52:49 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-d0b5ea36-9511-40ce-93d1-b130a6dfc755 tempest-ProjectReaderTests-565908593 None] Lock "cinder-quobyte-bdf2cb09-016f-451d-b2ce-c897565ad4b7" released by "delete_volume" :: held 1.409s {{(pid=87444) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 04:52:49 devstack cinder-volume[87444]: DEBUG cinder.quota [None req-d0b5ea36-9511-40ce-93d1-b130a6dfc755 tempest-ProjectReaderTests-565908593 None] Created reservations ['2086439c-3bfb-4133-a395-01b0578f172b', 'bb25c66c-d989-4f85-95d5-f9a457127c26', '59ac061f-d0ec-441b-925f-4c9bc2874718', '34b564a4-610c-44a1-8229-012f4391672f'] {{(pid=87444) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 04:52:49 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-d0b5ea36-9511-40ce-93d1-b130a6dfc755 tempest-ProjectReaderTests-565908593 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 04:52:49 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-d0b5ea36-9511-40ce-93d1-b130a6dfc755 tempest-ProjectReaderTests-565908593 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 04:52:49 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-d0b5ea36-9511-40ce-93d1-b130a6dfc755 tempest-ProjectReaderTests-565908593 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922': None} {{(pid=87444) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 04:52:49 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-d0b5ea36-9511-40ce-93d1-b130a6dfc755 tempest-ProjectReaderTests-565908593 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922'] {{(pid=87444) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 04:52:49 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-d0b5ea36-9511-40ce-93d1-b130a6dfc755 tempest-ProjectReaderTests-565908593 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 04:52:49 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-d0b5ea36-9511-40ce-93d1-b130a6dfc755 tempest-ProjectReaderTests-565908593 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:52:49 devstack sudo[104980]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097 Jul 10 04:52:49 devstack sudo[104980]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:52:50 devstack sudo[104980]: pam_unix(sudo:session): session closed for user root Jul 10 04:52:50 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-d0b5ea36-9511-40ce-93d1-b130a6dfc755 tempest-ProjectReaderTests-565908593 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097" returned: 0 in 0.628s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:52:50 devstack cinder-volume[87444]: DEBUG cinder.manager [None req-d0b5ea36-9511-40ce-93d1-b130a6dfc755 tempest-ProjectReaderTests-565908593 None] Notifying Schedulers of capabilities ... {{(pid=87444) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 04:52:50 devstack cinder-volume[87444]: INFO cinder.volume.manager [None req-d0b5ea36-9511-40ce-93d1-b130a6dfc755 tempest-ProjectReaderTests-565908593 None] Deleted volume successfully. Jul 10 04:52:50 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-d0b5ea36-9511-40ce-93d1-b130a6dfc755 tempest-ProjectReaderTests-565908593 None] Lock "cinder-bdf2cb09-016f-451d-b2ce-c897565ad4b7-delete_volume" released by "delete_volume" :: held 2.217s {{(pid=87444) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 04:52:59 devstack cinder-volume[87444]: DEBUG dbcounter [-] [87444] Writing DB stats cinder:SELECT=12,cinder:INSERT=5,cinder:UPDATE=16,cinder:DELETE=1 {{(pid=87444) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 10 04:53:00 devstack cinder-volume[87444]: DEBUG dbcounter [-] [87444] Writing DB stats cinder:INSERT=4,cinder:UPDATE=21,cinder:SELECT=8,cinder:DELETE=2 {{(pid=87444) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 10 04:53:06 devstack cinder-volume[87444]: DEBUG cinder.volume.flows.manager.create_volume [None req-2db7ac66-865e-43af-852b-5a069548c2ac tempest-CreateVolumesFromSourceVolumeTest-476912221 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87444) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 04:53:06 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-2db7ac66-865e-43af-852b-5a069548c2ac tempest-CreateVolumesFromSourceVolumeTest-476912221 None] Flow 'volume_create_manager' (6a661a18-949c-4796-9d07-a38d6ac3b65d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 04:53:06 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-2db7ac66-865e-43af-852b-5a069548c2ac tempest-CreateVolumesFromSourceVolumeTest-476912221 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7ddc40ed-9712-4278-ab20-8d1ace6c2641) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:53:06 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-2db7ac66-865e-43af-852b-5a069548c2ac tempest-CreateVolumesFromSourceVolumeTest-476912221 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7ddc40ed-9712-4278-ab20-8d1ace6c2641) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T02:53:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-47350960',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7ab773a3-2f42-432c-9479-fce0440f9c92,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5875dfdbb91249d4ab2dac0b694d375a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T02:53:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T02:53:06Z,use_quota=True,user_id='9f2d5539942c4adab93ad80cee4d06f1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(317e369e-1e06-434d-ae95-a335f0e6c903),volume_type_id=317e369e-1e06-434d-ae95-a335f0e6c903)' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:53:06 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-2db7ac66-865e-43af-852b-5a069548c2ac tempest-CreateVolumesFromSourceVolumeTest-476912221 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6f77a873-0fc1-4949-a3e5-052403c3d1e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:53:06 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-2db7ac66-865e-43af-852b-5a069548c2ac tempest-CreateVolumesFromSourceVolumeTest-476912221 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6f77a873-0fc1-4949-a3e5-052403c3d1e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:53:06 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-2db7ac66-865e-43af-852b-5a069548c2ac tempest-CreateVolumesFromSourceVolumeTest-476912221 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9d981592-fd5b-497f-9bb8-2070a452e040) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:53:06 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-2db7ac66-865e-43af-852b-5a069548c2ac tempest-CreateVolumesFromSourceVolumeTest-476912221 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9d981592-fd5b-497f-9bb8-2070a452e040) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7ab773a3-2f42-432c-9479-fce0440f9c92', 'volume_name': 'volume-7ab773a3-2f42-432c-9479-fce0440f9c92', 'volume_size': 1}' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:53:06 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-2db7ac66-865e-43af-852b-5a069548c2ac tempest-CreateVolumesFromSourceVolumeTest-476912221 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dc994b7e-7625-43be-a2b3-7f0b75260156) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:53:06 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-2db7ac66-865e-43af-852b-5a069548c2ac tempest-CreateVolumesFromSourceVolumeTest-476912221 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dc994b7e-7625-43be-a2b3-7f0b75260156) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:53:06 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-2db7ac66-865e-43af-852b-5a069548c2ac tempest-CreateVolumesFromSourceVolumeTest-476912221 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ad361726-c926-42d0-ba84-fc87d0b8857d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:53:06 devstack cinder-volume[87444]: INFO cinder.volume.flows.manager.create_volume [None req-2db7ac66-865e-43af-852b-5a069548c2ac tempest-CreateVolumesFromSourceVolumeTest-476912221 None] Volume 7ab773a3-2f42-432c-9479-fce0440f9c92: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7ab773a3-2f42-432c-9479-fce0440f9c92', 'volume_size': 1} Jul 10 04:53:06 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-2db7ac66-865e-43af-852b-5a069548c2ac tempest-CreateVolumesFromSourceVolumeTest-476912221 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 04:53:06 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-2db7ac66-865e-43af-852b-5a069548c2ac tempest-CreateVolumesFromSourceVolumeTest-476912221 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 04:53:06 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-2db7ac66-865e-43af-852b-5a069548c2ac tempest-CreateVolumesFromSourceVolumeTest-476912221 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T02:53:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-47350960',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7ab773a3-2f42-432c-9479-fce0440f9c92,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5875dfdbb91249d4ab2dac0b694d375a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T02:53:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T02:53:06Z,use_quota=True,user_id='9f2d5539942c4adab93ad80cee4d06f1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(317e369e-1e06-434d-ae95-a335f0e6c903),volume_type_id=317e369e-1e06-434d-ae95-a335f0e6c903)}" {{(pid=87444) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 04:53:06 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.remotefs [None req-2db7ac66-865e-43af-852b-5a069548c2ac tempest-CreateVolumesFromSourceVolumeTest-476912221 None] Creating volume 7ab773a3-2f42-432c-9479-fce0440f9c92 {{(pid=87444) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 04:53:06 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-2db7ac66-865e-43af-852b-5a069548c2ac tempest-CreateVolumesFromSourceVolumeTest-476912221 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 04:53:06 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-2db7ac66-865e-43af-852b-5a069548c2ac tempest-CreateVolumesFromSourceVolumeTest-476912221 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 04:53:06 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-2db7ac66-865e-43af-852b-5a069548c2ac tempest-CreateVolumesFromSourceVolumeTest-476912221 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922': None} {{(pid=87444) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 04:53:06 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-2db7ac66-865e-43af-852b-5a069548c2ac tempest-CreateVolumesFromSourceVolumeTest-476912221 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922'] {{(pid=87444) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 04:53:06 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-2db7ac66-865e-43af-852b-5a069548c2ac tempest-CreateVolumesFromSourceVolumeTest-476912221 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 04:53:06 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-2db7ac66-865e-43af-852b-5a069548c2ac tempest-CreateVolumesFromSourceVolumeTest-476912221 None] Selected osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922 as target Quobyte volume. {{(pid=87444) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 04:53:06 devstack cinder-volume[87444]: INFO cinder.volume.drivers.remotefs [None req-2db7ac66-865e-43af-852b-5a069548c2ac tempest-CreateVolumesFromSourceVolumeTest-476912221 None] casted to osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922 Jul 10 04:53:06 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-2db7ac66-865e-43af-852b-5a069548c2ac tempest-CreateVolumesFromSourceVolumeTest-476912221 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-7ab773a3-2f42-432c-9479-fce0440f9c92 1073741824 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:53:06 devstack cinder-volume[87444]: DEBUG cinder.volume.flows.manager.create_volume [None req-a4d09549-6a5c-427e-ada4-9bae0b378d68 tempest-CreateVolumesFromImageTest-1512620421 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87444) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 04:53:06 devstack sudo[105025]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-7ab773a3-2f42-432c-9479-fce0440f9c92 1073741824 Jul 10 04:53:06 devstack sudo[105025]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:53:06 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-a4d09549-6a5c-427e-ada4-9bae0b378d68 tempest-CreateVolumesFromImageTest-1512620421 None] Flow 'volume_create_manager' (f0511210-4484-43d4-a126-7f4c0398d1a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 04:53:06 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-a4d09549-6a5c-427e-ada4-9bae0b378d68 tempest-CreateVolumesFromImageTest-1512620421 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1ccb3c2e-6cb9-46a3-ba32-d5f19fe43f09) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:53:06 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-a4d09549-6a5c-427e-ada4-9bae0b378d68 tempest-CreateVolumesFromImageTest-1512620421 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1ccb3c2e-6cb9-46a3-ba32-d5f19fe43f09) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T02:53:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-65741829',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f7a59dd7-0999-4825-9a20-2184874a4250,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a2aef7a9504e4d66a472507f396bbe04',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T02:53:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T02:53:06Z,use_quota=True,user_id='e35b1c2e624d4f30a4746991187915d4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(317e369e-1e06-434d-ae95-a335f0e6c903),volume_type_id=317e369e-1e06-434d-ae95-a335f0e6c903)' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:53:06 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-a4d09549-6a5c-427e-ada4-9bae0b378d68 tempest-CreateVolumesFromImageTest-1512620421 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (50598027-dad7-4c3a-9afd-8dd84c1c8841) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:53:06 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-a4d09549-6a5c-427e-ada4-9bae0b378d68 tempest-CreateVolumesFromImageTest-1512620421 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (50598027-dad7-4c3a-9afd-8dd84c1c8841) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:53:06 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-a4d09549-6a5c-427e-ada4-9bae0b378d68 tempest-CreateVolumesFromImageTest-1512620421 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b378598d-e8b4-45c9-85b7-e5ae91386938) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:53:06 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-a4d09549-6a5c-427e-ada4-9bae0b378d68 tempest-CreateVolumesFromImageTest-1512620421 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b378598d-e8b4-45c9-85b7-e5ae91386938) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f7a59dd7-0999-4825-9a20-2184874a4250', 'volume_name': 'volume-f7a59dd7-0999-4825-9a20-2184874a4250', 'volume_size': 1}' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:53:06 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-a4d09549-6a5c-427e-ada4-9bae0b378d68 tempest-CreateVolumesFromImageTest-1512620421 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1805a781-9111-4b39-a33b-3cf1b332ecaf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:53:06 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-a4d09549-6a5c-427e-ada4-9bae0b378d68 tempest-CreateVolumesFromImageTest-1512620421 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1805a781-9111-4b39-a33b-3cf1b332ecaf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:53:06 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-a4d09549-6a5c-427e-ada4-9bae0b378d68 tempest-CreateVolumesFromImageTest-1512620421 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (36ffb46d-63cf-4b55-af93-3f7c9bf180b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:53:06 devstack cinder-volume[87444]: INFO cinder.volume.flows.manager.create_volume [None req-a4d09549-6a5c-427e-ada4-9bae0b378d68 tempest-CreateVolumesFromImageTest-1512620421 None] Volume f7a59dd7-0999-4825-9a20-2184874a4250: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f7a59dd7-0999-4825-9a20-2184874a4250', 'volume_size': 1} Jul 10 04:53:06 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-a4d09549-6a5c-427e-ada4-9bae0b378d68 tempest-CreateVolumesFromImageTest-1512620421 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 04:53:06 devstack cinder-volume[87444]: DEBUG cinder.volume.flows.manager.create_volume [None req-2aafbd2b-775e-4333-9c58-4d65bed8bc20 tempest-CreateVolumesFromImageTest-1512620421 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87444) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 04:53:06 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-2aafbd2b-775e-4333-9c58-4d65bed8bc20 tempest-CreateVolumesFromImageTest-1512620421 None] Flow 'volume_create_manager' (92654a2e-5287-4f1e-b5a2-48c1a74010d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 04:53:06 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-2aafbd2b-775e-4333-9c58-4d65bed8bc20 tempest-CreateVolumesFromImageTest-1512620421 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (467254e7-9812-4e52-a10f-14effd78cc6d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:53:06 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-2aafbd2b-775e-4333-9c58-4d65bed8bc20 tempest-CreateVolumesFromImageTest-1512620421 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (467254e7-9812-4e52-a10f-14effd78cc6d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T02:53:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1531984214',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d05e8536-35ba-463c-820a-8eeebc0fa9cc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a2aef7a9504e4d66a472507f396bbe04',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T02:53:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T02:53:07Z,use_quota=True,user_id='e35b1c2e624d4f30a4746991187915d4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(317e369e-1e06-434d-ae95-a335f0e6c903),volume_type_id=317e369e-1e06-434d-ae95-a335f0e6c903)' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:53:06 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-2aafbd2b-775e-4333-9c58-4d65bed8bc20 tempest-CreateVolumesFromImageTest-1512620421 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e0ac89e8-e6ad-47fb-ac60-065fa3cbb9e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:53:06 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-2aafbd2b-775e-4333-9c58-4d65bed8bc20 tempest-CreateVolumesFromImageTest-1512620421 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e0ac89e8-e6ad-47fb-ac60-065fa3cbb9e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:53:06 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-2aafbd2b-775e-4333-9c58-4d65bed8bc20 tempest-CreateVolumesFromImageTest-1512620421 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (94e19d1e-8e85-413f-8125-4bb374a1c61e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:53:06 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-2aafbd2b-775e-4333-9c58-4d65bed8bc20 tempest-CreateVolumesFromImageTest-1512620421 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (94e19d1e-8e85-413f-8125-4bb374a1c61e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd05e8536-35ba-463c-820a-8eeebc0fa9cc', 'volume_name': 'volume-d05e8536-35ba-463c-820a-8eeebc0fa9cc', 'volume_size': 1}' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:53:06 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-2aafbd2b-775e-4333-9c58-4d65bed8bc20 tempest-CreateVolumesFromImageTest-1512620421 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d83a5942-c037-4f01-987e-959b055949fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:53:06 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-2aafbd2b-775e-4333-9c58-4d65bed8bc20 tempest-CreateVolumesFromImageTest-1512620421 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d83a5942-c037-4f01-987e-959b055949fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:53:06 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-2aafbd2b-775e-4333-9c58-4d65bed8bc20 tempest-CreateVolumesFromImageTest-1512620421 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6d7f782e-d61a-40cb-9f10-d62e73434dcf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:53:06 devstack cinder-volume[87444]: INFO cinder.volume.flows.manager.create_volume [None req-2aafbd2b-775e-4333-9c58-4d65bed8bc20 tempest-CreateVolumesFromImageTest-1512620421 None] Volume d05e8536-35ba-463c-820a-8eeebc0fa9cc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d05e8536-35ba-463c-820a-8eeebc0fa9cc', 'volume_size': 1} Jul 10 04:53:06 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-2aafbd2b-775e-4333-9c58-4d65bed8bc20 tempest-CreateVolumesFromImageTest-1512620421 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 04:53:07 devstack cinder-volume[87444]: DEBUG cinder.volume.flows.manager.create_volume [None req-b966752f-2728-4d45-a866-4a166825edaa tempest-CreateVolumesFromSnapshotTest-1643372015 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87444) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 04:53:07 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-b966752f-2728-4d45-a866-4a166825edaa tempest-CreateVolumesFromSnapshotTest-1643372015 None] Flow 'volume_create_manager' (8f12264a-0b6b-4400-a441-7df4866f5e53) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 04:53:07 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-b966752f-2728-4d45-a866-4a166825edaa tempest-CreateVolumesFromSnapshotTest-1643372015 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8d94c60f-9b0a-4b56-9bf3-2360f9b8364c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:53:07 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-b966752f-2728-4d45-a866-4a166825edaa tempest-CreateVolumesFromSnapshotTest-1643372015 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8d94c60f-9b0a-4b56-9bf3-2360f9b8364c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T02:53:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-755763572',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6a52692c-d463-4776-aa0a-2fdfb275e2ef,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='eb19c0257a1a4527ad12a8fcf0b7404d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T02:53:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T02:53:07Z,use_quota=True,user_id='b3d05e57fb514af1a7774fbaec83fdec',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(317e369e-1e06-434d-ae95-a335f0e6c903),volume_type_id=317e369e-1e06-434d-ae95-a335f0e6c903)' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:53:07 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-b966752f-2728-4d45-a866-4a166825edaa tempest-CreateVolumesFromSnapshotTest-1643372015 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (68934134-c892-4d3e-9901-b1dc36e22be9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:53:07 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-b966752f-2728-4d45-a866-4a166825edaa tempest-CreateVolumesFromSnapshotTest-1643372015 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (68934134-c892-4d3e-9901-b1dc36e22be9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:53:07 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-b966752f-2728-4d45-a866-4a166825edaa tempest-CreateVolumesFromSnapshotTest-1643372015 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2f2494f2-ace9-4eb6-b42f-0f97f5dac849) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:53:07 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-b966752f-2728-4d45-a866-4a166825edaa tempest-CreateVolumesFromSnapshotTest-1643372015 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2f2494f2-ace9-4eb6-b42f-0f97f5dac849) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6a52692c-d463-4776-aa0a-2fdfb275e2ef', 'volume_name': 'volume-6a52692c-d463-4776-aa0a-2fdfb275e2ef', 'volume_size': 1}' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:53:07 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-b966752f-2728-4d45-a866-4a166825edaa tempest-CreateVolumesFromSnapshotTest-1643372015 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a4a78d6b-98c4-4a67-911a-6d834bc35e4b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:53:07 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-b966752f-2728-4d45-a866-4a166825edaa tempest-CreateVolumesFromSnapshotTest-1643372015 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a4a78d6b-98c4-4a67-911a-6d834bc35e4b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:53:07 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-b966752f-2728-4d45-a866-4a166825edaa tempest-CreateVolumesFromSnapshotTest-1643372015 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (527895eb-898d-4269-b00d-9283b8df295c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:53:07 devstack cinder-volume[87444]: INFO cinder.volume.flows.manager.create_volume [None req-b966752f-2728-4d45-a866-4a166825edaa tempest-CreateVolumesFromSnapshotTest-1643372015 None] Volume 6a52692c-d463-4776-aa0a-2fdfb275e2ef: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6a52692c-d463-4776-aa0a-2fdfb275e2ef', 'volume_size': 1} Jul 10 04:53:07 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-b966752f-2728-4d45-a866-4a166825edaa tempest-CreateVolumesFromSnapshotTest-1643372015 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 04:53:07 devstack cinder-volume[87444]: DEBUG cinder.volume.flows.manager.create_volume [None req-c0e7a747-c085-41c9-a39d-a4b15d1ada4f tempest-CreateVolumesFromImageTest-1512620421 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87444) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 04:53:07 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-c0e7a747-c085-41c9-a39d-a4b15d1ada4f tempest-CreateVolumesFromImageTest-1512620421 None] Flow 'volume_create_manager' (5bc20961-a7dc-4fd3-a469-d7fffd812007) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 04:53:07 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-c0e7a747-c085-41c9-a39d-a4b15d1ada4f tempest-CreateVolumesFromImageTest-1512620421 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f1297f6e-f672-4fef-ac13-e7f7f8e58946) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:53:07 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-c0e7a747-c085-41c9-a39d-a4b15d1ada4f tempest-CreateVolumesFromImageTest-1512620421 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f1297f6e-f672-4fef-ac13-e7f7f8e58946) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T02:53:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-817096861',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3df62cd2-4ea0-4528-a7bd-736121741f29,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a2aef7a9504e4d66a472507f396bbe04',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T02:53:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T02:53:07Z,use_quota=True,user_id='e35b1c2e624d4f30a4746991187915d4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(317e369e-1e06-434d-ae95-a335f0e6c903),volume_type_id=317e369e-1e06-434d-ae95-a335f0e6c903)' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:53:07 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-c0e7a747-c085-41c9-a39d-a4b15d1ada4f tempest-CreateVolumesFromImageTest-1512620421 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e394241d-cb46-48e7-9eaa-771fd91e4bef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:53:07 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-c0e7a747-c085-41c9-a39d-a4b15d1ada4f tempest-CreateVolumesFromImageTest-1512620421 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e394241d-cb46-48e7-9eaa-771fd91e4bef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:53:07 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-c0e7a747-c085-41c9-a39d-a4b15d1ada4f tempest-CreateVolumesFromImageTest-1512620421 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4ca16f04-c2f0-495b-8158-4cd72f35848c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:53:07 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-c0e7a747-c085-41c9-a39d-a4b15d1ada4f tempest-CreateVolumesFromImageTest-1512620421 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4ca16f04-c2f0-495b-8158-4cd72f35848c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3df62cd2-4ea0-4528-a7bd-736121741f29', 'volume_name': 'volume-3df62cd2-4ea0-4528-a7bd-736121741f29', 'volume_size': 1}' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:53:07 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-c0e7a747-c085-41c9-a39d-a4b15d1ada4f tempest-CreateVolumesFromImageTest-1512620421 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5b55d9be-e691-4977-b8ed-abbaeadc27ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:53:07 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-c0e7a747-c085-41c9-a39d-a4b15d1ada4f tempest-CreateVolumesFromImageTest-1512620421 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5b55d9be-e691-4977-b8ed-abbaeadc27ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:53:07 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-c0e7a747-c085-41c9-a39d-a4b15d1ada4f tempest-CreateVolumesFromImageTest-1512620421 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1ed0abd2-2ad0-41e1-bd71-eb713b0b0fad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:53:07 devstack cinder-volume[87444]: INFO cinder.volume.flows.manager.create_volume [None req-c0e7a747-c085-41c9-a39d-a4b15d1ada4f tempest-CreateVolumesFromImageTest-1512620421 None] Volume 3df62cd2-4ea0-4528-a7bd-736121741f29: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3df62cd2-4ea0-4528-a7bd-736121741f29', 'volume_size': 1} Jul 10 04:53:07 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-c0e7a747-c085-41c9-a39d-a4b15d1ada4f tempest-CreateVolumesFromImageTest-1512620421 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 04:53:07 devstack cinder-volume[87444]: DEBUG cinder.volume.flows.manager.create_volume [None req-82b411a2-3f66-48ef-8f4d-b8c080a2bf6f tempest-CreateVolumesFromImageTest-1512620421 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87444) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 04:53:07 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-82b411a2-3f66-48ef-8f4d-b8c080a2bf6f tempest-CreateVolumesFromImageTest-1512620421 None] Flow 'volume_create_manager' (2f85cbe0-9d68-438f-ba04-f0698bd7b16e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 04:53:07 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-82b411a2-3f66-48ef-8f4d-b8c080a2bf6f tempest-CreateVolumesFromImageTest-1512620421 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0b6e1bce-9f92-49d5-b061-e06c82ef01fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:53:07 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-82b411a2-3f66-48ef-8f4d-b8c080a2bf6f tempest-CreateVolumesFromImageTest-1512620421 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0b6e1bce-9f92-49d5-b061-e06c82ef01fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T02:53:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1137242240',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=37c5ed0d-7513-4a6e-9e78-be95fd22099f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a2aef7a9504e4d66a472507f396bbe04',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T02:53:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T02:53:08Z,use_quota=True,user_id='e35b1c2e624d4f30a4746991187915d4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(317e369e-1e06-434d-ae95-a335f0e6c903),volume_type_id=317e369e-1e06-434d-ae95-a335f0e6c903)' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:53:07 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-82b411a2-3f66-48ef-8f4d-b8c080a2bf6f tempest-CreateVolumesFromImageTest-1512620421 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ced904be-688d-4bc8-a444-2923748bb9c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:53:07 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-82b411a2-3f66-48ef-8f4d-b8c080a2bf6f tempest-CreateVolumesFromImageTest-1512620421 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ced904be-688d-4bc8-a444-2923748bb9c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:53:07 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-82b411a2-3f66-48ef-8f4d-b8c080a2bf6f tempest-CreateVolumesFromImageTest-1512620421 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cbb2ce37-6f2f-440a-8b02-6d6f17b1c82f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:53:07 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-82b411a2-3f66-48ef-8f4d-b8c080a2bf6f tempest-CreateVolumesFromImageTest-1512620421 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cbb2ce37-6f2f-440a-8b02-6d6f17b1c82f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '37c5ed0d-7513-4a6e-9e78-be95fd22099f', 'volume_name': 'volume-37c5ed0d-7513-4a6e-9e78-be95fd22099f', 'volume_size': 1}' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:53:07 devstack sudo[105025]: pam_unix(sudo:session): session closed for user root Jul 10 04:53:07 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-82b411a2-3f66-48ef-8f4d-b8c080a2bf6f tempest-CreateVolumesFromImageTest-1512620421 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9d6ffcfe-062d-40c1-ba22-5ff63b350391) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:53:07 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-82b411a2-3f66-48ef-8f4d-b8c080a2bf6f tempest-CreateVolumesFromImageTest-1512620421 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9d6ffcfe-062d-40c1-ba22-5ff63b350391) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:53:07 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-82b411a2-3f66-48ef-8f4d-b8c080a2bf6f tempest-CreateVolumesFromImageTest-1512620421 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ca6c5d71-2724-4393-a676-7ff891540fd6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:53:07 devstack cinder-volume[87444]: INFO cinder.volume.flows.manager.create_volume [None req-82b411a2-3f66-48ef-8f4d-b8c080a2bf6f tempest-CreateVolumesFromImageTest-1512620421 None] Volume 37c5ed0d-7513-4a6e-9e78-be95fd22099f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-37c5ed0d-7513-4a6e-9e78-be95fd22099f', 'volume_size': 1} Jul 10 04:53:07 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-82b411a2-3f66-48ef-8f4d-b8c080a2bf6f tempest-CreateVolumesFromImageTest-1512620421 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 04:53:07 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-2db7ac66-865e-43af-852b-5a069548c2ac tempest-CreateVolumesFromSourceVolumeTest-476912221 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-7ab773a3-2f42-432c-9479-fce0440f9c92 1073741824" returned: 0 in 1.339s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:53:07 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-2db7ac66-865e-43af-852b-5a069548c2ac tempest-CreateVolumesFromSourceVolumeTest-476912221 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-7ab773a3-2f42-432c-9479-fce0440f9c92 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:53:07 devstack sudo[105031]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-7ab773a3-2f42-432c-9479-fce0440f9c92 Jul 10 04:53:07 devstack sudo[105031]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:53:08 devstack cinder-volume[87444]: DEBUG cinder.volume.flows.manager.create_volume [None req-74a5ba6b-19cf-47df-912f-ec1d6a242e57 tempest-CreateVolumesFromImageTest-1512620421 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87444) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 04:53:08 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-74a5ba6b-19cf-47df-912f-ec1d6a242e57 tempest-CreateVolumesFromImageTest-1512620421 None] Flow 'volume_create_manager' (3955feba-2e11-4708-9689-af16b62a9cf9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 04:53:08 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-74a5ba6b-19cf-47df-912f-ec1d6a242e57 tempest-CreateVolumesFromImageTest-1512620421 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cbf7e001-c41c-4c97-8da9-80df4ffd07bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:53:08 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-74a5ba6b-19cf-47df-912f-ec1d6a242e57 tempest-CreateVolumesFromImageTest-1512620421 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cbf7e001-c41c-4c97-8da9-80df4ffd07bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T02:53:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-588137628',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=632fa08a-84bc-4075-8c5d-ffa519355541,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a2aef7a9504e4d66a472507f396bbe04',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T02:53:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T02:53:08Z,use_quota=True,user_id='e35b1c2e624d4f30a4746991187915d4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(317e369e-1e06-434d-ae95-a335f0e6c903),volume_type_id=317e369e-1e06-434d-ae95-a335f0e6c903)' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:53:08 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-74a5ba6b-19cf-47df-912f-ec1d6a242e57 tempest-CreateVolumesFromImageTest-1512620421 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bde891b9-39b7-43fc-a963-5a4b995408af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:53:08 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-74a5ba6b-19cf-47df-912f-ec1d6a242e57 tempest-CreateVolumesFromImageTest-1512620421 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bde891b9-39b7-43fc-a963-5a4b995408af) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:53:08 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-74a5ba6b-19cf-47df-912f-ec1d6a242e57 tempest-CreateVolumesFromImageTest-1512620421 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (227ad510-f985-470b-9f6d-58a1765f02c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:53:08 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-74a5ba6b-19cf-47df-912f-ec1d6a242e57 tempest-CreateVolumesFromImageTest-1512620421 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (227ad510-f985-470b-9f6d-58a1765f02c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '632fa08a-84bc-4075-8c5d-ffa519355541', 'volume_name': 'volume-632fa08a-84bc-4075-8c5d-ffa519355541', 'volume_size': 1}' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:53:08 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-74a5ba6b-19cf-47df-912f-ec1d6a242e57 tempest-CreateVolumesFromImageTest-1512620421 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (86313c2d-1bba-4e64-a7de-91e99541c80c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:53:08 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-74a5ba6b-19cf-47df-912f-ec1d6a242e57 tempest-CreateVolumesFromImageTest-1512620421 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (86313c2d-1bba-4e64-a7de-91e99541c80c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:53:08 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-74a5ba6b-19cf-47df-912f-ec1d6a242e57 tempest-CreateVolumesFromImageTest-1512620421 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (60fc99f6-fe22-4775-a1d1-1470a42f848b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:53:08 devstack cinder-volume[87444]: INFO cinder.volume.flows.manager.create_volume [None req-74a5ba6b-19cf-47df-912f-ec1d6a242e57 tempest-CreateVolumesFromImageTest-1512620421 None] Volume 632fa08a-84bc-4075-8c5d-ffa519355541: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-632fa08a-84bc-4075-8c5d-ffa519355541', 'volume_size': 1} Jul 10 04:53:08 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-74a5ba6b-19cf-47df-912f-ec1d6a242e57 tempest-CreateVolumesFromImageTest-1512620421 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 04:53:08 devstack sudo[105031]: pam_unix(sudo:session): session closed for user root Jul 10 04:53:08 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-2db7ac66-865e-43af-852b-5a069548c2ac tempest-CreateVolumesFromSourceVolumeTest-476912221 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-7ab773a3-2f42-432c-9479-fce0440f9c92" returned: 0 in 0.719s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:53:08 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-2db7ac66-865e-43af-852b-5a069548c2ac tempest-CreateVolumesFromSourceVolumeTest-476912221 None] <== create_volume: return (2128ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922'} {{(pid=87444) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 04:53:08 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-2db7ac66-865e-43af-852b-5a069548c2ac tempest-CreateVolumesFromSourceVolumeTest-476912221 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.132s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 04:53:08 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-a4d09549-6a5c-427e-ada4-9bae0b378d68 tempest-CreateVolumesFromImageTest-1512620421 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.003s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 04:53:08 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-a4d09549-6a5c-427e-ada4-9bae0b378d68 tempest-CreateVolumesFromImageTest-1512620421 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T02:53:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-65741829',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f7a59dd7-0999-4825-9a20-2184874a4250,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a2aef7a9504e4d66a472507f396bbe04',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T02:53:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T02:53:06Z,use_quota=True,user_id='e35b1c2e624d4f30a4746991187915d4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(317e369e-1e06-434d-ae95-a335f0e6c903),volume_type_id=317e369e-1e06-434d-ae95-a335f0e6c903)}" {{(pid=87444) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 04:53:08 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.remotefs [None req-a4d09549-6a5c-427e-ada4-9bae0b378d68 tempest-CreateVolumesFromImageTest-1512620421 None] Creating volume f7a59dd7-0999-4825-9a20-2184874a4250 {{(pid=87444) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 04:53:08 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-a4d09549-6a5c-427e-ada4-9bae0b378d68 tempest-CreateVolumesFromImageTest-1512620421 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 04:53:08 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-a4d09549-6a5c-427e-ada4-9bae0b378d68 tempest-CreateVolumesFromImageTest-1512620421 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 04:53:08 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-a4d09549-6a5c-427e-ada4-9bae0b378d68 tempest-CreateVolumesFromImageTest-1512620421 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922': None} {{(pid=87444) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 04:53:08 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-a4d09549-6a5c-427e-ada4-9bae0b378d68 tempest-CreateVolumesFromImageTest-1512620421 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922'] {{(pid=87444) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 04:53:08 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-a4d09549-6a5c-427e-ada4-9bae0b378d68 tempest-CreateVolumesFromImageTest-1512620421 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 04:53:08 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-a4d09549-6a5c-427e-ada4-9bae0b378d68 tempest-CreateVolumesFromImageTest-1512620421 None] Selected osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922 as target Quobyte volume. {{(pid=87444) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 04:53:08 devstack cinder-volume[87444]: INFO cinder.volume.drivers.remotefs [None req-a4d09549-6a5c-427e-ada4-9bae0b378d68 tempest-CreateVolumesFromImageTest-1512620421 None] casted to osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922 Jul 10 04:53:08 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-a4d09549-6a5c-427e-ada4-9bae0b378d68 tempest-CreateVolumesFromImageTest-1512620421 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-f7a59dd7-0999-4825-9a20-2184874a4250 1073741824 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:53:08 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-2db7ac66-865e-43af-852b-5a069548c2ac tempest-CreateVolumesFromSourceVolumeTest-476912221 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ad361726-c926-42d0-ba84-fc87d0b8857d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7ab773a3-2f42-432c-9479-fce0440f9c92', 'volume_size': 1}' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:53:08 devstack sudo[105034]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-f7a59dd7-0999-4825-9a20-2184874a4250 1073741824 Jul 10 04:53:08 devstack sudo[105034]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:53:08 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-2db7ac66-865e-43af-852b-5a069548c2ac tempest-CreateVolumesFromSourceVolumeTest-476912221 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (416c8233-d7f6-4a24-8917-aa50f13dfe2d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:53:08 devstack cinder-volume[87444]: INFO cinder.volume.flows.manager.create_volume [None req-2db7ac66-865e-43af-852b-5a069548c2ac tempest-CreateVolumesFromSourceVolumeTest-476912221 None] Volume volume-7ab773a3-2f42-432c-9479-fce0440f9c92 (7ab773a3-2f42-432c-9479-fce0440f9c92): created successfully Jul 10 04:53:08 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-2db7ac66-865e-43af-852b-5a069548c2ac tempest-CreateVolumesFromSourceVolumeTest-476912221 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (416c8233-d7f6-4a24-8917-aa50f13dfe2d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:53:08 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-2db7ac66-865e-43af-852b-5a069548c2ac tempest-CreateVolumesFromSourceVolumeTest-476912221 None] Flow 'volume_create_manager' (6a661a18-949c-4796-9d07-a38d6ac3b65d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87444) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 04:53:08 devstack cinder-volume[87444]: INFO cinder.volume.manager [None req-2db7ac66-865e-43af-852b-5a069548c2ac tempest-CreateVolumesFromSourceVolumeTest-476912221 None] Created volume successfully. Jul 10 04:53:09 devstack sudo[105034]: pam_unix(sudo:session): session closed for user root Jul 10 04:53:09 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-a4d09549-6a5c-427e-ada4-9bae0b378d68 tempest-CreateVolumesFromImageTest-1512620421 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-f7a59dd7-0999-4825-9a20-2184874a4250 1073741824" returned: 0 in 0.920s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:53:09 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-a4d09549-6a5c-427e-ada4-9bae0b378d68 tempest-CreateVolumesFromImageTest-1512620421 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-f7a59dd7-0999-4825-9a20-2184874a4250 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:53:09 devstack sudo[105039]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-f7a59dd7-0999-4825-9a20-2184874a4250 Jul 10 04:53:09 devstack sudo[105039]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:53:09 devstack cinder-volume[87444]: DEBUG cinder.volume.flows.manager.create_volume [None req-66fbd605-70e0-41b0-ab4e-e369fc08f434 tempest-CreateVolumesFromSourceVolumeTest-476912221 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87444) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 04:53:09 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-66fbd605-70e0-41b0-ab4e-e369fc08f434 tempest-CreateVolumesFromSourceVolumeTest-476912221 None] Flow 'volume_create_manager' (b27b5efe-1c87-4138-a64f-d0e96f9901cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 04:53:09 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-66fbd605-70e0-41b0-ab4e-e369fc08f434 tempest-CreateVolumesFromSourceVolumeTest-476912221 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (474f658b-ac04-4246-b081-ca87f5172629) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:53:09 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-66fbd605-70e0-41b0-ab4e-e369fc08f434 tempest-CreateVolumesFromSourceVolumeTest-476912221 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (474f658b-ac04-4246-b081-ca87f5172629) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T02:53:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1274680641',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4d92adfc-13a4-4a30-bc36-33ea181065b8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5875dfdbb91249d4ab2dac0b694d375a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T02:53:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T02:53:10Z,use_quota=True,user_id='9f2d5539942c4adab93ad80cee4d06f1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(317e369e-1e06-434d-ae95-a335f0e6c903),volume_type_id=317e369e-1e06-434d-ae95-a335f0e6c903)' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:53:09 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-66fbd605-70e0-41b0-ab4e-e369fc08f434 tempest-CreateVolumesFromSourceVolumeTest-476912221 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c65c85b0-7b94-4e6d-8fdf-e8fd8e9fea29) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:53:09 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-66fbd605-70e0-41b0-ab4e-e369fc08f434 tempest-CreateVolumesFromSourceVolumeTest-476912221 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c65c85b0-7b94-4e6d-8fdf-e8fd8e9fea29) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:53:09 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-66fbd605-70e0-41b0-ab4e-e369fc08f434 tempest-CreateVolumesFromSourceVolumeTest-476912221 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5314a482-cc05-402c-acdc-a9b399cb6acb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:53:09 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-66fbd605-70e0-41b0-ab4e-e369fc08f434 tempest-CreateVolumesFromSourceVolumeTest-476912221 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5314a482-cc05-402c-acdc-a9b399cb6acb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4d92adfc-13a4-4a30-bc36-33ea181065b8', 'volume_name': 'volume-4d92adfc-13a4-4a30-bc36-33ea181065b8', 'volume_size': 1}' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:53:09 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-66fbd605-70e0-41b0-ab4e-e369fc08f434 tempest-CreateVolumesFromSourceVolumeTest-476912221 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d5cbdff8-f8c1-4314-be2f-3f9f64d1473c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:53:09 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-66fbd605-70e0-41b0-ab4e-e369fc08f434 tempest-CreateVolumesFromSourceVolumeTest-476912221 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d5cbdff8-f8c1-4314-be2f-3f9f64d1473c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:53:09 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-66fbd605-70e0-41b0-ab4e-e369fc08f434 tempest-CreateVolumesFromSourceVolumeTest-476912221 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (22312c79-1de6-47da-b7ff-dd256fd7fcd4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:53:09 devstack cinder-volume[87444]: INFO cinder.volume.flows.manager.create_volume [None req-66fbd605-70e0-41b0-ab4e-e369fc08f434 tempest-CreateVolumesFromSourceVolumeTest-476912221 None] Volume 4d92adfc-13a4-4a30-bc36-33ea181065b8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4d92adfc-13a4-4a30-bc36-33ea181065b8', 'volume_size': 1} Jul 10 04:53:09 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-66fbd605-70e0-41b0-ab4e-e369fc08f434 tempest-CreateVolumesFromSourceVolumeTest-476912221 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 04:53:10 devstack cinder-volume[87444]: DEBUG cinder.volume.flows.manager.create_volume [None req-f4888a96-dbc8-42a9-b855-33696dbafb00 tempest-CreateVolumesFromSourceVolumeTest-476912221 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87444) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 04:53:10 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-f4888a96-dbc8-42a9-b855-33696dbafb00 tempest-CreateVolumesFromSourceVolumeTest-476912221 None] Flow 'volume_create_manager' (182c6f12-5428-4b72-9577-98544ddbbfae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 04:53:10 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-f4888a96-dbc8-42a9-b855-33696dbafb00 tempest-CreateVolumesFromSourceVolumeTest-476912221 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0c7bd2c9-0942-4190-8c52-4e992cd40da2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:53:10 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-f4888a96-dbc8-42a9-b855-33696dbafb00 tempest-CreateVolumesFromSourceVolumeTest-476912221 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0c7bd2c9-0942-4190-8c52-4e992cd40da2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T02:53:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1386443866',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=81d1981f-6a8f-4f71-b189-63c66f977047,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5875dfdbb91249d4ab2dac0b694d375a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T02:53:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T02:53:10Z,use_quota=True,user_id='9f2d5539942c4adab93ad80cee4d06f1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(317e369e-1e06-434d-ae95-a335f0e6c903),volume_type_id=317e369e-1e06-434d-ae95-a335f0e6c903)' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:53:10 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-f4888a96-dbc8-42a9-b855-33696dbafb00 tempest-CreateVolumesFromSourceVolumeTest-476912221 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eac05522-fe98-41fe-96ca-c51253641264) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:53:10 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-f4888a96-dbc8-42a9-b855-33696dbafb00 tempest-CreateVolumesFromSourceVolumeTest-476912221 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eac05522-fe98-41fe-96ca-c51253641264) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:53:10 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-f4888a96-dbc8-42a9-b855-33696dbafb00 tempest-CreateVolumesFromSourceVolumeTest-476912221 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7092a43b-9805-4265-9a3d-c98ab430ebc2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:53:10 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-f4888a96-dbc8-42a9-b855-33696dbafb00 tempest-CreateVolumesFromSourceVolumeTest-476912221 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7092a43b-9805-4265-9a3d-c98ab430ebc2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '81d1981f-6a8f-4f71-b189-63c66f977047', 'volume_name': 'volume-81d1981f-6a8f-4f71-b189-63c66f977047', 'volume_size': 1}' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:53:10 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-f4888a96-dbc8-42a9-b855-33696dbafb00 tempest-CreateVolumesFromSourceVolumeTest-476912221 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d978dd6a-568a-475b-b9ba-fad48cde7fd6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:53:10 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-f4888a96-dbc8-42a9-b855-33696dbafb00 tempest-CreateVolumesFromSourceVolumeTest-476912221 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d978dd6a-568a-475b-b9ba-fad48cde7fd6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:53:10 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-f4888a96-dbc8-42a9-b855-33696dbafb00 tempest-CreateVolumesFromSourceVolumeTest-476912221 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c3772479-267b-45b2-bc3e-9f6bd31e1e1d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:53:10 devstack cinder-volume[87444]: INFO cinder.volume.flows.manager.create_volume [None req-f4888a96-dbc8-42a9-b855-33696dbafb00 tempest-CreateVolumesFromSourceVolumeTest-476912221 None] Volume 81d1981f-6a8f-4f71-b189-63c66f977047: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-81d1981f-6a8f-4f71-b189-63c66f977047', 'volume_size': 1} Jul 10 04:53:10 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-f4888a96-dbc8-42a9-b855-33696dbafb00 tempest-CreateVolumesFromSourceVolumeTest-476912221 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 04:53:10 devstack sudo[105039]: pam_unix(sudo:session): session closed for user root Jul 10 04:53:10 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-a4d09549-6a5c-427e-ada4-9bae0b378d68 tempest-CreateVolumesFromImageTest-1512620421 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-f7a59dd7-0999-4825-9a20-2184874a4250" returned: 0 in 0.850s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:53:10 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-a4d09549-6a5c-427e-ada4-9bae0b378d68 tempest-CreateVolumesFromImageTest-1512620421 None] <== create_volume: return (1811ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922'} {{(pid=87444) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 04:53:10 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-a4d09549-6a5c-427e-ada4-9bae0b378d68 tempest-CreateVolumesFromImageTest-1512620421 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.813s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 04:53:10 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-2aafbd2b-775e-4333-9c58-4d65bed8bc20 tempest-CreateVolumesFromImageTest-1512620421 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.609s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 04:53:10 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-2aafbd2b-775e-4333-9c58-4d65bed8bc20 tempest-CreateVolumesFromImageTest-1512620421 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T02:53:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1531984214',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d05e8536-35ba-463c-820a-8eeebc0fa9cc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a2aef7a9504e4d66a472507f396bbe04',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T02:53:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T02:53:07Z,use_quota=True,user_id='e35b1c2e624d4f30a4746991187915d4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(317e369e-1e06-434d-ae95-a335f0e6c903),volume_type_id=317e369e-1e06-434d-ae95-a335f0e6c903)}" {{(pid=87444) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 04:53:10 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.remotefs [None req-2aafbd2b-775e-4333-9c58-4d65bed8bc20 tempest-CreateVolumesFromImageTest-1512620421 None] Creating volume d05e8536-35ba-463c-820a-8eeebc0fa9cc {{(pid=87444) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 04:53:10 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-2aafbd2b-775e-4333-9c58-4d65bed8bc20 tempest-CreateVolumesFromImageTest-1512620421 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 04:53:10 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-2aafbd2b-775e-4333-9c58-4d65bed8bc20 tempest-CreateVolumesFromImageTest-1512620421 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 04:53:10 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-2aafbd2b-775e-4333-9c58-4d65bed8bc20 tempest-CreateVolumesFromImageTest-1512620421 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922': None} {{(pid=87444) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 04:53:10 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-2aafbd2b-775e-4333-9c58-4d65bed8bc20 tempest-CreateVolumesFromImageTest-1512620421 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922'] {{(pid=87444) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 04:53:10 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-2aafbd2b-775e-4333-9c58-4d65bed8bc20 tempest-CreateVolumesFromImageTest-1512620421 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 04:53:10 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-2aafbd2b-775e-4333-9c58-4d65bed8bc20 tempest-CreateVolumesFromImageTest-1512620421 None] Selected osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922 as target Quobyte volume. {{(pid=87444) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 04:53:10 devstack cinder-volume[87444]: INFO cinder.volume.drivers.remotefs [None req-2aafbd2b-775e-4333-9c58-4d65bed8bc20 tempest-CreateVolumesFromImageTest-1512620421 None] casted to osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922 Jul 10 04:53:10 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-2aafbd2b-775e-4333-9c58-4d65bed8bc20 tempest-CreateVolumesFromImageTest-1512620421 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-d05e8536-35ba-463c-820a-8eeebc0fa9cc 1073741824 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:53:10 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-a4d09549-6a5c-427e-ada4-9bae0b378d68 tempest-CreateVolumesFromImageTest-1512620421 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (36ffb46d-63cf-4b55-af93-3f7c9bf180b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f7a59dd7-0999-4825-9a20-2184874a4250', 'volume_size': 1}' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:53:10 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-a4d09549-6a5c-427e-ada4-9bae0b378d68 tempest-CreateVolumesFromImageTest-1512620421 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (056cc85e-065f-487e-a4f2-c7b1b1228c3f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:53:10 devstack sudo[105042]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-d05e8536-35ba-463c-820a-8eeebc0fa9cc 1073741824 Jul 10 04:53:10 devstack sudo[105042]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:53:10 devstack cinder-volume[87444]: INFO cinder.volume.flows.manager.create_volume [None req-a4d09549-6a5c-427e-ada4-9bae0b378d68 tempest-CreateVolumesFromImageTest-1512620421 None] Volume volume-f7a59dd7-0999-4825-9a20-2184874a4250 (f7a59dd7-0999-4825-9a20-2184874a4250): created successfully Jul 10 04:53:10 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-a4d09549-6a5c-427e-ada4-9bae0b378d68 tempest-CreateVolumesFromImageTest-1512620421 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (056cc85e-065f-487e-a4f2-c7b1b1228c3f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:53:10 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-a4d09549-6a5c-427e-ada4-9bae0b378d68 tempest-CreateVolumesFromImageTest-1512620421 None] Flow 'volume_create_manager' (f0511210-4484-43d4-a126-7f4c0398d1a9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87444) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 04:53:10 devstack cinder-volume[87444]: INFO cinder.volume.manager [None req-a4d09549-6a5c-427e-ada4-9bae0b378d68 tempest-CreateVolumesFromImageTest-1512620421 None] Created volume successfully. Jul 10 04:53:10 devstack cinder-volume[87444]: DEBUG cinder.volume.flows.manager.create_volume [None req-9522ba1f-2af3-4c5c-80de-0d8e97bf5070 tempest-VolumeAndVolumeTypeFromImageTest-667796659 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87444) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 04:53:10 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-9522ba1f-2af3-4c5c-80de-0d8e97bf5070 tempest-VolumeAndVolumeTypeFromImageTest-667796659 None] Flow 'volume_create_manager' (92c46582-2ab1-42cb-b784-a0c344de1500) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 04:53:10 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-9522ba1f-2af3-4c5c-80de-0d8e97bf5070 tempest-VolumeAndVolumeTypeFromImageTest-667796659 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7f9da0be-0b5d-41bc-a972-76aee94d5e1c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:53:10 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-9522ba1f-2af3-4c5c-80de-0d8e97bf5070 tempest-VolumeAndVolumeTypeFromImageTest-667796659 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7f9da0be-0b5d-41bc-a972-76aee94d5e1c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T02:53:10Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e1e118ed-29ec-4a87-b93f-4ce4aabe0c96,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ff85958c095040fb8878a45f2568ef7b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T02:53:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T02:53:11Z,use_quota=True,user_id='9cc84feaf896498d9da35db0052071a6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(51ef4f95-b868-4ed2-b62d-0abd78ffdb9d),volume_type_id=51ef4f95-b868-4ed2-b62d-0abd78ffdb9d)' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:53:10 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-9522ba1f-2af3-4c5c-80de-0d8e97bf5070 tempest-VolumeAndVolumeTypeFromImageTest-667796659 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e1bad0b4-36b6-4d69-abe1-478b1cd9688a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:53:10 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-9522ba1f-2af3-4c5c-80de-0d8e97bf5070 tempest-VolumeAndVolumeTypeFromImageTest-667796659 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e1bad0b4-36b6-4d69-abe1-478b1cd9688a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:53:10 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-9522ba1f-2af3-4c5c-80de-0d8e97bf5070 tempest-VolumeAndVolumeTypeFromImageTest-667796659 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a83e8814-7337-48cb-bf44-68d384bc2530) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:53:10 devstack cinder-volume[87444]: DEBUG cinder.image.glance [None req-9522ba1f-2af3-4c5c-80de-0d8e97bf5070 tempest-VolumeAndVolumeTypeFromImageTest-667796659 None] Creating Keystone auth plugin from conf {{(pid=87444) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jul 10 04:53:10 devstack cinder-volume[87444]: DEBUG cinder.volume.flows.manager.create_volume [None req-d5d9e2bf-dd51-4cea-b498-694c1b04f9cc tempest-CreateVolumesFromSourceVolumeTest-476912221 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87444) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 04:53:10 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-d5d9e2bf-dd51-4cea-b498-694c1b04f9cc tempest-CreateVolumesFromSourceVolumeTest-476912221 None] Flow 'volume_create_manager' (86bc3c2d-cdeb-4342-aafa-f99b029fb88d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 04:53:10 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-d5d9e2bf-dd51-4cea-b498-694c1b04f9cc tempest-CreateVolumesFromSourceVolumeTest-476912221 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (90f8000b-8a3a-46de-8999-36016a8a4b4a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:53:10 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-d5d9e2bf-dd51-4cea-b498-694c1b04f9cc tempest-CreateVolumesFromSourceVolumeTest-476912221 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (90f8000b-8a3a-46de-8999-36016a8a4b4a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T02:53:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-150658558',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b3decc1b-92ad-455d-a22d-0583f61bb9be,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5875dfdbb91249d4ab2dac0b694d375a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T02:53:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T02:53:11Z,use_quota=True,user_id='9f2d5539942c4adab93ad80cee4d06f1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(317e369e-1e06-434d-ae95-a335f0e6c903),volume_type_id=317e369e-1e06-434d-ae95-a335f0e6c903)' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:53:10 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-d5d9e2bf-dd51-4cea-b498-694c1b04f9cc tempest-CreateVolumesFromSourceVolumeTest-476912221 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8536ebe9-a495-46fc-a152-ba8f3dfe1c81) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:53:10 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-d5d9e2bf-dd51-4cea-b498-694c1b04f9cc tempest-CreateVolumesFromSourceVolumeTest-476912221 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8536ebe9-a495-46fc-a152-ba8f3dfe1c81) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:53:10 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-d5d9e2bf-dd51-4cea-b498-694c1b04f9cc tempest-CreateVolumesFromSourceVolumeTest-476912221 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a4f492ab-aa2f-4168-9e98-dabb48e143f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:53:10 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-d5d9e2bf-dd51-4cea-b498-694c1b04f9cc tempest-CreateVolumesFromSourceVolumeTest-476912221 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a4f492ab-aa2f-4168-9e98-dabb48e143f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b3decc1b-92ad-455d-a22d-0583f61bb9be', 'volume_name': 'volume-b3decc1b-92ad-455d-a22d-0583f61bb9be', 'volume_size': 1}' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:53:10 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-d5d9e2bf-dd51-4cea-b498-694c1b04f9cc tempest-CreateVolumesFromSourceVolumeTest-476912221 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7d6a8745-9e5e-4887-a55e-351211287f09) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:53:10 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-d5d9e2bf-dd51-4cea-b498-694c1b04f9cc tempest-CreateVolumesFromSourceVolumeTest-476912221 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7d6a8745-9e5e-4887-a55e-351211287f09) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:53:10 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-d5d9e2bf-dd51-4cea-b498-694c1b04f9cc tempest-CreateVolumesFromSourceVolumeTest-476912221 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fe7e495f-e8d5-47c9-895e-1bfe5f3fe364) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:53:10 devstack cinder-volume[87444]: INFO cinder.volume.flows.manager.create_volume [None req-d5d9e2bf-dd51-4cea-b498-694c1b04f9cc tempest-CreateVolumesFromSourceVolumeTest-476912221 None] Volume b3decc1b-92ad-455d-a22d-0583f61bb9be: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b3decc1b-92ad-455d-a22d-0583f61bb9be', 'volume_size': 1} Jul 10 04:53:10 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-d5d9e2bf-dd51-4cea-b498-694c1b04f9cc tempest-CreateVolumesFromSourceVolumeTest-476912221 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 04:53:11 devstack cinder-volume[87444]: DEBUG cinder.volume.flows.manager.create_volume [None req-d0a3d0b1-18d7-4f01-a9a1-b30482465d6c tempest-CreateVolumesFromSourceVolumeTest-476912221 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87444) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 04:53:11 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-d0a3d0b1-18d7-4f01-a9a1-b30482465d6c tempest-CreateVolumesFromSourceVolumeTest-476912221 None] Flow 'volume_create_manager' (80f944e7-0847-4eb4-810b-30b74b9f36bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 04:53:11 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-d0a3d0b1-18d7-4f01-a9a1-b30482465d6c tempest-CreateVolumesFromSourceVolumeTest-476912221 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4b4ee9ca-0f71-40e4-b35b-a733964a2235) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:53:11 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-d0a3d0b1-18d7-4f01-a9a1-b30482465d6c tempest-CreateVolumesFromSourceVolumeTest-476912221 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4b4ee9ca-0f71-40e4-b35b-a733964a2235) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T02:53:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1074293448',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f4706ac5-3c3b-4a10-8ed3-493af8c34005,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5875dfdbb91249d4ab2dac0b694d375a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T02:53:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T02:53:11Z,use_quota=True,user_id='9f2d5539942c4adab93ad80cee4d06f1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(317e369e-1e06-434d-ae95-a335f0e6c903),volume_type_id=317e369e-1e06-434d-ae95-a335f0e6c903)' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:53:11 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-d0a3d0b1-18d7-4f01-a9a1-b30482465d6c tempest-CreateVolumesFromSourceVolumeTest-476912221 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a72449a5-d0ef-4307-9dcf-6aa1b38cace0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:53:11 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-d0a3d0b1-18d7-4f01-a9a1-b30482465d6c tempest-CreateVolumesFromSourceVolumeTest-476912221 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a72449a5-d0ef-4307-9dcf-6aa1b38cace0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:53:11 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-d0a3d0b1-18d7-4f01-a9a1-b30482465d6c tempest-CreateVolumesFromSourceVolumeTest-476912221 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dcc7f2ba-bf7b-44b4-83b4-78f604e39c85) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:53:11 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-d0a3d0b1-18d7-4f01-a9a1-b30482465d6c tempest-CreateVolumesFromSourceVolumeTest-476912221 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dcc7f2ba-bf7b-44b4-83b4-78f604e39c85) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f4706ac5-3c3b-4a10-8ed3-493af8c34005', 'volume_name': 'volume-f4706ac5-3c3b-4a10-8ed3-493af8c34005', 'volume_size': 1}' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:53:11 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-d0a3d0b1-18d7-4f01-a9a1-b30482465d6c tempest-CreateVolumesFromSourceVolumeTest-476912221 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9a9439b2-92b8-432e-873a-ae8e9554beff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:53:11 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-d0a3d0b1-18d7-4f01-a9a1-b30482465d6c tempest-CreateVolumesFromSourceVolumeTest-476912221 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9a9439b2-92b8-432e-873a-ae8e9554beff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:53:11 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-d0a3d0b1-18d7-4f01-a9a1-b30482465d6c tempest-CreateVolumesFromSourceVolumeTest-476912221 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (77b9cce3-5243-4188-a564-336fad99cd6b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:53:11 devstack cinder-volume[87444]: INFO cinder.volume.flows.manager.create_volume [None req-d0a3d0b1-18d7-4f01-a9a1-b30482465d6c tempest-CreateVolumesFromSourceVolumeTest-476912221 None] Volume f4706ac5-3c3b-4a10-8ed3-493af8c34005: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f4706ac5-3c3b-4a10-8ed3-493af8c34005', 'volume_size': 1} Jul 10 04:53:11 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-d0a3d0b1-18d7-4f01-a9a1-b30482465d6c tempest-CreateVolumesFromSourceVolumeTest-476912221 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 04:53:11 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-9522ba1f-2af3-4c5c-80de-0d8e97bf5070 tempest-VolumeAndVolumeTypeFromImageTest-667796659 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a83e8814-7337-48cb-bf44-68d384bc2530) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'e1e118ed-29ec-4a87-b93f-4ce4aabe0c96', 'volume_name': 'volume-e1e118ed-29ec-4a87-b93f-4ce4aabe0c96', 'volume_size': 1, 'image_id': '63070680-ed32-4c77-b773-d742aba1a2f3', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/63070680-ed32-4c77-b773-d742aba1a2f3', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'b65c1c37eb71fd58714fb856a270421e', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'ff85958c095040fb8878a45f2568ef7b', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '77eb6bab37d7b7a416e9ec9203a56a1d5202335dc1aeac9bdb3c763cfd29f5a439e0a4a8c67ef57edea3eb4a66f18a4048ab195ac7a6884eeca5f5b7dbbea013', 'id': '63070680-ed32-4c77-b773-d742aba1a2f3', 'created_at': datetime.datetime(2026, 7, 10, 2, 53, 8, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 10, 2, 53, 9, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/63070680-ed32-4c77-b773-d742aba1a2f3/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:53:11 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-9522ba1f-2af3-4c5c-80de-0d8e97bf5070 tempest-VolumeAndVolumeTypeFromImageTest-667796659 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (50387a24-7a63-425e-95bb-381d96546c64) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:53:11 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-9522ba1f-2af3-4c5c-80de-0d8e97bf5070 tempest-VolumeAndVolumeTypeFromImageTest-667796659 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (50387a24-7a63-425e-95bb-381d96546c64) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:53:11 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-9522ba1f-2af3-4c5c-80de-0d8e97bf5070 tempest-VolumeAndVolumeTypeFromImageTest-667796659 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c5c476ce-ef76-4e06-b7b4-a6debb6a18ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:53:11 devstack cinder-volume[87444]: INFO cinder.volume.flows.manager.create_volume [None req-9522ba1f-2af3-4c5c-80de-0d8e97bf5070 tempest-VolumeAndVolumeTypeFromImageTest-667796659 None] Volume e1e118ed-29ec-4a87-b93f-4ce4aabe0c96: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-e1e118ed-29ec-4a87-b93f-4ce4aabe0c96', 'volume_size': 1, 'image_id': '63070680-ed32-4c77-b773-d742aba1a2f3', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/63070680-ed32-4c77-b773-d742aba1a2f3', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'b65c1c37eb71fd58714fb856a270421e', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'ff85958c095040fb8878a45f2568ef7b', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '77eb6bab37d7b7a416e9ec9203a56a1d5202335dc1aeac9bdb3c763cfd29f5a439e0a4a8c67ef57edea3eb4a66f18a4048ab195ac7a6884eeca5f5b7dbbea013', 'id': '63070680-ed32-4c77-b773-d742aba1a2f3', 'created_at': datetime.datetime(2026, 7, 10, 2, 53, 8, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 10, 2, 53, 9, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/63070680-ed32-4c77-b773-d742aba1a2f3/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': } Jul 10 04:53:11 devstack cinder-volume[87444]: DEBUG cinder.volume.flows.manager.create_volume [None req-9522ba1f-2af3-4c5c-80de-0d8e97bf5070 tempest-VolumeAndVolumeTypeFromImageTest-667796659 None] Trying to clone e1e118ed-29ec-4a87-b93f-4ce4aabe0c96 from image 63070680-ed32-4c77-b773-d742aba1a2f3 at location (None, [{'url': 'file:///opt/stack/data/glance/images/63070680-ed32-4c77-b773-d742aba1a2f3', 'metadata': {}}]). {{(pid=87444) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jul 10 04:53:11 devstack cinder-volume[87444]: DEBUG cinder.image.image_utils [None req-9522ba1f-2af3-4c5c-80de-0d8e97bf5070 tempest-VolumeAndVolumeTypeFromImageTest-667796659 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_63070680-ed32-4c77-b773-d742aba1a2f3_bn_5pthmdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=87444) fetch /opt/stack/cinder/cinder/image/image_utils.py:765}} Jul 10 04:53:11 devstack cinder-volume[87444]: INFO cinder.image.image_utils [None req-9522ba1f-2af3-4c5c-80de-0d8e97bf5070 tempest-VolumeAndVolumeTypeFromImageTest-667796659 None] Image download 0.00 MB at 0.00 MB/s Jul 10 04:53:11 devstack cinder-volume[87444]: DEBUG oslo.privsep.daemon [-] privsep: reply[1741277b-f629-4e54-a06b-d5f6bb4d86d4]: (4, 'raw') {{(pid=88499) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 04:53:11 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-9522ba1f-2af3-4c5c-80de-0d8e97bf5070 tempest-VolumeAndVolumeTypeFromImageTest-667796659 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_63070680-ed32-4c77-b773-d742aba1a2f3_bn_5pthmdevstack@QuobyteHD {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:53:11 devstack sudo[105048]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_63070680-ed32-4c77-b773-d742aba1a2f3_bn_5pthmdevstack@QuobyteHD Jul 10 04:53:11 devstack cinder-volume[87444]: DEBUG cinder.volume.flows.manager.create_volume [None req-57197ffa-1db2-4faf-8b08-b3d4f6204840 tempest-CreateVolumesFromSourceVolumeTest-476912221 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87444) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 04:53:11 devstack sudo[105048]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:53:11 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-57197ffa-1db2-4faf-8b08-b3d4f6204840 tempest-CreateVolumesFromSourceVolumeTest-476912221 None] Flow 'volume_create_manager' (46fe5f28-12f1-43e1-9aea-01e7f19e3772) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 04:53:11 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-57197ffa-1db2-4faf-8b08-b3d4f6204840 tempest-CreateVolumesFromSourceVolumeTest-476912221 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (91ebe7c3-a7ba-4bcf-841c-233979208511) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:53:11 devstack sudo[105042]: pam_unix(sudo:session): session closed for user root Jul 10 04:53:11 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-57197ffa-1db2-4faf-8b08-b3d4f6204840 tempest-CreateVolumesFromSourceVolumeTest-476912221 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (91ebe7c3-a7ba-4bcf-841c-233979208511) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T02:53:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-237259959',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7a29f5d0-927e-421e-aaa1-bfca6dfeb8f9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5875dfdbb91249d4ab2dac0b694d375a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T02:53:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T02:53:11Z,use_quota=True,user_id='9f2d5539942c4adab93ad80cee4d06f1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(317e369e-1e06-434d-ae95-a335f0e6c903),volume_type_id=317e369e-1e06-434d-ae95-a335f0e6c903)' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:53:11 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-57197ffa-1db2-4faf-8b08-b3d4f6204840 tempest-CreateVolumesFromSourceVolumeTest-476912221 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (61009f84-4665-4932-970f-a76223100040) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:53:11 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-57197ffa-1db2-4faf-8b08-b3d4f6204840 tempest-CreateVolumesFromSourceVolumeTest-476912221 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (61009f84-4665-4932-970f-a76223100040) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:53:11 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-57197ffa-1db2-4faf-8b08-b3d4f6204840 tempest-CreateVolumesFromSourceVolumeTest-476912221 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (de22ea97-e190-41d9-b7aa-9a6699eea09f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:53:11 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-57197ffa-1db2-4faf-8b08-b3d4f6204840 tempest-CreateVolumesFromSourceVolumeTest-476912221 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (de22ea97-e190-41d9-b7aa-9a6699eea09f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7a29f5d0-927e-421e-aaa1-bfca6dfeb8f9', 'volume_name': 'volume-7a29f5d0-927e-421e-aaa1-bfca6dfeb8f9', 'volume_size': 1}' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:53:11 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-57197ffa-1db2-4faf-8b08-b3d4f6204840 tempest-CreateVolumesFromSourceVolumeTest-476912221 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f7f12b64-392c-4f09-bc70-1241dd7aa022) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:53:11 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-57197ffa-1db2-4faf-8b08-b3d4f6204840 tempest-CreateVolumesFromSourceVolumeTest-476912221 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f7f12b64-392c-4f09-bc70-1241dd7aa022) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:53:11 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-57197ffa-1db2-4faf-8b08-b3d4f6204840 tempest-CreateVolumesFromSourceVolumeTest-476912221 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bd106300-452d-4909-a733-a7eb1540c008) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:53:11 devstack cinder-volume[87444]: INFO cinder.volume.flows.manager.create_volume [None req-57197ffa-1db2-4faf-8b08-b3d4f6204840 tempest-CreateVolumesFromSourceVolumeTest-476912221 None] Volume 7a29f5d0-927e-421e-aaa1-bfca6dfeb8f9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7a29f5d0-927e-421e-aaa1-bfca6dfeb8f9', 'volume_size': 1} Jul 10 04:53:11 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-57197ffa-1db2-4faf-8b08-b3d4f6204840 tempest-CreateVolumesFromSourceVolumeTest-476912221 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 04:53:11 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-2aafbd2b-775e-4333-9c58-4d65bed8bc20 tempest-CreateVolumesFromImageTest-1512620421 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-d05e8536-35ba-463c-820a-8eeebc0fa9cc 1073741824" returned: 0 in 1.181s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:53:11 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-2aafbd2b-775e-4333-9c58-4d65bed8bc20 tempest-CreateVolumesFromImageTest-1512620421 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-d05e8536-35ba-463c-820a-8eeebc0fa9cc {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:53:11 devstack sudo[105050]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-d05e8536-35ba-463c-820a-8eeebc0fa9cc Jul 10 04:53:11 devstack sudo[105050]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:53:12 devstack sudo[105048]: pam_unix(sudo:session): session closed for user root Jul 10 04:53:12 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-9522ba1f-2af3-4c5c-80de-0d8e97bf5070 tempest-VolumeAndVolumeTypeFromImageTest-667796659 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_63070680-ed32-4c77-b773-d742aba1a2f3_bn_5pthmdevstack@QuobyteHD" returned: 0 in 0.770s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:53:12 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-9522ba1f-2af3-4c5c-80de-0d8e97bf5070 tempest-VolumeAndVolumeTypeFromImageTest-667796659 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_63070680-ed32-4c77-b773-d742aba1a2f3_bn_5pthmdevstack@QuobyteHD {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:53:12 devstack sudo[105054]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_63070680-ed32-4c77-b773-d742aba1a2f3_bn_5pthmdevstack@QuobyteHD Jul 10 04:53:12 devstack sudo[105054]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:53:12 devstack sudo[105050]: pam_unix(sudo:session): session closed for user root Jul 10 04:53:12 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-2aafbd2b-775e-4333-9c58-4d65bed8bc20 tempest-CreateVolumesFromImageTest-1512620421 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-d05e8536-35ba-463c-820a-8eeebc0fa9cc" returned: 0 in 0.631s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:53:12 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-2aafbd2b-775e-4333-9c58-4d65bed8bc20 tempest-CreateVolumesFromImageTest-1512620421 None] <== create_volume: return (1848ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922'} {{(pid=87444) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 04:53:12 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-2aafbd2b-775e-4333-9c58-4d65bed8bc20 tempest-CreateVolumesFromImageTest-1512620421 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.851s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 04:53:12 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-b966752f-2728-4d45-a866-4a166825edaa tempest-CreateVolumesFromSnapshotTest-1643372015 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.168s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 04:53:12 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-b966752f-2728-4d45-a866-4a166825edaa tempest-CreateVolumesFromSnapshotTest-1643372015 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T02:53:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-755763572',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6a52692c-d463-4776-aa0a-2fdfb275e2ef,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='eb19c0257a1a4527ad12a8fcf0b7404d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T02:53:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T02:53:07Z,use_quota=True,user_id='b3d05e57fb514af1a7774fbaec83fdec',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(317e369e-1e06-434d-ae95-a335f0e6c903),volume_type_id=317e369e-1e06-434d-ae95-a335f0e6c903)}" {{(pid=87444) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 04:53:12 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.remotefs [None req-b966752f-2728-4d45-a866-4a166825edaa tempest-CreateVolumesFromSnapshotTest-1643372015 None] Creating volume 6a52692c-d463-4776-aa0a-2fdfb275e2ef {{(pid=87444) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 04:53:12 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-b966752f-2728-4d45-a866-4a166825edaa tempest-CreateVolumesFromSnapshotTest-1643372015 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 04:53:12 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-b966752f-2728-4d45-a866-4a166825edaa tempest-CreateVolumesFromSnapshotTest-1643372015 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 04:53:12 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-b966752f-2728-4d45-a866-4a166825edaa tempest-CreateVolumesFromSnapshotTest-1643372015 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922': None} {{(pid=87444) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 04:53:12 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-b966752f-2728-4d45-a866-4a166825edaa tempest-CreateVolumesFromSnapshotTest-1643372015 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922'] {{(pid=87444) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 04:53:12 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-b966752f-2728-4d45-a866-4a166825edaa tempest-CreateVolumesFromSnapshotTest-1643372015 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 04:53:12 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-b966752f-2728-4d45-a866-4a166825edaa tempest-CreateVolumesFromSnapshotTest-1643372015 None] Selected osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922 as target Quobyte volume. {{(pid=87444) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 04:53:12 devstack cinder-volume[87444]: INFO cinder.volume.drivers.remotefs [None req-b966752f-2728-4d45-a866-4a166825edaa tempest-CreateVolumesFromSnapshotTest-1643372015 None] casted to osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922 Jul 10 04:53:12 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-b966752f-2728-4d45-a866-4a166825edaa tempest-CreateVolumesFromSnapshotTest-1643372015 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-6a52692c-d463-4776-aa0a-2fdfb275e2ef 1073741824 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:53:12 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-2aafbd2b-775e-4333-9c58-4d65bed8bc20 tempest-CreateVolumesFromImageTest-1512620421 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6d7f782e-d61a-40cb-9f10-d62e73434dcf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d05e8536-35ba-463c-820a-8eeebc0fa9cc', 'volume_size': 1}' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:53:12 devstack sudo[105057]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-6a52692c-d463-4776-aa0a-2fdfb275e2ef 1073741824 Jul 10 04:53:12 devstack sudo[105057]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:53:12 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-2aafbd2b-775e-4333-9c58-4d65bed8bc20 tempest-CreateVolumesFromImageTest-1512620421 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (764fd157-23a3-4345-91ff-6281b9c8c7ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:53:12 devstack cinder-volume[87444]: INFO cinder.volume.flows.manager.create_volume [None req-2aafbd2b-775e-4333-9c58-4d65bed8bc20 tempest-CreateVolumesFromImageTest-1512620421 None] Volume volume-d05e8536-35ba-463c-820a-8eeebc0fa9cc (d05e8536-35ba-463c-820a-8eeebc0fa9cc): created successfully Jul 10 04:53:12 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-2aafbd2b-775e-4333-9c58-4d65bed8bc20 tempest-CreateVolumesFromImageTest-1512620421 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (764fd157-23a3-4345-91ff-6281b9c8c7ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:53:12 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-2aafbd2b-775e-4333-9c58-4d65bed8bc20 tempest-CreateVolumesFromImageTest-1512620421 None] Flow 'volume_create_manager' (92654a2e-5287-4f1e-b5a2-48c1a74010d4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87444) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 04:53:12 devstack cinder-volume[87444]: INFO cinder.volume.manager [None req-2aafbd2b-775e-4333-9c58-4d65bed8bc20 tempest-CreateVolumesFromImageTest-1512620421 None] Created volume successfully. Jul 10 04:53:12 devstack sudo[105054]: pam_unix(sudo:session): session closed for user root Jul 10 04:53:12 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-9522ba1f-2af3-4c5c-80de-0d8e97bf5070 tempest-VolumeAndVolumeTypeFromImageTest-667796659 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_63070680-ed32-4c77-b773-d742aba1a2f3_bn_5pthmdevstack@QuobyteHD" returned: 1 in 0.747s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:53:12 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-9522ba1f-2af3-4c5c-80de-0d8e97bf5070 tempest-VolumeAndVolumeTypeFromImageTest-667796659 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_63070680-ed32-4c77-b773-d742aba1a2f3_bn_5pthmdevstack@QuobyteHD' failed. Not Retrying. {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 10 04:53:12 devstack cinder-volume[87444]: DEBUG cinder.image.image_utils [None req-9522ba1f-2af3-4c5c-80de-0d8e97bf5070 tempest-VolumeAndVolumeTypeFromImageTest-667796659 None] Temporary image 63070680-ed32-4c77-b773-d742aba1a2f3 is fetched for user 9cc84feaf896498d9da35db0052071a6. {{(pid=87444) fetch /opt/stack/cinder/cinder/image/image_utils.py:1464}} Jul 10 04:53:12 devstack cinder-volume[87444]: DEBUG oslo.privsep.daemon [-] privsep: reply[342bf6d9-bb66-4019-bce5-ec5372af9bf7]: (4, 'raw') {{(pid=88499) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 04:53:12 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-9522ba1f-2af3-4c5c-80de-0d8e97bf5070 tempest-VolumeAndVolumeTypeFromImageTest-667796659 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_63070680-ed32-4c77-b773-d742aba1a2f3_bn_5pthmdevstack@QuobyteHD {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:53:13 devstack sudo[105066]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_63070680-ed32-4c77-b773-d742aba1a2f3_bn_5pthmdevstack@QuobyteHD Jul 10 04:53:13 devstack sudo[105066]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:53:13 devstack sudo[105057]: pam_unix(sudo:session): session closed for user root Jul 10 04:53:13 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-b966752f-2728-4d45-a866-4a166825edaa tempest-CreateVolumesFromSnapshotTest-1643372015 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-6a52692c-d463-4776-aa0a-2fdfb275e2ef 1073741824" returned: 0 in 0.805s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:53:13 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-b966752f-2728-4d45-a866-4a166825edaa tempest-CreateVolumesFromSnapshotTest-1643372015 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-6a52692c-d463-4776-aa0a-2fdfb275e2ef {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:53:13 devstack sudo[105068]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-6a52692c-d463-4776-aa0a-2fdfb275e2ef Jul 10 04:53:13 devstack sudo[105068]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:53:13 devstack sudo[105066]: pam_unix(sudo:session): session closed for user root Jul 10 04:53:13 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-9522ba1f-2af3-4c5c-80de-0d8e97bf5070 tempest-VolumeAndVolumeTypeFromImageTest-667796659 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_63070680-ed32-4c77-b773-d742aba1a2f3_bn_5pthmdevstack@QuobyteHD" returned: 0 in 0.748s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:53:13 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-9522ba1f-2af3-4c5c-80de-0d8e97bf5070 tempest-VolumeAndVolumeTypeFromImageTest-667796659 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_63070680-ed32-4c77-b773-d742aba1a2f3_bn_5pthmdevstack@QuobyteHD {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:53:13 devstack sudo[105073]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_63070680-ed32-4c77-b773-d742aba1a2f3_bn_5pthmdevstack@QuobyteHD Jul 10 04:53:13 devstack sudo[105073]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:53:13 devstack sudo[105068]: pam_unix(sudo:session): session closed for user root Jul 10 04:53:13 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-b966752f-2728-4d45-a866-4a166825edaa tempest-CreateVolumesFromSnapshotTest-1643372015 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-6a52692c-d463-4776-aa0a-2fdfb275e2ef" returned: 0 in 0.712s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:53:13 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-b966752f-2728-4d45-a866-4a166825edaa tempest-CreateVolumesFromSnapshotTest-1643372015 None] <== create_volume: return (1556ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922'} {{(pid=87444) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 04:53:13 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-b966752f-2728-4d45-a866-4a166825edaa tempest-CreateVolumesFromSnapshotTest-1643372015 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.560s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 04:53:13 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-c0e7a747-c085-41c9-a39d-a4b15d1ada4f tempest-CreateVolumesFromImageTest-1512620421 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.379s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 04:53:13 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-c0e7a747-c085-41c9-a39d-a4b15d1ada4f tempest-CreateVolumesFromImageTest-1512620421 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T02:53:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-817096861',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3df62cd2-4ea0-4528-a7bd-736121741f29,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a2aef7a9504e4d66a472507f396bbe04',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T02:53:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T02:53:07Z,use_quota=True,user_id='e35b1c2e624d4f30a4746991187915d4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(317e369e-1e06-434d-ae95-a335f0e6c903),volume_type_id=317e369e-1e06-434d-ae95-a335f0e6c903)}" {{(pid=87444) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 04:53:13 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.remotefs [None req-c0e7a747-c085-41c9-a39d-a4b15d1ada4f tempest-CreateVolumesFromImageTest-1512620421 None] Creating volume 3df62cd2-4ea0-4528-a7bd-736121741f29 {{(pid=87444) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 04:53:13 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-c0e7a747-c085-41c9-a39d-a4b15d1ada4f tempest-CreateVolumesFromImageTest-1512620421 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 04:53:13 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-c0e7a747-c085-41c9-a39d-a4b15d1ada4f tempest-CreateVolumesFromImageTest-1512620421 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 04:53:13 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-c0e7a747-c085-41c9-a39d-a4b15d1ada4f tempest-CreateVolumesFromImageTest-1512620421 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922': None} {{(pid=87444) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 04:53:13 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-c0e7a747-c085-41c9-a39d-a4b15d1ada4f tempest-CreateVolumesFromImageTest-1512620421 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922'] {{(pid=87444) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 04:53:13 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-c0e7a747-c085-41c9-a39d-a4b15d1ada4f tempest-CreateVolumesFromImageTest-1512620421 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 04:53:13 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-c0e7a747-c085-41c9-a39d-a4b15d1ada4f tempest-CreateVolumesFromImageTest-1512620421 None] Selected osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922 as target Quobyte volume. {{(pid=87444) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 04:53:13 devstack cinder-volume[87444]: INFO cinder.volume.drivers.remotefs [None req-c0e7a747-c085-41c9-a39d-a4b15d1ada4f tempest-CreateVolumesFromImageTest-1512620421 None] casted to osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922 Jul 10 04:53:13 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-c0e7a747-c085-41c9-a39d-a4b15d1ada4f tempest-CreateVolumesFromImageTest-1512620421 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-3df62cd2-4ea0-4528-a7bd-736121741f29 1073741824 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:53:13 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-b966752f-2728-4d45-a866-4a166825edaa tempest-CreateVolumesFromSnapshotTest-1643372015 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (527895eb-898d-4269-b00d-9283b8df295c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6a52692c-d463-4776-aa0a-2fdfb275e2ef', 'volume_size': 1}' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:53:13 devstack sudo[105076]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-3df62cd2-4ea0-4528-a7bd-736121741f29 1073741824 Jul 10 04:53:13 devstack sudo[105076]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:53:13 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-b966752f-2728-4d45-a866-4a166825edaa tempest-CreateVolumesFromSnapshotTest-1643372015 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (63491bf0-f4ad-49c0-9592-3b59bef83a81) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:53:13 devstack cinder-volume[87444]: INFO cinder.volume.flows.manager.create_volume [None req-b966752f-2728-4d45-a866-4a166825edaa tempest-CreateVolumesFromSnapshotTest-1643372015 None] Volume volume-6a52692c-d463-4776-aa0a-2fdfb275e2ef (6a52692c-d463-4776-aa0a-2fdfb275e2ef): created successfully Jul 10 04:53:13 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-b966752f-2728-4d45-a866-4a166825edaa tempest-CreateVolumesFromSnapshotTest-1643372015 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (63491bf0-f4ad-49c0-9592-3b59bef83a81) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:53:13 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-b966752f-2728-4d45-a866-4a166825edaa tempest-CreateVolumesFromSnapshotTest-1643372015 None] Flow 'volume_create_manager' (8f12264a-0b6b-4400-a441-7df4866f5e53) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87444) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 04:53:13 devstack cinder-volume[87444]: INFO cinder.volume.manager [None req-b966752f-2728-4d45-a866-4a166825edaa tempest-CreateVolumesFromSnapshotTest-1643372015 None] Created volume successfully. Jul 10 04:53:14 devstack sudo[105073]: pam_unix(sudo:session): session closed for user root Jul 10 04:53:14 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-9522ba1f-2af3-4c5c-80de-0d8e97bf5070 tempest-VolumeAndVolumeTypeFromImageTest-667796659 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_63070680-ed32-4c77-b773-d742aba1a2f3_bn_5pthmdevstack@QuobyteHD" returned: 1 in 0.707s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:53:14 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-9522ba1f-2af3-4c5c-80de-0d8e97bf5070 tempest-VolumeAndVolumeTypeFromImageTest-667796659 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_63070680-ed32-4c77-b773-d742aba1a2f3_bn_5pthmdevstack@QuobyteHD' failed. Not Retrying. {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 10 04:53:14 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-9522ba1f-2af3-4c5c-80de-0d8e97bf5070 tempest-VolumeAndVolumeTypeFromImageTest-667796659 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 04:53:14 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-6c1d3a86-f10e-486a-93ec-2c346cf1a0ba tempest-CreateVolumesFromSnapshotTest-1643372015 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 04:53:14 devstack sudo[105076]: pam_unix(sudo:session): session closed for user root Jul 10 04:53:14 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-c0e7a747-c085-41c9-a39d-a4b15d1ada4f tempest-CreateVolumesFromImageTest-1512620421 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-3df62cd2-4ea0-4528-a7bd-736121741f29 1073741824" returned: 0 in 0.876s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:53:14 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-c0e7a747-c085-41c9-a39d-a4b15d1ada4f tempest-CreateVolumesFromImageTest-1512620421 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-3df62cd2-4ea0-4528-a7bd-736121741f29 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:53:14 devstack sudo[105085]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-3df62cd2-4ea0-4528-a7bd-736121741f29 Jul 10 04:53:14 devstack sudo[105085]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:53:15 devstack sudo[105085]: pam_unix(sudo:session): session closed for user root Jul 10 04:53:15 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-c0e7a747-c085-41c9-a39d-a4b15d1ada4f tempest-CreateVolumesFromImageTest-1512620421 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-3df62cd2-4ea0-4528-a7bd-736121741f29" returned: 0 in 0.655s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:53:15 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-c0e7a747-c085-41c9-a39d-a4b15d1ada4f tempest-CreateVolumesFromImageTest-1512620421 None] <== create_volume: return (1571ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922'} {{(pid=87444) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 04:53:15 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-c0e7a747-c085-41c9-a39d-a4b15d1ada4f tempest-CreateVolumesFromImageTest-1512620421 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.575s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 04:53:15 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-82b411a2-3f66-48ef-8f4d-b8c080a2bf6f tempest-CreateVolumesFromImageTest-1512620421 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.602s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 04:53:15 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-82b411a2-3f66-48ef-8f4d-b8c080a2bf6f tempest-CreateVolumesFromImageTest-1512620421 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T02:53:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1137242240',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=37c5ed0d-7513-4a6e-9e78-be95fd22099f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a2aef7a9504e4d66a472507f396bbe04',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T02:53:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T02:53:08Z,use_quota=True,user_id='e35b1c2e624d4f30a4746991187915d4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(317e369e-1e06-434d-ae95-a335f0e6c903),volume_type_id=317e369e-1e06-434d-ae95-a335f0e6c903)}" {{(pid=87444) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 04:53:15 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.remotefs [None req-82b411a2-3f66-48ef-8f4d-b8c080a2bf6f tempest-CreateVolumesFromImageTest-1512620421 None] Creating volume 37c5ed0d-7513-4a6e-9e78-be95fd22099f {{(pid=87444) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 04:53:15 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-82b411a2-3f66-48ef-8f4d-b8c080a2bf6f tempest-CreateVolumesFromImageTest-1512620421 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 04:53:15 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-82b411a2-3f66-48ef-8f4d-b8c080a2bf6f tempest-CreateVolumesFromImageTest-1512620421 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 04:53:15 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-82b411a2-3f66-48ef-8f4d-b8c080a2bf6f tempest-CreateVolumesFromImageTest-1512620421 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922': None} {{(pid=87444) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 04:53:15 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-82b411a2-3f66-48ef-8f4d-b8c080a2bf6f tempest-CreateVolumesFromImageTest-1512620421 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922'] {{(pid=87444) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 04:53:15 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-82b411a2-3f66-48ef-8f4d-b8c080a2bf6f tempest-CreateVolumesFromImageTest-1512620421 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 04:53:15 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-82b411a2-3f66-48ef-8f4d-b8c080a2bf6f tempest-CreateVolumesFromImageTest-1512620421 None] Selected osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922 as target Quobyte volume. {{(pid=87444) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 04:53:15 devstack cinder-volume[87444]: INFO cinder.volume.drivers.remotefs [None req-82b411a2-3f66-48ef-8f4d-b8c080a2bf6f tempest-CreateVolumesFromImageTest-1512620421 None] casted to osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922 Jul 10 04:53:15 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-82b411a2-3f66-48ef-8f4d-b8c080a2bf6f tempest-CreateVolumesFromImageTest-1512620421 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-37c5ed0d-7513-4a6e-9e78-be95fd22099f 1073741824 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:53:15 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-c0e7a747-c085-41c9-a39d-a4b15d1ada4f tempest-CreateVolumesFromImageTest-1512620421 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1ed0abd2-2ad0-41e1-bd71-eb713b0b0fad) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3df62cd2-4ea0-4528-a7bd-736121741f29', 'volume_size': 1}' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:53:15 devstack sudo[105088]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-37c5ed0d-7513-4a6e-9e78-be95fd22099f 1073741824 Jul 10 04:53:15 devstack sudo[105088]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:53:15 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-c0e7a747-c085-41c9-a39d-a4b15d1ada4f tempest-CreateVolumesFromImageTest-1512620421 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (269080b3-ed46-4c97-92fc-c962b8bbeffb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:53:15 devstack cinder-volume[87444]: INFO cinder.volume.flows.manager.create_volume [None req-c0e7a747-c085-41c9-a39d-a4b15d1ada4f tempest-CreateVolumesFromImageTest-1512620421 None] Volume volume-3df62cd2-4ea0-4528-a7bd-736121741f29 (3df62cd2-4ea0-4528-a7bd-736121741f29): created successfully Jul 10 04:53:15 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-c0e7a747-c085-41c9-a39d-a4b15d1ada4f tempest-CreateVolumesFromImageTest-1512620421 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (269080b3-ed46-4c97-92fc-c962b8bbeffb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:53:15 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-c0e7a747-c085-41c9-a39d-a4b15d1ada4f tempest-CreateVolumesFromImageTest-1512620421 None] Flow 'volume_create_manager' (5bc20961-a7dc-4fd3-a469-d7fffd812007) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87444) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 04:53:15 devstack cinder-volume[87444]: INFO cinder.volume.manager [None req-c0e7a747-c085-41c9-a39d-a4b15d1ada4f tempest-CreateVolumesFromImageTest-1512620421 None] Created volume successfully. Jul 10 04:53:16 devstack sudo[105088]: pam_unix(sudo:session): session closed for user root Jul 10 04:53:16 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-82b411a2-3f66-48ef-8f4d-b8c080a2bf6f tempest-CreateVolumesFromImageTest-1512620421 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-37c5ed0d-7513-4a6e-9e78-be95fd22099f 1073741824" returned: 0 in 0.819s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:53:16 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-82b411a2-3f66-48ef-8f4d-b8c080a2bf6f tempest-CreateVolumesFromImageTest-1512620421 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-37c5ed0d-7513-4a6e-9e78-be95fd22099f {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:53:16 devstack sudo[105093]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-37c5ed0d-7513-4a6e-9e78-be95fd22099f Jul 10 04:53:16 devstack sudo[105093]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:53:16 devstack sudo[105093]: pam_unix(sudo:session): session closed for user root Jul 10 04:53:16 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-82b411a2-3f66-48ef-8f4d-b8c080a2bf6f tempest-CreateVolumesFromImageTest-1512620421 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-37c5ed0d-7513-4a6e-9e78-be95fd22099f" returned: 0 in 0.666s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:53:16 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-82b411a2-3f66-48ef-8f4d-b8c080a2bf6f tempest-CreateVolumesFromImageTest-1512620421 None] <== create_volume: return (1521ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922'} {{(pid=87444) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 04:53:16 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-82b411a2-3f66-48ef-8f4d-b8c080a2bf6f tempest-CreateVolumesFromImageTest-1512620421 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.524s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 04:53:16 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-74a5ba6b-19cf-47df-912f-ec1d6a242e57 tempest-CreateVolumesFromImageTest-1512620421 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 8.736s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 04:53:16 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-74a5ba6b-19cf-47df-912f-ec1d6a242e57 tempest-CreateVolumesFromImageTest-1512620421 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T02:53:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-588137628',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=632fa08a-84bc-4075-8c5d-ffa519355541,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a2aef7a9504e4d66a472507f396bbe04',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T02:53:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T02:53:08Z,use_quota=True,user_id='e35b1c2e624d4f30a4746991187915d4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(317e369e-1e06-434d-ae95-a335f0e6c903),volume_type_id=317e369e-1e06-434d-ae95-a335f0e6c903)}" {{(pid=87444) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 04:53:16 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.remotefs [None req-74a5ba6b-19cf-47df-912f-ec1d6a242e57 tempest-CreateVolumesFromImageTest-1512620421 None] Creating volume 632fa08a-84bc-4075-8c5d-ffa519355541 {{(pid=87444) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 04:53:16 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-74a5ba6b-19cf-47df-912f-ec1d6a242e57 tempest-CreateVolumesFromImageTest-1512620421 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 04:53:16 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-74a5ba6b-19cf-47df-912f-ec1d6a242e57 tempest-CreateVolumesFromImageTest-1512620421 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 04:53:16 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-74a5ba6b-19cf-47df-912f-ec1d6a242e57 tempest-CreateVolumesFromImageTest-1512620421 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922': None} {{(pid=87444) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 04:53:16 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-74a5ba6b-19cf-47df-912f-ec1d6a242e57 tempest-CreateVolumesFromImageTest-1512620421 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922'] {{(pid=87444) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 04:53:16 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-74a5ba6b-19cf-47df-912f-ec1d6a242e57 tempest-CreateVolumesFromImageTest-1512620421 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 04:53:16 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-74a5ba6b-19cf-47df-912f-ec1d6a242e57 tempest-CreateVolumesFromImageTest-1512620421 None] Selected osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922 as target Quobyte volume. {{(pid=87444) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 04:53:16 devstack cinder-volume[87444]: INFO cinder.volume.drivers.remotefs [None req-74a5ba6b-19cf-47df-912f-ec1d6a242e57 tempest-CreateVolumesFromImageTest-1512620421 None] casted to osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922 Jul 10 04:53:16 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-74a5ba6b-19cf-47df-912f-ec1d6a242e57 tempest-CreateVolumesFromImageTest-1512620421 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-632fa08a-84bc-4075-8c5d-ffa519355541 1073741824 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:53:17 devstack sudo[105096]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-632fa08a-84bc-4075-8c5d-ffa519355541 1073741824 Jul 10 04:53:17 devstack sudo[105096]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:53:17 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-82b411a2-3f66-48ef-8f4d-b8c080a2bf6f tempest-CreateVolumesFromImageTest-1512620421 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ca6c5d71-2724-4393-a676-7ff891540fd6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-37c5ed0d-7513-4a6e-9e78-be95fd22099f', 'volume_size': 1}' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:53:17 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-82b411a2-3f66-48ef-8f4d-b8c080a2bf6f tempest-CreateVolumesFromImageTest-1512620421 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e9cc8d2a-cd77-40a4-8b73-bc7d004d1925) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:53:17 devstack cinder-volume[87444]: INFO cinder.volume.flows.manager.create_volume [None req-82b411a2-3f66-48ef-8f4d-b8c080a2bf6f tempest-CreateVolumesFromImageTest-1512620421 None] Volume volume-37c5ed0d-7513-4a6e-9e78-be95fd22099f (37c5ed0d-7513-4a6e-9e78-be95fd22099f): created successfully Jul 10 04:53:17 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-82b411a2-3f66-48ef-8f4d-b8c080a2bf6f tempest-CreateVolumesFromImageTest-1512620421 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e9cc8d2a-cd77-40a4-8b73-bc7d004d1925) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:53:17 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-82b411a2-3f66-48ef-8f4d-b8c080a2bf6f tempest-CreateVolumesFromImageTest-1512620421 None] Flow 'volume_create_manager' (2f85cbe0-9d68-438f-ba04-f0698bd7b16e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87444) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 04:53:17 devstack cinder-volume[87444]: INFO cinder.volume.manager [None req-82b411a2-3f66-48ef-8f4d-b8c080a2bf6f tempest-CreateVolumesFromImageTest-1512620421 None] Created volume successfully. Jul 10 04:53:17 devstack sudo[105096]: pam_unix(sudo:session): session closed for user root Jul 10 04:53:17 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-74a5ba6b-19cf-47df-912f-ec1d6a242e57 tempest-CreateVolumesFromImageTest-1512620421 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-632fa08a-84bc-4075-8c5d-ffa519355541 1073741824" returned: 0 in 0.799s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:53:17 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-74a5ba6b-19cf-47df-912f-ec1d6a242e57 tempest-CreateVolumesFromImageTest-1512620421 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-632fa08a-84bc-4075-8c5d-ffa519355541 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:53:17 devstack sudo[105102]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-632fa08a-84bc-4075-8c5d-ffa519355541 Jul 10 04:53:17 devstack sudo[105102]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:53:18 devstack sudo[105102]: pam_unix(sudo:session): session closed for user root Jul 10 04:53:18 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-74a5ba6b-19cf-47df-912f-ec1d6a242e57 tempest-CreateVolumesFromImageTest-1512620421 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-632fa08a-84bc-4075-8c5d-ffa519355541" returned: 0 in 0.646s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:53:18 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-74a5ba6b-19cf-47df-912f-ec1d6a242e57 tempest-CreateVolumesFromImageTest-1512620421 None] <== create_volume: return (1484ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922'} {{(pid=87444) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 04:53:18 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-74a5ba6b-19cf-47df-912f-ec1d6a242e57 tempest-CreateVolumesFromImageTest-1512620421 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.487s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 04:53:18 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-66fbd605-70e0-41b0-ab4e-e369fc08f434 tempest-CreateVolumesFromSourceVolumeTest-476912221 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 8.552s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 04:53:18 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-66fbd605-70e0-41b0-ab4e-e369fc08f434 tempest-CreateVolumesFromSourceVolumeTest-476912221 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T02:53:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1274680641',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4d92adfc-13a4-4a30-bc36-33ea181065b8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5875dfdbb91249d4ab2dac0b694d375a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T02:53:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T02:53:10Z,use_quota=True,user_id='9f2d5539942c4adab93ad80cee4d06f1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(317e369e-1e06-434d-ae95-a335f0e6c903),volume_type_id=317e369e-1e06-434d-ae95-a335f0e6c903)}" {{(pid=87444) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 04:53:18 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.remotefs [None req-66fbd605-70e0-41b0-ab4e-e369fc08f434 tempest-CreateVolumesFromSourceVolumeTest-476912221 None] Creating volume 4d92adfc-13a4-4a30-bc36-33ea181065b8 {{(pid=87444) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 04:53:18 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-66fbd605-70e0-41b0-ab4e-e369fc08f434 tempest-CreateVolumesFromSourceVolumeTest-476912221 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 04:53:18 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-66fbd605-70e0-41b0-ab4e-e369fc08f434 tempest-CreateVolumesFromSourceVolumeTest-476912221 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 04:53:18 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-66fbd605-70e0-41b0-ab4e-e369fc08f434 tempest-CreateVolumesFromSourceVolumeTest-476912221 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922': None} {{(pid=87444) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 04:53:18 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-66fbd605-70e0-41b0-ab4e-e369fc08f434 tempest-CreateVolumesFromSourceVolumeTest-476912221 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922'] {{(pid=87444) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 04:53:18 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-66fbd605-70e0-41b0-ab4e-e369fc08f434 tempest-CreateVolumesFromSourceVolumeTest-476912221 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 04:53:18 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-66fbd605-70e0-41b0-ab4e-e369fc08f434 tempest-CreateVolumesFromSourceVolumeTest-476912221 None] Selected osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922 as target Quobyte volume. {{(pid=87444) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 04:53:18 devstack cinder-volume[87444]: INFO cinder.volume.drivers.remotefs [None req-66fbd605-70e0-41b0-ab4e-e369fc08f434 tempest-CreateVolumesFromSourceVolumeTest-476912221 None] casted to osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922 Jul 10 04:53:18 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-66fbd605-70e0-41b0-ab4e-e369fc08f434 tempest-CreateVolumesFromSourceVolumeTest-476912221 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-4d92adfc-13a4-4a30-bc36-33ea181065b8 1073741824 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:53:18 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-74a5ba6b-19cf-47df-912f-ec1d6a242e57 tempest-CreateVolumesFromImageTest-1512620421 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (60fc99f6-fe22-4775-a1d1-1470a42f848b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-632fa08a-84bc-4075-8c5d-ffa519355541', 'volume_size': 1}' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:53:18 devstack sudo[105105]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-4d92adfc-13a4-4a30-bc36-33ea181065b8 1073741824 Jul 10 04:53:18 devstack sudo[105105]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:53:18 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-74a5ba6b-19cf-47df-912f-ec1d6a242e57 tempest-CreateVolumesFromImageTest-1512620421 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (61b532b7-a525-4a3a-ac5b-48b46193fed9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:53:18 devstack cinder-volume[87444]: INFO cinder.volume.flows.manager.create_volume [None req-74a5ba6b-19cf-47df-912f-ec1d6a242e57 tempest-CreateVolumesFromImageTest-1512620421 None] Volume volume-632fa08a-84bc-4075-8c5d-ffa519355541 (632fa08a-84bc-4075-8c5d-ffa519355541): created successfully Jul 10 04:53:18 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-74a5ba6b-19cf-47df-912f-ec1d6a242e57 tempest-CreateVolumesFromImageTest-1512620421 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (61b532b7-a525-4a3a-ac5b-48b46193fed9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:53:18 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-74a5ba6b-19cf-47df-912f-ec1d6a242e57 tempest-CreateVolumesFromImageTest-1512620421 None] Flow 'volume_create_manager' (3955feba-2e11-4708-9689-af16b62a9cf9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87444) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 04:53:18 devstack cinder-volume[87444]: INFO cinder.volume.manager [None req-74a5ba6b-19cf-47df-912f-ec1d6a242e57 tempest-CreateVolumesFromImageTest-1512620421 None] Created volume successfully. Jul 10 04:53:19 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-0eb9346e-a91d-4d2f-a4cf-8127518f1074 tempest-CreateVolumesFromImageTest-1512620421 None] Acquiring lock "cinder-632fa08a-84bc-4075-8c5d-ffa519355541-delete_volume" by "delete_volume" {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 04:53:19 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-0eb9346e-a91d-4d2f-a4cf-8127518f1074 tempest-CreateVolumesFromImageTest-1512620421 None] Lock "cinder-632fa08a-84bc-4075-8c5d-ffa519355541-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 04:53:19 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-0eb9346e-a91d-4d2f-a4cf-8127518f1074 tempest-CreateVolumesFromImageTest-1512620421 None] Acquiring lock "cinder-quobyte-632fa08a-84bc-4075-8c5d-ffa519355541" by "delete_volume" {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 04:53:19 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-0eb9346e-a91d-4d2f-a4cf-8127518f1074 tempest-CreateVolumesFromImageTest-1512620421 None] Lock "cinder-quobyte-632fa08a-84bc-4075-8c5d-ffa519355541" acquired by "delete_volume" :: waited 0.015s {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 04:53:19 devstack cinder-volume[87444]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ed04c0e-b9a5-47d7-8845-044927302bde]: (4, 'qcow2') {{(pid=88499) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 04:53:19 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-0eb9346e-a91d-4d2f-a4cf-8127518f1074 tempest-CreateVolumesFromImageTest-1512620421 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-632fa08a-84bc-4075-8c5d-ffa519355541 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:53:19 devstack sudo[105105]: pam_unix(sudo:session): session closed for user root Jul 10 04:53:19 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-66fbd605-70e0-41b0-ab4e-e369fc08f434 tempest-CreateVolumesFromSourceVolumeTest-476912221 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-4d92adfc-13a4-4a30-bc36-33ea181065b8 1073741824" returned: 0 in 0.889s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:53:19 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-66fbd605-70e0-41b0-ab4e-e369fc08f434 tempest-CreateVolumesFromSourceVolumeTest-476912221 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-4d92adfc-13a4-4a30-bc36-33ea181065b8 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:53:19 devstack sudo[105111]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-632fa08a-84bc-4075-8c5d-ffa519355541 Jul 10 04:53:19 devstack sudo[105111]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:53:19 devstack sudo[105113]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-4d92adfc-13a4-4a30-bc36-33ea181065b8 Jul 10 04:53:19 devstack sudo[105113]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:53:20 devstack sudo[105113]: pam_unix(sudo:session): session closed for user root Jul 10 04:53:20 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-66fbd605-70e0-41b0-ab4e-e369fc08f434 tempest-CreateVolumesFromSourceVolumeTest-476912221 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-4d92adfc-13a4-4a30-bc36-33ea181065b8" returned: 0 in 0.649s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:53:20 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-66fbd605-70e0-41b0-ab4e-e369fc08f434 tempest-CreateVolumesFromSourceVolumeTest-476912221 None] <== create_volume: return (1578ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922'} {{(pid=87444) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 04:53:20 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-66fbd605-70e0-41b0-ab4e-e369fc08f434 tempest-CreateVolumesFromSourceVolumeTest-476912221 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.582s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 04:53:20 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-f4888a96-dbc8-42a9-b855-33696dbafb00 tempest-CreateVolumesFromSourceVolumeTest-476912221 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 9.680s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 04:53:20 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-f4888a96-dbc8-42a9-b855-33696dbafb00 tempest-CreateVolumesFromSourceVolumeTest-476912221 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T02:53:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1386443866',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=81d1981f-6a8f-4f71-b189-63c66f977047,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5875dfdbb91249d4ab2dac0b694d375a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T02:53:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T02:53:10Z,use_quota=True,user_id='9f2d5539942c4adab93ad80cee4d06f1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(317e369e-1e06-434d-ae95-a335f0e6c903),volume_type_id=317e369e-1e06-434d-ae95-a335f0e6c903)}" {{(pid=87444) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 04:53:20 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.remotefs [None req-f4888a96-dbc8-42a9-b855-33696dbafb00 tempest-CreateVolumesFromSourceVolumeTest-476912221 None] Creating volume 81d1981f-6a8f-4f71-b189-63c66f977047 {{(pid=87444) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 04:53:20 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-f4888a96-dbc8-42a9-b855-33696dbafb00 tempest-CreateVolumesFromSourceVolumeTest-476912221 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 04:53:20 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-f4888a96-dbc8-42a9-b855-33696dbafb00 tempest-CreateVolumesFromSourceVolumeTest-476912221 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 04:53:20 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-f4888a96-dbc8-42a9-b855-33696dbafb00 tempest-CreateVolumesFromSourceVolumeTest-476912221 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922': None} {{(pid=87444) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 04:53:20 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-f4888a96-dbc8-42a9-b855-33696dbafb00 tempest-CreateVolumesFromSourceVolumeTest-476912221 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922'] {{(pid=87444) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 04:53:20 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-f4888a96-dbc8-42a9-b855-33696dbafb00 tempest-CreateVolumesFromSourceVolumeTest-476912221 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 04:53:20 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-f4888a96-dbc8-42a9-b855-33696dbafb00 tempest-CreateVolumesFromSourceVolumeTest-476912221 None] Selected osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922 as target Quobyte volume. {{(pid=87444) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 04:53:20 devstack cinder-volume[87444]: INFO cinder.volume.drivers.remotefs [None req-f4888a96-dbc8-42a9-b855-33696dbafb00 tempest-CreateVolumesFromSourceVolumeTest-476912221 None] casted to osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922 Jul 10 04:53:20 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-f4888a96-dbc8-42a9-b855-33696dbafb00 tempest-CreateVolumesFromSourceVolumeTest-476912221 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-81d1981f-6a8f-4f71-b189-63c66f977047 1073741824 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:53:20 devstack sudo[105111]: pam_unix(sudo:session): session closed for user root Jul 10 04:53:20 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-0eb9346e-a91d-4d2f-a4cf-8127518f1074 tempest-CreateVolumesFromImageTest-1512620421 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-632fa08a-84bc-4075-8c5d-ffa519355541" returned: 0 in 0.793s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:53:20 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-0eb9346e-a91d-4d2f-a4cf-8127518f1074 tempest-CreateVolumesFromImageTest-1512620421 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-632fa08a-84bc-4075-8c5d-ffa519355541 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:53:20 devstack sudo[105119]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-81d1981f-6a8f-4f71-b189-63c66f977047 1073741824 Jul 10 04:53:20 devstack sudo[105119]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:53:20 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-66fbd605-70e0-41b0-ab4e-e369fc08f434 tempest-CreateVolumesFromSourceVolumeTest-476912221 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (22312c79-1de6-47da-b7ff-dd256fd7fcd4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4d92adfc-13a4-4a30-bc36-33ea181065b8', 'volume_size': 1}' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:53:20 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-66fbd605-70e0-41b0-ab4e-e369fc08f434 tempest-CreateVolumesFromSourceVolumeTest-476912221 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6eefa148-0ce6-47db-868c-386c92c9b1f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:53:20 devstack sudo[105121]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-632fa08a-84bc-4075-8c5d-ffa519355541 Jul 10 04:53:20 devstack sudo[105121]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:53:20 devstack cinder-volume[87444]: INFO cinder.volume.flows.manager.create_volume [None req-66fbd605-70e0-41b0-ab4e-e369fc08f434 tempest-CreateVolumesFromSourceVolumeTest-476912221 None] Volume volume-4d92adfc-13a4-4a30-bc36-33ea181065b8 (4d92adfc-13a4-4a30-bc36-33ea181065b8): created successfully Jul 10 04:53:20 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-66fbd605-70e0-41b0-ab4e-e369fc08f434 tempest-CreateVolumesFromSourceVolumeTest-476912221 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6eefa148-0ce6-47db-868c-386c92c9b1f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:53:20 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-66fbd605-70e0-41b0-ab4e-e369fc08f434 tempest-CreateVolumesFromSourceVolumeTest-476912221 None] Flow 'volume_create_manager' (b27b5efe-1c87-4138-a64f-d0e96f9901cb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87444) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 04:53:20 devstack cinder-volume[87444]: INFO cinder.volume.manager [None req-66fbd605-70e0-41b0-ab4e-e369fc08f434 tempest-CreateVolumesFromSourceVolumeTest-476912221 None] Created volume successfully. Jul 10 04:53:20 devstack sudo[105121]: pam_unix(sudo:session): session closed for user root Jul 10 04:53:20 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-0eb9346e-a91d-4d2f-a4cf-8127518f1074 tempest-CreateVolumesFromImageTest-1512620421 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-632fa08a-84bc-4075-8c5d-ffa519355541" returned: 0 in 0.704s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:53:20 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-0eb9346e-a91d-4d2f-a4cf-8127518f1074 tempest-CreateVolumesFromImageTest-1512620421 None] Lock "cinder-quobyte-632fa08a-84bc-4075-8c5d-ffa519355541" released by "delete_volume" :: held 1.538s {{(pid=87444) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 04:53:20 devstack cinder-volume[87444]: DEBUG cinder.quota [None req-0eb9346e-a91d-4d2f-a4cf-8127518f1074 tempest-CreateVolumesFromImageTest-1512620421 None] Created reservations ['1b161f32-1276-4eec-8842-6a518358c649', '72b72791-a0c7-4879-aed3-3f3c0cf4ac6c', '7a1bc559-6fbc-4fdf-9219-426216d2fad6', 'eac6a937-72af-4a60-b913-74e99a02eafc'] {{(pid=87444) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 04:53:20 devstack sudo[105119]: pam_unix(sudo:session): session closed for user root Jul 10 04:53:20 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-f4888a96-dbc8-42a9-b855-33696dbafb00 tempest-CreateVolumesFromSourceVolumeTest-476912221 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-81d1981f-6a8f-4f71-b189-63c66f977047 1073741824" returned: 0 in 0.847s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:53:20 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-0eb9346e-a91d-4d2f-a4cf-8127518f1074 tempest-CreateVolumesFromImageTest-1512620421 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 04:53:20 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-0eb9346e-a91d-4d2f-a4cf-8127518f1074 tempest-CreateVolumesFromImageTest-1512620421 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 04:53:20 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-0eb9346e-a91d-4d2f-a4cf-8127518f1074 tempest-CreateVolumesFromImageTest-1512620421 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922': None} {{(pid=87444) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 04:53:20 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-0eb9346e-a91d-4d2f-a4cf-8127518f1074 tempest-CreateVolumesFromImageTest-1512620421 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922'] {{(pid=87444) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 04:53:20 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-0eb9346e-a91d-4d2f-a4cf-8127518f1074 tempest-CreateVolumesFromImageTest-1512620421 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 04:53:20 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-0eb9346e-a91d-4d2f-a4cf-8127518f1074 tempest-CreateVolumesFromImageTest-1512620421 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:53:20 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-f4888a96-dbc8-42a9-b855-33696dbafb00 tempest-CreateVolumesFromSourceVolumeTest-476912221 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-81d1981f-6a8f-4f71-b189-63c66f977047 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:53:20 devstack sudo[105128]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097 Jul 10 04:53:20 devstack sudo[105128]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:53:20 devstack sudo[105129]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-81d1981f-6a8f-4f71-b189-63c66f977047 Jul 10 04:53:20 devstack sudo[105129]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:53:21 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-08c039f9-0f41-48ab-8f0a-68876ff34b4d tempest-CreateVolumesFromImageTest-1512620421 None] Acquiring lock "cinder-37c5ed0d-7513-4a6e-9e78-be95fd22099f-delete_volume" by "delete_volume" {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 04:53:21 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-08c039f9-0f41-48ab-8f0a-68876ff34b4d tempest-CreateVolumesFromImageTest-1512620421 None] Lock "cinder-37c5ed0d-7513-4a6e-9e78-be95fd22099f-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 04:53:21 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-08c039f9-0f41-48ab-8f0a-68876ff34b4d tempest-CreateVolumesFromImageTest-1512620421 None] Acquiring lock "cinder-quobyte-37c5ed0d-7513-4a6e-9e78-be95fd22099f" by "delete_volume" {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 04:53:21 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-08c039f9-0f41-48ab-8f0a-68876ff34b4d tempest-CreateVolumesFromImageTest-1512620421 None] Lock "cinder-quobyte-37c5ed0d-7513-4a6e-9e78-be95fd22099f" acquired by "delete_volume" :: waited 0.018s {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 04:53:21 devstack cinder-volume[87444]: DEBUG oslo.privsep.daemon [-] privsep: reply[570ff137-c2a3-406e-9c97-d3b02950c706]: (4, 'qcow2') {{(pid=88499) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 04:53:21 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-08c039f9-0f41-48ab-8f0a-68876ff34b4d tempest-CreateVolumesFromImageTest-1512620421 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-37c5ed0d-7513-4a6e-9e78-be95fd22099f {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:53:21 devstack sudo[105129]: pam_unix(sudo:session): session closed for user root Jul 10 04:53:21 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-f4888a96-dbc8-42a9-b855-33696dbafb00 tempest-CreateVolumesFromSourceVolumeTest-476912221 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-81d1981f-6a8f-4f71-b189-63c66f977047" returned: 0 in 0.678s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:53:21 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-f4888a96-dbc8-42a9-b855-33696dbafb00 tempest-CreateVolumesFromSourceVolumeTest-476912221 None] <== create_volume: return (1591ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922'} {{(pid=87444) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 04:53:21 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-f4888a96-dbc8-42a9-b855-33696dbafb00 tempest-CreateVolumesFromSourceVolumeTest-476912221 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.593s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 04:53:21 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-d5d9e2bf-dd51-4cea-b498-694c1b04f9cc tempest-CreateVolumesFromSourceVolumeTest-476912221 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 10.748s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 04:53:21 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-d5d9e2bf-dd51-4cea-b498-694c1b04f9cc tempest-CreateVolumesFromSourceVolumeTest-476912221 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T02:53:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-150658558',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b3decc1b-92ad-455d-a22d-0583f61bb9be,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5875dfdbb91249d4ab2dac0b694d375a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T02:53:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T02:53:11Z,use_quota=True,user_id='9f2d5539942c4adab93ad80cee4d06f1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(317e369e-1e06-434d-ae95-a335f0e6c903),volume_type_id=317e369e-1e06-434d-ae95-a335f0e6c903)}" {{(pid=87444) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 04:53:21 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.remotefs [None req-d5d9e2bf-dd51-4cea-b498-694c1b04f9cc tempest-CreateVolumesFromSourceVolumeTest-476912221 None] Creating volume b3decc1b-92ad-455d-a22d-0583f61bb9be {{(pid=87444) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 04:53:21 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-d5d9e2bf-dd51-4cea-b498-694c1b04f9cc tempest-CreateVolumesFromSourceVolumeTest-476912221 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 04:53:21 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-d5d9e2bf-dd51-4cea-b498-694c1b04f9cc tempest-CreateVolumesFromSourceVolumeTest-476912221 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 04:53:21 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-d5d9e2bf-dd51-4cea-b498-694c1b04f9cc tempest-CreateVolumesFromSourceVolumeTest-476912221 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922': None} {{(pid=87444) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 04:53:21 devstack sudo[105128]: pam_unix(sudo:session): session closed for user root Jul 10 04:53:21 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-d5d9e2bf-dd51-4cea-b498-694c1b04f9cc tempest-CreateVolumesFromSourceVolumeTest-476912221 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922'] {{(pid=87444) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 04:53:21 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-d5d9e2bf-dd51-4cea-b498-694c1b04f9cc tempest-CreateVolumesFromSourceVolumeTest-476912221 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 04:53:21 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-d5d9e2bf-dd51-4cea-b498-694c1b04f9cc tempest-CreateVolumesFromSourceVolumeTest-476912221 None] Selected osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922 as target Quobyte volume. {{(pid=87444) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 04:53:21 devstack cinder-volume[87444]: INFO cinder.volume.drivers.remotefs [None req-d5d9e2bf-dd51-4cea-b498-694c1b04f9cc tempest-CreateVolumesFromSourceVolumeTest-476912221 None] casted to osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922 Jul 10 04:53:21 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-d5d9e2bf-dd51-4cea-b498-694c1b04f9cc tempest-CreateVolumesFromSourceVolumeTest-476912221 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-b3decc1b-92ad-455d-a22d-0583f61bb9be 1073741824 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:53:21 devstack sudo[105134]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-37c5ed0d-7513-4a6e-9e78-be95fd22099f Jul 10 04:53:21 devstack sudo[105134]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:53:21 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-0eb9346e-a91d-4d2f-a4cf-8127518f1074 tempest-CreateVolumesFromImageTest-1512620421 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097" returned: 0 in 0.746s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:53:21 devstack cinder-volume[87444]: DEBUG cinder.manager [None req-0eb9346e-a91d-4d2f-a4cf-8127518f1074 tempest-CreateVolumesFromImageTest-1512620421 None] Notifying Schedulers of capabilities ... {{(pid=87444) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 04:53:21 devstack cinder-volume[87444]: INFO cinder.volume.manager [None req-0eb9346e-a91d-4d2f-a4cf-8127518f1074 tempest-CreateVolumesFromImageTest-1512620421 None] Deleted volume successfully. Jul 10 04:53:21 devstack sudo[105135]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-b3decc1b-92ad-455d-a22d-0583f61bb9be 1073741824 Jul 10 04:53:21 devstack sudo[105135]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:53:21 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-f4888a96-dbc8-42a9-b855-33696dbafb00 tempest-CreateVolumesFromSourceVolumeTest-476912221 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c3772479-267b-45b2-bc3e-9f6bd31e1e1d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-81d1981f-6a8f-4f71-b189-63c66f977047', 'volume_size': 1}' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:53:21 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-f4888a96-dbc8-42a9-b855-33696dbafb00 tempest-CreateVolumesFromSourceVolumeTest-476912221 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d4a82eb3-ff00-4425-a75a-3318ad8ae192) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:53:21 devstack cinder-volume[87444]: INFO cinder.volume.flows.manager.create_volume [None req-f4888a96-dbc8-42a9-b855-33696dbafb00 tempest-CreateVolumesFromSourceVolumeTest-476912221 None] Volume volume-81d1981f-6a8f-4f71-b189-63c66f977047 (81d1981f-6a8f-4f71-b189-63c66f977047): created successfully Jul 10 04:53:21 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-f4888a96-dbc8-42a9-b855-33696dbafb00 tempest-CreateVolumesFromSourceVolumeTest-476912221 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d4a82eb3-ff00-4425-a75a-3318ad8ae192) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:53:21 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-f4888a96-dbc8-42a9-b855-33696dbafb00 tempest-CreateVolumesFromSourceVolumeTest-476912221 None] Flow 'volume_create_manager' (182c6f12-5428-4b72-9577-98544ddbbfae) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87444) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 04:53:21 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-0eb9346e-a91d-4d2f-a4cf-8127518f1074 tempest-CreateVolumesFromImageTest-1512620421 None] Lock "cinder-632fa08a-84bc-4075-8c5d-ffa519355541-delete_volume" released by "delete_volume" :: held 2.558s {{(pid=87444) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 04:53:21 devstack cinder-volume[87444]: INFO cinder.volume.manager [None req-f4888a96-dbc8-42a9-b855-33696dbafb00 tempest-CreateVolumesFromSourceVolumeTest-476912221 None] Created volume successfully. Jul 10 04:53:22 devstack sudo[105134]: pam_unix(sudo:session): session closed for user root Jul 10 04:53:22 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-08c039f9-0f41-48ab-8f0a-68876ff34b4d tempest-CreateVolumesFromImageTest-1512620421 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-37c5ed0d-7513-4a6e-9e78-be95fd22099f" returned: 0 in 0.790s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:53:22 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-08c039f9-0f41-48ab-8f0a-68876ff34b4d tempest-CreateVolumesFromImageTest-1512620421 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-37c5ed0d-7513-4a6e-9e78-be95fd22099f {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:53:22 devstack sudo[105144]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-37c5ed0d-7513-4a6e-9e78-be95fd22099f Jul 10 04:53:22 devstack sudo[105144]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:53:22 devstack sudo[105135]: pam_unix(sudo:session): session closed for user root Jul 10 04:53:22 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-d5d9e2bf-dd51-4cea-b498-694c1b04f9cc tempest-CreateVolumesFromSourceVolumeTest-476912221 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-b3decc1b-92ad-455d-a22d-0583f61bb9be 1073741824" returned: 0 in 0.898s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:53:22 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-d5d9e2bf-dd51-4cea-b498-694c1b04f9cc tempest-CreateVolumesFromSourceVolumeTest-476912221 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-b3decc1b-92ad-455d-a22d-0583f61bb9be {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:53:22 devstack sudo[105147]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-b3decc1b-92ad-455d-a22d-0583f61bb9be Jul 10 04:53:22 devstack sudo[105147]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:53:23 devstack sudo[105144]: pam_unix(sudo:session): session closed for user root Jul 10 04:53:23 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-08c039f9-0f41-48ab-8f0a-68876ff34b4d tempest-CreateVolumesFromImageTest-1512620421 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-37c5ed0d-7513-4a6e-9e78-be95fd22099f" returned: 0 in 0.654s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:53:23 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-08c039f9-0f41-48ab-8f0a-68876ff34b4d tempest-CreateVolumesFromImageTest-1512620421 None] Lock "cinder-quobyte-37c5ed0d-7513-4a6e-9e78-be95fd22099f" released by "delete_volume" :: held 1.491s {{(pid=87444) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 04:53:23 devstack cinder-volume[87444]: DEBUG cinder.quota [None req-08c039f9-0f41-48ab-8f0a-68876ff34b4d tempest-CreateVolumesFromImageTest-1512620421 None] Created reservations ['3d8d8010-9452-4d54-83de-bb995de0d555', '5115fb0a-e860-4fb0-bc7b-0f47d466b9c7', '928597c2-effd-42ee-a23c-ecafef45445e', '0fe86b3f-cc6c-4bba-ac2c-dbfc2c637818'] {{(pid=87444) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 04:53:23 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-08c039f9-0f41-48ab-8f0a-68876ff34b4d tempest-CreateVolumesFromImageTest-1512620421 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 04:53:23 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-08c039f9-0f41-48ab-8f0a-68876ff34b4d tempest-CreateVolumesFromImageTest-1512620421 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 04:53:23 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-08c039f9-0f41-48ab-8f0a-68876ff34b4d tempest-CreateVolumesFromImageTest-1512620421 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922': None} {{(pid=87444) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 04:53:23 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-08c039f9-0f41-48ab-8f0a-68876ff34b4d tempest-CreateVolumesFromImageTest-1512620421 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922'] {{(pid=87444) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 04:53:23 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-08c039f9-0f41-48ab-8f0a-68876ff34b4d tempest-CreateVolumesFromImageTest-1512620421 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 04:53:23 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-08c039f9-0f41-48ab-8f0a-68876ff34b4d tempest-CreateVolumesFromImageTest-1512620421 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:53:23 devstack sudo[105151]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097 Jul 10 04:53:23 devstack sudo[105151]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:53:23 devstack sudo[105147]: pam_unix(sudo:session): session closed for user root Jul 10 04:53:23 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-d5d9e2bf-dd51-4cea-b498-694c1b04f9cc tempest-CreateVolumesFromSourceVolumeTest-476912221 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-b3decc1b-92ad-455d-a22d-0583f61bb9be" returned: 0 in 0.640s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:53:23 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-d5d9e2bf-dd51-4cea-b498-694c1b04f9cc tempest-CreateVolumesFromSourceVolumeTest-476912221 None] <== create_volume: return (1590ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922'} {{(pid=87444) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 04:53:23 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-d5d9e2bf-dd51-4cea-b498-694c1b04f9cc tempest-CreateVolumesFromSourceVolumeTest-476912221 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.594s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 04:53:23 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-d0a3d0b1-18d7-4f01-a9a1-b30482465d6c tempest-CreateVolumesFromSourceVolumeTest-476912221 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 12.049s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 04:53:23 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-d0a3d0b1-18d7-4f01-a9a1-b30482465d6c tempest-CreateVolumesFromSourceVolumeTest-476912221 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T02:53:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1074293448',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f4706ac5-3c3b-4a10-8ed3-493af8c34005,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5875dfdbb91249d4ab2dac0b694d375a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T02:53:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T02:53:11Z,use_quota=True,user_id='9f2d5539942c4adab93ad80cee4d06f1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(317e369e-1e06-434d-ae95-a335f0e6c903),volume_type_id=317e369e-1e06-434d-ae95-a335f0e6c903)}" {{(pid=87444) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 04:53:23 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.remotefs [None req-d0a3d0b1-18d7-4f01-a9a1-b30482465d6c tempest-CreateVolumesFromSourceVolumeTest-476912221 None] Creating volume f4706ac5-3c3b-4a10-8ed3-493af8c34005 {{(pid=87444) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 04:53:23 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-d0a3d0b1-18d7-4f01-a9a1-b30482465d6c tempest-CreateVolumesFromSourceVolumeTest-476912221 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 04:53:23 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-d0a3d0b1-18d7-4f01-a9a1-b30482465d6c tempest-CreateVolumesFromSourceVolumeTest-476912221 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 04:53:23 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-d0a3d0b1-18d7-4f01-a9a1-b30482465d6c tempest-CreateVolumesFromSourceVolumeTest-476912221 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922': None} {{(pid=87444) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 04:53:23 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-d0a3d0b1-18d7-4f01-a9a1-b30482465d6c tempest-CreateVolumesFromSourceVolumeTest-476912221 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922'] {{(pid=87444) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 04:53:23 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-d0a3d0b1-18d7-4f01-a9a1-b30482465d6c tempest-CreateVolumesFromSourceVolumeTest-476912221 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 04:53:23 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-d0a3d0b1-18d7-4f01-a9a1-b30482465d6c tempest-CreateVolumesFromSourceVolumeTest-476912221 None] Selected osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922 as target Quobyte volume. {{(pid=87444) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 04:53:23 devstack cinder-volume[87444]: INFO cinder.volume.drivers.remotefs [None req-d0a3d0b1-18d7-4f01-a9a1-b30482465d6c tempest-CreateVolumesFromSourceVolumeTest-476912221 None] casted to osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922 Jul 10 04:53:23 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-d0a3d0b1-18d7-4f01-a9a1-b30482465d6c tempest-CreateVolumesFromSourceVolumeTest-476912221 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-f4706ac5-3c3b-4a10-8ed3-493af8c34005 1073741824 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:53:23 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-d5d9e2bf-dd51-4cea-b498-694c1b04f9cc tempest-CreateVolumesFromSourceVolumeTest-476912221 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fe7e495f-e8d5-47c9-895e-1bfe5f3fe364) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b3decc1b-92ad-455d-a22d-0583f61bb9be', 'volume_size': 1}' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:53:23 devstack sudo[105153]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-f4706ac5-3c3b-4a10-8ed3-493af8c34005 1073741824 Jul 10 04:53:23 devstack sudo[105153]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:53:23 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-d5d9e2bf-dd51-4cea-b498-694c1b04f9cc tempest-CreateVolumesFromSourceVolumeTest-476912221 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (120c4918-81b1-4c48-8fe8-4c72a2ac54f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:53:23 devstack cinder-volume[87444]: INFO cinder.volume.flows.manager.create_volume [None req-d5d9e2bf-dd51-4cea-b498-694c1b04f9cc tempest-CreateVolumesFromSourceVolumeTest-476912221 None] Volume volume-b3decc1b-92ad-455d-a22d-0583f61bb9be (b3decc1b-92ad-455d-a22d-0583f61bb9be): created successfully Jul 10 04:53:23 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-d5d9e2bf-dd51-4cea-b498-694c1b04f9cc tempest-CreateVolumesFromSourceVolumeTest-476912221 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (120c4918-81b1-4c48-8fe8-4c72a2ac54f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:53:23 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-d5d9e2bf-dd51-4cea-b498-694c1b04f9cc tempest-CreateVolumesFromSourceVolumeTest-476912221 None] Flow 'volume_create_manager' (86bc3c2d-cdeb-4342-aafa-f99b029fb88d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87444) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 04:53:23 devstack cinder-volume[87444]: INFO cinder.volume.manager [None req-d5d9e2bf-dd51-4cea-b498-694c1b04f9cc tempest-CreateVolumesFromSourceVolumeTest-476912221 None] Created volume successfully. Jul 10 04:53:23 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-8cc3451d-1c56-4717-a81c-68dc28e75479 tempest-CreateVolumesFromImageTest-1512620421 None] Acquiring lock "cinder-3df62cd2-4ea0-4528-a7bd-736121741f29-delete_volume" by "delete_volume" {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 04:53:23 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-8cc3451d-1c56-4717-a81c-68dc28e75479 tempest-CreateVolumesFromImageTest-1512620421 None] Lock "cinder-3df62cd2-4ea0-4528-a7bd-736121741f29-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 04:53:23 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-8cc3451d-1c56-4717-a81c-68dc28e75479 tempest-CreateVolumesFromImageTest-1512620421 None] Acquiring lock "cinder-quobyte-3df62cd2-4ea0-4528-a7bd-736121741f29" by "delete_volume" {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 04:53:23 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-8cc3451d-1c56-4717-a81c-68dc28e75479 tempest-CreateVolumesFromImageTest-1512620421 None] Lock "cinder-quobyte-3df62cd2-4ea0-4528-a7bd-736121741f29" acquired by "delete_volume" :: waited 0.023s {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 04:53:23 devstack cinder-volume[87444]: DEBUG oslo.privsep.daemon [-] privsep: reply[996a82c6-e0b7-4517-8a3b-8db457beb963]: (4, 'qcow2') {{(pid=88499) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 04:53:23 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-8cc3451d-1c56-4717-a81c-68dc28e75479 tempest-CreateVolumesFromImageTest-1512620421 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-3df62cd2-4ea0-4528-a7bd-736121741f29 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:53:23 devstack sudo[105159]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-3df62cd2-4ea0-4528-a7bd-736121741f29 Jul 10 04:53:23 devstack sudo[105159]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:53:23 devstack sudo[105151]: pam_unix(sudo:session): session closed for user root Jul 10 04:53:23 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-08c039f9-0f41-48ab-8f0a-68876ff34b4d tempest-CreateVolumesFromImageTest-1512620421 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097" returned: 0 in 0.770s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:53:23 devstack cinder-volume[87444]: DEBUG cinder.manager [None req-08c039f9-0f41-48ab-8f0a-68876ff34b4d tempest-CreateVolumesFromImageTest-1512620421 None] Notifying Schedulers of capabilities ... {{(pid=87444) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 04:53:23 devstack cinder-volume[87444]: INFO cinder.volume.manager [None req-08c039f9-0f41-48ab-8f0a-68876ff34b4d tempest-CreateVolumesFromImageTest-1512620421 None] Deleted volume successfully. Jul 10 04:53:23 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-08c039f9-0f41-48ab-8f0a-68876ff34b4d tempest-CreateVolumesFromImageTest-1512620421 None] Lock "cinder-37c5ed0d-7513-4a6e-9e78-be95fd22099f-delete_volume" released by "delete_volume" :: held 2.493s {{(pid=87444) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 04:53:24 devstack sudo[105153]: pam_unix(sudo:session): session closed for user root Jul 10 04:53:24 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-d0a3d0b1-18d7-4f01-a9a1-b30482465d6c tempest-CreateVolumesFromSourceVolumeTest-476912221 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-f4706ac5-3c3b-4a10-8ed3-493af8c34005 1073741824" returned: 0 in 0.841s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:53:24 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-d0a3d0b1-18d7-4f01-a9a1-b30482465d6c tempest-CreateVolumesFromSourceVolumeTest-476912221 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-f4706ac5-3c3b-4a10-8ed3-493af8c34005 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:53:24 devstack sudo[105162]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-f4706ac5-3c3b-4a10-8ed3-493af8c34005 Jul 10 04:53:24 devstack sudo[105162]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:53:24 devstack sudo[105159]: pam_unix(sudo:session): session closed for user root Jul 10 04:53:24 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-8cc3451d-1c56-4717-a81c-68dc28e75479 tempest-CreateVolumesFromImageTest-1512620421 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-3df62cd2-4ea0-4528-a7bd-736121741f29" returned: 0 in 0.797s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:53:24 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-8cc3451d-1c56-4717-a81c-68dc28e75479 tempest-CreateVolumesFromImageTest-1512620421 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-3df62cd2-4ea0-4528-a7bd-736121741f29 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:53:24 devstack sudo[105167]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-3df62cd2-4ea0-4528-a7bd-736121741f29 Jul 10 04:53:24 devstack sudo[105167]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:53:24 devstack sudo[105162]: pam_unix(sudo:session): session closed for user root Jul 10 04:53:24 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-d0a3d0b1-18d7-4f01-a9a1-b30482465d6c tempest-CreateVolumesFromSourceVolumeTest-476912221 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-f4706ac5-3c3b-4a10-8ed3-493af8c34005" returned: 0 in 0.702s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:53:24 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-d0a3d0b1-18d7-4f01-a9a1-b30482465d6c tempest-CreateVolumesFromSourceVolumeTest-476912221 None] <== create_volume: return (1583ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922'} {{(pid=87444) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 04:53:24 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-d0a3d0b1-18d7-4f01-a9a1-b30482465d6c tempest-CreateVolumesFromSourceVolumeTest-476912221 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.588s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 04:53:24 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-57197ffa-1db2-4faf-8b08-b3d4f6204840 tempest-CreateVolumesFromSourceVolumeTest-476912221 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 13.203s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 04:53:24 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-57197ffa-1db2-4faf-8b08-b3d4f6204840 tempest-CreateVolumesFromSourceVolumeTest-476912221 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T02:53:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-237259959',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7a29f5d0-927e-421e-aaa1-bfca6dfeb8f9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5875dfdbb91249d4ab2dac0b694d375a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T02:53:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T02:53:11Z,use_quota=True,user_id='9f2d5539942c4adab93ad80cee4d06f1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(317e369e-1e06-434d-ae95-a335f0e6c903),volume_type_id=317e369e-1e06-434d-ae95-a335f0e6c903)}" {{(pid=87444) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 04:53:24 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.remotefs [None req-57197ffa-1db2-4faf-8b08-b3d4f6204840 tempest-CreateVolumesFromSourceVolumeTest-476912221 None] Creating volume 7a29f5d0-927e-421e-aaa1-bfca6dfeb8f9 {{(pid=87444) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 04:53:24 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-57197ffa-1db2-4faf-8b08-b3d4f6204840 tempest-CreateVolumesFromSourceVolumeTest-476912221 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 04:53:24 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-57197ffa-1db2-4faf-8b08-b3d4f6204840 tempest-CreateVolumesFromSourceVolumeTest-476912221 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 04:53:24 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-57197ffa-1db2-4faf-8b08-b3d4f6204840 tempest-CreateVolumesFromSourceVolumeTest-476912221 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922': None} {{(pid=87444) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 04:53:24 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-57197ffa-1db2-4faf-8b08-b3d4f6204840 tempest-CreateVolumesFromSourceVolumeTest-476912221 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922'] {{(pid=87444) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 04:53:24 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-57197ffa-1db2-4faf-8b08-b3d4f6204840 tempest-CreateVolumesFromSourceVolumeTest-476912221 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 04:53:24 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-57197ffa-1db2-4faf-8b08-b3d4f6204840 tempest-CreateVolumesFromSourceVolumeTest-476912221 None] Selected osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922 as target Quobyte volume. {{(pid=87444) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 04:53:24 devstack cinder-volume[87444]: INFO cinder.volume.drivers.remotefs [None req-57197ffa-1db2-4faf-8b08-b3d4f6204840 tempest-CreateVolumesFromSourceVolumeTest-476912221 None] casted to osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922 Jul 10 04:53:24 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-57197ffa-1db2-4faf-8b08-b3d4f6204840 tempest-CreateVolumesFromSourceVolumeTest-476912221 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-7a29f5d0-927e-421e-aaa1-bfca6dfeb8f9 1073741824 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:53:24 devstack sudo[105170]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-7a29f5d0-927e-421e-aaa1-bfca6dfeb8f9 1073741824 Jul 10 04:53:24 devstack sudo[105170]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:53:24 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-d0a3d0b1-18d7-4f01-a9a1-b30482465d6c tempest-CreateVolumesFromSourceVolumeTest-476912221 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (77b9cce3-5243-4188-a564-336fad99cd6b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f4706ac5-3c3b-4a10-8ed3-493af8c34005', 'volume_size': 1}' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:53:24 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-d0a3d0b1-18d7-4f01-a9a1-b30482465d6c tempest-CreateVolumesFromSourceVolumeTest-476912221 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ecb9f8d3-0302-4639-89b0-c2549da51424) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:53:24 devstack cinder-volume[87444]: INFO cinder.volume.flows.manager.create_volume [None req-d0a3d0b1-18d7-4f01-a9a1-b30482465d6c tempest-CreateVolumesFromSourceVolumeTest-476912221 None] Volume volume-f4706ac5-3c3b-4a10-8ed3-493af8c34005 (f4706ac5-3c3b-4a10-8ed3-493af8c34005): created successfully Jul 10 04:53:24 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-d0a3d0b1-18d7-4f01-a9a1-b30482465d6c tempest-CreateVolumesFromSourceVolumeTest-476912221 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ecb9f8d3-0302-4639-89b0-c2549da51424) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:53:24 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-d0a3d0b1-18d7-4f01-a9a1-b30482465d6c tempest-CreateVolumesFromSourceVolumeTest-476912221 None] Flow 'volume_create_manager' (80f944e7-0847-4eb4-810b-30b74b9f36bd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87444) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 04:53:24 devstack cinder-volume[87444]: INFO cinder.volume.manager [None req-d0a3d0b1-18d7-4f01-a9a1-b30482465d6c tempest-CreateVolumesFromSourceVolumeTest-476912221 None] Created volume successfully. Jul 10 04:53:25 devstack sudo[105167]: pam_unix(sudo:session): session closed for user root Jul 10 04:53:25 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-8cc3451d-1c56-4717-a81c-68dc28e75479 tempest-CreateVolumesFromImageTest-1512620421 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-3df62cd2-4ea0-4528-a7bd-736121741f29" returned: 0 in 0.643s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:53:25 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-8cc3451d-1c56-4717-a81c-68dc28e75479 tempest-CreateVolumesFromImageTest-1512620421 None] Lock "cinder-quobyte-3df62cd2-4ea0-4528-a7bd-736121741f29" released by "delete_volume" :: held 1.493s {{(pid=87444) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 04:53:25 devstack cinder-volume[87444]: DEBUG cinder.quota [None req-8cc3451d-1c56-4717-a81c-68dc28e75479 tempest-CreateVolumesFromImageTest-1512620421 None] Created reservations ['9940e562-ae01-45be-833d-4619424f21a4', '598b59f6-a020-42f3-8d2d-2beb71f4f3a5', 'bf53a495-658f-4cd9-9f5c-042f6fc5e8b9', '91accc37-6deb-47b0-ab87-4e791fe0a34b'] {{(pid=87444) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 04:53:25 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-8cc3451d-1c56-4717-a81c-68dc28e75479 tempest-CreateVolumesFromImageTest-1512620421 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 04:53:25 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-8cc3451d-1c56-4717-a81c-68dc28e75479 tempest-CreateVolumesFromImageTest-1512620421 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 04:53:25 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-8cc3451d-1c56-4717-a81c-68dc28e75479 tempest-CreateVolumesFromImageTest-1512620421 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922': None} {{(pid=87444) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 04:53:25 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-8cc3451d-1c56-4717-a81c-68dc28e75479 tempest-CreateVolumesFromImageTest-1512620421 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922'] {{(pid=87444) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 04:53:25 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-8cc3451d-1c56-4717-a81c-68dc28e75479 tempest-CreateVolumesFromImageTest-1512620421 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 04:53:25 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-8cc3451d-1c56-4717-a81c-68dc28e75479 tempest-CreateVolumesFromImageTest-1512620421 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:53:25 devstack sudo[105173]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097 Jul 10 04:53:25 devstack sudo[105173]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:53:25 devstack sudo[105170]: pam_unix(sudo:session): session closed for user root Jul 10 04:53:25 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-57197ffa-1db2-4faf-8b08-b3d4f6204840 tempest-CreateVolumesFromSourceVolumeTest-476912221 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-7a29f5d0-927e-421e-aaa1-bfca6dfeb8f9 1073741824" returned: 0 in 0.885s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:53:25 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-57197ffa-1db2-4faf-8b08-b3d4f6204840 tempest-CreateVolumesFromSourceVolumeTest-476912221 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-7a29f5d0-927e-421e-aaa1-bfca6dfeb8f9 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:53:25 devstack sudo[105178]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-7a29f5d0-927e-421e-aaa1-bfca6dfeb8f9 Jul 10 04:53:25 devstack sudo[105178]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:53:25 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-e7a0b622-394f-4fed-8fa7-5cd56c0f85b8 tempest-CreateVolumesFromImageTest-1512620421 None] Acquiring lock "cinder-d05e8536-35ba-463c-820a-8eeebc0fa9cc-delete_volume" by "delete_volume" {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 04:53:25 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-e7a0b622-394f-4fed-8fa7-5cd56c0f85b8 tempest-CreateVolumesFromImageTest-1512620421 None] Lock "cinder-d05e8536-35ba-463c-820a-8eeebc0fa9cc-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 04:53:25 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-e7a0b622-394f-4fed-8fa7-5cd56c0f85b8 tempest-CreateVolumesFromImageTest-1512620421 None] Acquiring lock "cinder-quobyte-d05e8536-35ba-463c-820a-8eeebc0fa9cc" by "delete_volume" {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 04:53:26 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-e7a0b622-394f-4fed-8fa7-5cd56c0f85b8 tempest-CreateVolumesFromImageTest-1512620421 None] Lock "cinder-quobyte-d05e8536-35ba-463c-820a-8eeebc0fa9cc" acquired by "delete_volume" :: waited 0.014s {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 04:53:26 devstack cinder-volume[87444]: DEBUG oslo.privsep.daemon [-] privsep: reply[eddcbfba-db62-42e8-9f5a-54c44d68425c]: (4, 'qcow2') {{(pid=88499) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 04:53:26 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-e7a0b622-394f-4fed-8fa7-5cd56c0f85b8 tempest-CreateVolumesFromImageTest-1512620421 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-d05e8536-35ba-463c-820a-8eeebc0fa9cc {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:53:26 devstack sudo[105173]: pam_unix(sudo:session): session closed for user root Jul 10 04:53:26 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-8cc3451d-1c56-4717-a81c-68dc28e75479 tempest-CreateVolumesFromImageTest-1512620421 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097" returned: 0 in 0.709s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:53:26 devstack cinder-volume[87444]: DEBUG cinder.manager [None req-8cc3451d-1c56-4717-a81c-68dc28e75479 tempest-CreateVolumesFromImageTest-1512620421 None] Notifying Schedulers of capabilities ... {{(pid=87444) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 04:53:26 devstack cinder-volume[87444]: INFO cinder.volume.manager [None req-8cc3451d-1c56-4717-a81c-68dc28e75479 tempest-CreateVolumesFromImageTest-1512620421 None] Deleted volume successfully. Jul 10 04:53:26 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-8cc3451d-1c56-4717-a81c-68dc28e75479 tempest-CreateVolumesFromImageTest-1512620421 None] Lock "cinder-3df62cd2-4ea0-4528-a7bd-736121741f29-delete_volume" released by "delete_volume" :: held 2.427s {{(pid=87444) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 04:53:26 devstack sudo[105181]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-d05e8536-35ba-463c-820a-8eeebc0fa9cc Jul 10 04:53:26 devstack sudo[105181]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:53:26 devstack sudo[105178]: pam_unix(sudo:session): session closed for user root Jul 10 04:53:26 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-57197ffa-1db2-4faf-8b08-b3d4f6204840 tempest-CreateVolumesFromSourceVolumeTest-476912221 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-7a29f5d0-927e-421e-aaa1-bfca6dfeb8f9" returned: 0 in 0.680s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:53:26 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-57197ffa-1db2-4faf-8b08-b3d4f6204840 tempest-CreateVolumesFromSourceVolumeTest-476912221 None] <== create_volume: return (1620ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922'} {{(pid=87444) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 04:53:26 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-57197ffa-1db2-4faf-8b08-b3d4f6204840 tempest-CreateVolumesFromSourceVolumeTest-476912221 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.624s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 04:53:26 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-9522ba1f-2af3-4c5c-80de-0d8e97bf5070 tempest-VolumeAndVolumeTypeFromImageTest-667796659 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 12.022s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 04:53:26 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-9522ba1f-2af3-4c5c-80de-0d8e97bf5070 tempest-VolumeAndVolumeTypeFromImageTest-667796659 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T02:53:10Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e1e118ed-29ec-4a87-b93f-4ce4aabe0c96,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ff85958c095040fb8878a45f2568ef7b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T02:53:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T02:53:11Z,use_quota=True,user_id='9cc84feaf896498d9da35db0052071a6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(51ef4f95-b868-4ed2-b62d-0abd78ffdb9d),volume_type_id=51ef4f95-b868-4ed2-b62d-0abd78ffdb9d)}" {{(pid=87444) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 04:53:26 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.remotefs [None req-9522ba1f-2af3-4c5c-80de-0d8e97bf5070 tempest-VolumeAndVolumeTypeFromImageTest-667796659 None] Creating volume e1e118ed-29ec-4a87-b93f-4ce4aabe0c96 {{(pid=87444) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 04:53:26 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-9522ba1f-2af3-4c5c-80de-0d8e97bf5070 tempest-VolumeAndVolumeTypeFromImageTest-667796659 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 04:53:26 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-9522ba1f-2af3-4c5c-80de-0d8e97bf5070 tempest-VolumeAndVolumeTypeFromImageTest-667796659 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 04:53:26 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-9522ba1f-2af3-4c5c-80de-0d8e97bf5070 tempest-VolumeAndVolumeTypeFromImageTest-667796659 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922': None} {{(pid=87444) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 04:53:26 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-9522ba1f-2af3-4c5c-80de-0d8e97bf5070 tempest-VolumeAndVolumeTypeFromImageTest-667796659 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922'] {{(pid=87444) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 04:53:26 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-9522ba1f-2af3-4c5c-80de-0d8e97bf5070 tempest-VolumeAndVolumeTypeFromImageTest-667796659 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 04:53:26 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-9522ba1f-2af3-4c5c-80de-0d8e97bf5070 tempest-VolumeAndVolumeTypeFromImageTest-667796659 None] Selected osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922 as target Quobyte volume. {{(pid=87444) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 04:53:26 devstack cinder-volume[87444]: INFO cinder.volume.drivers.remotefs [None req-9522ba1f-2af3-4c5c-80de-0d8e97bf5070 tempest-VolumeAndVolumeTypeFromImageTest-667796659 None] casted to osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922 Jul 10 04:53:26 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-9522ba1f-2af3-4c5c-80de-0d8e97bf5070 tempest-VolumeAndVolumeTypeFromImageTest-667796659 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-e1e118ed-29ec-4a87-b93f-4ce4aabe0c96 1073741824 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:53:26 devstack sudo[105184]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-e1e118ed-29ec-4a87-b93f-4ce4aabe0c96 1073741824 Jul 10 04:53:26 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-57197ffa-1db2-4faf-8b08-b3d4f6204840 tempest-CreateVolumesFromSourceVolumeTest-476912221 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bd106300-452d-4909-a733-a7eb1540c008) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7a29f5d0-927e-421e-aaa1-bfca6dfeb8f9', 'volume_size': 1}' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:53:26 devstack sudo[105184]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:53:26 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-57197ffa-1db2-4faf-8b08-b3d4f6204840 tempest-CreateVolumesFromSourceVolumeTest-476912221 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (61a5b6ad-4003-4484-9bf0-ac544433b0a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:53:26 devstack cinder-volume[87444]: INFO cinder.volume.flows.manager.create_volume [None req-57197ffa-1db2-4faf-8b08-b3d4f6204840 tempest-CreateVolumesFromSourceVolumeTest-476912221 None] Volume volume-7a29f5d0-927e-421e-aaa1-bfca6dfeb8f9 (7a29f5d0-927e-421e-aaa1-bfca6dfeb8f9): created successfully Jul 10 04:53:26 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-57197ffa-1db2-4faf-8b08-b3d4f6204840 tempest-CreateVolumesFromSourceVolumeTest-476912221 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (61a5b6ad-4003-4484-9bf0-ac544433b0a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:53:26 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-57197ffa-1db2-4faf-8b08-b3d4f6204840 tempest-CreateVolumesFromSourceVolumeTest-476912221 None] Flow 'volume_create_manager' (46fe5f28-12f1-43e1-9aea-01e7f19e3772) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87444) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 04:53:26 devstack cinder-volume[87444]: INFO cinder.volume.manager [None req-57197ffa-1db2-4faf-8b08-b3d4f6204840 tempest-CreateVolumesFromSourceVolumeTest-476912221 None] Created volume successfully. Jul 10 04:53:26 devstack sudo[105181]: pam_unix(sudo:session): session closed for user root Jul 10 04:53:26 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-e7a0b622-394f-4fed-8fa7-5cd56c0f85b8 tempest-CreateVolumesFromImageTest-1512620421 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-d05e8536-35ba-463c-820a-8eeebc0fa9cc" returned: 0 in 0.831s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:53:26 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-e7a0b622-394f-4fed-8fa7-5cd56c0f85b8 tempest-CreateVolumesFromImageTest-1512620421 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-d05e8536-35ba-463c-820a-8eeebc0fa9cc {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:53:26 devstack sudo[105189]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-d05e8536-35ba-463c-820a-8eeebc0fa9cc Jul 10 04:53:26 devstack sudo[105189]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:53:27 devstack sudo[105184]: pam_unix(sudo:session): session closed for user root Jul 10 04:53:27 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-9522ba1f-2af3-4c5c-80de-0d8e97bf5070 tempest-VolumeAndVolumeTypeFromImageTest-667796659 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-e1e118ed-29ec-4a87-b93f-4ce4aabe0c96 1073741824" returned: 0 in 0.834s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:53:27 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-9522ba1f-2af3-4c5c-80de-0d8e97bf5070 tempest-VolumeAndVolumeTypeFromImageTest-667796659 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-e1e118ed-29ec-4a87-b93f-4ce4aabe0c96 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:53:27 devstack sudo[105194]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-e1e118ed-29ec-4a87-b93f-4ce4aabe0c96 Jul 10 04:53:27 devstack sudo[105194]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:53:27 devstack sudo[105189]: pam_unix(sudo:session): session closed for user root Jul 10 04:53:27 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-e7a0b622-394f-4fed-8fa7-5cd56c0f85b8 tempest-CreateVolumesFromImageTest-1512620421 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-d05e8536-35ba-463c-820a-8eeebc0fa9cc" returned: 0 in 0.688s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:53:27 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-e7a0b622-394f-4fed-8fa7-5cd56c0f85b8 tempest-CreateVolumesFromImageTest-1512620421 None] Lock "cinder-quobyte-d05e8536-35ba-463c-820a-8eeebc0fa9cc" released by "delete_volume" :: held 1.568s {{(pid=87444) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 04:53:27 devstack cinder-volume[87444]: DEBUG cinder.quota [None req-e7a0b622-394f-4fed-8fa7-5cd56c0f85b8 tempest-CreateVolumesFromImageTest-1512620421 None] Created reservations ['67859a81-2f48-42c7-9200-10133b01d38c', '853c3426-fed5-4fe3-8a7b-9b3414ad857e', '791c5099-e19a-4398-a97f-3d9f4037486d', '72219333-d416-445f-bc1b-1cf90c194c13'] {{(pid=87444) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 04:53:27 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-1e48556d-dac3-42fa-b13f-d5c6c90a4639 tempest-CreateVolumesFromSourceVolumeTest-476912221 None] Acquiring lock "cinder-7a29f5d0-927e-421e-aaa1-bfca6dfeb8f9-delete_volume" by "delete_volume" {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 04:53:27 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-1e48556d-dac3-42fa-b13f-d5c6c90a4639 tempest-CreateVolumesFromSourceVolumeTest-476912221 None] Lock "cinder-7a29f5d0-927e-421e-aaa1-bfca6dfeb8f9-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 04:53:27 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-e7a0b622-394f-4fed-8fa7-5cd56c0f85b8 tempest-CreateVolumesFromImageTest-1512620421 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 04:53:27 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-e7a0b622-394f-4fed-8fa7-5cd56c0f85b8 tempest-CreateVolumesFromImageTest-1512620421 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 04:53:27 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-e7a0b622-394f-4fed-8fa7-5cd56c0f85b8 tempest-CreateVolumesFromImageTest-1512620421 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922': None} {{(pid=87444) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 04:53:27 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-e7a0b622-394f-4fed-8fa7-5cd56c0f85b8 tempest-CreateVolumesFromImageTest-1512620421 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922'] {{(pid=87444) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 04:53:27 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-e7a0b622-394f-4fed-8fa7-5cd56c0f85b8 tempest-CreateVolumesFromImageTest-1512620421 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 04:53:27 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-e7a0b622-394f-4fed-8fa7-5cd56c0f85b8 tempest-CreateVolumesFromImageTest-1512620421 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:53:27 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-1e48556d-dac3-42fa-b13f-d5c6c90a4639 tempest-CreateVolumesFromSourceVolumeTest-476912221 None] Acquiring lock "cinder-quobyte-7a29f5d0-927e-421e-aaa1-bfca6dfeb8f9" by "delete_volume" {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 04:53:27 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-1e48556d-dac3-42fa-b13f-d5c6c90a4639 tempest-CreateVolumesFromSourceVolumeTest-476912221 None] Lock "cinder-quobyte-7a29f5d0-927e-421e-aaa1-bfca6dfeb8f9" acquired by "delete_volume" :: waited 0.019s {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 04:53:27 devstack sudo[105197]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097 Jul 10 04:53:27 devstack sudo[105197]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:53:27 devstack cinder-volume[87444]: DEBUG oslo.privsep.daemon [-] privsep: reply[c85ecd3e-2335-46a8-8ff9-73d716fc5e51]: (4, 'qcow2') {{(pid=88499) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 04:53:27 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-1e48556d-dac3-42fa-b13f-d5c6c90a4639 tempest-CreateVolumesFromSourceVolumeTest-476912221 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-7a29f5d0-927e-421e-aaa1-bfca6dfeb8f9 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:53:27 devstack sudo[105199]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-7a29f5d0-927e-421e-aaa1-bfca6dfeb8f9 Jul 10 04:53:27 devstack sudo[105199]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:53:28 devstack sudo[105194]: pam_unix(sudo:session): session closed for user root Jul 10 04:53:28 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-9522ba1f-2af3-4c5c-80de-0d8e97bf5070 tempest-VolumeAndVolumeTypeFromImageTest-667796659 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-e1e118ed-29ec-4a87-b93f-4ce4aabe0c96" returned: 0 in 0.701s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:53:28 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-9522ba1f-2af3-4c5c-80de-0d8e97bf5070 tempest-VolumeAndVolumeTypeFromImageTest-667796659 None] <== create_volume: return (1580ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922'} {{(pid=87444) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 04:53:28 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-9522ba1f-2af3-4c5c-80de-0d8e97bf5070 tempest-VolumeAndVolumeTypeFromImageTest-667796659 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.585s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 04:53:28 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-6c1d3a86-f10e-486a-93ec-2c346cf1a0ba tempest-CreateVolumesFromSnapshotTest-1643372015 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 13.470s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 04:53:28 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.remotefs [None req-6c1d3a86-f10e-486a-93ec-2c346cf1a0ba tempest-CreateVolumesFromSnapshotTest-1643372015 None] Creating offline snapshot b77fe7ba-a1f2-4180-9db0-1010d17e6a32 of volume 6a52692c-d463-4776-aa0a-2fdfb275e2ef {{(pid=87444) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 10 04:53:28 devstack cinder-volume[87444]: DEBUG cinder.volume.volume_utils [None req-9522ba1f-2af3-4c5c-80de-0d8e97bf5070 tempest-VolumeAndVolumeTypeFromImageTest-667796659 None] Attempting download of 63070680-ed32-4c77-b773-d742aba1a2f3 ((None, [{'url': 'file:///opt/stack/data/glance/images/63070680-ed32-4c77-b773-d742aba1a2f3', 'metadata': {}}])) to volume e1e118ed-29ec-4a87-b93f-4ce4aabe0c96. {{(pid=87444) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jul 10 04:53:28 devstack cinder-volume[87444]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6141ceb-f6ad-44eb-b0b8-9ec684604bbb]: (4, 'qcow2') {{(pid=88499) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 04:53:28 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-6c1d3a86-f10e-486a-93ec-2c346cf1a0ba tempest-CreateVolumesFromSnapshotTest-1643372015 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-6a52692c-d463-4776-aa0a-2fdfb275e2ef {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:53:28 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-53480665-1979-4f43-8501-b39ef85aa98d tempest-CreateVolumesFromImageTest-1512620421 None] Acquiring lock "cinder-f7a59dd7-0999-4825-9a20-2184874a4250-delete_volume" by "delete_volume" {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 04:53:28 devstack cinder-volume[87444]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb4f928b-4194-4132-ae34-aec792372ab7]: (4, 'raw') {{(pid=88499) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 04:53:28 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-9522ba1f-2af3-4c5c-80de-0d8e97bf5070 tempest-VolumeAndVolumeTypeFromImageTest-667796659 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_63070680-ed32-4c77-b773-d742aba1a2f3_niacr3uk {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:53:28 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-53480665-1979-4f43-8501-b39ef85aa98d tempest-CreateVolumesFromImageTest-1512620421 None] Lock "cinder-f7a59dd7-0999-4825-9a20-2184874a4250-delete_volume" acquired by "delete_volume" :: waited 0.043s {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 04:53:28 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-53480665-1979-4f43-8501-b39ef85aa98d tempest-CreateVolumesFromImageTest-1512620421 None] Acquiring lock "cinder-quobyte-f7a59dd7-0999-4825-9a20-2184874a4250" by "delete_volume" {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 04:53:28 devstack sudo[105202]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-6a52692c-d463-4776-aa0a-2fdfb275e2ef Jul 10 04:53:28 devstack sudo[105202]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:53:28 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-53480665-1979-4f43-8501-b39ef85aa98d tempest-CreateVolumesFromImageTest-1512620421 None] Lock "cinder-quobyte-f7a59dd7-0999-4825-9a20-2184874a4250" acquired by "delete_volume" :: waited 0.022s {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 04:53:28 devstack cinder-volume[87444]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f9e3929-184e-4008-aaf2-e2f11e641af4]: (4, 'qcow2') {{(pid=88499) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 04:53:28 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-53480665-1979-4f43-8501-b39ef85aa98d tempest-CreateVolumesFromImageTest-1512620421 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-f7a59dd7-0999-4825-9a20-2184874a4250 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:53:28 devstack sudo[105203]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_63070680-ed32-4c77-b773-d742aba1a2f3_niacr3uk Jul 10 04:53:28 devstack sudo[105203]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:53:28 devstack sudo[105205]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-f7a59dd7-0999-4825-9a20-2184874a4250 Jul 10 04:53:28 devstack sudo[105205]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:53:28 devstack sudo[105197]: pam_unix(sudo:session): session closed for user root Jul 10 04:53:28 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-e7a0b622-394f-4fed-8fa7-5cd56c0f85b8 tempest-CreateVolumesFromImageTest-1512620421 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097" returned: 0 in 0.962s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:53:28 devstack cinder-volume[87444]: DEBUG cinder.manager [None req-e7a0b622-394f-4fed-8fa7-5cd56c0f85b8 tempest-CreateVolumesFromImageTest-1512620421 None] Notifying Schedulers of capabilities ... {{(pid=87444) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 04:53:28 devstack cinder-volume[87444]: INFO cinder.volume.manager [None req-e7a0b622-394f-4fed-8fa7-5cd56c0f85b8 tempest-CreateVolumesFromImageTest-1512620421 None] Deleted volume successfully. Jul 10 04:53:28 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-e7a0b622-394f-4fed-8fa7-5cd56c0f85b8 tempest-CreateVolumesFromImageTest-1512620421 None] Lock "cinder-d05e8536-35ba-463c-820a-8eeebc0fa9cc-delete_volume" released by "delete_volume" :: held 2.869s {{(pid=87444) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 04:53:28 devstack sudo[105199]: pam_unix(sudo:session): session closed for user root Jul 10 04:53:28 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-1e48556d-dac3-42fa-b13f-d5c6c90a4639 tempest-CreateVolumesFromSourceVolumeTest-476912221 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-7a29f5d0-927e-421e-aaa1-bfca6dfeb8f9" returned: 0 in 1.130s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:53:28 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-1e48556d-dac3-42fa-b13f-d5c6c90a4639 tempest-CreateVolumesFromSourceVolumeTest-476912221 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-7a29f5d0-927e-421e-aaa1-bfca6dfeb8f9 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:53:28 devstack sudo[105215]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-7a29f5d0-927e-421e-aaa1-bfca6dfeb8f9 Jul 10 04:53:28 devstack sudo[105215]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:53:29 devstack sudo[105202]: pam_unix(sudo:session): session closed for user root Jul 10 04:53:29 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-6c1d3a86-f10e-486a-93ec-2c346cf1a0ba tempest-CreateVolumesFromSnapshotTest-1643372015 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-6a52692c-d463-4776-aa0a-2fdfb275e2ef" returned: 0 in 1.005s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:53:29 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-6c1d3a86-f10e-486a-93ec-2c346cf1a0ba tempest-CreateVolumesFromSnapshotTest-1643372015 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-6a52692c-d463-4776-aa0a-2fdfb275e2ef,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-6a52692c-d463-4776-aa0a-2fdfb275e2ef.b77fe7ba-a1f2-4180-9db0-1010d17e6a32 1G {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:53:29 devstack sudo[105219]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-6a52692c-d463-4776-aa0a-2fdfb275e2ef,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-6a52692c-d463-4776-aa0a-2fdfb275e2ef.b77fe7ba-a1f2-4180-9db0-1010d17e6a32 1G Jul 10 04:53:29 devstack sudo[105219]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:53:29 devstack sudo[105203]: pam_unix(sudo:session): session closed for user root Jul 10 04:53:29 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-9522ba1f-2af3-4c5c-80de-0d8e97bf5070 tempest-VolumeAndVolumeTypeFromImageTest-667796659 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_63070680-ed32-4c77-b773-d742aba1a2f3_niacr3uk" returned: 0 in 0.958s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:53:29 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-9522ba1f-2af3-4c5c-80de-0d8e97bf5070 tempest-VolumeAndVolumeTypeFromImageTest-667796659 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_63070680-ed32-4c77-b773-d742aba1a2f3_niacr3uk {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:53:29 devstack sudo[105224]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_63070680-ed32-4c77-b773-d742aba1a2f3_niacr3uk Jul 10 04:53:29 devstack sudo[105224]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:53:29 devstack sudo[105205]: pam_unix(sudo:session): session closed for user root Jul 10 04:53:29 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-53480665-1979-4f43-8501-b39ef85aa98d tempest-CreateVolumesFromImageTest-1512620421 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-f7a59dd7-0999-4825-9a20-2184874a4250" returned: 0 in 0.969s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:53:29 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-53480665-1979-4f43-8501-b39ef85aa98d tempest-CreateVolumesFromImageTest-1512620421 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-f7a59dd7-0999-4825-9a20-2184874a4250 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:53:29 devstack sudo[105226]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-f7a59dd7-0999-4825-9a20-2184874a4250 Jul 10 04:53:29 devstack sudo[105226]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:53:29 devstack sudo[105215]: pam_unix(sudo:session): session closed for user root Jul 10 04:53:29 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-1e48556d-dac3-42fa-b13f-d5c6c90a4639 tempest-CreateVolumesFromSourceVolumeTest-476912221 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-7a29f5d0-927e-421e-aaa1-bfca6dfeb8f9" returned: 0 in 0.738s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:53:29 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-1e48556d-dac3-42fa-b13f-d5c6c90a4639 tempest-CreateVolumesFromSourceVolumeTest-476912221 None] Lock "cinder-quobyte-7a29f5d0-927e-421e-aaa1-bfca6dfeb8f9" released by "delete_volume" :: held 1.918s {{(pid=87444) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 04:53:29 devstack cinder-volume[87444]: DEBUG cinder.quota [None req-1e48556d-dac3-42fa-b13f-d5c6c90a4639 tempest-CreateVolumesFromSourceVolumeTest-476912221 None] Created reservations ['4a16bf72-e3ef-41d6-8de1-51d48038ee36', 'e7654cae-5676-46ea-a376-ca3a3e3c28a3', '8f8166b3-6391-4116-bbc0-393d01345a8d', '5de02b69-3ebc-4b7c-849b-4b40aca713b3'] {{(pid=87444) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 04:53:29 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-1e48556d-dac3-42fa-b13f-d5c6c90a4639 tempest-CreateVolumesFromSourceVolumeTest-476912221 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 04:53:29 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-1e48556d-dac3-42fa-b13f-d5c6c90a4639 tempest-CreateVolumesFromSourceVolumeTest-476912221 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 04:53:29 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-1e48556d-dac3-42fa-b13f-d5c6c90a4639 tempest-CreateVolumesFromSourceVolumeTest-476912221 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922': None} {{(pid=87444) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 04:53:29 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-1e48556d-dac3-42fa-b13f-d5c6c90a4639 tempest-CreateVolumesFromSourceVolumeTest-476912221 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922'] {{(pid=87444) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 04:53:29 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-1e48556d-dac3-42fa-b13f-d5c6c90a4639 tempest-CreateVolumesFromSourceVolumeTest-476912221 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 04:53:29 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-1e48556d-dac3-42fa-b13f-d5c6c90a4639 tempest-CreateVolumesFromSourceVolumeTest-476912221 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:53:29 devstack sudo[105234]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097 Jul 10 04:53:29 devstack sudo[105234]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:53:29 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-4253d4c2-88e3-4a1e-b6f7-3392371ff52b tempest-CreateVolumesFromSourceVolumeTest-476912221 None] Acquiring lock "cinder-f4706ac5-3c3b-4a10-8ed3-493af8c34005-delete_volume" by "delete_volume" {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 04:53:30 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-4253d4c2-88e3-4a1e-b6f7-3392371ff52b tempest-CreateVolumesFromSourceVolumeTest-476912221 None] Lock "cinder-f4706ac5-3c3b-4a10-8ed3-493af8c34005-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 04:53:30 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-4253d4c2-88e3-4a1e-b6f7-3392371ff52b tempest-CreateVolumesFromSourceVolumeTest-476912221 None] Acquiring lock "cinder-quobyte-f4706ac5-3c3b-4a10-8ed3-493af8c34005" by "delete_volume" {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 04:53:30 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-4253d4c2-88e3-4a1e-b6f7-3392371ff52b tempest-CreateVolumesFromSourceVolumeTest-476912221 None] Lock "cinder-quobyte-f4706ac5-3c3b-4a10-8ed3-493af8c34005" acquired by "delete_volume" :: waited 0.025s {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 04:53:30 devstack sudo[105226]: pam_unix(sudo:session): session closed for user root Jul 10 04:53:30 devstack sudo[105224]: pam_unix(sudo:session): session closed for user root Jul 10 04:53:30 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-9522ba1f-2af3-4c5c-80de-0d8e97bf5070 tempest-VolumeAndVolumeTypeFromImageTest-667796659 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_63070680-ed32-4c77-b773-d742aba1a2f3_niacr3uk" returned: 1 in 0.962s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:53:30 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-9522ba1f-2af3-4c5c-80de-0d8e97bf5070 tempest-VolumeAndVolumeTypeFromImageTest-667796659 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_63070680-ed32-4c77-b773-d742aba1a2f3_niacr3uk' failed. Not Retrying. {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 10 04:53:30 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-53480665-1979-4f43-8501-b39ef85aa98d tempest-CreateVolumesFromImageTest-1512620421 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-f7a59dd7-0999-4825-9a20-2184874a4250" returned: 0 in 0.816s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:53:30 devstack cinder-volume[87444]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b4e3abf-2380-4572-88c7-81fef1dcfc6e]: (4, 'raw') {{(pid=88499) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 04:53:30 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-9522ba1f-2af3-4c5c-80de-0d8e97bf5070 tempest-VolumeAndVolumeTypeFromImageTest-667796659 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_63070680-ed32-4c77-b773-d742aba1a2f3_bn_5pthmdevstack@QuobyteHD {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:53:30 devstack cinder-volume[87444]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac7073ac-3025-488d-9402-a90e5f829bc7]: (4, 'qcow2') {{(pid=88499) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 04:53:30 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-4253d4c2-88e3-4a1e-b6f7-3392371ff52b tempest-CreateVolumesFromSourceVolumeTest-476912221 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-f4706ac5-3c3b-4a10-8ed3-493af8c34005 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:53:30 devstack sudo[105219]: pam_unix(sudo:session): session closed for user root Jul 10 04:53:30 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-53480665-1979-4f43-8501-b39ef85aa98d tempest-CreateVolumesFromImageTest-1512620421 None] Lock "cinder-quobyte-f7a59dd7-0999-4825-9a20-2184874a4250" released by "delete_volume" :: held 1.869s {{(pid=87444) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 04:53:30 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-6c1d3a86-f10e-486a-93ec-2c346cf1a0ba tempest-CreateVolumesFromSnapshotTest-1643372015 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-6a52692c-d463-4776-aa0a-2fdfb275e2ef,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-6a52692c-d463-4776-aa0a-2fdfb275e2ef.b77fe7ba-a1f2-4180-9db0-1010d17e6a32 1G" returned: 0 in 1.074s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:53:30 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-6c1d3a86-f10e-486a-93ec-2c346cf1a0ba tempest-CreateVolumesFromSnapshotTest-1643372015 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6a52692c-d463-4776-aa0a-2fdfb275e2ef -F qcow2 /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-6a52692c-d463-4776-aa0a-2fdfb275e2ef.b77fe7ba-a1f2-4180-9db0-1010d17e6a32 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:53:30 devstack sudo[105240]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6a52692c-d463-4776-aa0a-2fdfb275e2ef -F qcow2 /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-6a52692c-d463-4776-aa0a-2fdfb275e2ef.b77fe7ba-a1f2-4180-9db0-1010d17e6a32 Jul 10 04:53:30 devstack sudo[105240]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:53:30 devstack sudo[105238]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_63070680-ed32-4c77-b773-d742aba1a2f3_bn_5pthmdevstack@QuobyteHD Jul 10 04:53:30 devstack sudo[105238]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:53:30 devstack sudo[105239]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-f4706ac5-3c3b-4a10-8ed3-493af8c34005 Jul 10 04:53:30 devstack cinder-volume[87444]: DEBUG cinder.quota [None req-53480665-1979-4f43-8501-b39ef85aa98d tempest-CreateVolumesFromImageTest-1512620421 None] Created reservations ['f6194469-a3b6-400f-a180-37613366a85c', '476349e8-1977-4522-9e03-4d3e1a3fd912', '0ca48fad-38ed-4ce6-a8a8-f21efbd6bc20', 'eb6da05e-4f51-41e6-8403-cae3a3d7ebeb'] {{(pid=87444) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 04:53:30 devstack sudo[105239]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:53:30 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-53480665-1979-4f43-8501-b39ef85aa98d tempest-CreateVolumesFromImageTest-1512620421 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 04:53:30 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-53480665-1979-4f43-8501-b39ef85aa98d tempest-CreateVolumesFromImageTest-1512620421 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 04:53:30 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-53480665-1979-4f43-8501-b39ef85aa98d tempest-CreateVolumesFromImageTest-1512620421 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922': None} {{(pid=87444) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 04:53:30 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-53480665-1979-4f43-8501-b39ef85aa98d tempest-CreateVolumesFromImageTest-1512620421 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922'] {{(pid=87444) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 04:53:30 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-53480665-1979-4f43-8501-b39ef85aa98d tempest-CreateVolumesFromImageTest-1512620421 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 04:53:30 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-53480665-1979-4f43-8501-b39ef85aa98d tempest-CreateVolumesFromImageTest-1512620421 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:53:30 devstack sudo[105244]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097 Jul 10 04:53:30 devstack sudo[105244]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:53:30 devstack sudo[105234]: pam_unix(sudo:session): session closed for user root Jul 10 04:53:30 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-1e48556d-dac3-42fa-b13f-d5c6c90a4639 tempest-CreateVolumesFromSourceVolumeTest-476912221 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097" returned: 0 in 0.873s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:53:30 devstack cinder-volume[87444]: DEBUG cinder.manager [None req-1e48556d-dac3-42fa-b13f-d5c6c90a4639 tempest-CreateVolumesFromSourceVolumeTest-476912221 None] Notifying Schedulers of capabilities ... {{(pid=87444) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 04:53:30 devstack cinder-volume[87444]: INFO cinder.volume.manager [None req-1e48556d-dac3-42fa-b13f-d5c6c90a4639 tempest-CreateVolumesFromSourceVolumeTest-476912221 None] Deleted volume successfully. Jul 10 04:53:30 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-1e48556d-dac3-42fa-b13f-d5c6c90a4639 tempest-CreateVolumesFromSourceVolumeTest-476912221 None] Lock "cinder-7a29f5d0-927e-421e-aaa1-bfca6dfeb8f9-delete_volume" released by "delete_volume" :: held 3.108s {{(pid=87444) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 04:53:31 devstack sudo[105238]: pam_unix(sudo:session): session closed for user root Jul 10 04:53:31 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-9522ba1f-2af3-4c5c-80de-0d8e97bf5070 tempest-VolumeAndVolumeTypeFromImageTest-667796659 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_63070680-ed32-4c77-b773-d742aba1a2f3_bn_5pthmdevstack@QuobyteHD" returned: 0 in 1.151s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:53:31 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-9522ba1f-2af3-4c5c-80de-0d8e97bf5070 tempest-VolumeAndVolumeTypeFromImageTest-667796659 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_63070680-ed32-4c77-b773-d742aba1a2f3_bn_5pthmdevstack@QuobyteHD {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:53:31 devstack sudo[105240]: pam_unix(sudo:session): session closed for user root Jul 10 04:53:31 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-6c1d3a86-f10e-486a-93ec-2c346cf1a0ba tempest-CreateVolumesFromSnapshotTest-1643372015 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6a52692c-d463-4776-aa0a-2fdfb275e2ef -F qcow2 /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-6a52692c-d463-4776-aa0a-2fdfb275e2ef.b77fe7ba-a1f2-4180-9db0-1010d17e6a32" returned: 0 in 1.127s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:53:31 devstack cinder-volume[87444]: WARNING cinder.volume.drivers.remotefs [None req-6c1d3a86-f10e-486a-93ec-2c346cf1a0ba tempest-CreateVolumesFromSnapshotTest-1643372015 None] /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-6a52692c-d463-4776-aa0a-2fdfb275e2ef.b77fe7ba-a1f2-4180-9db0-1010d17e6a32 is being set with open permissions: ugo+rw Jul 10 04:53:31 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-6c1d3a86-f10e-486a-93ec-2c346cf1a0ba tempest-CreateVolumesFromSnapshotTest-1643372015 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-6a52692c-d463-4776-aa0a-2fdfb275e2ef.b77fe7ba-a1f2-4180-9db0-1010d17e6a32 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:53:31 devstack sudo[105244]: pam_unix(sudo:session): session closed for user root Jul 10 04:53:31 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-53480665-1979-4f43-8501-b39ef85aa98d tempest-CreateVolumesFromImageTest-1512620421 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097" returned: 0 in 0.919s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:53:31 devstack sudo[105257]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-6a52692c-d463-4776-aa0a-2fdfb275e2ef.b77fe7ba-a1f2-4180-9db0-1010d17e6a32 Jul 10 04:53:31 devstack sudo[105257]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:53:31 devstack cinder-volume[87444]: DEBUG cinder.manager [None req-53480665-1979-4f43-8501-b39ef85aa98d tempest-CreateVolumesFromImageTest-1512620421 None] Notifying Schedulers of capabilities ... {{(pid=87444) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 04:53:31 devstack cinder-volume[87444]: INFO cinder.volume.manager [None req-53480665-1979-4f43-8501-b39ef85aa98d tempest-CreateVolumesFromImageTest-1512620421 None] Deleted volume successfully. Jul 10 04:53:31 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-53480665-1979-4f43-8501-b39ef85aa98d tempest-CreateVolumesFromImageTest-1512620421 None] Lock "cinder-f7a59dd7-0999-4825-9a20-2184874a4250-delete_volume" released by "delete_volume" :: held 3.157s {{(pid=87444) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 04:53:31 devstack sudo[105239]: pam_unix(sudo:session): session closed for user root Jul 10 04:53:31 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-4253d4c2-88e3-4a1e-b6f7-3392371ff52b tempest-CreateVolumesFromSourceVolumeTest-476912221 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-f4706ac5-3c3b-4a10-8ed3-493af8c34005" returned: 0 in 1.279s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:53:31 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-4253d4c2-88e3-4a1e-b6f7-3392371ff52b tempest-CreateVolumesFromSourceVolumeTest-476912221 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-f4706ac5-3c3b-4a10-8ed3-493af8c34005 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:53:31 devstack sudo[105256]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_63070680-ed32-4c77-b773-d742aba1a2f3_bn_5pthmdevstack@QuobyteHD Jul 10 04:53:31 devstack sudo[105256]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:53:31 devstack sudo[105259]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-f4706ac5-3c3b-4a10-8ed3-493af8c34005 Jul 10 04:53:31 devstack sudo[105259]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:53:32 devstack sudo[105256]: pam_unix(sudo:session): session closed for user root Jul 10 04:53:32 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-9522ba1f-2af3-4c5c-80de-0d8e97bf5070 tempest-VolumeAndVolumeTypeFromImageTest-667796659 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_63070680-ed32-4c77-b773-d742aba1a2f3_bn_5pthmdevstack@QuobyteHD" returned: 1 in 0.889s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:53:32 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-9522ba1f-2af3-4c5c-80de-0d8e97bf5070 tempest-VolumeAndVolumeTypeFromImageTest-667796659 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_63070680-ed32-4c77-b773-d742aba1a2f3_bn_5pthmdevstack@QuobyteHD' failed. Not Retrying. {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 10 04:53:32 devstack cinder-volume[87444]: DEBUG cinder.image.image_utils [None req-9522ba1f-2af3-4c5c-80de-0d8e97bf5070 tempest-VolumeAndVolumeTypeFromImageTest-667796659 None] 63070680-ed32-4c77-b773-d742aba1a2f3 was raw, converting to raw {{(pid=87444) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1153}} Jul 10 04:53:32 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-9522ba1f-2af3-4c5c-80de-0d8e97bf5070 tempest-VolumeAndVolumeTypeFromImageTest-667796659 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_63070680-ed32-4c77-b773-d742aba1a2f3_bn_5pthmdevstack@QuobyteHD /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-e1e118ed-29ec-4a87-b93f-4ce4aabe0c96 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:53:32 devstack sudo[105268]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_63070680-ed32-4c77-b773-d742aba1a2f3_bn_5pthmdevstack@QuobyteHD /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-e1e118ed-29ec-4a87-b93f-4ce4aabe0c96 Jul 10 04:53:32 devstack sudo[105268]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:53:32 devstack sudo[105257]: pam_unix(sudo:session): session closed for user root Jul 10 04:53:32 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-6c1d3a86-f10e-486a-93ec-2c346cf1a0ba tempest-CreateVolumesFromSnapshotTest-1643372015 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-6a52692c-d463-4776-aa0a-2fdfb275e2ef.b77fe7ba-a1f2-4180-9db0-1010d17e6a32" returned: 0 in 1.022s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:53:32 devstack sudo[105259]: pam_unix(sudo:session): session closed for user root Jul 10 04:53:32 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-4253d4c2-88e3-4a1e-b6f7-3392371ff52b tempest-CreateVolumesFromSourceVolumeTest-476912221 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-f4706ac5-3c3b-4a10-8ed3-493af8c34005" returned: 0 in 0.911s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:53:32 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-4253d4c2-88e3-4a1e-b6f7-3392371ff52b tempest-CreateVolumesFromSourceVolumeTest-476912221 None] Lock "cinder-quobyte-f4706ac5-3c3b-4a10-8ed3-493af8c34005" released by "delete_volume" :: held 2.282s {{(pid=87444) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 04:53:32 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-6c1d3a86-f10e-486a-93ec-2c346cf1a0ba tempest-CreateVolumesFromSnapshotTest-1643372015 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-6a52692c-d463-4776-aa0a-2fdfb275e2ef.info {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:53:32 devstack sudo[105270]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-6a52692c-d463-4776-aa0a-2fdfb275e2ef.info Jul 10 04:53:32 devstack sudo[105270]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:53:32 devstack cinder-volume[87444]: DEBUG cinder.quota [None req-4253d4c2-88e3-4a1e-b6f7-3392371ff52b tempest-CreateVolumesFromSourceVolumeTest-476912221 None] Created reservations ['baa8b580-0667-40f0-b3d6-c5cda3f05122', '134f74e7-8480-4df1-b9b2-7612ff7e050f', '378bf6af-dbab-4d4f-9798-38a54c612fbe', '9b29f939-c472-4000-9b55-713281023882'] {{(pid=87444) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 04:53:32 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-4253d4c2-88e3-4a1e-b6f7-3392371ff52b tempest-CreateVolumesFromSourceVolumeTest-476912221 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 04:53:32 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-4253d4c2-88e3-4a1e-b6f7-3392371ff52b tempest-CreateVolumesFromSourceVolumeTest-476912221 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 04:53:32 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-4253d4c2-88e3-4a1e-b6f7-3392371ff52b tempest-CreateVolumesFromSourceVolumeTest-476912221 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922': None} {{(pid=87444) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 04:53:32 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-4253d4c2-88e3-4a1e-b6f7-3392371ff52b tempest-CreateVolumesFromSourceVolumeTest-476912221 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922'] {{(pid=87444) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 04:53:32 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-4253d4c2-88e3-4a1e-b6f7-3392371ff52b tempest-CreateVolumesFromSourceVolumeTest-476912221 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 04:53:32 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-4253d4c2-88e3-4a1e-b6f7-3392371ff52b tempest-CreateVolumesFromSourceVolumeTest-476912221 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:53:32 devstack sudo[105272]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097 Jul 10 04:53:32 devstack sudo[105272]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:53:33 devstack cinder-volume[87444]: DEBUG oslo_service.periodic_task [None req-01f0ce3e-6850-4e14-881d-e40d3c4ad6e5 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87444) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 10 04:53:33 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-01f0ce3e-6850-4e14-881d-e40d3c4ad6e5 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 04:53:33 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-01f0ce3e-6850-4e14-881d-e40d3c4ad6e5 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 04:53:33 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-01f0ce3e-6850-4e14-881d-e40d3c4ad6e5 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922': None} {{(pid=87444) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 04:53:33 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-01f0ce3e-6850-4e14-881d-e40d3c4ad6e5 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922'] {{(pid=87444) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 04:53:33 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-01f0ce3e-6850-4e14-881d-e40d3c4ad6e5 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 04:53:33 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-01f0ce3e-6850-4e14-881d-e40d3c4ad6e5 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:53:33 devstack sudo[105278]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097 Jul 10 04:53:33 devstack sudo[105278]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:53:33 devstack sudo[105270]: pam_unix(sudo:session): session closed for user root Jul 10 04:53:33 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-6c1d3a86-f10e-486a-93ec-2c346cf1a0ba tempest-CreateVolumesFromSnapshotTest-1643372015 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-6a52692c-d463-4776-aa0a-2fdfb275e2ef.info" returned: 0 in 0.769s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:53:33 devstack cinder-volume[87444]: WARNING cinder.volume.drivers.remotefs [None req-6c1d3a86-f10e-486a-93ec-2c346cf1a0ba tempest-CreateVolumesFromSnapshotTest-1643372015 None] /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-6a52692c-d463-4776-aa0a-2fdfb275e2ef.info is being set with open permissions: ugo+rw Jul 10 04:53:33 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-6c1d3a86-f10e-486a-93ec-2c346cf1a0ba tempest-CreateVolumesFromSnapshotTest-1643372015 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-6a52692c-d463-4776-aa0a-2fdfb275e2ef.info {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:53:33 devstack sudo[105268]: pam_unix(sudo:session): session closed for user root Jul 10 04:53:33 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-9522ba1f-2af3-4c5c-80de-0d8e97bf5070 tempest-VolumeAndVolumeTypeFromImageTest-667796659 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_63070680-ed32-4c77-b773-d742aba1a2f3_bn_5pthmdevstack@QuobyteHD /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-e1e118ed-29ec-4a87-b93f-4ce4aabe0c96" returned: 0 in 1.001s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:53:33 devstack cinder-volume[87444]: DEBUG cinder.image.image_utils [None req-9522ba1f-2af3-4c5c-80de-0d8e97bf5070 tempest-VolumeAndVolumeTypeFromImageTest-667796659 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_63070680-ed32-4c77-b773-d742aba1a2f3_bn_5pthmdevstack@QuobyteHD, size 0.00 MB, duration 1.01 sec, destination /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-e1e118ed-29ec-4a87-b93f-4ce4aabe0c96 {{(pid=87444) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:561}} Jul 10 04:53:33 devstack cinder-volume[87444]: INFO cinder.image.image_utils [None req-9522ba1f-2af3-4c5c-80de-0d8e97bf5070 tempest-VolumeAndVolumeTypeFromImageTest-667796659 None] Converted 0.00 MB image at 0.00 MB/s Jul 10 04:53:33 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-9522ba1f-2af3-4c5c-80de-0d8e97bf5070 tempest-VolumeAndVolumeTypeFromImageTest-667796659 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-e1e118ed-29ec-4a87-b93f-4ce4aabe0c96 1G {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:53:33 devstack sudo[105280]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-6a52692c-d463-4776-aa0a-2fdfb275e2ef.info Jul 10 04:53:33 devstack sudo[105280]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:53:33 devstack sudo[105282]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-e1e118ed-29ec-4a87-b93f-4ce4aabe0c96 1G Jul 10 04:53:33 devstack sudo[105282]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:53:33 devstack sudo[105272]: pam_unix(sudo:session): session closed for user root Jul 10 04:53:33 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-4253d4c2-88e3-4a1e-b6f7-3392371ff52b tempest-CreateVolumesFromSourceVolumeTest-476912221 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097" returned: 0 in 0.843s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:53:33 devstack cinder-volume[87444]: DEBUG cinder.manager [None req-4253d4c2-88e3-4a1e-b6f7-3392371ff52b tempest-CreateVolumesFromSourceVolumeTest-476912221 None] Notifying Schedulers of capabilities ... {{(pid=87444) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 04:53:33 devstack cinder-volume[87444]: INFO cinder.volume.manager [None req-4253d4c2-88e3-4a1e-b6f7-3392371ff52b tempest-CreateVolumesFromSourceVolumeTest-476912221 None] Deleted volume successfully. Jul 10 04:53:33 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-4253d4c2-88e3-4a1e-b6f7-3392371ff52b tempest-CreateVolumesFromSourceVolumeTest-476912221 None] Lock "cinder-f4706ac5-3c3b-4a10-8ed3-493af8c34005-delete_volume" released by "delete_volume" :: held 3.456s {{(pid=87444) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 04:53:33 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-16032f35-e767-4a42-9908-8b5c7a3e34d5 tempest-CreateVolumesFromSourceVolumeTest-476912221 None] Acquiring lock "cinder-b3decc1b-92ad-455d-a22d-0583f61bb9be-delete_volume" by "delete_volume" {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 04:53:33 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-16032f35-e767-4a42-9908-8b5c7a3e34d5 tempest-CreateVolumesFromSourceVolumeTest-476912221 None] Lock "cinder-b3decc1b-92ad-455d-a22d-0583f61bb9be-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 04:53:33 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-16032f35-e767-4a42-9908-8b5c7a3e34d5 tempest-CreateVolumesFromSourceVolumeTest-476912221 None] Acquiring lock "cinder-quobyte-b3decc1b-92ad-455d-a22d-0583f61bb9be" by "delete_volume" {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 04:53:33 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-16032f35-e767-4a42-9908-8b5c7a3e34d5 tempest-CreateVolumesFromSourceVolumeTest-476912221 None] Lock "cinder-quobyte-b3decc1b-92ad-455d-a22d-0583f61bb9be" acquired by "delete_volume" :: waited 0.025s {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 04:53:33 devstack cinder-volume[87444]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4738d68-b280-4571-8790-722a58da7391]: (4, 'qcow2') {{(pid=88499) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 04:53:33 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-16032f35-e767-4a42-9908-8b5c7a3e34d5 tempest-CreateVolumesFromSourceVolumeTest-476912221 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-b3decc1b-92ad-455d-a22d-0583f61bb9be {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:53:33 devstack sudo[105286]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-b3decc1b-92ad-455d-a22d-0583f61bb9be Jul 10 04:53:33 devstack sudo[105286]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:53:33 devstack sudo[105278]: pam_unix(sudo:session): session closed for user root Jul 10 04:53:33 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-01f0ce3e-6850-4e14-881d-e40d3c4ad6e5 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097" returned: 0 in 0.911s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:53:33 devstack cinder-volume[87444]: DEBUG cinder.manager [None req-01f0ce3e-6850-4e14-881d-e40d3c4ad6e5 None None] Notifying Schedulers of capabilities ... {{(pid=87444) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 04:53:33 devstack cinder-volume[87444]: DEBUG oslo_service.periodic_task [None req-01f0ce3e-6850-4e14-881d-e40d3c4ad6e5 None None] Running periodic task VolumeManager._thread_info {{(pid=87444) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 10 04:53:33 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-01f0ce3e-6850-4e14-881d-e40d3c4ad6e5 None None] thread count: 28 {{(pid=87444) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 10 04:53:33 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-01f0ce3e-6850-4e14-881d-e40d3c4ad6e5 None None] thread info: [<_MainThread(MainThread, started 126839257915520)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87444) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 10 04:53:34 devstack sudo[105280]: pam_unix(sudo:session): session closed for user root Jul 10 04:53:34 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-6c1d3a86-f10e-486a-93ec-2c346cf1a0ba tempest-CreateVolumesFromSnapshotTest-1643372015 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-6a52692c-d463-4776-aa0a-2fdfb275e2ef.info" returned: 0 in 1.030s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:53:34 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-6c1d3a86-f10e-486a-93ec-2c346cf1a0ba tempest-CreateVolumesFromSnapshotTest-1643372015 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 6.171s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 04:53:34 devstack sudo[105282]: pam_unix(sudo:session): session closed for user root Jul 10 04:53:34 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-9522ba1f-2af3-4c5c-80de-0d8e97bf5070 tempest-VolumeAndVolumeTypeFromImageTest-667796659 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-e1e118ed-29ec-4a87-b93f-4ce4aabe0c96 1G" returned: 0 in 1.058s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:53:34 devstack cinder-volume[87444]: INFO cinder.volume.manager [None req-6c1d3a86-f10e-486a-93ec-2c346cf1a0ba tempest-CreateVolumesFromSnapshotTest-1643372015 None] Create snapshot completed successfully Jul 10 04:53:34 devstack cinder-volume[87444]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e043aee-5bb8-4279-962d-207c45b15291]: (4, 'raw') {{(pid=88499) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 04:53:34 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-9522ba1f-2af3-4c5c-80de-0d8e97bf5070 tempest-VolumeAndVolumeTypeFromImageTest-667796659 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-e1e118ed-29ec-4a87-b93f-4ce4aabe0c96 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:53:34 devstack sudo[105293]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-e1e118ed-29ec-4a87-b93f-4ce4aabe0c96 Jul 10 04:53:34 devstack sudo[105293]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:53:34 devstack sudo[105286]: pam_unix(sudo:session): session closed for user root Jul 10 04:53:34 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-16032f35-e767-4a42-9908-8b5c7a3e34d5 tempest-CreateVolumesFromSourceVolumeTest-476912221 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-b3decc1b-92ad-455d-a22d-0583f61bb9be" returned: 0 in 1.052s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:53:34 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-16032f35-e767-4a42-9908-8b5c7a3e34d5 tempest-CreateVolumesFromSourceVolumeTest-476912221 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-b3decc1b-92ad-455d-a22d-0583f61bb9be {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:53:34 devstack cinder-volume[87444]: DEBUG cinder.volume.flows.manager.create_volume [None req-db8cf9c3-8ad8-46b5-802e-c23f60f6cce2 tempest-VolumeDependencyTests-2054620824 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87444) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 04:53:34 devstack sudo[105299]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-b3decc1b-92ad-455d-a22d-0583f61bb9be Jul 10 04:53:34 devstack sudo[105299]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:53:34 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-db8cf9c3-8ad8-46b5-802e-c23f60f6cce2 tempest-VolumeDependencyTests-2054620824 None] Flow 'volume_create_manager' (7dff4ea3-716e-430f-a9c2-a14f83c1028b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 04:53:34 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-db8cf9c3-8ad8-46b5-802e-c23f60f6cce2 tempest-VolumeDependencyTests-2054620824 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3a127f0f-4d51-4dba-b7d1-f19de9053bda) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:53:34 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-db8cf9c3-8ad8-46b5-802e-c23f60f6cce2 tempest-VolumeDependencyTests-2054620824 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3a127f0f-4d51-4dba-b7d1-f19de9053bda) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T02:53:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-2105244631',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c9291bec-53ee-4b51-8bdf-8b3ea5eefacd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='78b1918d5df24f7f929f1a3952f5e277',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T02:53:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T02:53:35Z,use_quota=True,user_id='4e38d0c84cb84f579f7af6e3050fc2c6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(317e369e-1e06-434d-ae95-a335f0e6c903),volume_type_id=317e369e-1e06-434d-ae95-a335f0e6c903)' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:53:34 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-db8cf9c3-8ad8-46b5-802e-c23f60f6cce2 tempest-VolumeDependencyTests-2054620824 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3f9248de-69b3-4949-8f81-d61d70489a16) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:53:34 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-db8cf9c3-8ad8-46b5-802e-c23f60f6cce2 tempest-VolumeDependencyTests-2054620824 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3f9248de-69b3-4949-8f81-d61d70489a16) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:53:34 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-db8cf9c3-8ad8-46b5-802e-c23f60f6cce2 tempest-VolumeDependencyTests-2054620824 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b61a7f6e-2750-4c64-8402-74a320e0bd9e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:53:34 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-db8cf9c3-8ad8-46b5-802e-c23f60f6cce2 tempest-VolumeDependencyTests-2054620824 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b61a7f6e-2750-4c64-8402-74a320e0bd9e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c9291bec-53ee-4b51-8bdf-8b3ea5eefacd', 'volume_name': 'volume-c9291bec-53ee-4b51-8bdf-8b3ea5eefacd', 'volume_size': 1}' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:53:34 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-db8cf9c3-8ad8-46b5-802e-c23f60f6cce2 tempest-VolumeDependencyTests-2054620824 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3bbf5b45-97e5-45b9-b531-bf51db8ad95e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:53:34 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-db8cf9c3-8ad8-46b5-802e-c23f60f6cce2 tempest-VolumeDependencyTests-2054620824 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3bbf5b45-97e5-45b9-b531-bf51db8ad95e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:53:34 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-db8cf9c3-8ad8-46b5-802e-c23f60f6cce2 tempest-VolumeDependencyTests-2054620824 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4a6c1986-b31d-4c10-82ad-08aa519073fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:53:34 devstack cinder-volume[87444]: INFO cinder.volume.flows.manager.create_volume [None req-db8cf9c3-8ad8-46b5-802e-c23f60f6cce2 tempest-VolumeDependencyTests-2054620824 None] Volume c9291bec-53ee-4b51-8bdf-8b3ea5eefacd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c9291bec-53ee-4b51-8bdf-8b3ea5eefacd', 'volume_size': 1} Jul 10 04:53:34 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-db8cf9c3-8ad8-46b5-802e-c23f60f6cce2 tempest-VolumeDependencyTests-2054620824 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 04:53:34 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-db8cf9c3-8ad8-46b5-802e-c23f60f6cce2 tempest-VolumeDependencyTests-2054620824 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 04:53:34 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-db8cf9c3-8ad8-46b5-802e-c23f60f6cce2 tempest-VolumeDependencyTests-2054620824 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T02:53:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-2105244631',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c9291bec-53ee-4b51-8bdf-8b3ea5eefacd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='78b1918d5df24f7f929f1a3952f5e277',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T02:53:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T02:53:35Z,use_quota=True,user_id='4e38d0c84cb84f579f7af6e3050fc2c6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(317e369e-1e06-434d-ae95-a335f0e6c903),volume_type_id=317e369e-1e06-434d-ae95-a335f0e6c903)}" {{(pid=87444) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 04:53:34 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.remotefs [None req-db8cf9c3-8ad8-46b5-802e-c23f60f6cce2 tempest-VolumeDependencyTests-2054620824 None] Creating volume c9291bec-53ee-4b51-8bdf-8b3ea5eefacd {{(pid=87444) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 04:53:34 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-db8cf9c3-8ad8-46b5-802e-c23f60f6cce2 tempest-VolumeDependencyTests-2054620824 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 04:53:34 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-db8cf9c3-8ad8-46b5-802e-c23f60f6cce2 tempest-VolumeDependencyTests-2054620824 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 04:53:34 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-db8cf9c3-8ad8-46b5-802e-c23f60f6cce2 tempest-VolumeDependencyTests-2054620824 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922': None} {{(pid=87444) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 04:53:34 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-db8cf9c3-8ad8-46b5-802e-c23f60f6cce2 tempest-VolumeDependencyTests-2054620824 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922'] {{(pid=87444) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 04:53:34 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-db8cf9c3-8ad8-46b5-802e-c23f60f6cce2 tempest-VolumeDependencyTests-2054620824 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 04:53:34 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-db8cf9c3-8ad8-46b5-802e-c23f60f6cce2 tempest-VolumeDependencyTests-2054620824 None] Selected osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922 as target Quobyte volume. {{(pid=87444) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 04:53:34 devstack cinder-volume[87444]: INFO cinder.volume.drivers.remotefs [None req-db8cf9c3-8ad8-46b5-802e-c23f60f6cce2 tempest-VolumeDependencyTests-2054620824 None] casted to osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922 Jul 10 04:53:34 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-db8cf9c3-8ad8-46b5-802e-c23f60f6cce2 tempest-VolumeDependencyTests-2054620824 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-c9291bec-53ee-4b51-8bdf-8b3ea5eefacd 1073741824 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:53:34 devstack sudo[105301]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-c9291bec-53ee-4b51-8bdf-8b3ea5eefacd 1073741824 Jul 10 04:53:34 devstack sudo[105301]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:53:35 devstack cinder-volume[87444]: DEBUG cinder.volume.flows.manager.create_volume [None req-ac98f247-4e3c-4203-8ee3-04ce1dd8af7a tempest-CreateVolumesFromSnapshotTest-1643372015 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87444) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 04:53:35 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-ac98f247-4e3c-4203-8ee3-04ce1dd8af7a tempest-CreateVolumesFromSnapshotTest-1643372015 None] Flow 'volume_create_manager' (69f4a793-1a5d-4bbd-b1f7-0ca21d8b27df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 04:53:35 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-ac98f247-4e3c-4203-8ee3-04ce1dd8af7a tempest-CreateVolumesFromSnapshotTest-1643372015 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fe84d74c-82dd-4873-a223-cec50c3757b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:53:35 devstack sudo[105293]: pam_unix(sudo:session): session closed for user root Jul 10 04:53:35 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-9522ba1f-2af3-4c5c-80de-0d8e97bf5070 tempest-VolumeAndVolumeTypeFromImageTest-667796659 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-e1e118ed-29ec-4a87-b93f-4ce4aabe0c96" returned: 0 in 0.986s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:53:35 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-9522ba1f-2af3-4c5c-80de-0d8e97bf5070 tempest-VolumeAndVolumeTypeFromImageTest-667796659 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-e1e118ed-29ec-4a87-b93f-4ce4aabe0c96 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:53:35 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-ac98f247-4e3c-4203-8ee3-04ce1dd8af7a tempest-CreateVolumesFromSnapshotTest-1643372015 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fe84d74c-82dd-4873-a223-cec50c3757b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T02:53:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-698570581',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=75d4cfca-8f6e-4d14-a79a-af38fad63479,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='eb19c0257a1a4527ad12a8fcf0b7404d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T02:53:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T02:53:35Z,use_quota=True,user_id='b3d05e57fb514af1a7774fbaec83fdec',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(317e369e-1e06-434d-ae95-a335f0e6c903),volume_type_id=317e369e-1e06-434d-ae95-a335f0e6c903)' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:53:35 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-ac98f247-4e3c-4203-8ee3-04ce1dd8af7a tempest-CreateVolumesFromSnapshotTest-1643372015 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ca15f174-4454-4f64-869c-27f10b197ef9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:53:35 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-ac98f247-4e3c-4203-8ee3-04ce1dd8af7a tempest-CreateVolumesFromSnapshotTest-1643372015 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ca15f174-4454-4f64-869c-27f10b197ef9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:53:35 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-ac98f247-4e3c-4203-8ee3-04ce1dd8af7a tempest-CreateVolumesFromSnapshotTest-1643372015 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6f82187c-d98c-4cc2-8dd6-91e33b082dab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:53:35 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-ac98f247-4e3c-4203-8ee3-04ce1dd8af7a tempest-CreateVolumesFromSnapshotTest-1643372015 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6f82187c-d98c-4cc2-8dd6-91e33b082dab) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '75d4cfca-8f6e-4d14-a79a-af38fad63479', 'volume_name': 'volume-75d4cfca-8f6e-4d14-a79a-af38fad63479', 'volume_size': 1}' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:53:35 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-ac98f247-4e3c-4203-8ee3-04ce1dd8af7a tempest-CreateVolumesFromSnapshotTest-1643372015 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (46cb9ed7-9bb9-4772-a090-88fbe6fa27d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:53:35 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-ac98f247-4e3c-4203-8ee3-04ce1dd8af7a tempest-CreateVolumesFromSnapshotTest-1643372015 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (46cb9ed7-9bb9-4772-a090-88fbe6fa27d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:53:35 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-ac98f247-4e3c-4203-8ee3-04ce1dd8af7a tempest-CreateVolumesFromSnapshotTest-1643372015 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (13148fb4-7ab3-4e8e-8939-63d2412cfbe2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:53:35 devstack cinder-volume[87444]: INFO cinder.volume.flows.manager.create_volume [None req-ac98f247-4e3c-4203-8ee3-04ce1dd8af7a tempest-CreateVolumesFromSnapshotTest-1643372015 None] Volume 75d4cfca-8f6e-4d14-a79a-af38fad63479: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-75d4cfca-8f6e-4d14-a79a-af38fad63479', 'volume_size': 1} Jul 10 04:53:35 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-ac98f247-4e3c-4203-8ee3-04ce1dd8af7a tempest-CreateVolumesFromSnapshotTest-1643372015 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 04:53:35 devstack sudo[105305]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-e1e118ed-29ec-4a87-b93f-4ce4aabe0c96 Jul 10 04:53:35 devstack sudo[105305]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:53:35 devstack cinder-volume[87444]: DEBUG cinder.volume.flows.manager.create_volume [None req-617ecbc6-2a3f-44f4-9aa5-74e650f98737 tempest-CreateVolumesFromSnapshotTest-1643372015 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87444) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 04:53:35 devstack sudo[105299]: pam_unix(sudo:session): session closed for user root Jul 10 04:53:35 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-617ecbc6-2a3f-44f4-9aa5-74e650f98737 tempest-CreateVolumesFromSnapshotTest-1643372015 None] Flow 'volume_create_manager' (f4a1eed0-19c7-43c5-a455-f5e1990deeac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 04:53:35 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-617ecbc6-2a3f-44f4-9aa5-74e650f98737 tempest-CreateVolumesFromSnapshotTest-1643372015 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (27246438-5177-4f62-b5b3-3f38c814b5b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:53:35 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-16032f35-e767-4a42-9908-8b5c7a3e34d5 tempest-CreateVolumesFromSourceVolumeTest-476912221 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-b3decc1b-92ad-455d-a22d-0583f61bb9be" returned: 0 in 0.950s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:53:35 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-617ecbc6-2a3f-44f4-9aa5-74e650f98737 tempest-CreateVolumesFromSnapshotTest-1643372015 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (27246438-5177-4f62-b5b3-3f38c814b5b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T02:53:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-208828683',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a32e71b3-683f-4214-b096-f0fb0d9842fe,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='eb19c0257a1a4527ad12a8fcf0b7404d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T02:53:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T02:53:36Z,use_quota=True,user_id='b3d05e57fb514af1a7774fbaec83fdec',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(317e369e-1e06-434d-ae95-a335f0e6c903),volume_type_id=317e369e-1e06-434d-ae95-a335f0e6c903)' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:53:35 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-617ecbc6-2a3f-44f4-9aa5-74e650f98737 tempest-CreateVolumesFromSnapshotTest-1643372015 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9f1f7f49-ee35-4bd0-9d03-6c366ea43ec5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:53:35 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-617ecbc6-2a3f-44f4-9aa5-74e650f98737 tempest-CreateVolumesFromSnapshotTest-1643372015 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9f1f7f49-ee35-4bd0-9d03-6c366ea43ec5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:53:35 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-617ecbc6-2a3f-44f4-9aa5-74e650f98737 tempest-CreateVolumesFromSnapshotTest-1643372015 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a829ef2b-de07-4617-836a-8b77590871d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:53:35 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-617ecbc6-2a3f-44f4-9aa5-74e650f98737 tempest-CreateVolumesFromSnapshotTest-1643372015 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a829ef2b-de07-4617-836a-8b77590871d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a32e71b3-683f-4214-b096-f0fb0d9842fe', 'volume_name': 'volume-a32e71b3-683f-4214-b096-f0fb0d9842fe', 'volume_size': 1}' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:53:35 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-617ecbc6-2a3f-44f4-9aa5-74e650f98737 tempest-CreateVolumesFromSnapshotTest-1643372015 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3b72c30e-ebe3-44c1-8a1a-952518336404) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:53:35 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-617ecbc6-2a3f-44f4-9aa5-74e650f98737 tempest-CreateVolumesFromSnapshotTest-1643372015 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3b72c30e-ebe3-44c1-8a1a-952518336404) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:53:35 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-617ecbc6-2a3f-44f4-9aa5-74e650f98737 tempest-CreateVolumesFromSnapshotTest-1643372015 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (11e1b4df-a4f7-449a-94a2-45a2a92d6e1d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:53:35 devstack cinder-volume[87444]: INFO cinder.volume.flows.manager.create_volume [None req-617ecbc6-2a3f-44f4-9aa5-74e650f98737 tempest-CreateVolumesFromSnapshotTest-1643372015 None] Volume a32e71b3-683f-4214-b096-f0fb0d9842fe: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a32e71b3-683f-4214-b096-f0fb0d9842fe', 'volume_size': 1} Jul 10 04:53:35 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-617ecbc6-2a3f-44f4-9aa5-74e650f98737 tempest-CreateVolumesFromSnapshotTest-1643372015 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 04:53:35 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-16032f35-e767-4a42-9908-8b5c7a3e34d5 tempest-CreateVolumesFromSourceVolumeTest-476912221 None] Lock "cinder-quobyte-b3decc1b-92ad-455d-a22d-0583f61bb9be" released by "delete_volume" :: held 2.154s {{(pid=87444) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 04:53:35 devstack cinder-volume[87444]: DEBUG cinder.quota [None req-16032f35-e767-4a42-9908-8b5c7a3e34d5 tempest-CreateVolumesFromSourceVolumeTest-476912221 None] Created reservations ['dd8ca45a-9a9a-4fb8-944b-f6f0c21b6c75', '25359ac0-ba20-4701-9f2a-681697b00a1e', '15d98720-4413-4159-a132-e06770b6d95c', 'b16625a2-67e6-4d43-aac2-b4b7805e45d8'] {{(pid=87444) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 04:53:36 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-16032f35-e767-4a42-9908-8b5c7a3e34d5 tempest-CreateVolumesFromSourceVolumeTest-476912221 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 04:53:36 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-16032f35-e767-4a42-9908-8b5c7a3e34d5 tempest-CreateVolumesFromSourceVolumeTest-476912221 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 04:53:36 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-16032f35-e767-4a42-9908-8b5c7a3e34d5 tempest-CreateVolumesFromSourceVolumeTest-476912221 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922': None} {{(pid=87444) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 04:53:36 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-16032f35-e767-4a42-9908-8b5c7a3e34d5 tempest-CreateVolumesFromSourceVolumeTest-476912221 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922'] {{(pid=87444) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 04:53:36 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-16032f35-e767-4a42-9908-8b5c7a3e34d5 tempest-CreateVolumesFromSourceVolumeTest-476912221 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 04:53:36 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-16032f35-e767-4a42-9908-8b5c7a3e34d5 tempest-CreateVolumesFromSourceVolumeTest-476912221 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:53:36 devstack sudo[105311]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097 Jul 10 04:53:36 devstack sudo[105311]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:53:36 devstack cinder-volume[87444]: DEBUG cinder.volume.flows.manager.create_volume [None req-d1a6f72d-a929-4057-bd56-792f6b03f442 tempest-CreateVolumesFromSnapshotTest-1643372015 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87444) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 04:53:36 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-d1a6f72d-a929-4057-bd56-792f6b03f442 tempest-CreateVolumesFromSnapshotTest-1643372015 None] Flow 'volume_create_manager' (9c4e46ff-6402-42ad-85d5-91bf956c3232) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 04:53:36 devstack sudo[105301]: pam_unix(sudo:session): session closed for user root Jul 10 04:53:36 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-d1a6f72d-a929-4057-bd56-792f6b03f442 tempest-CreateVolumesFromSnapshotTest-1643372015 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f7f69d43-c165-43a2-b434-1ed5b2113672) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:53:36 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-db8cf9c3-8ad8-46b5-802e-c23f60f6cce2 tempest-VolumeDependencyTests-2054620824 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-c9291bec-53ee-4b51-8bdf-8b3ea5eefacd 1073741824" returned: 0 in 1.252s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:53:36 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-d1a6f72d-a929-4057-bd56-792f6b03f442 tempest-CreateVolumesFromSnapshotTest-1643372015 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f7f69d43-c165-43a2-b434-1ed5b2113672) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T02:53:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1602278588',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ef0a6ca2-a409-4a17-98fc-e039fa3405a4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='eb19c0257a1a4527ad12a8fcf0b7404d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T02:53:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T02:53:36Z,use_quota=True,user_id='b3d05e57fb514af1a7774fbaec83fdec',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(317e369e-1e06-434d-ae95-a335f0e6c903),volume_type_id=317e369e-1e06-434d-ae95-a335f0e6c903)' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:53:36 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-d1a6f72d-a929-4057-bd56-792f6b03f442 tempest-CreateVolumesFromSnapshotTest-1643372015 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (42cb00b1-500f-41aa-8573-b3aeff7cee55) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:53:36 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-d1a6f72d-a929-4057-bd56-792f6b03f442 tempest-CreateVolumesFromSnapshotTest-1643372015 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (42cb00b1-500f-41aa-8573-b3aeff7cee55) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:53:36 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-d1a6f72d-a929-4057-bd56-792f6b03f442 tempest-CreateVolumesFromSnapshotTest-1643372015 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fb737418-0925-414e-9c82-f8b58e738663) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:53:36 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-d1a6f72d-a929-4057-bd56-792f6b03f442 tempest-CreateVolumesFromSnapshotTest-1643372015 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fb737418-0925-414e-9c82-f8b58e738663) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ef0a6ca2-a409-4a17-98fc-e039fa3405a4', 'volume_name': 'volume-ef0a6ca2-a409-4a17-98fc-e039fa3405a4', 'volume_size': 1}' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:53:36 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-d1a6f72d-a929-4057-bd56-792f6b03f442 tempest-CreateVolumesFromSnapshotTest-1643372015 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e230aeb8-cc4c-4799-9a20-93591ecde44e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:53:36 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-d1a6f72d-a929-4057-bd56-792f6b03f442 tempest-CreateVolumesFromSnapshotTest-1643372015 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e230aeb8-cc4c-4799-9a20-93591ecde44e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:53:36 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-d1a6f72d-a929-4057-bd56-792f6b03f442 tempest-CreateVolumesFromSnapshotTest-1643372015 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (470e6bf2-6934-42a9-801a-30d1127d4bbd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:53:36 devstack cinder-volume[87444]: INFO cinder.volume.flows.manager.create_volume [None req-d1a6f72d-a929-4057-bd56-792f6b03f442 tempest-CreateVolumesFromSnapshotTest-1643372015 None] Volume ef0a6ca2-a409-4a17-98fc-e039fa3405a4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ef0a6ca2-a409-4a17-98fc-e039fa3405a4', 'volume_size': 1} Jul 10 04:53:36 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-d1a6f72d-a929-4057-bd56-792f6b03f442 tempest-CreateVolumesFromSnapshotTest-1643372015 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 04:53:36 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-db8cf9c3-8ad8-46b5-802e-c23f60f6cce2 tempest-VolumeDependencyTests-2054620824 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-c9291bec-53ee-4b51-8bdf-8b3ea5eefacd {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:53:36 devstack sudo[105313]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-c9291bec-53ee-4b51-8bdf-8b3ea5eefacd Jul 10 04:53:36 devstack sudo[105313]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:53:36 devstack sudo[105305]: pam_unix(sudo:session): session closed for user root Jul 10 04:53:36 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-9522ba1f-2af3-4c5c-80de-0d8e97bf5070 tempest-VolumeAndVolumeTypeFromImageTest-667796659 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-e1e118ed-29ec-4a87-b93f-4ce4aabe0c96" returned: 1 in 1.217s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:53:36 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-9522ba1f-2af3-4c5c-80de-0d8e97bf5070 tempest-VolumeAndVolumeTypeFromImageTest-667796659 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-e1e118ed-29ec-4a87-b93f-4ce4aabe0c96' failed. Not Retrying. {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 10 04:53:36 devstack cinder-volume[87444]: DEBUG cinder.volume.volume_utils [None req-9522ba1f-2af3-4c5c-80de-0d8e97bf5070 tempest-VolumeAndVolumeTypeFromImageTest-667796659 None] Downloaded image 63070680-ed32-4c77-b773-d742aba1a2f3 ((None, [{'url': 'file:///opt/stack/data/glance/images/63070680-ed32-4c77-b773-d742aba1a2f3', 'metadata': {}}])) to volume e1e118ed-29ec-4a87-b93f-4ce4aabe0c96 successfully. {{(pid=87444) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jul 10 04:53:36 devstack cinder-volume[87444]: DEBUG cinder.image.image_utils [None req-9522ba1f-2af3-4c5c-80de-0d8e97bf5070 tempest-VolumeAndVolumeTypeFromImageTest-667796659 None] Temporary image 63070680-ed32-4c77-b773-d742aba1a2f3 for user 9cc84feaf896498d9da35db0052071a6 is deleted. {{(pid=87444) fetch /opt/stack/cinder/cinder/image/image_utils.py:1468}} Jul 10 04:53:36 devstack cinder-volume[87444]: DEBUG cinder.volume.volume_utils [None req-9522ba1f-2af3-4c5c-80de-0d8e97bf5070 tempest-VolumeAndVolumeTypeFromImageTest-667796659 None] Marking volume e1e118ed-29ec-4a87-b93f-4ce4aabe0c96 as bootable. {{(pid=87444) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jul 10 04:53:36 devstack cinder-volume[87444]: DEBUG cinder.volume.flows.manager.create_volume [None req-9522ba1f-2af3-4c5c-80de-0d8e97bf5070 tempest-VolumeAndVolumeTypeFromImageTest-667796659 None] Copying metadata from image 63070680-ed32-4c77-b773-d742aba1a2f3 to e1e118ed-29ec-4a87-b93f-4ce4aabe0c96. {{(pid=87444) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jul 10 04:53:36 devstack cinder-volume[87444]: DEBUG cinder.volume.flows.manager.create_volume [None req-9522ba1f-2af3-4c5c-80de-0d8e97bf5070 tempest-VolumeAndVolumeTypeFromImageTest-667796659 None] Creating volume glance metadata for volume e1e118ed-29ec-4a87-b93f-4ce4aabe0c96 backed by image 63070680-ed32-4c77-b773-d742aba1a2f3 with: {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'image_id': '63070680-ed32-4c77-b773-d742aba1a2f3', 'image_name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'checksum': 'b65c1c37eb71fd58714fb856a270421e', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=87444) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jul 10 04:53:36 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-9522ba1f-2af3-4c5c-80de-0d8e97bf5070 tempest-VolumeAndVolumeTypeFromImageTest-667796659 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c5c476ce-ef76-4e06-b7b4-a6debb6a18ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e1e118ed-29ec-4a87-b93f-4ce4aabe0c96', 'volume_size': 1, 'image_id': '63070680-ed32-4c77-b773-d742aba1a2f3', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/63070680-ed32-4c77-b773-d742aba1a2f3', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'b65c1c37eb71fd58714fb856a270421e', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'ff85958c095040fb8878a45f2568ef7b', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '77eb6bab37d7b7a416e9ec9203a56a1d5202335dc1aeac9bdb3c763cfd29f5a439e0a4a8c67ef57edea3eb4a66f18a4048ab195ac7a6884eeca5f5b7dbbea013', 'id': '63070680-ed32-4c77-b773-d742aba1a2f3', 'created_at': datetime.datetime(2026, 7, 10, 2, 53, 8, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 10, 2, 53, 9, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/63070680-ed32-4c77-b773-d742aba1a2f3/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:53:36 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-9522ba1f-2af3-4c5c-80de-0d8e97bf5070 tempest-VolumeAndVolumeTypeFromImageTest-667796659 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (de96bb6f-625b-4642-a143-008521c099ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:53:36 devstack cinder-volume[87444]: INFO cinder.volume.flows.manager.create_volume [None req-9522ba1f-2af3-4c5c-80de-0d8e97bf5070 tempest-VolumeAndVolumeTypeFromImageTest-667796659 None] Volume volume-e1e118ed-29ec-4a87-b93f-4ce4aabe0c96 (e1e118ed-29ec-4a87-b93f-4ce4aabe0c96): created successfully Jul 10 04:53:36 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-9522ba1f-2af3-4c5c-80de-0d8e97bf5070 tempest-VolumeAndVolumeTypeFromImageTest-667796659 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (de96bb6f-625b-4642-a143-008521c099ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:53:36 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-9522ba1f-2af3-4c5c-80de-0d8e97bf5070 tempest-VolumeAndVolumeTypeFromImageTest-667796659 None] Flow 'volume_create_manager' (92c46582-2ab1-42cb-b784-a0c344de1500) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87444) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 04:53:36 devstack cinder-volume[87444]: INFO cinder.volume.manager [None req-9522ba1f-2af3-4c5c-80de-0d8e97bf5070 tempest-VolumeAndVolumeTypeFromImageTest-667796659 None] Created volume successfully. Jul 10 04:53:36 devstack cinder-volume[87444]: DEBUG cinder.volume.flows.manager.create_volume [None req-6abd7297-27dc-43a2-8777-8fc07a465497 tempest-CreateVolumesFromSnapshotTest-1643372015 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87444) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 04:53:36 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-6abd7297-27dc-43a2-8777-8fc07a465497 tempest-CreateVolumesFromSnapshotTest-1643372015 None] Flow 'volume_create_manager' (506022ae-5d91-4ca8-8f10-9b4934c78664) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 04:53:36 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-6abd7297-27dc-43a2-8777-8fc07a465497 tempest-CreateVolumesFromSnapshotTest-1643372015 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (965bddb6-4ee5-4428-ae3d-d701260c742a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:53:36 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-6abd7297-27dc-43a2-8777-8fc07a465497 tempest-CreateVolumesFromSnapshotTest-1643372015 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (965bddb6-4ee5-4428-ae3d-d701260c742a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T02:53:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1228211681',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=82a9daa1-5862-4cac-adb8-c294dce35034,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='eb19c0257a1a4527ad12a8fcf0b7404d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T02:53:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T02:53:37Z,use_quota=True,user_id='b3d05e57fb514af1a7774fbaec83fdec',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(317e369e-1e06-434d-ae95-a335f0e6c903),volume_type_id=317e369e-1e06-434d-ae95-a335f0e6c903)' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:53:36 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-6abd7297-27dc-43a2-8777-8fc07a465497 tempest-CreateVolumesFromSnapshotTest-1643372015 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5383c861-ac0b-40f9-bb5a-dbf069410a4b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:53:36 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-6abd7297-27dc-43a2-8777-8fc07a465497 tempest-CreateVolumesFromSnapshotTest-1643372015 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5383c861-ac0b-40f9-bb5a-dbf069410a4b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:53:36 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-6abd7297-27dc-43a2-8777-8fc07a465497 tempest-CreateVolumesFromSnapshotTest-1643372015 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cf75e599-a59b-45c5-bfdc-0caeef29002a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:53:36 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-6abd7297-27dc-43a2-8777-8fc07a465497 tempest-CreateVolumesFromSnapshotTest-1643372015 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cf75e599-a59b-45c5-bfdc-0caeef29002a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '82a9daa1-5862-4cac-adb8-c294dce35034', 'volume_name': 'volume-82a9daa1-5862-4cac-adb8-c294dce35034', 'volume_size': 1}' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:53:36 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-6abd7297-27dc-43a2-8777-8fc07a465497 tempest-CreateVolumesFromSnapshotTest-1643372015 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (868998db-fba7-4557-9bca-0e3c0e0c42c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:53:36 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-6abd7297-27dc-43a2-8777-8fc07a465497 tempest-CreateVolumesFromSnapshotTest-1643372015 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (868998db-fba7-4557-9bca-0e3c0e0c42c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:53:36 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-6abd7297-27dc-43a2-8777-8fc07a465497 tempest-CreateVolumesFromSnapshotTest-1643372015 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ad5f58bf-3ba1-4ac8-baf8-3e9587992bbe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:53:36 devstack cinder-volume[87444]: INFO cinder.volume.flows.manager.create_volume [None req-6abd7297-27dc-43a2-8777-8fc07a465497 tempest-CreateVolumesFromSnapshotTest-1643372015 None] Volume 82a9daa1-5862-4cac-adb8-c294dce35034: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-82a9daa1-5862-4cac-adb8-c294dce35034', 'volume_size': 1} Jul 10 04:53:36 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-6abd7297-27dc-43a2-8777-8fc07a465497 tempest-CreateVolumesFromSnapshotTest-1643372015 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 04:53:36 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-5b59fe42-c04b-4622-beb4-ce992c1fc198 tempest-CreateVolumesFromSourceVolumeTest-476912221 None] Acquiring lock "cinder-81d1981f-6a8f-4f71-b189-63c66f977047-delete_volume" by "delete_volume" {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 04:53:37 devstack sudo[105311]: pam_unix(sudo:session): session closed for user root Jul 10 04:53:37 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-16032f35-e767-4a42-9908-8b5c7a3e34d5 tempest-CreateVolumesFromSourceVolumeTest-476912221 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097" returned: 0 in 0.962s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:53:37 devstack cinder-volume[87444]: DEBUG cinder.manager [None req-16032f35-e767-4a42-9908-8b5c7a3e34d5 tempest-CreateVolumesFromSourceVolumeTest-476912221 None] Notifying Schedulers of capabilities ... {{(pid=87444) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 04:53:37 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-5b59fe42-c04b-4622-beb4-ce992c1fc198 tempest-CreateVolumesFromSourceVolumeTest-476912221 None] Lock "cinder-81d1981f-6a8f-4f71-b189-63c66f977047-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 04:53:37 devstack cinder-volume[87444]: INFO cinder.volume.manager [None req-16032f35-e767-4a42-9908-8b5c7a3e34d5 tempest-CreateVolumesFromSourceVolumeTest-476912221 None] Deleted volume successfully. Jul 10 04:53:37 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-16032f35-e767-4a42-9908-8b5c7a3e34d5 tempest-CreateVolumesFromSourceVolumeTest-476912221 None] Lock "cinder-b3decc1b-92ad-455d-a22d-0583f61bb9be-delete_volume" released by "delete_volume" :: held 3.450s {{(pid=87444) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 04:53:37 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-5b59fe42-c04b-4622-beb4-ce992c1fc198 tempest-CreateVolumesFromSourceVolumeTest-476912221 None] Acquiring lock "cinder-quobyte-81d1981f-6a8f-4f71-b189-63c66f977047" by "delete_volume" {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 04:53:37 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-5b59fe42-c04b-4622-beb4-ce992c1fc198 tempest-CreateVolumesFromSourceVolumeTest-476912221 None] Lock "cinder-quobyte-81d1981f-6a8f-4f71-b189-63c66f977047" acquired by "delete_volume" :: waited 0.022s {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 04:53:37 devstack cinder-volume[87444]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b5bb277-7732-4098-8cc0-bed6d6a7441f]: (4, 'qcow2') {{(pid=88499) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 04:53:37 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-5b59fe42-c04b-4622-beb4-ce992c1fc198 tempest-CreateVolumesFromSourceVolumeTest-476912221 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-81d1981f-6a8f-4f71-b189-63c66f977047 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:53:37 devstack sudo[105313]: pam_unix(sudo:session): session closed for user root Jul 10 04:53:37 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-db8cf9c3-8ad8-46b5-802e-c23f60f6cce2 tempest-VolumeDependencyTests-2054620824 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-c9291bec-53ee-4b51-8bdf-8b3ea5eefacd" returned: 0 in 0.890s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:53:37 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-db8cf9c3-8ad8-46b5-802e-c23f60f6cce2 tempest-VolumeDependencyTests-2054620824 None] <== create_volume: return (2239ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922'} {{(pid=87444) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 04:53:37 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-db8cf9c3-8ad8-46b5-802e-c23f60f6cce2 tempest-VolumeDependencyTests-2054620824 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.243s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 04:53:37 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-ac98f247-4e3c-4203-8ee3-04ce1dd8af7a tempest-CreateVolumesFromSnapshotTest-1643372015 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.772s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 04:53:37 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-ac98f247-4e3c-4203-8ee3-04ce1dd8af7a tempest-CreateVolumesFromSnapshotTest-1643372015 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T02:53:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-698570581',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=75d4cfca-8f6e-4d14-a79a-af38fad63479,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='eb19c0257a1a4527ad12a8fcf0b7404d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T02:53:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T02:53:35Z,use_quota=True,user_id='b3d05e57fb514af1a7774fbaec83fdec',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(317e369e-1e06-434d-ae95-a335f0e6c903),volume_type_id=317e369e-1e06-434d-ae95-a335f0e6c903)}" {{(pid=87444) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 04:53:37 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.remotefs [None req-ac98f247-4e3c-4203-8ee3-04ce1dd8af7a tempest-CreateVolumesFromSnapshotTest-1643372015 None] Creating volume 75d4cfca-8f6e-4d14-a79a-af38fad63479 {{(pid=87444) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 04:53:37 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-ac98f247-4e3c-4203-8ee3-04ce1dd8af7a tempest-CreateVolumesFromSnapshotTest-1643372015 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 04:53:37 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-ac98f247-4e3c-4203-8ee3-04ce1dd8af7a tempest-CreateVolumesFromSnapshotTest-1643372015 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 04:53:37 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-ac98f247-4e3c-4203-8ee3-04ce1dd8af7a tempest-CreateVolumesFromSnapshotTest-1643372015 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922': None} {{(pid=87444) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 04:53:37 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-ac98f247-4e3c-4203-8ee3-04ce1dd8af7a tempest-CreateVolumesFromSnapshotTest-1643372015 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922'] {{(pid=87444) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 04:53:37 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-ac98f247-4e3c-4203-8ee3-04ce1dd8af7a tempest-CreateVolumesFromSnapshotTest-1643372015 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 04:53:37 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-ac98f247-4e3c-4203-8ee3-04ce1dd8af7a tempest-CreateVolumesFromSnapshotTest-1643372015 None] Selected osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922 as target Quobyte volume. {{(pid=87444) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 04:53:37 devstack cinder-volume[87444]: INFO cinder.volume.drivers.remotefs [None req-ac98f247-4e3c-4203-8ee3-04ce1dd8af7a tempest-CreateVolumesFromSnapshotTest-1643372015 None] casted to osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922 Jul 10 04:53:37 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-ac98f247-4e3c-4203-8ee3-04ce1dd8af7a tempest-CreateVolumesFromSnapshotTest-1643372015 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-75d4cfca-8f6e-4d14-a79a-af38fad63479 1073741824 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:53:37 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-db8cf9c3-8ad8-46b5-802e-c23f60f6cce2 tempest-VolumeDependencyTests-2054620824 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4a6c1986-b31d-4c10-82ad-08aa519073fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c9291bec-53ee-4b51-8bdf-8b3ea5eefacd', 'volume_size': 1}' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:53:37 devstack sudo[105321]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-75d4cfca-8f6e-4d14-a79a-af38fad63479 1073741824 Jul 10 04:53:37 devstack sudo[105321]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:53:37 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-db8cf9c3-8ad8-46b5-802e-c23f60f6cce2 tempest-VolumeDependencyTests-2054620824 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (74e072f5-f782-45ca-88a0-74f0b4a134bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:53:37 devstack cinder-volume[87444]: INFO cinder.volume.flows.manager.create_volume [None req-db8cf9c3-8ad8-46b5-802e-c23f60f6cce2 tempest-VolumeDependencyTests-2054620824 None] Volume volume-c9291bec-53ee-4b51-8bdf-8b3ea5eefacd (c9291bec-53ee-4b51-8bdf-8b3ea5eefacd): created successfully Jul 10 04:53:37 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-db8cf9c3-8ad8-46b5-802e-c23f60f6cce2 tempest-VolumeDependencyTests-2054620824 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (74e072f5-f782-45ca-88a0-74f0b4a134bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:53:37 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-db8cf9c3-8ad8-46b5-802e-c23f60f6cce2 tempest-VolumeDependencyTests-2054620824 None] Flow 'volume_create_manager' (7dff4ea3-716e-430f-a9c2-a14f83c1028b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87444) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 04:53:37 devstack sudo[105320]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-81d1981f-6a8f-4f71-b189-63c66f977047 Jul 10 04:53:37 devstack sudo[105320]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:53:37 devstack cinder-volume[87444]: INFO cinder.volume.manager [None req-db8cf9c3-8ad8-46b5-802e-c23f60f6cce2 tempest-VolumeDependencyTests-2054620824 None] Created volume successfully. Jul 10 04:53:37 devstack cinder-volume[87444]: DEBUG cinder.volume.flows.manager.create_volume [None req-d3fca98b-04b6-490d-a359-75369701d710 tempest-CreateVolumesFromSnapshotTest-1643372015 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87444) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 04:53:37 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-d3fca98b-04b6-490d-a359-75369701d710 tempest-CreateVolumesFromSnapshotTest-1643372015 None] Flow 'volume_create_manager' (e14b69b1-50cc-4a96-a92c-952a22c5afee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 04:53:37 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-d3fca98b-04b6-490d-a359-75369701d710 tempest-CreateVolumesFromSnapshotTest-1643372015 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2261ba02-021b-43dc-b881-a68dea3ae5ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:53:37 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-d3fca98b-04b6-490d-a359-75369701d710 tempest-CreateVolumesFromSnapshotTest-1643372015 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2261ba02-021b-43dc-b881-a68dea3ae5ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T02:53:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1261166354',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=41cad359-1a56-47e1-b0a2-78a7d1254b41,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='eb19c0257a1a4527ad12a8fcf0b7404d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T02:53:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T02:53:37Z,use_quota=True,user_id='b3d05e57fb514af1a7774fbaec83fdec',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(317e369e-1e06-434d-ae95-a335f0e6c903),volume_type_id=317e369e-1e06-434d-ae95-a335f0e6c903)' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:53:37 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-d3fca98b-04b6-490d-a359-75369701d710 tempest-CreateVolumesFromSnapshotTest-1643372015 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dc7e5afd-fc39-426d-bf71-09a92aa0a034) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:53:37 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-d3fca98b-04b6-490d-a359-75369701d710 tempest-CreateVolumesFromSnapshotTest-1643372015 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dc7e5afd-fc39-426d-bf71-09a92aa0a034) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:53:37 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-d3fca98b-04b6-490d-a359-75369701d710 tempest-CreateVolumesFromSnapshotTest-1643372015 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b53c1362-67b3-43df-8fc3-e6eebc209e12) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:53:37 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-d3fca98b-04b6-490d-a359-75369701d710 tempest-CreateVolumesFromSnapshotTest-1643372015 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b53c1362-67b3-43df-8fc3-e6eebc209e12) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '41cad359-1a56-47e1-b0a2-78a7d1254b41', 'volume_name': 'volume-41cad359-1a56-47e1-b0a2-78a7d1254b41', 'volume_size': 1}' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:53:37 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-d3fca98b-04b6-490d-a359-75369701d710 tempest-CreateVolumesFromSnapshotTest-1643372015 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6a5e2908-6764-4949-a3a9-957b1809ae18) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:53:37 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-d3fca98b-04b6-490d-a359-75369701d710 tempest-CreateVolumesFromSnapshotTest-1643372015 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6a5e2908-6764-4949-a3a9-957b1809ae18) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:53:37 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-d3fca98b-04b6-490d-a359-75369701d710 tempest-CreateVolumesFromSnapshotTest-1643372015 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (32cefc90-0a1f-4e59-9593-dea191bc3ac6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:53:37 devstack cinder-volume[87444]: INFO cinder.volume.flows.manager.create_volume [None req-d3fca98b-04b6-490d-a359-75369701d710 tempest-CreateVolumesFromSnapshotTest-1643372015 None] Volume 41cad359-1a56-47e1-b0a2-78a7d1254b41: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-41cad359-1a56-47e1-b0a2-78a7d1254b41', 'volume_size': 1} Jul 10 04:53:37 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-d3fca98b-04b6-490d-a359-75369701d710 tempest-CreateVolumesFromSnapshotTest-1643372015 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 04:53:37 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-32cab35d-3fb1-47f7-8500-12b2c21a1d3e tempest-VolumeAndVolumeTypeFromImageTest-667796659 None] Acquiring lock "cinder-e1e118ed-29ec-4a87-b93f-4ce4aabe0c96-delete_volume" by "delete_volume" {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 04:53:37 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-32cab35d-3fb1-47f7-8500-12b2c21a1d3e tempest-VolumeAndVolumeTypeFromImageTest-667796659 None] Lock "cinder-e1e118ed-29ec-4a87-b93f-4ce4aabe0c96-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 04:53:37 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-32cab35d-3fb1-47f7-8500-12b2c21a1d3e tempest-VolumeAndVolumeTypeFromImageTest-667796659 None] Acquiring lock "cinder-quobyte-e1e118ed-29ec-4a87-b93f-4ce4aabe0c96" by "delete_volume" {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 04:53:37 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-32cab35d-3fb1-47f7-8500-12b2c21a1d3e tempest-VolumeAndVolumeTypeFromImageTest-667796659 None] Lock "cinder-quobyte-e1e118ed-29ec-4a87-b93f-4ce4aabe0c96" acquired by "delete_volume" :: waited 0.017s {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 04:53:37 devstack cinder-volume[87444]: DEBUG oslo.privsep.daemon [-] privsep: reply[8aab9703-8204-4a2e-8113-5ebba3697e7b]: (4, 'raw') {{(pid=88499) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 04:53:37 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-32cab35d-3fb1-47f7-8500-12b2c21a1d3e tempest-VolumeAndVolumeTypeFromImageTest-667796659 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-e1e118ed-29ec-4a87-b93f-4ce4aabe0c96 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:53:37 devstack sudo[105320]: pam_unix(sudo:session): session closed for user root Jul 10 04:53:37 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-5b59fe42-c04b-4622-beb4-ce992c1fc198 tempest-CreateVolumesFromSourceVolumeTest-476912221 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-81d1981f-6a8f-4f71-b189-63c66f977047" returned: 0 in 0.851s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:53:37 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-5b59fe42-c04b-4622-beb4-ce992c1fc198 tempest-CreateVolumesFromSourceVolumeTest-476912221 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-81d1981f-6a8f-4f71-b189-63c66f977047 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:53:38 devstack sudo[105332]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-81d1981f-6a8f-4f71-b189-63c66f977047 Jul 10 04:53:38 devstack sudo[105332]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:53:38 devstack sudo[105331]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-e1e118ed-29ec-4a87-b93f-4ce4aabe0c96 Jul 10 04:53:38 devstack sudo[105331]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:53:38 devstack sudo[105321]: pam_unix(sudo:session): session closed for user root Jul 10 04:53:38 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-ac98f247-4e3c-4203-8ee3-04ce1dd8af7a tempest-CreateVolumesFromSnapshotTest-1643372015 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-75d4cfca-8f6e-4d14-a79a-af38fad63479 1073741824" returned: 0 in 0.954s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:53:38 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-ac98f247-4e3c-4203-8ee3-04ce1dd8af7a tempest-CreateVolumesFromSnapshotTest-1643372015 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-75d4cfca-8f6e-4d14-a79a-af38fad63479 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:53:38 devstack sudo[105335]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-75d4cfca-8f6e-4d14-a79a-af38fad63479 Jul 10 04:53:38 devstack sudo[105335]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:53:38 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-88abb252-898f-4b1d-8abe-9f0a8997311a tempest-VolumeDependencyTests-2054620824 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 04:53:38 devstack sudo[105332]: pam_unix(sudo:session): session closed for user root Jul 10 04:53:38 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-5b59fe42-c04b-4622-beb4-ce992c1fc198 tempest-CreateVolumesFromSourceVolumeTest-476912221 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-81d1981f-6a8f-4f71-b189-63c66f977047" returned: 0 in 0.772s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:53:38 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-5b59fe42-c04b-4622-beb4-ce992c1fc198 tempest-CreateVolumesFromSourceVolumeTest-476912221 None] Lock "cinder-quobyte-81d1981f-6a8f-4f71-b189-63c66f977047" released by "delete_volume" :: held 1.690s {{(pid=87444) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 04:53:38 devstack cinder-volume[87444]: DEBUG cinder.quota [None req-5b59fe42-c04b-4622-beb4-ce992c1fc198 tempest-CreateVolumesFromSourceVolumeTest-476912221 None] Created reservations ['344bf593-df90-4b7a-9903-f5e0d7011265', 'df872c3a-adf7-45d5-bade-d40c62c555fb', 'db94c75e-6438-4998-9450-e9bb56c22418', '35fb1ce3-a09c-421d-b337-d45cfcc743ce'] {{(pid=87444) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 04:53:38 devstack sudo[105331]: pam_unix(sudo:session): session closed for user root Jul 10 04:53:38 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-32cab35d-3fb1-47f7-8500-12b2c21a1d3e tempest-VolumeAndVolumeTypeFromImageTest-667796659 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-e1e118ed-29ec-4a87-b93f-4ce4aabe0c96" returned: 0 in 0.952s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:53:38 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-32cab35d-3fb1-47f7-8500-12b2c21a1d3e tempest-VolumeAndVolumeTypeFromImageTest-667796659 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-e1e118ed-29ec-4a87-b93f-4ce4aabe0c96 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:53:38 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-5b59fe42-c04b-4622-beb4-ce992c1fc198 tempest-CreateVolumesFromSourceVolumeTest-476912221 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 04:53:38 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-5b59fe42-c04b-4622-beb4-ce992c1fc198 tempest-CreateVolumesFromSourceVolumeTest-476912221 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 04:53:38 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-5b59fe42-c04b-4622-beb4-ce992c1fc198 tempest-CreateVolumesFromSourceVolumeTest-476912221 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922': None} {{(pid=87444) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 04:53:38 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-5b59fe42-c04b-4622-beb4-ce992c1fc198 tempest-CreateVolumesFromSourceVolumeTest-476912221 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922'] {{(pid=87444) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 04:53:38 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-5b59fe42-c04b-4622-beb4-ce992c1fc198 tempest-CreateVolumesFromSourceVolumeTest-476912221 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 04:53:38 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-5b59fe42-c04b-4622-beb4-ce992c1fc198 tempest-CreateVolumesFromSourceVolumeTest-476912221 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:53:38 devstack sudo[105335]: pam_unix(sudo:session): session closed for user root Jul 10 04:53:38 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-ac98f247-4e3c-4203-8ee3-04ce1dd8af7a tempest-CreateVolumesFromSnapshotTest-1643372015 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-75d4cfca-8f6e-4d14-a79a-af38fad63479" returned: 0 in 0.749s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:53:38 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-ac98f247-4e3c-4203-8ee3-04ce1dd8af7a tempest-CreateVolumesFromSnapshotTest-1643372015 None] <== create_volume: return (1778ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922'} {{(pid=87444) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 04:53:38 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-ac98f247-4e3c-4203-8ee3-04ce1dd8af7a tempest-CreateVolumesFromSnapshotTest-1643372015 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.782s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 04:53:38 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-617ecbc6-2a3f-44f4-9aa5-74e650f98737 tempest-CreateVolumesFromSnapshotTest-1643372015 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.111s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 04:53:38 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-617ecbc6-2a3f-44f4-9aa5-74e650f98737 tempest-CreateVolumesFromSnapshotTest-1643372015 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T02:53:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-208828683',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a32e71b3-683f-4214-b096-f0fb0d9842fe,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='eb19c0257a1a4527ad12a8fcf0b7404d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T02:53:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T02:53:36Z,use_quota=True,user_id='b3d05e57fb514af1a7774fbaec83fdec',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(317e369e-1e06-434d-ae95-a335f0e6c903),volume_type_id=317e369e-1e06-434d-ae95-a335f0e6c903)}" {{(pid=87444) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 04:53:38 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.remotefs [None req-617ecbc6-2a3f-44f4-9aa5-74e650f98737 tempest-CreateVolumesFromSnapshotTest-1643372015 None] Creating volume a32e71b3-683f-4214-b096-f0fb0d9842fe {{(pid=87444) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 04:53:38 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-617ecbc6-2a3f-44f4-9aa5-74e650f98737 tempest-CreateVolumesFromSnapshotTest-1643372015 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 04:53:38 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-617ecbc6-2a3f-44f4-9aa5-74e650f98737 tempest-CreateVolumesFromSnapshotTest-1643372015 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 04:53:38 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-617ecbc6-2a3f-44f4-9aa5-74e650f98737 tempest-CreateVolumesFromSnapshotTest-1643372015 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922': None} {{(pid=87444) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 04:53:38 devstack sudo[105342]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097 Jul 10 04:53:38 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-617ecbc6-2a3f-44f4-9aa5-74e650f98737 tempest-CreateVolumesFromSnapshotTest-1643372015 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922'] {{(pid=87444) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 04:53:38 devstack sudo[105342]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:53:38 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-617ecbc6-2a3f-44f4-9aa5-74e650f98737 tempest-CreateVolumesFromSnapshotTest-1643372015 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 04:53:38 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-617ecbc6-2a3f-44f4-9aa5-74e650f98737 tempest-CreateVolumesFromSnapshotTest-1643372015 None] Selected osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922 as target Quobyte volume. {{(pid=87444) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 04:53:38 devstack cinder-volume[87444]: INFO cinder.volume.drivers.remotefs [None req-617ecbc6-2a3f-44f4-9aa5-74e650f98737 tempest-CreateVolumesFromSnapshotTest-1643372015 None] casted to osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922 Jul 10 04:53:38 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-617ecbc6-2a3f-44f4-9aa5-74e650f98737 tempest-CreateVolumesFromSnapshotTest-1643372015 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-a32e71b3-683f-4214-b096-f0fb0d9842fe 1073741824 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:53:38 devstack sudo[105341]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-e1e118ed-29ec-4a87-b93f-4ce4aabe0c96 Jul 10 04:53:38 devstack sudo[105341]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:53:38 devstack sudo[105344]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-a32e71b3-683f-4214-b096-f0fb0d9842fe 1073741824 Jul 10 04:53:38 devstack sudo[105344]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:53:39 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-ac98f247-4e3c-4203-8ee3-04ce1dd8af7a tempest-CreateVolumesFromSnapshotTest-1643372015 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (13148fb4-7ab3-4e8e-8939-63d2412cfbe2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-75d4cfca-8f6e-4d14-a79a-af38fad63479', 'volume_size': 1}' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:53:39 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-ac98f247-4e3c-4203-8ee3-04ce1dd8af7a tempest-CreateVolumesFromSnapshotTest-1643372015 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (82a80d1b-0970-4475-a2a6-d64cb0e9a6a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:53:39 devstack cinder-volume[87444]: INFO cinder.volume.flows.manager.create_volume [None req-ac98f247-4e3c-4203-8ee3-04ce1dd8af7a tempest-CreateVolumesFromSnapshotTest-1643372015 None] Volume volume-75d4cfca-8f6e-4d14-a79a-af38fad63479 (75d4cfca-8f6e-4d14-a79a-af38fad63479): created successfully Jul 10 04:53:39 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-ac98f247-4e3c-4203-8ee3-04ce1dd8af7a tempest-CreateVolumesFromSnapshotTest-1643372015 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (82a80d1b-0970-4475-a2a6-d64cb0e9a6a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:53:39 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-ac98f247-4e3c-4203-8ee3-04ce1dd8af7a tempest-CreateVolumesFromSnapshotTest-1643372015 None] Flow 'volume_create_manager' (69f4a793-1a5d-4bbd-b1f7-0ca21d8b27df) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87444) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 04:53:39 devstack cinder-volume[87444]: INFO cinder.volume.manager [None req-ac98f247-4e3c-4203-8ee3-04ce1dd8af7a tempest-CreateVolumesFromSnapshotTest-1643372015 None] Created volume successfully. Jul 10 04:53:39 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-f409c4af-a94d-448d-82f1-5ea90a919811 tempest-CreateVolumesFromSourceVolumeTest-476912221 None] Acquiring lock "cinder-4d92adfc-13a4-4a30-bc36-33ea181065b8-delete_volume" by "delete_volume" {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 04:53:39 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-f409c4af-a94d-448d-82f1-5ea90a919811 tempest-CreateVolumesFromSourceVolumeTest-476912221 None] Lock "cinder-4d92adfc-13a4-4a30-bc36-33ea181065b8-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 04:53:39 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-f409c4af-a94d-448d-82f1-5ea90a919811 tempest-CreateVolumesFromSourceVolumeTest-476912221 None] Acquiring lock "cinder-quobyte-4d92adfc-13a4-4a30-bc36-33ea181065b8" by "delete_volume" {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 04:53:39 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-f409c4af-a94d-448d-82f1-5ea90a919811 tempest-CreateVolumesFromSourceVolumeTest-476912221 None] Lock "cinder-quobyte-4d92adfc-13a4-4a30-bc36-33ea181065b8" acquired by "delete_volume" :: waited 0.032s {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 04:53:39 devstack cinder-volume[87444]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2ba273f-2013-4c5f-bd0a-ff0f68cfcc8e]: (4, 'qcow2') {{(pid=88499) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 04:53:39 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-f409c4af-a94d-448d-82f1-5ea90a919811 tempest-CreateVolumesFromSourceVolumeTest-476912221 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-4d92adfc-13a4-4a30-bc36-33ea181065b8 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:53:39 devstack sudo[105347]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-4d92adfc-13a4-4a30-bc36-33ea181065b8 Jul 10 04:53:39 devstack sudo[105347]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:53:39 devstack sudo[105342]: pam_unix(sudo:session): session closed for user root Jul 10 04:53:39 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-5b59fe42-c04b-4622-beb4-ce992c1fc198 tempest-CreateVolumesFromSourceVolumeTest-476912221 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097" returned: 0 in 0.774s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:53:39 devstack cinder-volume[87444]: DEBUG cinder.manager [None req-5b59fe42-c04b-4622-beb4-ce992c1fc198 tempest-CreateVolumesFromSourceVolumeTest-476912221 None] Notifying Schedulers of capabilities ... {{(pid=87444) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 04:53:39 devstack cinder-volume[87444]: INFO cinder.volume.manager [None req-5b59fe42-c04b-4622-beb4-ce992c1fc198 tempest-CreateVolumesFromSourceVolumeTest-476912221 None] Deleted volume successfully. Jul 10 04:53:39 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-5b59fe42-c04b-4622-beb4-ce992c1fc198 tempest-CreateVolumesFromSourceVolumeTest-476912221 None] Lock "cinder-81d1981f-6a8f-4f71-b189-63c66f977047-delete_volume" released by "delete_volume" :: held 2.744s {{(pid=87444) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 04:53:39 devstack sudo[105341]: pam_unix(sudo:session): session closed for user root Jul 10 04:53:39 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-32cab35d-3fb1-47f7-8500-12b2c21a1d3e tempest-VolumeAndVolumeTypeFromImageTest-667796659 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-e1e118ed-29ec-4a87-b93f-4ce4aabe0c96" returned: 1 in 0.913s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:53:39 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-32cab35d-3fb1-47f7-8500-12b2c21a1d3e tempest-VolumeAndVolumeTypeFromImageTest-667796659 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-e1e118ed-29ec-4a87-b93f-4ce4aabe0c96' failed. Not Retrying. {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 10 04:53:39 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-32cab35d-3fb1-47f7-8500-12b2c21a1d3e tempest-VolumeAndVolumeTypeFromImageTest-667796659 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-e1e118ed-29ec-4a87-b93f-4ce4aabe0c96 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:53:39 devstack sudo[105356]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-e1e118ed-29ec-4a87-b93f-4ce4aabe0c96 Jul 10 04:53:39 devstack sudo[105356]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:53:39 devstack sudo[105344]: pam_unix(sudo:session): session closed for user root Jul 10 04:53:39 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-617ecbc6-2a3f-44f4-9aa5-74e650f98737 tempest-CreateVolumesFromSnapshotTest-1643372015 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-a32e71b3-683f-4214-b096-f0fb0d9842fe 1073741824" returned: 0 in 1.003s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:53:40 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-617ecbc6-2a3f-44f4-9aa5-74e650f98737 tempest-CreateVolumesFromSnapshotTest-1643372015 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-a32e71b3-683f-4214-b096-f0fb0d9842fe {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:53:40 devstack sudo[105393]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-a32e71b3-683f-4214-b096-f0fb0d9842fe Jul 10 04:53:40 devstack sudo[105393]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:53:40 devstack sudo[105347]: pam_unix(sudo:session): session closed for user root Jul 10 04:53:40 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-f409c4af-a94d-448d-82f1-5ea90a919811 tempest-CreateVolumesFromSourceVolumeTest-476912221 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-4d92adfc-13a4-4a30-bc36-33ea181065b8" returned: 0 in 0.872s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:53:40 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-f409c4af-a94d-448d-82f1-5ea90a919811 tempest-CreateVolumesFromSourceVolumeTest-476912221 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-4d92adfc-13a4-4a30-bc36-33ea181065b8 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:53:40 devstack sudo[105401]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-4d92adfc-13a4-4a30-bc36-33ea181065b8 Jul 10 04:53:40 devstack sudo[105401]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:53:40 devstack sudo[105356]: pam_unix(sudo:session): session closed for user root Jul 10 04:53:40 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-32cab35d-3fb1-47f7-8500-12b2c21a1d3e tempest-VolumeAndVolumeTypeFromImageTest-667796659 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-e1e118ed-29ec-4a87-b93f-4ce4aabe0c96" returned: 0 in 0.808s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:53:40 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-32cab35d-3fb1-47f7-8500-12b2c21a1d3e tempest-VolumeAndVolumeTypeFromImageTest-667796659 None] Lock "cinder-quobyte-e1e118ed-29ec-4a87-b93f-4ce4aabe0c96" released by "delete_volume" :: held 2.744s {{(pid=87444) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 04:53:40 devstack cinder-volume[87444]: DEBUG cinder.quota [None req-32cab35d-3fb1-47f7-8500-12b2c21a1d3e tempest-VolumeAndVolumeTypeFromImageTest-667796659 None] Created reservations ['f7a0b7d5-0d38-459b-945d-ca998bbe5128', 'cb9f621c-455a-43f5-86e9-152e4eceebca', 'c62bdcd9-5559-403a-ad63-d09527e22cfd', '373ff753-4cea-4928-8ac0-da0be75e0bfd'] {{(pid=87444) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 04:53:40 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-32cab35d-3fb1-47f7-8500-12b2c21a1d3e tempest-VolumeAndVolumeTypeFromImageTest-667796659 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 04:53:40 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-32cab35d-3fb1-47f7-8500-12b2c21a1d3e tempest-VolumeAndVolumeTypeFromImageTest-667796659 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 04:53:40 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-32cab35d-3fb1-47f7-8500-12b2c21a1d3e tempest-VolumeAndVolumeTypeFromImageTest-667796659 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922': None} {{(pid=87444) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 04:53:40 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-32cab35d-3fb1-47f7-8500-12b2c21a1d3e tempest-VolumeAndVolumeTypeFromImageTest-667796659 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922'] {{(pid=87444) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 04:53:40 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-32cab35d-3fb1-47f7-8500-12b2c21a1d3e tempest-VolumeAndVolumeTypeFromImageTest-667796659 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 04:53:40 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-32cab35d-3fb1-47f7-8500-12b2c21a1d3e tempest-VolumeAndVolumeTypeFromImageTest-667796659 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:53:40 devstack sudo[105393]: pam_unix(sudo:session): session closed for user root Jul 10 04:53:40 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-617ecbc6-2a3f-44f4-9aa5-74e650f98737 tempest-CreateVolumesFromSnapshotTest-1643372015 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-a32e71b3-683f-4214-b096-f0fb0d9842fe" returned: 0 in 0.729s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:53:40 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-617ecbc6-2a3f-44f4-9aa5-74e650f98737 tempest-CreateVolumesFromSnapshotTest-1643372015 None] <== create_volume: return (1810ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922'} {{(pid=87444) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 04:53:40 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-617ecbc6-2a3f-44f4-9aa5-74e650f98737 tempest-CreateVolumesFromSnapshotTest-1643372015 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.815s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 04:53:40 devstack sudo[105405]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097 Jul 10 04:53:40 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-d1a6f72d-a929-4057-bd56-792f6b03f442 tempest-CreateVolumesFromSnapshotTest-1643372015 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.530s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 04:53:40 devstack sudo[105405]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:53:40 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-d1a6f72d-a929-4057-bd56-792f6b03f442 tempest-CreateVolumesFromSnapshotTest-1643372015 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T02:53:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1602278588',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ef0a6ca2-a409-4a17-98fc-e039fa3405a4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='eb19c0257a1a4527ad12a8fcf0b7404d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T02:53:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T02:53:36Z,use_quota=True,user_id='b3d05e57fb514af1a7774fbaec83fdec',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(317e369e-1e06-434d-ae95-a335f0e6c903),volume_type_id=317e369e-1e06-434d-ae95-a335f0e6c903)}" {{(pid=87444) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 04:53:40 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.remotefs [None req-d1a6f72d-a929-4057-bd56-792f6b03f442 tempest-CreateVolumesFromSnapshotTest-1643372015 None] Creating volume ef0a6ca2-a409-4a17-98fc-e039fa3405a4 {{(pid=87444) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 04:53:40 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-d1a6f72d-a929-4057-bd56-792f6b03f442 tempest-CreateVolumesFromSnapshotTest-1643372015 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 04:53:40 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-d1a6f72d-a929-4057-bd56-792f6b03f442 tempest-CreateVolumesFromSnapshotTest-1643372015 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 04:53:40 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-d1a6f72d-a929-4057-bd56-792f6b03f442 tempest-CreateVolumesFromSnapshotTest-1643372015 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922': None} {{(pid=87444) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 04:53:40 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-d1a6f72d-a929-4057-bd56-792f6b03f442 tempest-CreateVolumesFromSnapshotTest-1643372015 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922'] {{(pid=87444) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 04:53:40 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-d1a6f72d-a929-4057-bd56-792f6b03f442 tempest-CreateVolumesFromSnapshotTest-1643372015 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 04:53:40 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-d1a6f72d-a929-4057-bd56-792f6b03f442 tempest-CreateVolumesFromSnapshotTest-1643372015 None] Selected osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922 as target Quobyte volume. {{(pid=87444) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 04:53:40 devstack cinder-volume[87444]: INFO cinder.volume.drivers.remotefs [None req-d1a6f72d-a929-4057-bd56-792f6b03f442 tempest-CreateVolumesFromSnapshotTest-1643372015 None] casted to osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922 Jul 10 04:53:40 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-d1a6f72d-a929-4057-bd56-792f6b03f442 tempest-CreateVolumesFromSnapshotTest-1643372015 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-ef0a6ca2-a409-4a17-98fc-e039fa3405a4 1073741824 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:53:40 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-617ecbc6-2a3f-44f4-9aa5-74e650f98737 tempest-CreateVolumesFromSnapshotTest-1643372015 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (11e1b4df-a4f7-449a-94a2-45a2a92d6e1d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a32e71b3-683f-4214-b096-f0fb0d9842fe', 'volume_size': 1}' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:53:40 devstack sudo[105407]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-ef0a6ca2-a409-4a17-98fc-e039fa3405a4 1073741824 Jul 10 04:53:40 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-617ecbc6-2a3f-44f4-9aa5-74e650f98737 tempest-CreateVolumesFromSnapshotTest-1643372015 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a1895d35-29de-4c0d-aba2-454533a99383) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:53:40 devstack sudo[105407]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:53:40 devstack cinder-volume[87444]: INFO cinder.volume.flows.manager.create_volume [None req-617ecbc6-2a3f-44f4-9aa5-74e650f98737 tempest-CreateVolumesFromSnapshotTest-1643372015 None] Volume volume-a32e71b3-683f-4214-b096-f0fb0d9842fe (a32e71b3-683f-4214-b096-f0fb0d9842fe): created successfully Jul 10 04:53:40 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-617ecbc6-2a3f-44f4-9aa5-74e650f98737 tempest-CreateVolumesFromSnapshotTest-1643372015 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a1895d35-29de-4c0d-aba2-454533a99383) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:53:40 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-617ecbc6-2a3f-44f4-9aa5-74e650f98737 tempest-CreateVolumesFromSnapshotTest-1643372015 None] Flow 'volume_create_manager' (f4a1eed0-19c7-43c5-a455-f5e1990deeac) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87444) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 04:53:40 devstack cinder-volume[87444]: INFO cinder.volume.manager [None req-617ecbc6-2a3f-44f4-9aa5-74e650f98737 tempest-CreateVolumesFromSnapshotTest-1643372015 None] Created volume successfully. Jul 10 04:53:41 devstack sudo[105401]: pam_unix(sudo:session): session closed for user root Jul 10 04:53:41 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-f409c4af-a94d-448d-82f1-5ea90a919811 tempest-CreateVolumesFromSourceVolumeTest-476912221 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-4d92adfc-13a4-4a30-bc36-33ea181065b8" returned: 0 in 0.732s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:53:41 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-f409c4af-a94d-448d-82f1-5ea90a919811 tempest-CreateVolumesFromSourceVolumeTest-476912221 None] Lock "cinder-quobyte-4d92adfc-13a4-4a30-bc36-33ea181065b8" released by "delete_volume" :: held 1.660s {{(pid=87444) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 04:53:41 devstack cinder-volume[87444]: DEBUG cinder.quota [None req-f409c4af-a94d-448d-82f1-5ea90a919811 tempest-CreateVolumesFromSourceVolumeTest-476912221 None] Created reservations ['4982b3ee-6333-43bb-819b-6fb7df49bfac', '6bf665bb-007d-4acd-95ba-458efc6113d7', '7e4a9a42-e748-4399-8b19-e26924d44203', '7d1dde16-85d5-424c-a418-062fc096e048'] {{(pid=87444) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 04:53:41 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-f409c4af-a94d-448d-82f1-5ea90a919811 tempest-CreateVolumesFromSourceVolumeTest-476912221 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 04:53:41 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-f409c4af-a94d-448d-82f1-5ea90a919811 tempest-CreateVolumesFromSourceVolumeTest-476912221 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 04:53:41 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-f409c4af-a94d-448d-82f1-5ea90a919811 tempest-CreateVolumesFromSourceVolumeTest-476912221 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922': None} {{(pid=87444) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 04:53:41 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-f409c4af-a94d-448d-82f1-5ea90a919811 tempest-CreateVolumesFromSourceVolumeTest-476912221 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922'] {{(pid=87444) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 04:53:41 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-f409c4af-a94d-448d-82f1-5ea90a919811 tempest-CreateVolumesFromSourceVolumeTest-476912221 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 04:53:41 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-f409c4af-a94d-448d-82f1-5ea90a919811 tempest-CreateVolumesFromSourceVolumeTest-476912221 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:53:41 devstack sudo[105410]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097 Jul 10 04:53:41 devstack sudo[105410]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:53:41 devstack sudo[105405]: pam_unix(sudo:session): session closed for user root Jul 10 04:53:41 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-32cab35d-3fb1-47f7-8500-12b2c21a1d3e tempest-VolumeAndVolumeTypeFromImageTest-667796659 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097" returned: 0 in 0.736s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:53:41 devstack cinder-volume[87444]: DEBUG cinder.manager [None req-32cab35d-3fb1-47f7-8500-12b2c21a1d3e tempest-VolumeAndVolumeTypeFromImageTest-667796659 None] Notifying Schedulers of capabilities ... {{(pid=87444) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 04:53:41 devstack cinder-volume[87444]: INFO cinder.volume.manager [None req-32cab35d-3fb1-47f7-8500-12b2c21a1d3e tempest-VolumeAndVolumeTypeFromImageTest-667796659 None] Deleted volume successfully. Jul 10 04:53:41 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-32cab35d-3fb1-47f7-8500-12b2c21a1d3e tempest-VolumeAndVolumeTypeFromImageTest-667796659 None] Lock "cinder-e1e118ed-29ec-4a87-b93f-4ce4aabe0c96-delete_volume" released by "delete_volume" :: held 3.709s {{(pid=87444) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 04:53:41 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-1eedc733-2241-4a94-a76d-f2caeff18a61 tempest-CreateVolumesFromSourceVolumeTest-476912221 None] Acquiring lock "cinder-7ab773a3-2f42-432c-9479-fce0440f9c92-delete_volume" by "delete_volume" {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 04:53:41 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-1eedc733-2241-4a94-a76d-f2caeff18a61 tempest-CreateVolumesFromSourceVolumeTest-476912221 None] Lock "cinder-7ab773a3-2f42-432c-9479-fce0440f9c92-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 04:53:41 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-1eedc733-2241-4a94-a76d-f2caeff18a61 tempest-CreateVolumesFromSourceVolumeTest-476912221 None] Acquiring lock "cinder-quobyte-7ab773a3-2f42-432c-9479-fce0440f9c92" by "delete_volume" {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 04:53:41 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-1eedc733-2241-4a94-a76d-f2caeff18a61 tempest-CreateVolumesFromSourceVolumeTest-476912221 None] Lock "cinder-quobyte-7ab773a3-2f42-432c-9479-fce0440f9c92" acquired by "delete_volume" :: waited 0.026s {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 04:53:41 devstack cinder-volume[87444]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f29fbb4-3650-4230-b8be-8ea5a1bf8880]: (4, 'qcow2') {{(pid=88499) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 04:53:41 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-1eedc733-2241-4a94-a76d-f2caeff18a61 tempest-CreateVolumesFromSourceVolumeTest-476912221 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-7ab773a3-2f42-432c-9479-fce0440f9c92 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:53:41 devstack sudo[105407]: pam_unix(sudo:session): session closed for user root Jul 10 04:53:41 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-d1a6f72d-a929-4057-bd56-792f6b03f442 tempest-CreateVolumesFromSnapshotTest-1643372015 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-ef0a6ca2-a409-4a17-98fc-e039fa3405a4 1073741824" returned: 0 in 1.071s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:53:41 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-d1a6f72d-a929-4057-bd56-792f6b03f442 tempest-CreateVolumesFromSnapshotTest-1643372015 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-ef0a6ca2-a409-4a17-98fc-e039fa3405a4 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:53:41 devstack sudo[105417]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-ef0a6ca2-a409-4a17-98fc-e039fa3405a4 Jul 10 04:53:41 devstack sudo[105417]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:53:41 devstack sudo[105416]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-7ab773a3-2f42-432c-9479-fce0440f9c92 Jul 10 04:53:41 devstack sudo[105416]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:53:42 devstack sudo[105410]: pam_unix(sudo:session): session closed for user root Jul 10 04:53:42 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-f409c4af-a94d-448d-82f1-5ea90a919811 tempest-CreateVolumesFromSourceVolumeTest-476912221 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097" returned: 0 in 0.879s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:53:42 devstack cinder-volume[87444]: DEBUG cinder.manager [None req-f409c4af-a94d-448d-82f1-5ea90a919811 tempest-CreateVolumesFromSourceVolumeTest-476912221 None] Notifying Schedulers of capabilities ... {{(pid=87444) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 04:53:42 devstack cinder-volume[87444]: INFO cinder.volume.manager [None req-f409c4af-a94d-448d-82f1-5ea90a919811 tempest-CreateVolumesFromSourceVolumeTest-476912221 None] Deleted volume successfully. Jul 10 04:53:42 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-f409c4af-a94d-448d-82f1-5ea90a919811 tempest-CreateVolumesFromSourceVolumeTest-476912221 None] Lock "cinder-4d92adfc-13a4-4a30-bc36-33ea181065b8-delete_volume" released by "delete_volume" :: held 2.836s {{(pid=87444) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 04:53:42 devstack sudo[105417]: pam_unix(sudo:session): session closed for user root Jul 10 04:53:42 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-d1a6f72d-a929-4057-bd56-792f6b03f442 tempest-CreateVolumesFromSnapshotTest-1643372015 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-ef0a6ca2-a409-4a17-98fc-e039fa3405a4" returned: 0 in 0.701s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:53:42 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-d1a6f72d-a929-4057-bd56-792f6b03f442 tempest-CreateVolumesFromSnapshotTest-1643372015 None] <== create_volume: return (1827ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922'} {{(pid=87444) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 04:53:42 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-d1a6f72d-a929-4057-bd56-792f6b03f442 tempest-CreateVolumesFromSnapshotTest-1643372015 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.833s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 04:53:42 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-6abd7297-27dc-43a2-8777-8fc07a465497 tempest-CreateVolumesFromSnapshotTest-1643372015 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.742s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 04:53:42 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-6abd7297-27dc-43a2-8777-8fc07a465497 tempest-CreateVolumesFromSnapshotTest-1643372015 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T02:53:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1228211681',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=82a9daa1-5862-4cac-adb8-c294dce35034,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='eb19c0257a1a4527ad12a8fcf0b7404d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T02:53:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T02:53:37Z,use_quota=True,user_id='b3d05e57fb514af1a7774fbaec83fdec',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(317e369e-1e06-434d-ae95-a335f0e6c903),volume_type_id=317e369e-1e06-434d-ae95-a335f0e6c903)}" {{(pid=87444) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 04:53:42 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.remotefs [None req-6abd7297-27dc-43a2-8777-8fc07a465497 tempest-CreateVolumesFromSnapshotTest-1643372015 None] Creating volume 82a9daa1-5862-4cac-adb8-c294dce35034 {{(pid=87444) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 04:53:42 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-6abd7297-27dc-43a2-8777-8fc07a465497 tempest-CreateVolumesFromSnapshotTest-1643372015 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 04:53:42 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-6abd7297-27dc-43a2-8777-8fc07a465497 tempest-CreateVolumesFromSnapshotTest-1643372015 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 04:53:42 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-6abd7297-27dc-43a2-8777-8fc07a465497 tempest-CreateVolumesFromSnapshotTest-1643372015 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922': None} {{(pid=87444) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 04:53:42 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-6abd7297-27dc-43a2-8777-8fc07a465497 tempest-CreateVolumesFromSnapshotTest-1643372015 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922'] {{(pid=87444) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 04:53:42 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-6abd7297-27dc-43a2-8777-8fc07a465497 tempest-CreateVolumesFromSnapshotTest-1643372015 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 04:53:42 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-6abd7297-27dc-43a2-8777-8fc07a465497 tempest-CreateVolumesFromSnapshotTest-1643372015 None] Selected osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922 as target Quobyte volume. {{(pid=87444) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 04:53:42 devstack cinder-volume[87444]: INFO cinder.volume.drivers.remotefs [None req-6abd7297-27dc-43a2-8777-8fc07a465497 tempest-CreateVolumesFromSnapshotTest-1643372015 None] casted to osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922 Jul 10 04:53:42 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-6abd7297-27dc-43a2-8777-8fc07a465497 tempest-CreateVolumesFromSnapshotTest-1643372015 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-82a9daa1-5862-4cac-adb8-c294dce35034 1073741824 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:53:42 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-d1a6f72d-a929-4057-bd56-792f6b03f442 tempest-CreateVolumesFromSnapshotTest-1643372015 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (470e6bf2-6934-42a9-801a-30d1127d4bbd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ef0a6ca2-a409-4a17-98fc-e039fa3405a4', 'volume_size': 1}' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:53:42 devstack sudo[105425]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-82a9daa1-5862-4cac-adb8-c294dce35034 1073741824 Jul 10 04:53:42 devstack sudo[105425]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:53:42 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-d1a6f72d-a929-4057-bd56-792f6b03f442 tempest-CreateVolumesFromSnapshotTest-1643372015 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (174af770-e83a-45dd-8e80-94614af407a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:53:42 devstack cinder-volume[87444]: INFO cinder.volume.flows.manager.create_volume [None req-d1a6f72d-a929-4057-bd56-792f6b03f442 tempest-CreateVolumesFromSnapshotTest-1643372015 None] Volume volume-ef0a6ca2-a409-4a17-98fc-e039fa3405a4 (ef0a6ca2-a409-4a17-98fc-e039fa3405a4): created successfully Jul 10 04:53:42 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-d1a6f72d-a929-4057-bd56-792f6b03f442 tempest-CreateVolumesFromSnapshotTest-1643372015 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (174af770-e83a-45dd-8e80-94614af407a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:53:42 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-d1a6f72d-a929-4057-bd56-792f6b03f442 tempest-CreateVolumesFromSnapshotTest-1643372015 None] Flow 'volume_create_manager' (9c4e46ff-6402-42ad-85d5-91bf956c3232) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87444) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 04:53:42 devstack cinder-volume[87444]: INFO cinder.volume.manager [None req-d1a6f72d-a929-4057-bd56-792f6b03f442 tempest-CreateVolumesFromSnapshotTest-1643372015 None] Created volume successfully. Jul 10 04:53:42 devstack sudo[105416]: pam_unix(sudo:session): session closed for user root Jul 10 04:53:42 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-1eedc733-2241-4a94-a76d-f2caeff18a61 tempest-CreateVolumesFromSourceVolumeTest-476912221 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-7ab773a3-2f42-432c-9479-fce0440f9c92" returned: 0 in 0.928s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:53:42 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-1eedc733-2241-4a94-a76d-f2caeff18a61 tempest-CreateVolumesFromSourceVolumeTest-476912221 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-7ab773a3-2f42-432c-9479-fce0440f9c92 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:53:42 devstack sudo[105427]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-7ab773a3-2f42-432c-9479-fce0440f9c92 Jul 10 04:53:42 devstack sudo[105427]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:53:43 devstack sudo[105427]: pam_unix(sudo:session): session closed for user root Jul 10 04:53:43 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-1eedc733-2241-4a94-a76d-f2caeff18a61 tempest-CreateVolumesFromSourceVolumeTest-476912221 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-7ab773a3-2f42-432c-9479-fce0440f9c92" returned: 0 in 0.790s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:53:43 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-1eedc733-2241-4a94-a76d-f2caeff18a61 tempest-CreateVolumesFromSourceVolumeTest-476912221 None] Lock "cinder-quobyte-7ab773a3-2f42-432c-9479-fce0440f9c92" released by "delete_volume" :: held 1.791s {{(pid=87444) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 04:53:43 devstack cinder-volume[87444]: DEBUG cinder.quota [None req-1eedc733-2241-4a94-a76d-f2caeff18a61 tempest-CreateVolumesFromSourceVolumeTest-476912221 None] Created reservations ['5b1329d5-d19e-4eb3-a639-ae593228e7ad', '1d8fb6ca-1ddf-4da0-8146-1055f50d21f8', '37d2ad9c-e481-4253-be4a-c3ffb3b14346', '6a884559-a321-46a5-853d-e9ff91c18cdf'] {{(pid=87444) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 04:53:43 devstack sudo[105425]: pam_unix(sudo:session): session closed for user root Jul 10 04:53:43 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-6abd7297-27dc-43a2-8777-8fc07a465497 tempest-CreateVolumesFromSnapshotTest-1643372015 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-82a9daa1-5862-4cac-adb8-c294dce35034 1073741824" returned: 0 in 1.035s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:53:43 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-6abd7297-27dc-43a2-8777-8fc07a465497 tempest-CreateVolumesFromSnapshotTest-1643372015 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-82a9daa1-5862-4cac-adb8-c294dce35034 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:53:43 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-1eedc733-2241-4a94-a76d-f2caeff18a61 tempest-CreateVolumesFromSourceVolumeTest-476912221 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 04:53:43 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-1eedc733-2241-4a94-a76d-f2caeff18a61 tempest-CreateVolumesFromSourceVolumeTest-476912221 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 04:53:43 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-1eedc733-2241-4a94-a76d-f2caeff18a61 tempest-CreateVolumesFromSourceVolumeTest-476912221 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922': None} {{(pid=87444) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 04:53:43 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-1eedc733-2241-4a94-a76d-f2caeff18a61 tempest-CreateVolumesFromSourceVolumeTest-476912221 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922'] {{(pid=87444) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 04:53:43 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-1eedc733-2241-4a94-a76d-f2caeff18a61 tempest-CreateVolumesFromSourceVolumeTest-476912221 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 04:53:43 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-1eedc733-2241-4a94-a76d-f2caeff18a61 tempest-CreateVolumesFromSourceVolumeTest-476912221 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:53:43 devstack sudo[105435]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-82a9daa1-5862-4cac-adb8-c294dce35034 Jul 10 04:53:43 devstack sudo[105435]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:53:43 devstack sudo[105437]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097 Jul 10 04:53:43 devstack sudo[105437]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:53:44 devstack sudo[105435]: pam_unix(sudo:session): session closed for user root Jul 10 04:53:44 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-6abd7297-27dc-43a2-8777-8fc07a465497 tempest-CreateVolumesFromSnapshotTest-1643372015 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-82a9daa1-5862-4cac-adb8-c294dce35034" returned: 0 in 0.866s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:53:44 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-6abd7297-27dc-43a2-8777-8fc07a465497 tempest-CreateVolumesFromSnapshotTest-1643372015 None] <== create_volume: return (1966ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922'} {{(pid=87444) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 04:53:44 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-6abd7297-27dc-43a2-8777-8fc07a465497 tempest-CreateVolumesFromSnapshotTest-1643372015 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.972s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 04:53:44 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-d3fca98b-04b6-490d-a359-75369701d710 tempest-CreateVolumesFromSnapshotTest-1643372015 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.217s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 04:53:44 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-d3fca98b-04b6-490d-a359-75369701d710 tempest-CreateVolumesFromSnapshotTest-1643372015 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T02:53:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1261166354',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=41cad359-1a56-47e1-b0a2-78a7d1254b41,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='eb19c0257a1a4527ad12a8fcf0b7404d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T02:53:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T02:53:37Z,use_quota=True,user_id='b3d05e57fb514af1a7774fbaec83fdec',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(317e369e-1e06-434d-ae95-a335f0e6c903),volume_type_id=317e369e-1e06-434d-ae95-a335f0e6c903)}" {{(pid=87444) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 04:53:44 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.remotefs [None req-d3fca98b-04b6-490d-a359-75369701d710 tempest-CreateVolumesFromSnapshotTest-1643372015 None] Creating volume 41cad359-1a56-47e1-b0a2-78a7d1254b41 {{(pid=87444) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 04:53:44 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-d3fca98b-04b6-490d-a359-75369701d710 tempest-CreateVolumesFromSnapshotTest-1643372015 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 04:53:44 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-d3fca98b-04b6-490d-a359-75369701d710 tempest-CreateVolumesFromSnapshotTest-1643372015 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 04:53:44 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-d3fca98b-04b6-490d-a359-75369701d710 tempest-CreateVolumesFromSnapshotTest-1643372015 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922': None} {{(pid=87444) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 04:53:44 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-d3fca98b-04b6-490d-a359-75369701d710 tempest-CreateVolumesFromSnapshotTest-1643372015 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922'] {{(pid=87444) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 04:53:44 devstack sudo[105437]: pam_unix(sudo:session): session closed for user root Jul 10 04:53:44 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-d3fca98b-04b6-490d-a359-75369701d710 tempest-CreateVolumesFromSnapshotTest-1643372015 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 04:53:44 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-d3fca98b-04b6-490d-a359-75369701d710 tempest-CreateVolumesFromSnapshotTest-1643372015 None] Selected osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922 as target Quobyte volume. {{(pid=87444) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 04:53:44 devstack cinder-volume[87444]: INFO cinder.volume.drivers.remotefs [None req-d3fca98b-04b6-490d-a359-75369701d710 tempest-CreateVolumesFromSnapshotTest-1643372015 None] casted to osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922 Jul 10 04:53:44 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-d3fca98b-04b6-490d-a359-75369701d710 tempest-CreateVolumesFromSnapshotTest-1643372015 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-41cad359-1a56-47e1-b0a2-78a7d1254b41 1073741824 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:53:44 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-1eedc733-2241-4a94-a76d-f2caeff18a61 tempest-CreateVolumesFromSourceVolumeTest-476912221 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097" returned: 0 in 0.891s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:53:44 devstack cinder-volume[87444]: DEBUG cinder.manager [None req-1eedc733-2241-4a94-a76d-f2caeff18a61 tempest-CreateVolumesFromSourceVolumeTest-476912221 None] Notifying Schedulers of capabilities ... {{(pid=87444) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 04:53:44 devstack cinder-volume[87444]: INFO cinder.volume.manager [None req-1eedc733-2241-4a94-a76d-f2caeff18a61 tempest-CreateVolumesFromSourceVolumeTest-476912221 None] Deleted volume successfully. Jul 10 04:53:44 devstack sudo[105441]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-41cad359-1a56-47e1-b0a2-78a7d1254b41 1073741824 Jul 10 04:53:44 devstack sudo[105441]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:53:44 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-6abd7297-27dc-43a2-8777-8fc07a465497 tempest-CreateVolumesFromSnapshotTest-1643372015 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ad5f58bf-3ba1-4ac8-baf8-3e9587992bbe) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-82a9daa1-5862-4cac-adb8-c294dce35034', 'volume_size': 1}' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:53:44 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-6abd7297-27dc-43a2-8777-8fc07a465497 tempest-CreateVolumesFromSnapshotTest-1643372015 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8d831c5a-8b3f-4eb9-ad40-6f23812135fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:53:44 devstack cinder-volume[87444]: INFO cinder.volume.flows.manager.create_volume [None req-6abd7297-27dc-43a2-8777-8fc07a465497 tempest-CreateVolumesFromSnapshotTest-1643372015 None] Volume volume-82a9daa1-5862-4cac-adb8-c294dce35034 (82a9daa1-5862-4cac-adb8-c294dce35034): created successfully Jul 10 04:53:44 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-6abd7297-27dc-43a2-8777-8fc07a465497 tempest-CreateVolumesFromSnapshotTest-1643372015 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8d831c5a-8b3f-4eb9-ad40-6f23812135fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:53:44 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-6abd7297-27dc-43a2-8777-8fc07a465497 tempest-CreateVolumesFromSnapshotTest-1643372015 None] Flow 'volume_create_manager' (506022ae-5d91-4ca8-8f10-9b4934c78664) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87444) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 04:53:44 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-1eedc733-2241-4a94-a76d-f2caeff18a61 tempest-CreateVolumesFromSourceVolumeTest-476912221 None] Lock "cinder-7ab773a3-2f42-432c-9479-fce0440f9c92-delete_volume" released by "delete_volume" :: held 3.049s {{(pid=87444) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 04:53:44 devstack cinder-volume[87444]: INFO cinder.volume.manager [None req-6abd7297-27dc-43a2-8777-8fc07a465497 tempest-CreateVolumesFromSnapshotTest-1643372015 None] Created volume successfully. Jul 10 04:53:45 devstack sudo[105441]: pam_unix(sudo:session): session closed for user root Jul 10 04:53:45 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-d3fca98b-04b6-490d-a359-75369701d710 tempest-CreateVolumesFromSnapshotTest-1643372015 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-41cad359-1a56-47e1-b0a2-78a7d1254b41 1073741824" returned: 0 in 0.960s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:53:45 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-d3fca98b-04b6-490d-a359-75369701d710 tempest-CreateVolumesFromSnapshotTest-1643372015 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-41cad359-1a56-47e1-b0a2-78a7d1254b41 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:53:45 devstack sudo[105447]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-41cad359-1a56-47e1-b0a2-78a7d1254b41 Jul 10 04:53:45 devstack sudo[105447]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:53:46 devstack sudo[105447]: pam_unix(sudo:session): session closed for user root Jul 10 04:53:46 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-d3fca98b-04b6-490d-a359-75369701d710 tempest-CreateVolumesFromSnapshotTest-1643372015 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-41cad359-1a56-47e1-b0a2-78a7d1254b41" returned: 0 in 0.703s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:53:46 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-d3fca98b-04b6-490d-a359-75369701d710 tempest-CreateVolumesFromSnapshotTest-1643372015 None] <== create_volume: return (1723ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922'} {{(pid=87444) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 04:53:46 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-d3fca98b-04b6-490d-a359-75369701d710 tempest-CreateVolumesFromSnapshotTest-1643372015 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.729s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 04:53:46 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-88abb252-898f-4b1d-8abe-9f0a8997311a tempest-VolumeDependencyTests-2054620824 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 8.001s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 04:53:46 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-d3fca98b-04b6-490d-a359-75369701d710 tempest-CreateVolumesFromSnapshotTest-1643372015 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (32cefc90-0a1f-4e59-9593-dea191bc3ac6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-41cad359-1a56-47e1-b0a2-78a7d1254b41', 'volume_size': 1}' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:53:46 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-d3fca98b-04b6-490d-a359-75369701d710 tempest-CreateVolumesFromSnapshotTest-1643372015 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (73a2b5d3-6946-4666-aa2e-fe19f5a33342) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:53:46 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.remotefs [None req-88abb252-898f-4b1d-8abe-9f0a8997311a tempest-VolumeDependencyTests-2054620824 None] Creating offline snapshot 92218a8a-04cf-41f9-b1ab-85508b375c69 of volume c9291bec-53ee-4b51-8bdf-8b3ea5eefacd {{(pid=87444) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 10 04:53:46 devstack cinder-volume[87444]: INFO cinder.volume.flows.manager.create_volume [None req-d3fca98b-04b6-490d-a359-75369701d710 tempest-CreateVolumesFromSnapshotTest-1643372015 None] Volume volume-41cad359-1a56-47e1-b0a2-78a7d1254b41 (41cad359-1a56-47e1-b0a2-78a7d1254b41): created successfully Jul 10 04:53:46 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-d3fca98b-04b6-490d-a359-75369701d710 tempest-CreateVolumesFromSnapshotTest-1643372015 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (73a2b5d3-6946-4666-aa2e-fe19f5a33342) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:53:46 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-d3fca98b-04b6-490d-a359-75369701d710 tempest-CreateVolumesFromSnapshotTest-1643372015 None] Flow 'volume_create_manager' (e14b69b1-50cc-4a96-a92c-952a22c5afee) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87444) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 04:53:46 devstack cinder-volume[87444]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b865241-e896-4f55-839d-d2898b0957ff]: (4, 'qcow2') {{(pid=88499) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 04:53:46 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-88abb252-898f-4b1d-8abe-9f0a8997311a tempest-VolumeDependencyTests-2054620824 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-c9291bec-53ee-4b51-8bdf-8b3ea5eefacd {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:53:46 devstack cinder-volume[87444]: INFO cinder.volume.manager [None req-d3fca98b-04b6-490d-a359-75369701d710 tempest-CreateVolumesFromSnapshotTest-1643372015 None] Created volume successfully. Jul 10 04:53:46 devstack sudo[105451]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-c9291bec-53ee-4b51-8bdf-8b3ea5eefacd Jul 10 04:53:46 devstack sudo[105451]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:53:47 devstack sudo[105451]: pam_unix(sudo:session): session closed for user root Jul 10 04:53:47 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-88abb252-898f-4b1d-8abe-9f0a8997311a tempest-VolumeDependencyTests-2054620824 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-c9291bec-53ee-4b51-8bdf-8b3ea5eefacd" returned: 0 in 0.898s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:53:47 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-88abb252-898f-4b1d-8abe-9f0a8997311a tempest-VolumeDependencyTests-2054620824 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-c9291bec-53ee-4b51-8bdf-8b3ea5eefacd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-c9291bec-53ee-4b51-8bdf-8b3ea5eefacd.92218a8a-04cf-41f9-b1ab-85508b375c69 1G {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:53:47 devstack sudo[105462]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-c9291bec-53ee-4b51-8bdf-8b3ea5eefacd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-c9291bec-53ee-4b51-8bdf-8b3ea5eefacd.92218a8a-04cf-41f9-b1ab-85508b375c69 1G Jul 10 04:53:47 devstack sudo[105462]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:53:47 devstack cinder-volume[87444]: DEBUG cinder.volume.flows.manager.create_volume [None req-086d0c57-6e27-4a82-8262-dbee90c17ea5 tempest-CinderUnicodeTest-973446373 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87444) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 04:53:47 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-086d0c57-6e27-4a82-8262-dbee90c17ea5 tempest-CinderUnicodeTest-973446373 None] Flow 'volume_create_manager' (3f67aa45-727c-4449-a109-42665266811e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 04:53:47 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-086d0c57-6e27-4a82-8262-dbee90c17ea5 tempest-CinderUnicodeTest-973446373 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (53fb9687-bc0d-4034-a69a-ab9e4e9b53ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:53:47 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-086d0c57-6e27-4a82-8262-dbee90c17ea5 tempest-CinderUnicodeTest-973446373 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (53fb9687-bc0d-4034-a69a-ab9e4e9b53ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T02:53:47Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1fc1c39b-736a-48e4-ad7d-95706dee36f8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8d7f6fd0a13d429c87a6594f91c7475d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T02:53:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T02:53:47Z,use_quota=True,user_id='9271ef5b15fa4893a4aaff48d719045d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(317e369e-1e06-434d-ae95-a335f0e6c903),volume_type_id=317e369e-1e06-434d-ae95-a335f0e6c903)' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:53:47 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-086d0c57-6e27-4a82-8262-dbee90c17ea5 tempest-CinderUnicodeTest-973446373 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6b917b26-af1b-4f3f-8566-2466b3296b17) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:53:47 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-086d0c57-6e27-4a82-8262-dbee90c17ea5 tempest-CinderUnicodeTest-973446373 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6b917b26-af1b-4f3f-8566-2466b3296b17) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:53:47 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-086d0c57-6e27-4a82-8262-dbee90c17ea5 tempest-CinderUnicodeTest-973446373 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (080af029-3842-481f-a164-d86fdc907704) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:53:47 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-086d0c57-6e27-4a82-8262-dbee90c17ea5 tempest-CinderUnicodeTest-973446373 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (080af029-3842-481f-a164-d86fdc907704) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1fc1c39b-736a-48e4-ad7d-95706dee36f8', 'volume_name': 'volume-1fc1c39b-736a-48e4-ad7d-95706dee36f8', 'volume_size': 1}' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:53:47 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-086d0c57-6e27-4a82-8262-dbee90c17ea5 tempest-CinderUnicodeTest-973446373 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (14760b4c-86db-408d-82cc-15068ffc9144) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:53:47 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-086d0c57-6e27-4a82-8262-dbee90c17ea5 tempest-CinderUnicodeTest-973446373 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (14760b4c-86db-408d-82cc-15068ffc9144) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:53:47 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-086d0c57-6e27-4a82-8262-dbee90c17ea5 tempest-CinderUnicodeTest-973446373 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3395d236-09ed-48e0-95a0-0b3fa042ccce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:53:47 devstack cinder-volume[87444]: INFO cinder.volume.flows.manager.create_volume [None req-086d0c57-6e27-4a82-8262-dbee90c17ea5 tempest-CinderUnicodeTest-973446373 None] Volume 1fc1c39b-736a-48e4-ad7d-95706dee36f8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1fc1c39b-736a-48e4-ad7d-95706dee36f8', 'volume_size': 1} Jul 10 04:53:47 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-086d0c57-6e27-4a82-8262-dbee90c17ea5 tempest-CinderUnicodeTest-973446373 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 04:53:47 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-236e077c-3fa4-4d6a-9e9a-f4477e242d8c tempest-CreateVolumesFromSnapshotTest-1643372015 None] Acquiring lock "cinder-41cad359-1a56-47e1-b0a2-78a7d1254b41-delete_volume" by "delete_volume" {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 04:53:47 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-236e077c-3fa4-4d6a-9e9a-f4477e242d8c tempest-CreateVolumesFromSnapshotTest-1643372015 None] Lock "cinder-41cad359-1a56-47e1-b0a2-78a7d1254b41-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 04:53:47 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-236e077c-3fa4-4d6a-9e9a-f4477e242d8c tempest-CreateVolumesFromSnapshotTest-1643372015 None] Acquiring lock "cinder-quobyte-41cad359-1a56-47e1-b0a2-78a7d1254b41" by "delete_volume" {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 04:53:47 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-236e077c-3fa4-4d6a-9e9a-f4477e242d8c tempest-CreateVolumesFromSnapshotTest-1643372015 None] Lock "cinder-quobyte-41cad359-1a56-47e1-b0a2-78a7d1254b41" acquired by "delete_volume" :: waited 0.023s {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 04:53:47 devstack cinder-volume[87444]: DEBUG oslo.privsep.daemon [-] privsep: reply[da5daabd-fd15-4e8b-9baa-9b3f3e1f8fe6]: (4, 'qcow2') {{(pid=88499) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 04:53:47 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-236e077c-3fa4-4d6a-9e9a-f4477e242d8c tempest-CreateVolumesFromSnapshotTest-1643372015 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-41cad359-1a56-47e1-b0a2-78a7d1254b41 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:53:47 devstack sudo[105464]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-41cad359-1a56-47e1-b0a2-78a7d1254b41 Jul 10 04:53:47 devstack sudo[105464]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:53:48 devstack sudo[105462]: pam_unix(sudo:session): session closed for user root Jul 10 04:53:48 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-88abb252-898f-4b1d-8abe-9f0a8997311a tempest-VolumeDependencyTests-2054620824 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-c9291bec-53ee-4b51-8bdf-8b3ea5eefacd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-c9291bec-53ee-4b51-8bdf-8b3ea5eefacd.92218a8a-04cf-41f9-b1ab-85508b375c69 1G" returned: 0 in 0.912s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:53:48 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-88abb252-898f-4b1d-8abe-9f0a8997311a tempest-VolumeDependencyTests-2054620824 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c9291bec-53ee-4b51-8bdf-8b3ea5eefacd -F qcow2 /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-c9291bec-53ee-4b51-8bdf-8b3ea5eefacd.92218a8a-04cf-41f9-b1ab-85508b375c69 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:53:48 devstack sudo[105470]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c9291bec-53ee-4b51-8bdf-8b3ea5eefacd -F qcow2 /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-c9291bec-53ee-4b51-8bdf-8b3ea5eefacd.92218a8a-04cf-41f9-b1ab-85508b375c69 Jul 10 04:53:48 devstack sudo[105470]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:53:48 devstack sudo[105464]: pam_unix(sudo:session): session closed for user root Jul 10 04:53:48 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-236e077c-3fa4-4d6a-9e9a-f4477e242d8c tempest-CreateVolumesFromSnapshotTest-1643372015 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-41cad359-1a56-47e1-b0a2-78a7d1254b41" returned: 0 in 0.827s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:53:48 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-236e077c-3fa4-4d6a-9e9a-f4477e242d8c tempest-CreateVolumesFromSnapshotTest-1643372015 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-41cad359-1a56-47e1-b0a2-78a7d1254b41 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:53:48 devstack sudo[105475]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-41cad359-1a56-47e1-b0a2-78a7d1254b41 Jul 10 04:53:48 devstack sudo[105475]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:53:48 devstack sudo[105470]: pam_unix(sudo:session): session closed for user root Jul 10 04:53:48 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-88abb252-898f-4b1d-8abe-9f0a8997311a tempest-VolumeDependencyTests-2054620824 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c9291bec-53ee-4b51-8bdf-8b3ea5eefacd -F qcow2 /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-c9291bec-53ee-4b51-8bdf-8b3ea5eefacd.92218a8a-04cf-41f9-b1ab-85508b375c69" returned: 0 in 0.752s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:53:48 devstack cinder-volume[87444]: WARNING cinder.volume.drivers.remotefs [None req-88abb252-898f-4b1d-8abe-9f0a8997311a tempest-VolumeDependencyTests-2054620824 None] /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-c9291bec-53ee-4b51-8bdf-8b3ea5eefacd.92218a8a-04cf-41f9-b1ab-85508b375c69 is being set with open permissions: ugo+rw Jul 10 04:53:48 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-88abb252-898f-4b1d-8abe-9f0a8997311a tempest-VolumeDependencyTests-2054620824 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-c9291bec-53ee-4b51-8bdf-8b3ea5eefacd.92218a8a-04cf-41f9-b1ab-85508b375c69 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:53:48 devstack sudo[105480]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-c9291bec-53ee-4b51-8bdf-8b3ea5eefacd.92218a8a-04cf-41f9-b1ab-85508b375c69 Jul 10 04:53:48 devstack sudo[105480]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:53:49 devstack sudo[105475]: pam_unix(sudo:session): session closed for user root Jul 10 04:53:49 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-236e077c-3fa4-4d6a-9e9a-f4477e242d8c tempest-CreateVolumesFromSnapshotTest-1643372015 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-41cad359-1a56-47e1-b0a2-78a7d1254b41" returned: 0 in 0.725s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:53:49 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-236e077c-3fa4-4d6a-9e9a-f4477e242d8c tempest-CreateVolumesFromSnapshotTest-1643372015 None] Lock "cinder-quobyte-41cad359-1a56-47e1-b0a2-78a7d1254b41" released by "delete_volume" :: held 1.608s {{(pid=87444) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 04:53:49 devstack cinder-volume[87444]: DEBUG cinder.quota [None req-236e077c-3fa4-4d6a-9e9a-f4477e242d8c tempest-CreateVolumesFromSnapshotTest-1643372015 None] Created reservations ['4e7c6c3f-e7a1-4eee-acfa-ded9ff021f72', '28c54345-489c-4d7f-8b85-218afd8d163a', '21c75df0-c449-4fbb-96b7-55b8dd25bca7', '9aeeed7c-c2a4-4fb7-b2ed-55f807ed29d6'] {{(pid=87444) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 04:53:49 devstack cinder-volume[87444]: DEBUG cinder.volume.flows.manager.create_volume [None req-b8e92057-a062-4fd6-a681-5107d912f569 tempest-VolumeImageDependencyTests-2146091144 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87444) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 04:53:49 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-b8e92057-a062-4fd6-a681-5107d912f569 tempest-VolumeImageDependencyTests-2146091144 None] Flow 'volume_create_manager' (532b48e9-df57-4f64-a887-59b9b2ca62d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 04:53:49 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-b8e92057-a062-4fd6-a681-5107d912f569 tempest-VolumeImageDependencyTests-2146091144 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (016dcb07-c96f-4315-934f-d1b127f8b5f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:53:49 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-236e077c-3fa4-4d6a-9e9a-f4477e242d8c tempest-CreateVolumesFromSnapshotTest-1643372015 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 04:53:49 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-236e077c-3fa4-4d6a-9e9a-f4477e242d8c tempest-CreateVolumesFromSnapshotTest-1643372015 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 04:53:49 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-236e077c-3fa4-4d6a-9e9a-f4477e242d8c tempest-CreateVolumesFromSnapshotTest-1643372015 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922': None} {{(pid=87444) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 04:53:49 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-236e077c-3fa4-4d6a-9e9a-f4477e242d8c tempest-CreateVolumesFromSnapshotTest-1643372015 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922'] {{(pid=87444) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 04:53:49 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-236e077c-3fa4-4d6a-9e9a-f4477e242d8c tempest-CreateVolumesFromSnapshotTest-1643372015 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 04:53:49 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-236e077c-3fa4-4d6a-9e9a-f4477e242d8c tempest-CreateVolumesFromSnapshotTest-1643372015 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:53:49 devstack sudo[105483]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097 Jul 10 04:53:49 devstack sudo[105483]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:53:49 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-b8e92057-a062-4fd6-a681-5107d912f569 tempest-VolumeImageDependencyTests-2146091144 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (016dcb07-c96f-4315-934f-d1b127f8b5f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T02:53:49Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fdbeaa65-057f-49d9-8c6a-836a39956e47,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c3a161ac220741e4a10764dea998083c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T02:53:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T02:53:49Z,use_quota=True,user_id='71f947d3bb634ad5a35d00d3321ae508',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(317e369e-1e06-434d-ae95-a335f0e6c903),volume_type_id=317e369e-1e06-434d-ae95-a335f0e6c903)' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:53:49 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-b8e92057-a062-4fd6-a681-5107d912f569 tempest-VolumeImageDependencyTests-2146091144 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f4e93905-148a-4043-9638-41eef2101c2c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:53:49 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-b8e92057-a062-4fd6-a681-5107d912f569 tempest-VolumeImageDependencyTests-2146091144 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f4e93905-148a-4043-9638-41eef2101c2c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:53:49 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-b8e92057-a062-4fd6-a681-5107d912f569 tempest-VolumeImageDependencyTests-2146091144 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f107e0e2-3e84-4365-b017-87788241e6fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:53:49 devstack cinder-volume[87444]: DEBUG cinder.image.glance [None req-b8e92057-a062-4fd6-a681-5107d912f569 tempest-VolumeImageDependencyTests-2146091144 None] Creating Keystone auth plugin from conf {{(pid=87444) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jul 10 04:53:49 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-b8e92057-a062-4fd6-a681-5107d912f569 tempest-VolumeImageDependencyTests-2146091144 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f107e0e2-3e84-4365-b017-87788241e6fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'fdbeaa65-057f-49d9-8c6a-836a39956e47', 'volume_name': 'volume-fdbeaa65-057f-49d9-8c6a-836a39956e47', 'volume_size': 1, 'image_id': 'd2551751-8a61-40ac-88de-2f8910f6fc78', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/d2551751-8a61-40ac-88de-2f8910f6fc78', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'ff2def80f4d9193a53cf1655603f6faf', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'c3a161ac220741e4a10764dea998083c', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'b7a8f232467ada123df98e6d320c4e6e32f63400542d97c02d1a6312724019ce66c990d237d28c7612a07d7fd55d6f44e3fb211d0c2d526542080ebabf22bc35', 'id': 'd2551751-8a61-40ac-88de-2f8910f6fc78', 'created_at': datetime.datetime(2026, 7, 10, 2, 53, 47, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 10, 2, 53, 48, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/d2551751-8a61-40ac-88de-2f8910f6fc78/file', 'properties': {}}, 'image_service': }' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:53:49 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-b8e92057-a062-4fd6-a681-5107d912f569 tempest-VolumeImageDependencyTests-2146091144 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d2adee5e-88fb-4ef9-9524-a8514455b410) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:53:49 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-b8e92057-a062-4fd6-a681-5107d912f569 tempest-VolumeImageDependencyTests-2146091144 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d2adee5e-88fb-4ef9-9524-a8514455b410) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:53:49 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-b8e92057-a062-4fd6-a681-5107d912f569 tempest-VolumeImageDependencyTests-2146091144 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (01848fc3-109d-4ffc-830e-b1ce8f6a6358) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:53:49 devstack cinder-volume[87444]: INFO cinder.volume.flows.manager.create_volume [None req-b8e92057-a062-4fd6-a681-5107d912f569 tempest-VolumeImageDependencyTests-2146091144 None] Volume fdbeaa65-057f-49d9-8c6a-836a39956e47: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-fdbeaa65-057f-49d9-8c6a-836a39956e47', 'volume_size': 1, 'image_id': 'd2551751-8a61-40ac-88de-2f8910f6fc78', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/d2551751-8a61-40ac-88de-2f8910f6fc78', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'ff2def80f4d9193a53cf1655603f6faf', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'c3a161ac220741e4a10764dea998083c', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'b7a8f232467ada123df98e6d320c4e6e32f63400542d97c02d1a6312724019ce66c990d237d28c7612a07d7fd55d6f44e3fb211d0c2d526542080ebabf22bc35', 'id': 'd2551751-8a61-40ac-88de-2f8910f6fc78', 'created_at': datetime.datetime(2026, 7, 10, 2, 53, 47, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 10, 2, 53, 48, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/d2551751-8a61-40ac-88de-2f8910f6fc78/file', 'properties': {}}, 'image_service': } Jul 10 04:53:49 devstack cinder-volume[87444]: DEBUG cinder.volume.flows.manager.create_volume [None req-b8e92057-a062-4fd6-a681-5107d912f569 tempest-VolumeImageDependencyTests-2146091144 None] Trying to clone fdbeaa65-057f-49d9-8c6a-836a39956e47 from image d2551751-8a61-40ac-88de-2f8910f6fc78 at location (None, [{'url': 'file:///opt/stack/data/glance/images/d2551751-8a61-40ac-88de-2f8910f6fc78', 'metadata': {}}]). {{(pid=87444) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jul 10 04:53:49 devstack sudo[105480]: pam_unix(sudo:session): session closed for user root Jul 10 04:53:49 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-88abb252-898f-4b1d-8abe-9f0a8997311a tempest-VolumeDependencyTests-2054620824 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-c9291bec-53ee-4b51-8bdf-8b3ea5eefacd.92218a8a-04cf-41f9-b1ab-85508b375c69" returned: 0 in 0.709s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:53:49 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-88abb252-898f-4b1d-8abe-9f0a8997311a tempest-VolumeDependencyTests-2054620824 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-c9291bec-53ee-4b51-8bdf-8b3ea5eefacd.info {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:53:49 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-39c478fa-f7b2-4d1d-afff-e601df3b276c tempest-CreateVolumesFromSnapshotTest-1643372015 None] Acquiring lock "cinder-82a9daa1-5862-4cac-adb8-c294dce35034-delete_volume" by "delete_volume" {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 04:53:49 devstack cinder-volume[87444]: DEBUG cinder.image.image_utils [None req-b8e92057-a062-4fd6-a681-5107d912f569 tempest-VolumeImageDependencyTests-2146091144 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_d2551751-8a61-40ac-88de-2f8910f6fc78_mfspowf9devstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=87444) fetch /opt/stack/cinder/cinder/image/image_utils.py:765}} Jul 10 04:53:49 devstack cinder-volume[87444]: INFO cinder.image.image_utils [None req-b8e92057-a062-4fd6-a681-5107d912f569 tempest-VolumeImageDependencyTests-2146091144 None] Image download 0.00 MB at 0.00 MB/s Jul 10 04:53:49 devstack sudo[105486]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-c9291bec-53ee-4b51-8bdf-8b3ea5eefacd.info Jul 10 04:53:49 devstack sudo[105486]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:53:49 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-39c478fa-f7b2-4d1d-afff-e601df3b276c tempest-CreateVolumesFromSnapshotTest-1643372015 None] Lock "cinder-82a9daa1-5862-4cac-adb8-c294dce35034-delete_volume" acquired by "delete_volume" :: waited 0.049s {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 04:53:49 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-39c478fa-f7b2-4d1d-afff-e601df3b276c tempest-CreateVolumesFromSnapshotTest-1643372015 None] Acquiring lock "cinder-quobyte-82a9daa1-5862-4cac-adb8-c294dce35034" by "delete_volume" {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 04:53:49 devstack cinder-volume[87444]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f3429f1-53df-4d93-abd9-31dc79c12315]: (4, 'raw') {{(pid=88499) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 04:53:49 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-b8e92057-a062-4fd6-a681-5107d912f569 tempest-VolumeImageDependencyTests-2146091144 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_d2551751-8a61-40ac-88de-2f8910f6fc78_mfspowf9devstack@QuobyteHD {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:53:49 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-39c478fa-f7b2-4d1d-afff-e601df3b276c tempest-CreateVolumesFromSnapshotTest-1643372015 None] Lock "cinder-quobyte-82a9daa1-5862-4cac-adb8-c294dce35034" acquired by "delete_volume" :: waited 0.034s {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 04:53:49 devstack cinder-volume[87444]: DEBUG oslo.privsep.daemon [-] privsep: reply[51bae368-d020-46d4-99ed-76fe0f55d582]: (4, 'qcow2') {{(pid=88499) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 04:53:49 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-39c478fa-f7b2-4d1d-afff-e601df3b276c tempest-CreateVolumesFromSnapshotTest-1643372015 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-82a9daa1-5862-4cac-adb8-c294dce35034 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:53:49 devstack sudo[105488]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_d2551751-8a61-40ac-88de-2f8910f6fc78_mfspowf9devstack@QuobyteHD Jul 10 04:53:49 devstack sudo[105488]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:53:50 devstack sudo[105489]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-82a9daa1-5862-4cac-adb8-c294dce35034 Jul 10 04:53:50 devstack sudo[105489]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:53:50 devstack sudo[105483]: pam_unix(sudo:session): session closed for user root Jul 10 04:53:50 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-236e077c-3fa4-4d6a-9e9a-f4477e242d8c tempest-CreateVolumesFromSnapshotTest-1643372015 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097" returned: 0 in 0.703s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:53:50 devstack cinder-volume[87444]: DEBUG cinder.manager [None req-236e077c-3fa4-4d6a-9e9a-f4477e242d8c tempest-CreateVolumesFromSnapshotTest-1643372015 None] Notifying Schedulers of capabilities ... {{(pid=87444) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 04:53:50 devstack cinder-volume[87444]: INFO cinder.volume.manager [None req-236e077c-3fa4-4d6a-9e9a-f4477e242d8c tempest-CreateVolumesFromSnapshotTest-1643372015 None] Deleted volume successfully. Jul 10 04:53:50 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-236e077c-3fa4-4d6a-9e9a-f4477e242d8c tempest-CreateVolumesFromSnapshotTest-1643372015 None] Lock "cinder-41cad359-1a56-47e1-b0a2-78a7d1254b41-delete_volume" released by "delete_volume" :: held 2.599s {{(pid=87444) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 04:53:50 devstack sudo[105486]: pam_unix(sudo:session): session closed for user root Jul 10 04:53:50 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-88abb252-898f-4b1d-8abe-9f0a8997311a tempest-VolumeDependencyTests-2054620824 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-c9291bec-53ee-4b51-8bdf-8b3ea5eefacd.info" returned: 0 in 0.757s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:53:50 devstack cinder-volume[87444]: WARNING cinder.volume.drivers.remotefs [None req-88abb252-898f-4b1d-8abe-9f0a8997311a tempest-VolumeDependencyTests-2054620824 None] /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-c9291bec-53ee-4b51-8bdf-8b3ea5eefacd.info is being set with open permissions: ugo+rw Jul 10 04:53:50 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-88abb252-898f-4b1d-8abe-9f0a8997311a tempest-VolumeDependencyTests-2054620824 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-c9291bec-53ee-4b51-8bdf-8b3ea5eefacd.info {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:53:50 devstack sudo[105494]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-c9291bec-53ee-4b51-8bdf-8b3ea5eefacd.info Jul 10 04:53:50 devstack sudo[105494]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:53:50 devstack sudo[105488]: pam_unix(sudo:session): session closed for user root Jul 10 04:53:50 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-b8e92057-a062-4fd6-a681-5107d912f569 tempest-VolumeImageDependencyTests-2146091144 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_d2551751-8a61-40ac-88de-2f8910f6fc78_mfspowf9devstack@QuobyteHD" returned: 0 in 0.810s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:53:50 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-b8e92057-a062-4fd6-a681-5107d912f569 tempest-VolumeImageDependencyTests-2146091144 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_d2551751-8a61-40ac-88de-2f8910f6fc78_mfspowf9devstack@QuobyteHD {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:53:50 devstack sudo[105489]: pam_unix(sudo:session): session closed for user root Jul 10 04:53:50 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-39c478fa-f7b2-4d1d-afff-e601df3b276c tempest-CreateVolumesFromSnapshotTest-1643372015 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-82a9daa1-5862-4cac-adb8-c294dce35034" returned: 0 in 0.799s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:53:50 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-39c478fa-f7b2-4d1d-afff-e601df3b276c tempest-CreateVolumesFromSnapshotTest-1643372015 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-82a9daa1-5862-4cac-adb8-c294dce35034 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:53:50 devstack sudo[105503]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-82a9daa1-5862-4cac-adb8-c294dce35034 Jul 10 04:53:50 devstack sudo[105503]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:53:50 devstack sudo[105502]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_d2551751-8a61-40ac-88de-2f8910f6fc78_mfspowf9devstack@QuobyteHD Jul 10 04:53:50 devstack sudo[105502]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:53:51 devstack sudo[105494]: pam_unix(sudo:session): session closed for user root Jul 10 04:53:51 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-88abb252-898f-4b1d-8abe-9f0a8997311a tempest-VolumeDependencyTests-2054620824 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-c9291bec-53ee-4b51-8bdf-8b3ea5eefacd.info" returned: 0 in 0.645s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:53:51 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-88abb252-898f-4b1d-8abe-9f0a8997311a tempest-VolumeDependencyTests-2054620824 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.810s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 04:53:51 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-086d0c57-6e27-4a82-8262-dbee90c17ea5 tempest-CinderUnicodeTest-973446373 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.676s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 04:53:51 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-086d0c57-6e27-4a82-8262-dbee90c17ea5 tempest-CinderUnicodeTest-973446373 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T02:53:47Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1fc1c39b-736a-48e4-ad7d-95706dee36f8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8d7f6fd0a13d429c87a6594f91c7475d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T02:53:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T02:53:47Z,use_quota=True,user_id='9271ef5b15fa4893a4aaff48d719045d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(317e369e-1e06-434d-ae95-a335f0e6c903),volume_type_id=317e369e-1e06-434d-ae95-a335f0e6c903)}" {{(pid=87444) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 04:53:51 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.remotefs [None req-086d0c57-6e27-4a82-8262-dbee90c17ea5 tempest-CinderUnicodeTest-973446373 None] Creating volume 1fc1c39b-736a-48e4-ad7d-95706dee36f8 {{(pid=87444) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 04:53:51 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-086d0c57-6e27-4a82-8262-dbee90c17ea5 tempest-CinderUnicodeTest-973446373 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 04:53:51 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-086d0c57-6e27-4a82-8262-dbee90c17ea5 tempest-CinderUnicodeTest-973446373 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 04:53:51 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-086d0c57-6e27-4a82-8262-dbee90c17ea5 tempest-CinderUnicodeTest-973446373 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922': None} {{(pid=87444) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 04:53:51 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-086d0c57-6e27-4a82-8262-dbee90c17ea5 tempest-CinderUnicodeTest-973446373 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922'] {{(pid=87444) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 04:53:51 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-086d0c57-6e27-4a82-8262-dbee90c17ea5 tempest-CinderUnicodeTest-973446373 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 04:53:51 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-086d0c57-6e27-4a82-8262-dbee90c17ea5 tempest-CinderUnicodeTest-973446373 None] Selected osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922 as target Quobyte volume. {{(pid=87444) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 04:53:51 devstack cinder-volume[87444]: INFO cinder.volume.drivers.remotefs [None req-086d0c57-6e27-4a82-8262-dbee90c17ea5 tempest-CinderUnicodeTest-973446373 None] casted to osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922 Jul 10 04:53:51 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-086d0c57-6e27-4a82-8262-dbee90c17ea5 tempest-CinderUnicodeTest-973446373 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-1fc1c39b-736a-48e4-ad7d-95706dee36f8 1073741824 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:53:51 devstack sudo[105507]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-1fc1c39b-736a-48e4-ad7d-95706dee36f8 1073741824 Jul 10 04:53:51 devstack sudo[105507]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:53:51 devstack cinder-volume[87444]: INFO cinder.volume.manager [None req-88abb252-898f-4b1d-8abe-9f0a8997311a tempest-VolumeDependencyTests-2054620824 None] Create snapshot completed successfully Jul 10 04:53:51 devstack sudo[105503]: pam_unix(sudo:session): session closed for user root Jul 10 04:53:51 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-39c478fa-f7b2-4d1d-afff-e601df3b276c tempest-CreateVolumesFromSnapshotTest-1643372015 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-82a9daa1-5862-4cac-adb8-c294dce35034" returned: 0 in 0.704s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:53:51 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-39c478fa-f7b2-4d1d-afff-e601df3b276c tempest-CreateVolumesFromSnapshotTest-1643372015 None] Lock "cinder-quobyte-82a9daa1-5862-4cac-adb8-c294dce35034" released by "delete_volume" :: held 1.568s {{(pid=87444) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 04:53:51 devstack sudo[105502]: pam_unix(sudo:session): session closed for user root Jul 10 04:53:51 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-b8e92057-a062-4fd6-a681-5107d912f569 tempest-VolumeImageDependencyTests-2146091144 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_d2551751-8a61-40ac-88de-2f8910f6fc78_mfspowf9devstack@QuobyteHD" returned: 1 in 0.801s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:53:51 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-b8e92057-a062-4fd6-a681-5107d912f569 tempest-VolumeImageDependencyTests-2146091144 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_d2551751-8a61-40ac-88de-2f8910f6fc78_mfspowf9devstack@QuobyteHD' failed. Not Retrying. {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 10 04:53:51 devstack cinder-volume[87444]: DEBUG cinder.image.image_utils [None req-b8e92057-a062-4fd6-a681-5107d912f569 tempest-VolumeImageDependencyTests-2146091144 None] Temporary image d2551751-8a61-40ac-88de-2f8910f6fc78 is fetched for user 71f947d3bb634ad5a35d00d3321ae508. {{(pid=87444) fetch /opt/stack/cinder/cinder/image/image_utils.py:1464}} Jul 10 04:53:51 devstack cinder-volume[87444]: DEBUG cinder.quota [None req-39c478fa-f7b2-4d1d-afff-e601df3b276c tempest-CreateVolumesFromSnapshotTest-1643372015 None] Created reservations ['9d9474de-b795-4810-87d0-4e932c5f35c3', 'f809d825-e861-4e26-a885-d60168c67d77', 'e86826e5-3b81-4b62-975e-cb9122710216', '99f090c3-612f-4934-8495-5512164eaa9e'] {{(pid=87444) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 04:53:51 devstack cinder-volume[87444]: DEBUG oslo.privsep.daemon [-] privsep: reply[136d66f2-b9a5-4f70-b4ce-219265ac6d29]: (4, 'raw') {{(pid=88499) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 04:53:51 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-b8e92057-a062-4fd6-a681-5107d912f569 tempest-VolumeImageDependencyTests-2146091144 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_d2551751-8a61-40ac-88de-2f8910f6fc78_mfspowf9devstack@QuobyteHD {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:53:51 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-39c478fa-f7b2-4d1d-afff-e601df3b276c tempest-CreateVolumesFromSnapshotTest-1643372015 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 04:53:51 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-39c478fa-f7b2-4d1d-afff-e601df3b276c tempest-CreateVolumesFromSnapshotTest-1643372015 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 04:53:51 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-39c478fa-f7b2-4d1d-afff-e601df3b276c tempest-CreateVolumesFromSnapshotTest-1643372015 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922': None} {{(pid=87444) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 04:53:51 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-39c478fa-f7b2-4d1d-afff-e601df3b276c tempest-CreateVolumesFromSnapshotTest-1643372015 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922'] {{(pid=87444) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 04:53:51 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-39c478fa-f7b2-4d1d-afff-e601df3b276c tempest-CreateVolumesFromSnapshotTest-1643372015 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 04:53:51 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-39c478fa-f7b2-4d1d-afff-e601df3b276c tempest-CreateVolumesFromSnapshotTest-1643372015 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:53:51 devstack sudo[105514]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097 Jul 10 04:53:51 devstack sudo[105514]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:53:51 devstack sudo[105513]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_d2551751-8a61-40ac-88de-2f8910f6fc78_mfspowf9devstack@QuobyteHD Jul 10 04:53:51 devstack sudo[105513]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:53:52 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-8907dd4d-5579-4d96-a9e4-9e31cf2482be tempest-CreateVolumesFromSnapshotTest-1643372015 None] Acquiring lock "cinder-ef0a6ca2-a409-4a17-98fc-e039fa3405a4-delete_volume" by "delete_volume" {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 04:53:52 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-8907dd4d-5579-4d96-a9e4-9e31cf2482be tempest-CreateVolumesFromSnapshotTest-1643372015 None] Lock "cinder-ef0a6ca2-a409-4a17-98fc-e039fa3405a4-delete_volume" acquired by "delete_volume" :: waited 0.045s {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 04:53:52 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-8907dd4d-5579-4d96-a9e4-9e31cf2482be tempest-CreateVolumesFromSnapshotTest-1643372015 None] Acquiring lock "cinder-quobyte-ef0a6ca2-a409-4a17-98fc-e039fa3405a4" by "delete_volume" {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 04:53:52 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-8907dd4d-5579-4d96-a9e4-9e31cf2482be tempest-CreateVolumesFromSnapshotTest-1643372015 None] Lock "cinder-quobyte-ef0a6ca2-a409-4a17-98fc-e039fa3405a4" acquired by "delete_volume" :: waited 0.019s {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 04:53:52 devstack cinder-volume[87444]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb9a9866-91c4-4d6f-bedf-c04d6f2cb6b1]: (4, 'qcow2') {{(pid=88499) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 04:53:52 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-8907dd4d-5579-4d96-a9e4-9e31cf2482be tempest-CreateVolumesFromSnapshotTest-1643372015 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-ef0a6ca2-a409-4a17-98fc-e039fa3405a4 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:53:52 devstack sudo[105507]: pam_unix(sudo:session): session closed for user root Jul 10 04:53:52 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-086d0c57-6e27-4a82-8262-dbee90c17ea5 tempest-CinderUnicodeTest-973446373 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-1fc1c39b-736a-48e4-ad7d-95706dee36f8 1073741824" returned: 0 in 1.125s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:53:52 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-086d0c57-6e27-4a82-8262-dbee90c17ea5 tempest-CinderUnicodeTest-973446373 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-1fc1c39b-736a-48e4-ad7d-95706dee36f8 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:53:52 devstack sudo[105514]: pam_unix(sudo:session): session closed for user root Jul 10 04:53:52 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-39c478fa-f7b2-4d1d-afff-e601df3b276c tempest-CreateVolumesFromSnapshotTest-1643372015 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097" returned: 0 in 0.738s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:53:52 devstack cinder-volume[87444]: DEBUG cinder.manager [None req-39c478fa-f7b2-4d1d-afff-e601df3b276c tempest-CreateVolumesFromSnapshotTest-1643372015 None] Notifying Schedulers of capabilities ... {{(pid=87444) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 04:53:52 devstack cinder-volume[87444]: INFO cinder.volume.manager [None req-39c478fa-f7b2-4d1d-afff-e601df3b276c tempest-CreateVolumesFromSnapshotTest-1643372015 None] Deleted volume successfully. Jul 10 04:53:52 devstack sudo[105525]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-1fc1c39b-736a-48e4-ad7d-95706dee36f8 Jul 10 04:53:52 devstack sudo[105525]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:53:52 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-39c478fa-f7b2-4d1d-afff-e601df3b276c tempest-CreateVolumesFromSnapshotTest-1643372015 None] Lock "cinder-82a9daa1-5862-4cac-adb8-c294dce35034-delete_volume" released by "delete_volume" :: held 2.592s {{(pid=87444) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 04:53:52 devstack sudo[105523]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-ef0a6ca2-a409-4a17-98fc-e039fa3405a4 Jul 10 04:53:52 devstack sudo[105523]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:53:52 devstack sudo[105513]: pam_unix(sudo:session): session closed for user root Jul 10 04:53:52 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-b8e92057-a062-4fd6-a681-5107d912f569 tempest-VolumeImageDependencyTests-2146091144 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_d2551751-8a61-40ac-88de-2f8910f6fc78_mfspowf9devstack@QuobyteHD" returned: 0 in 0.908s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:53:52 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-b8e92057-a062-4fd6-a681-5107d912f569 tempest-VolumeImageDependencyTests-2146091144 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_d2551751-8a61-40ac-88de-2f8910f6fc78_mfspowf9devstack@QuobyteHD {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:53:52 devstack sudo[105528]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_d2551751-8a61-40ac-88de-2f8910f6fc78_mfspowf9devstack@QuobyteHD Jul 10 04:53:52 devstack sudo[105528]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:53:52 devstack cinder-volume[87444]: DEBUG cinder.volume.flows.manager.create_volume [None req-b7b4e127-4a75-420e-88cd-a81c8dd90f22 tempest-VolumeDependencyTests-2054620824 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87444) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 04:53:52 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-b7b4e127-4a75-420e-88cd-a81c8dd90f22 tempest-VolumeDependencyTests-2054620824 None] Flow 'volume_create_manager' (ef3e8077-ab51-4af1-9dbe-1c83b0b69422) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 04:53:52 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-b7b4e127-4a75-420e-88cd-a81c8dd90f22 tempest-VolumeDependencyTests-2054620824 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5b1416e5-f94f-49fa-9340-e239f9ea08b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:53:52 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-b7b4e127-4a75-420e-88cd-a81c8dd90f22 tempest-VolumeDependencyTests-2054620824 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5b1416e5-f94f-49fa-9340-e239f9ea08b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T02:53:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1368868312',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=794a766c-d221-45ff-b609-b3342e00de15,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='78b1918d5df24f7f929f1a3952f5e277',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T02:53:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=92218a8a-04cf-41f9-b1ab-85508b375c69,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T02:53:53Z,use_quota=True,user_id='4e38d0c84cb84f579f7af6e3050fc2c6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(317e369e-1e06-434d-ae95-a335f0e6c903),volume_type_id=317e369e-1e06-434d-ae95-a335f0e6c903)' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:53:52 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-b7b4e127-4a75-420e-88cd-a81c8dd90f22 tempest-VolumeDependencyTests-2054620824 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1974c180-52b9-4507-94ab-37f40ce02fe7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:53:52 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-b7b4e127-4a75-420e-88cd-a81c8dd90f22 tempest-VolumeDependencyTests-2054620824 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1974c180-52b9-4507-94ab-37f40ce02fe7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:53:52 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-b7b4e127-4a75-420e-88cd-a81c8dd90f22 tempest-VolumeDependencyTests-2054620824 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b6ebfdb1-dda0-4770-8eda-b7f307531b99) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:53:52 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-b7b4e127-4a75-420e-88cd-a81c8dd90f22 tempest-VolumeDependencyTests-2054620824 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b6ebfdb1-dda0-4770-8eda-b7f307531b99) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '794a766c-d221-45ff-b609-b3342e00de15', 'volume_name': 'volume-794a766c-d221-45ff-b609-b3342e00de15', 'volume_size': 1, 'snapshot_id': '92218a8a-04cf-41f9-b1ab-85508b375c69'}' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:53:53 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-b7b4e127-4a75-420e-88cd-a81c8dd90f22 tempest-VolumeDependencyTests-2054620824 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7630d59b-a77c-4734-89c0-404d2a630723) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:53:53 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-b7b4e127-4a75-420e-88cd-a81c8dd90f22 tempest-VolumeDependencyTests-2054620824 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7630d59b-a77c-4734-89c0-404d2a630723) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:53:53 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-b7b4e127-4a75-420e-88cd-a81c8dd90f22 tempest-VolumeDependencyTests-2054620824 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (67621b1a-434e-4627-baf7-7999d677f237) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:53:53 devstack cinder-volume[87444]: INFO cinder.volume.flows.manager.create_volume [None req-b7b4e127-4a75-420e-88cd-a81c8dd90f22 tempest-VolumeDependencyTests-2054620824 None] Volume 794a766c-d221-45ff-b609-b3342e00de15: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-794a766c-d221-45ff-b609-b3342e00de15', 'volume_size': 1, 'snapshot_id': '92218a8a-04cf-41f9-b1ab-85508b375c69'} Jul 10 04:53:53 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-b7b4e127-4a75-420e-88cd-a81c8dd90f22 tempest-VolumeDependencyTests-2054620824 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 04:53:53 devstack sudo[105525]: pam_unix(sudo:session): session closed for user root Jul 10 04:53:53 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-086d0c57-6e27-4a82-8262-dbee90c17ea5 tempest-CinderUnicodeTest-973446373 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-1fc1c39b-736a-48e4-ad7d-95706dee36f8" returned: 0 in 0.727s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:53:53 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-086d0c57-6e27-4a82-8262-dbee90c17ea5 tempest-CinderUnicodeTest-973446373 None] <== create_volume: return (1903ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922'} {{(pid=87444) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 04:53:53 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-086d0c57-6e27-4a82-8262-dbee90c17ea5 tempest-CinderUnicodeTest-973446373 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.908s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 04:53:53 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-b7b4e127-4a75-420e-88cd-a81c8dd90f22 tempest-VolumeDependencyTests-2054620824 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.018s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 04:53:53 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-b7b4e127-4a75-420e-88cd-a81c8dd90f22 tempest-VolumeDependencyTests-2054620824 None] Acquiring lock "cinder-quobyte-92218a8a-04cf-41f9-b1ab-85508b375c69-794a766c-d221-45ff-b609-b3342e00de15" by "_create_volume_from_snapshot" {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 04:53:53 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-086d0c57-6e27-4a82-8262-dbee90c17ea5 tempest-CinderUnicodeTest-973446373 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3395d236-09ed-48e0-95a0-0b3fa042ccce) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1fc1c39b-736a-48e4-ad7d-95706dee36f8', 'volume_size': 1}' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:53:53 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-086d0c57-6e27-4a82-8262-dbee90c17ea5 tempest-CinderUnicodeTest-973446373 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9f5f5c66-9e3c-4561-8755-28dc2c0619b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:53:53 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-b7b4e127-4a75-420e-88cd-a81c8dd90f22 tempest-VolumeDependencyTests-2054620824 None] Lock "cinder-quobyte-92218a8a-04cf-41f9-b1ab-85508b375c69-794a766c-d221-45ff-b609-b3342e00de15" acquired by "_create_volume_from_snapshot" :: waited 0.031s {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 04:53:53 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-b7b4e127-4a75-420e-88cd-a81c8dd90f22 tempest-VolumeDependencyTests-2054620824 None] Creating volume 794a766c-d221-45ff-b609-b3342e00de15 from snapshot 92218a8a-04cf-41f9-b1ab-85508b375c69 {{(pid=87444) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Jul 10 04:53:53 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-b7b4e127-4a75-420e-88cd-a81c8dd90f22 tempest-VolumeDependencyTests-2054620824 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 04:53:53 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-b7b4e127-4a75-420e-88cd-a81c8dd90f22 tempest-VolumeDependencyTests-2054620824 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 04:53:53 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-b7b4e127-4a75-420e-88cd-a81c8dd90f22 tempest-VolumeDependencyTests-2054620824 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922': None} {{(pid=87444) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 04:53:53 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-b7b4e127-4a75-420e-88cd-a81c8dd90f22 tempest-VolumeDependencyTests-2054620824 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922'] {{(pid=87444) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 04:53:53 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-b7b4e127-4a75-420e-88cd-a81c8dd90f22 tempest-VolumeDependencyTests-2054620824 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 04:53:53 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-b7b4e127-4a75-420e-88cd-a81c8dd90f22 tempest-VolumeDependencyTests-2054620824 None] Selected osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922 as target Quobyte volume. {{(pid=87444) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 04:53:53 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-b7b4e127-4a75-420e-88cd-a81c8dd90f22 tempest-VolumeDependencyTests-2054620824 None] Acquiring lock "cinder-quobyte-794a766c-d221-45ff-b609-b3342e00de15" by "_copy_volume_from_snapshot" {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 04:53:53 devstack cinder-volume[87444]: INFO cinder.volume.flows.manager.create_volume [None req-086d0c57-6e27-4a82-8262-dbee90c17ea5 tempest-CinderUnicodeTest-973446373 None] Volume volume-1fc1c39b-736a-48e4-ad7d-95706dee36f8 (1fc1c39b-736a-48e4-ad7d-95706dee36f8): created successfully Jul 10 04:53:53 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-086d0c57-6e27-4a82-8262-dbee90c17ea5 tempest-CinderUnicodeTest-973446373 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9f5f5c66-9e3c-4561-8755-28dc2c0619b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:53:53 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-086d0c57-6e27-4a82-8262-dbee90c17ea5 tempest-CinderUnicodeTest-973446373 None] Flow 'volume_create_manager' (3f67aa45-727c-4449-a109-42665266811e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87444) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 04:53:53 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-b7b4e127-4a75-420e-88cd-a81c8dd90f22 tempest-VolumeDependencyTests-2054620824 None] Lock "cinder-quobyte-794a766c-d221-45ff-b609-b3342e00de15" acquired by "_copy_volume_from_snapshot" :: waited 0.028s {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 04:53:53 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-b7b4e127-4a75-420e-88cd-a81c8dd90f22 tempest-VolumeDependencyTests-2054620824 None] snapshot: 92218a8a-04cf-41f9-b1ab-85508b375c69, volume: 794a766c-d221-45ff-b609-b3342e00de15, {{(pid=87444) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jul 10 04:53:53 devstack cinder-volume[87444]: INFO cinder.volume.manager [None req-086d0c57-6e27-4a82-8262-dbee90c17ea5 tempest-CinderUnicodeTest-973446373 None] Created volume successfully. Jul 10 04:53:53 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-b7b4e127-4a75-420e-88cd-a81c8dd90f22 tempest-VolumeDependencyTests-2054620824 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 04:53:53 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-b7b4e127-4a75-420e-88cd-a81c8dd90f22 tempest-VolumeDependencyTests-2054620824 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 04:53:53 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-b7b4e127-4a75-420e-88cd-a81c8dd90f22 tempest-VolumeDependencyTests-2054620824 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922': None} {{(pid=87444) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 04:53:53 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-b7b4e127-4a75-420e-88cd-a81c8dd90f22 tempest-VolumeDependencyTests-2054620824 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922'] {{(pid=87444) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 04:53:53 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-b7b4e127-4a75-420e-88cd-a81c8dd90f22 tempest-VolumeDependencyTests-2054620824 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 04:53:53 devstack cinder-volume[87444]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce993830-7555-4169-b42e-06eff48e2c53]: (4, 'qcow2') {{(pid=88499) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 04:53:53 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-b7b4e127-4a75-420e-88cd-a81c8dd90f22 tempest-VolumeDependencyTests-2054620824 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-c9291bec-53ee-4b51-8bdf-8b3ea5eefacd.92218a8a-04cf-41f9-b1ab-85508b375c69 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:53:53 devstack sudo[105523]: pam_unix(sudo:session): session closed for user root Jul 10 04:53:53 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-8907dd4d-5579-4d96-a9e4-9e31cf2482be tempest-CreateVolumesFromSnapshotTest-1643372015 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-ef0a6ca2-a409-4a17-98fc-e039fa3405a4" returned: 0 in 0.995s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:53:53 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-8907dd4d-5579-4d96-a9e4-9e31cf2482be tempest-CreateVolumesFromSnapshotTest-1643372015 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-ef0a6ca2-a409-4a17-98fc-e039fa3405a4 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:53:53 devstack sudo[105538]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-ef0a6ca2-a409-4a17-98fc-e039fa3405a4 Jul 10 04:53:53 devstack sudo[105538]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:53:53 devstack sudo[105528]: pam_unix(sudo:session): session closed for user root Jul 10 04:53:53 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-b8e92057-a062-4fd6-a681-5107d912f569 tempest-VolumeImageDependencyTests-2146091144 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_d2551751-8a61-40ac-88de-2f8910f6fc78_mfspowf9devstack@QuobyteHD" returned: 1 in 0.823s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:53:53 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-b8e92057-a062-4fd6-a681-5107d912f569 tempest-VolumeImageDependencyTests-2146091144 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_d2551751-8a61-40ac-88de-2f8910f6fc78_mfspowf9devstack@QuobyteHD' failed. Not Retrying. {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 10 04:53:53 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-b8e92057-a062-4fd6-a681-5107d912f569 tempest-VolumeImageDependencyTests-2146091144 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 04:53:53 devstack sudo[105537]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-c9291bec-53ee-4b51-8bdf-8b3ea5eefacd.92218a8a-04cf-41f9-b1ab-85508b375c69 Jul 10 04:53:53 devstack sudo[105537]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:53:53 devstack sudo[105538]: pam_unix(sudo:session): session closed for user root Jul 10 04:53:53 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-8907dd4d-5579-4d96-a9e4-9e31cf2482be tempest-CreateVolumesFromSnapshotTest-1643372015 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-ef0a6ca2-a409-4a17-98fc-e039fa3405a4" returned: 0 in 0.682s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:53:53 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-8907dd4d-5579-4d96-a9e4-9e31cf2482be tempest-CreateVolumesFromSnapshotTest-1643372015 None] Lock "cinder-quobyte-ef0a6ca2-a409-4a17-98fc-e039fa3405a4" released by "delete_volume" :: held 1.732s {{(pid=87444) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 04:53:53 devstack cinder-volume[87444]: DEBUG cinder.quota [None req-8907dd4d-5579-4d96-a9e4-9e31cf2482be tempest-CreateVolumesFromSnapshotTest-1643372015 None] Created reservations ['7154f0af-f1c5-4b05-b1d0-34d5b8155b76', '44754285-84a3-422d-98cd-1a359af5919f', 'dbad3d1f-3795-47fe-826c-40fa89e029f1', 'a11f34e0-a142-404d-82dd-719fa865a48e'] {{(pid=87444) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 04:53:53 devstack sudo[105537]: pam_unix(sudo:session): session closed for user root Jul 10 04:53:54 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-b7b4e127-4a75-420e-88cd-a81c8dd90f22 tempest-VolumeDependencyTests-2054620824 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-c9291bec-53ee-4b51-8bdf-8b3ea5eefacd.92218a8a-04cf-41f9-b1ab-85508b375c69" returned: 0 in 0.802s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:53:54 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.remotefs [None req-b7b4e127-4a75-420e-88cd-a81c8dd90f22 tempest-VolumeDependencyTests-2054620824 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c9291bec-53ee-4b51-8bdf-8b3ea5eefacd(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87444) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 10 04:53:54 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-b7b4e127-4a75-420e-88cd-a81c8dd90f22 tempest-VolumeDependencyTests-2054620824 None] will copy from snapshot at /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-c9291bec-53ee-4b51-8bdf-8b3ea5eefacd {{(pid=87444) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jul 10 04:53:54 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-b7b4e127-4a75-420e-88cd-a81c8dd90f22 tempest-VolumeDependencyTests-2054620824 None] Creating direct copy from snapshot {{(pid=87444) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jul 10 04:53:54 devstack cinder-volume[87444]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b76644b-2b52-4a0f-babe-cb656911ed8f]: (4, 'qcow2') {{(pid=88499) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 04:53:54 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-b7b4e127-4a75-420e-88cd-a81c8dd90f22 tempest-VolumeDependencyTests-2054620824 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-c9291bec-53ee-4b51-8bdf-8b3ea5eefacd {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:53:54 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-8907dd4d-5579-4d96-a9e4-9e31cf2482be tempest-CreateVolumesFromSnapshotTest-1643372015 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 04:53:54 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-8907dd4d-5579-4d96-a9e4-9e31cf2482be tempest-CreateVolumesFromSnapshotTest-1643372015 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 04:53:54 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-8907dd4d-5579-4d96-a9e4-9e31cf2482be tempest-CreateVolumesFromSnapshotTest-1643372015 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922': None} {{(pid=87444) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 04:53:54 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-8907dd4d-5579-4d96-a9e4-9e31cf2482be tempest-CreateVolumesFromSnapshotTest-1643372015 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922'] {{(pid=87444) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 04:53:54 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-8907dd4d-5579-4d96-a9e4-9e31cf2482be tempest-CreateVolumesFromSnapshotTest-1643372015 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 04:53:54 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-8907dd4d-5579-4d96-a9e4-9e31cf2482be tempest-CreateVolumesFromSnapshotTest-1643372015 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:53:54 devstack sudo[105547]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097 Jul 10 04:53:54 devstack sudo[105547]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:53:54 devstack sudo[105546]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-c9291bec-53ee-4b51-8bdf-8b3ea5eefacd Jul 10 04:53:54 devstack sudo[105546]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:53:54 devstack cinder-volume[87444]: DEBUG cinder.volume.flows.manager.create_volume [None req-3cba9d21-8e8f-46aa-91ef-e5d18446807a tempest-CinderUnicodeTest-973446373 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87444) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 04:53:54 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-3cba9d21-8e8f-46aa-91ef-e5d18446807a tempest-CinderUnicodeTest-973446373 None] Flow 'volume_create_manager' (775d4e12-41ad-410c-bfc3-f2e9d6ef8c18) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 04:53:54 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-3cba9d21-8e8f-46aa-91ef-e5d18446807a tempest-CinderUnicodeTest-973446373 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (67a75b0f-4b36-4bdb-b084-99116103a2eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:53:54 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-3cba9d21-8e8f-46aa-91ef-e5d18446807a tempest-CinderUnicodeTest-973446373 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (67a75b0f-4b36-4bdb-b084-99116103a2eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T02:53:54Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1330564285',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c3059c57-3952-4b3b-a43f-88ab14f29952,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8d7f6fd0a13d429c87a6594f91c7475d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T02:53:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T02:53:54Z,use_quota=True,user_id='9271ef5b15fa4893a4aaff48d719045d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(317e369e-1e06-434d-ae95-a335f0e6c903),volume_type_id=317e369e-1e06-434d-ae95-a335f0e6c903)' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:53:54 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-3cba9d21-8e8f-46aa-91ef-e5d18446807a tempest-CinderUnicodeTest-973446373 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9f09f0de-61ce-4ad9-baa5-9b47b0c1c534) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:53:54 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-3cba9d21-8e8f-46aa-91ef-e5d18446807a tempest-CinderUnicodeTest-973446373 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9f09f0de-61ce-4ad9-baa5-9b47b0c1c534) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:53:54 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-3cba9d21-8e8f-46aa-91ef-e5d18446807a tempest-CinderUnicodeTest-973446373 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fe030bfb-12a7-4abb-98c6-1024cabc9901) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:53:54 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-3cba9d21-8e8f-46aa-91ef-e5d18446807a tempest-CinderUnicodeTest-973446373 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fe030bfb-12a7-4abb-98c6-1024cabc9901) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c3059c57-3952-4b3b-a43f-88ab14f29952', 'volume_name': 'volume-c3059c57-3952-4b3b-a43f-88ab14f29952', 'volume_size': 1}' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:53:54 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-3cba9d21-8e8f-46aa-91ef-e5d18446807a tempest-CinderUnicodeTest-973446373 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cb9d4a5b-e39a-4d3c-8cf9-026dadb7dbe6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:53:54 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-3cba9d21-8e8f-46aa-91ef-e5d18446807a tempest-CinderUnicodeTest-973446373 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cb9d4a5b-e39a-4d3c-8cf9-026dadb7dbe6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:53:54 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-3cba9d21-8e8f-46aa-91ef-e5d18446807a tempest-CinderUnicodeTest-973446373 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (96f6c8b5-b9dd-4d67-8cfb-3b62f644a960) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:53:54 devstack cinder-volume[87444]: INFO cinder.volume.flows.manager.create_volume [None req-3cba9d21-8e8f-46aa-91ef-e5d18446807a tempest-CinderUnicodeTest-973446373 None] Volume c3059c57-3952-4b3b-a43f-88ab14f29952: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c3059c57-3952-4b3b-a43f-88ab14f29952', 'volume_size': 1} Jul 10 04:53:54 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-3cba9d21-8e8f-46aa-91ef-e5d18446807a tempest-CinderUnicodeTest-973446373 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 04:53:54 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-4df28690-43c7-47d5-b59b-5e829f8097a3 tempest-CreateVolumesFromSnapshotTest-1643372015 None] Acquiring lock "cinder-a32e71b3-683f-4214-b096-f0fb0d9842fe-delete_volume" by "delete_volume" {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 04:53:54 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-4df28690-43c7-47d5-b59b-5e829f8097a3 tempest-CreateVolumesFromSnapshotTest-1643372015 None] Lock "cinder-a32e71b3-683f-4214-b096-f0fb0d9842fe-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 04:53:54 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-4df28690-43c7-47d5-b59b-5e829f8097a3 tempest-CreateVolumesFromSnapshotTest-1643372015 None] Acquiring lock "cinder-quobyte-a32e71b3-683f-4214-b096-f0fb0d9842fe" by "delete_volume" {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 04:53:54 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-4df28690-43c7-47d5-b59b-5e829f8097a3 tempest-CreateVolumesFromSnapshotTest-1643372015 None] Lock "cinder-quobyte-a32e71b3-683f-4214-b096-f0fb0d9842fe" acquired by "delete_volume" :: waited 0.013s {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 04:53:54 devstack cinder-volume[87444]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2e917e9-428f-42f6-9aa3-5bbbe3277a4f]: (4, 'qcow2') {{(pid=88499) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 04:53:54 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-4df28690-43c7-47d5-b59b-5e829f8097a3 tempest-CreateVolumesFromSnapshotTest-1643372015 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-a32e71b3-683f-4214-b096-f0fb0d9842fe {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:53:54 devstack sudo[105550]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-a32e71b3-683f-4214-b096-f0fb0d9842fe Jul 10 04:53:54 devstack sudo[105550]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:53:54 devstack sudo[105547]: pam_unix(sudo:session): session closed for user root Jul 10 04:53:54 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-8907dd4d-5579-4d96-a9e4-9e31cf2482be tempest-CreateVolumesFromSnapshotTest-1643372015 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097" returned: 0 in 0.802s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:53:54 devstack cinder-volume[87444]: DEBUG cinder.manager [None req-8907dd4d-5579-4d96-a9e4-9e31cf2482be tempest-CreateVolumesFromSnapshotTest-1643372015 None] Notifying Schedulers of capabilities ... {{(pid=87444) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 04:53:54 devstack cinder-volume[87444]: INFO cinder.volume.manager [None req-8907dd4d-5579-4d96-a9e4-9e31cf2482be tempest-CreateVolumesFromSnapshotTest-1643372015 None] Deleted volume successfully. Jul 10 04:53:54 devstack sudo[105546]: pam_unix(sudo:session): session closed for user root Jul 10 04:53:54 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-b7b4e127-4a75-420e-88cd-a81c8dd90f22 tempest-VolumeDependencyTests-2054620824 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-c9291bec-53ee-4b51-8bdf-8b3ea5eefacd" returned: 0 in 0.876s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:53:54 devstack cinder-volume[87444]: DEBUG cinder.utils [None req-b7b4e127-4a75-420e-88cd-a81c8dd90f22 tempest-VolumeDependencyTests-2054620824 None] Path /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-794a766c-d221-45ff-b609-b3342e00de15 not found in is_blk_device check {{(pid=87444) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 10 04:53:54 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-b7b4e127-4a75-420e-88cd-a81c8dd90f22 tempest-VolumeDependencyTests-2054620824 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-c9291bec-53ee-4b51-8bdf-8b3ea5eefacd /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-794a766c-d221-45ff-b609-b3342e00de15 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:53:54 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-8907dd4d-5579-4d96-a9e4-9e31cf2482be tempest-CreateVolumesFromSnapshotTest-1643372015 None] Lock "cinder-ef0a6ca2-a409-4a17-98fc-e039fa3405a4-delete_volume" released by "delete_volume" :: held 2.835s {{(pid=87444) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 04:53:54 devstack sudo[105556]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-c9291bec-53ee-4b51-8bdf-8b3ea5eefacd /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-794a766c-d221-45ff-b609-b3342e00de15 Jul 10 04:53:54 devstack sudo[105556]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:53:55 devstack sudo[105550]: pam_unix(sudo:session): session closed for user root Jul 10 04:53:55 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-4df28690-43c7-47d5-b59b-5e829f8097a3 tempest-CreateVolumesFromSnapshotTest-1643372015 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-a32e71b3-683f-4214-b096-f0fb0d9842fe" returned: 0 in 0.797s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:53:55 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-4df28690-43c7-47d5-b59b-5e829f8097a3 tempest-CreateVolumesFromSnapshotTest-1643372015 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-a32e71b3-683f-4214-b096-f0fb0d9842fe {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:53:55 devstack sudo[105561]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-a32e71b3-683f-4214-b096-f0fb0d9842fe Jul 10 04:53:55 devstack sudo[105561]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:53:56 devstack sudo[105561]: pam_unix(sudo:session): session closed for user root Jul 10 04:53:56 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-4df28690-43c7-47d5-b59b-5e829f8097a3 tempest-CreateVolumesFromSnapshotTest-1643372015 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-a32e71b3-683f-4214-b096-f0fb0d9842fe" returned: 0 in 1.098s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:53:56 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-4df28690-43c7-47d5-b59b-5e829f8097a3 tempest-CreateVolumesFromSnapshotTest-1643372015 None] Lock "cinder-quobyte-a32e71b3-683f-4214-b096-f0fb0d9842fe" released by "delete_volume" :: held 1.974s {{(pid=87444) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 04:53:56 devstack cinder-volume[87444]: DEBUG cinder.quota [None req-4df28690-43c7-47d5-b59b-5e829f8097a3 tempest-CreateVolumesFromSnapshotTest-1643372015 None] Created reservations ['81d8010f-6791-4eb5-bf0f-13282d3bbdad', '7d9d6777-cb69-487b-afd8-57921271d899', '4dc28e18-80f8-4839-aea8-484bb96ee5a2', '9b3c1bbb-10bf-4e2c-8c4d-72193aa49a2c'] {{(pid=87444) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 04:53:56 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-4df28690-43c7-47d5-b59b-5e829f8097a3 tempest-CreateVolumesFromSnapshotTest-1643372015 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 04:53:56 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-4df28690-43c7-47d5-b59b-5e829f8097a3 tempest-CreateVolumesFromSnapshotTest-1643372015 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 04:53:56 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-4df28690-43c7-47d5-b59b-5e829f8097a3 tempest-CreateVolumesFromSnapshotTest-1643372015 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922': None} {{(pid=87444) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 04:53:56 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-4df28690-43c7-47d5-b59b-5e829f8097a3 tempest-CreateVolumesFromSnapshotTest-1643372015 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922'] {{(pid=87444) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 04:53:56 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-4df28690-43c7-47d5-b59b-5e829f8097a3 tempest-CreateVolumesFromSnapshotTest-1643372015 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 04:53:56 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-4df28690-43c7-47d5-b59b-5e829f8097a3 tempest-CreateVolumesFromSnapshotTest-1643372015 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:53:56 devstack sudo[105575]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097 Jul 10 04:53:56 devstack sudo[105575]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:53:57 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-fd58d5e7-cf27-4a99-bffc-c62279c217c6 tempest-CreateVolumesFromSnapshotTest-1643372015 None] Acquiring lock "cinder-75d4cfca-8f6e-4d14-a79a-af38fad63479-delete_volume" by "delete_volume" {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 04:53:57 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-fd58d5e7-cf27-4a99-bffc-c62279c217c6 tempest-CreateVolumesFromSnapshotTest-1643372015 None] Lock "cinder-75d4cfca-8f6e-4d14-a79a-af38fad63479-delete_volume" acquired by "delete_volume" :: waited 0.044s {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 04:53:57 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-fd58d5e7-cf27-4a99-bffc-c62279c217c6 tempest-CreateVolumesFromSnapshotTest-1643372015 None] Acquiring lock "cinder-quobyte-75d4cfca-8f6e-4d14-a79a-af38fad63479" by "delete_volume" {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 04:53:57 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-fd58d5e7-cf27-4a99-bffc-c62279c217c6 tempest-CreateVolumesFromSnapshotTest-1643372015 None] Lock "cinder-quobyte-75d4cfca-8f6e-4d14-a79a-af38fad63479" acquired by "delete_volume" :: waited 0.030s {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 04:53:57 devstack cinder-volume[87444]: DEBUG oslo.privsep.daemon [-] privsep: reply[79fa9262-ff85-4670-8d1f-f8b0c26e1c50]: (4, 'qcow2') {{(pid=88499) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 04:53:57 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-fd58d5e7-cf27-4a99-bffc-c62279c217c6 tempest-CreateVolumesFromSnapshotTest-1643372015 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-75d4cfca-8f6e-4d14-a79a-af38fad63479 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:53:58 devstack sudo[105575]: pam_unix(sudo:session): session closed for user root Jul 10 04:53:58 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-4df28690-43c7-47d5-b59b-5e829f8097a3 tempest-CreateVolumesFromSnapshotTest-1643372015 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097" returned: 0 in 1.410s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:53:58 devstack cinder-volume[87444]: DEBUG cinder.manager [None req-4df28690-43c7-47d5-b59b-5e829f8097a3 tempest-CreateVolumesFromSnapshotTest-1643372015 None] Notifying Schedulers of capabilities ... {{(pid=87444) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 04:53:58 devstack sudo[105578]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-75d4cfca-8f6e-4d14-a79a-af38fad63479 Jul 10 04:53:58 devstack sudo[105578]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:53:58 devstack cinder-volume[87444]: INFO cinder.volume.manager [None req-4df28690-43c7-47d5-b59b-5e829f8097a3 tempest-CreateVolumesFromSnapshotTest-1643372015 None] Deleted volume successfully. Jul 10 04:53:58 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-4df28690-43c7-47d5-b59b-5e829f8097a3 tempest-CreateVolumesFromSnapshotTest-1643372015 None] Lock "cinder-a32e71b3-683f-4214-b096-f0fb0d9842fe-delete_volume" released by "delete_volume" :: held 3.754s {{(pid=87444) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 04:53:59 devstack sudo[105578]: pam_unix(sudo:session): session closed for user root Jul 10 04:53:59 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-fd58d5e7-cf27-4a99-bffc-c62279c217c6 tempest-CreateVolumesFromSnapshotTest-1643372015 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-75d4cfca-8f6e-4d14-a79a-af38fad63479" returned: 0 in 1.155s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:53:59 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-fd58d5e7-cf27-4a99-bffc-c62279c217c6 tempest-CreateVolumesFromSnapshotTest-1643372015 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-75d4cfca-8f6e-4d14-a79a-af38fad63479 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:53:59 devstack sudo[105584]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-75d4cfca-8f6e-4d14-a79a-af38fad63479 Jul 10 04:53:59 devstack sudo[105584]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:54:00 devstack sudo[105584]: pam_unix(sudo:session): session closed for user root Jul 10 04:54:00 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-fd58d5e7-cf27-4a99-bffc-c62279c217c6 tempest-CreateVolumesFromSnapshotTest-1643372015 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-75d4cfca-8f6e-4d14-a79a-af38fad63479" returned: 0 in 1.143s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:54:00 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-fd58d5e7-cf27-4a99-bffc-c62279c217c6 tempest-CreateVolumesFromSnapshotTest-1643372015 None] Lock "cinder-quobyte-75d4cfca-8f6e-4d14-a79a-af38fad63479" released by "delete_volume" :: held 2.362s {{(pid=87444) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 04:54:00 devstack cinder-volume[87444]: DEBUG dbcounter [-] [87444] Writing DB stats cinder:UPDATE=200,cinder:SELECT=134,cinder:INSERT=56,cinder:DELETE=22 {{(pid=87444) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 10 04:54:00 devstack cinder-volume[87444]: DEBUG dbcounter [-] [87444] Writing DB stats cinder:SELECT=147,cinder:UPDATE=190,cinder:DELETE=16,cinder:INSERT=41 {{(pid=87444) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 10 04:54:00 devstack cinder-volume[87444]: DEBUG cinder.quota [None req-fd58d5e7-cf27-4a99-bffc-c62279c217c6 tempest-CreateVolumesFromSnapshotTest-1643372015 None] Created reservations ['fac92d04-d2e3-4944-a103-0430c2afa7db', 'b1273336-c224-4b17-845a-99d5c26d9014', 'c838e7a1-49f0-4452-8be0-b1a5c4e3af93', '96ac8562-db83-4762-81b3-bc896a465c52'] {{(pid=87444) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 04:54:00 devstack sudo[105556]: pam_unix(sudo:session): session closed for user root Jul 10 04:54:00 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-b7b4e127-4a75-420e-88cd-a81c8dd90f22 tempest-VolumeDependencyTests-2054620824 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-c9291bec-53ee-4b51-8bdf-8b3ea5eefacd /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-794a766c-d221-45ff-b609-b3342e00de15" returned: 0 in 5.428s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:54:00 devstack cinder-volume[87444]: DEBUG oslo.privsep.daemon [-] privsep: reply[03befc67-568b-4afb-8181-e286a03c89fe]: (4, 'qcow2') {{(pid=88499) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 04:54:00 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-b7b4e127-4a75-420e-88cd-a81c8dd90f22 tempest-VolumeDependencyTests-2054620824 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-c9291bec-53ee-4b51-8bdf-8b3ea5eefacd {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:54:00 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-fd58d5e7-cf27-4a99-bffc-c62279c217c6 tempest-CreateVolumesFromSnapshotTest-1643372015 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 04:54:00 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-fd58d5e7-cf27-4a99-bffc-c62279c217c6 tempest-CreateVolumesFromSnapshotTest-1643372015 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 04:54:00 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-fd58d5e7-cf27-4a99-bffc-c62279c217c6 tempest-CreateVolumesFromSnapshotTest-1643372015 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922': None} {{(pid=87444) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 04:54:00 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-fd58d5e7-cf27-4a99-bffc-c62279c217c6 tempest-CreateVolumesFromSnapshotTest-1643372015 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922'] {{(pid=87444) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 04:54:00 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-fd58d5e7-cf27-4a99-bffc-c62279c217c6 tempest-CreateVolumesFromSnapshotTest-1643372015 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 04:54:00 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-fd58d5e7-cf27-4a99-bffc-c62279c217c6 tempest-CreateVolumesFromSnapshotTest-1643372015 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:54:00 devstack sudo[105589]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097 Jul 10 04:54:00 devstack sudo[105589]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:54:00 devstack sudo[105588]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-c9291bec-53ee-4b51-8bdf-8b3ea5eefacd Jul 10 04:54:00 devstack sudo[105588]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:54:01 devstack sudo[105589]: pam_unix(sudo:session): session closed for user root Jul 10 04:54:01 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-fd58d5e7-cf27-4a99-bffc-c62279c217c6 tempest-CreateVolumesFromSnapshotTest-1643372015 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097" returned: 0 in 0.631s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:54:01 devstack cinder-volume[87444]: DEBUG cinder.manager [None req-fd58d5e7-cf27-4a99-bffc-c62279c217c6 tempest-CreateVolumesFromSnapshotTest-1643372015 None] Notifying Schedulers of capabilities ... {{(pid=87444) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 04:54:01 devstack cinder-volume[87444]: INFO cinder.volume.manager [None req-fd58d5e7-cf27-4a99-bffc-c62279c217c6 tempest-CreateVolumesFromSnapshotTest-1643372015 None] Deleted volume successfully. Jul 10 04:54:01 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-fd58d5e7-cf27-4a99-bffc-c62279c217c6 tempest-CreateVolumesFromSnapshotTest-1643372015 None] Lock "cinder-75d4cfca-8f6e-4d14-a79a-af38fad63479-delete_volume" released by "delete_volume" :: held 3.274s {{(pid=87444) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 04:54:01 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-4fc92d34-87b0-41d9-a59c-e9411fec083f tempest-CreateVolumesFromSnapshotTest-1643372015 None] Acquiring lock "cinder-b77fe7ba-a1f2-4180-9db0-1010d17e6a32-delete_snapshot" by "delete_snapshot" {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 04:54:01 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-4fc92d34-87b0-41d9-a59c-e9411fec083f tempest-CreateVolumesFromSnapshotTest-1643372015 None] Lock "cinder-b77fe7ba-a1f2-4180-9db0-1010d17e6a32-delete_snapshot" acquired by "delete_snapshot" :: waited 0.017s {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 04:54:01 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-4fc92d34-87b0-41d9-a59c-e9411fec083f tempest-CreateVolumesFromSnapshotTest-1643372015 None] Acquiring lock "cinder-quobyte-6a52692c-d463-4776-aa0a-2fdfb275e2ef" by "delete_snapshot" {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 04:54:01 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-4fc92d34-87b0-41d9-a59c-e9411fec083f tempest-CreateVolumesFromSnapshotTest-1643372015 None] Lock "cinder-quobyte-6a52692c-d463-4776-aa0a-2fdfb275e2ef" acquired by "delete_snapshot" :: waited 0.016s {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 04:54:01 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-4fc92d34-87b0-41d9-a59c-e9411fec083f tempest-CreateVolumesFromSnapshotTest-1643372015 None] Acquiring lock "cinder-quobyte-b77fe7ba-a1f2-4180-9db0-1010d17e6a32" by "_delete_snapshot" {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 04:54:01 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-4fc92d34-87b0-41d9-a59c-e9411fec083f tempest-CreateVolumesFromSnapshotTest-1643372015 None] Lock "cinder-quobyte-b77fe7ba-a1f2-4180-9db0-1010d17e6a32" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 04:54:01 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.remotefs [None req-4fc92d34-87b0-41d9-a59c-e9411fec083f tempest-CreateVolumesFromSnapshotTest-1643372015 None] Deleting offline snapshot b77fe7ba-a1f2-4180-9db0-1010d17e6a32 of volume 6a52692c-d463-4776-aa0a-2fdfb275e2ef {{(pid=87444) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 10 04:54:01 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.remotefs [None req-4fc92d34-87b0-41d9-a59c-e9411fec083f tempest-CreateVolumesFromSnapshotTest-1643372015 None] snapshot_file for this snap is: volume-6a52692c-d463-4776-aa0a-2fdfb275e2ef.b77fe7ba-a1f2-4180-9db0-1010d17e6a32 {{(pid=87444) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 10 04:54:01 devstack cinder-volume[87444]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1dce885-00d9-42a9-b209-7863500c269a]: (4, 'qcow2') {{(pid=88499) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 04:54:01 devstack sudo[105588]: pam_unix(sudo:session): session closed for user root Jul 10 04:54:01 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-4fc92d34-87b0-41d9-a59c-e9411fec083f tempest-CreateVolumesFromSnapshotTest-1643372015 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-6a52692c-d463-4776-aa0a-2fdfb275e2ef.b77fe7ba-a1f2-4180-9db0-1010d17e6a32 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:54:01 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-b7b4e127-4a75-420e-88cd-a81c8dd90f22 tempest-VolumeDependencyTests-2054620824 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-c9291bec-53ee-4b51-8bdf-8b3ea5eefacd" returned: 0 in 0.970s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:54:01 devstack cinder-volume[87444]: DEBUG cinder.image.image_utils [None req-b7b4e127-4a75-420e-88cd-a81c8dd90f22 tempest-VolumeDependencyTests-2054620824 None] Image conversion details: src /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-c9291bec-53ee-4b51-8bdf-8b3ea5eefacd, size 1024.00 MB, duration 5.43 sec, destination /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-794a766c-d221-45ff-b609-b3342e00de15 {{(pid=87444) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:561}} Jul 10 04:54:01 devstack cinder-volume[87444]: INFO cinder.image.image_utils [None req-b7b4e127-4a75-420e-88cd-a81c8dd90f22 tempest-VolumeDependencyTests-2054620824 None] Converted 1024.00 MB image at 188.54 MB/s Jul 10 04:54:01 devstack cinder-volume[87444]: WARNING cinder.volume.drivers.remotefs [None req-b7b4e127-4a75-420e-88cd-a81c8dd90f22 tempest-VolumeDependencyTests-2054620824 None] /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-794a766c-d221-45ff-b609-b3342e00de15 is being set with open permissions: ugo+rw Jul 10 04:54:01 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-b7b4e127-4a75-420e-88cd-a81c8dd90f22 tempest-VolumeDependencyTests-2054620824 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-794a766c-d221-45ff-b609-b3342e00de15 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:54:01 devstack sudo[105597]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-794a766c-d221-45ff-b609-b3342e00de15 Jul 10 04:54:01 devstack sudo[105597]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:54:01 devstack sudo[105596]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-6a52692c-d463-4776-aa0a-2fdfb275e2ef.b77fe7ba-a1f2-4180-9db0-1010d17e6a32 Jul 10 04:54:01 devstack sudo[105596]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:54:01 devstack sudo[105597]: pam_unix(sudo:session): session closed for user root Jul 10 04:54:01 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-b7b4e127-4a75-420e-88cd-a81c8dd90f22 tempest-VolumeDependencyTests-2054620824 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-794a766c-d221-45ff-b609-b3342e00de15" returned: 0 in 0.666s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:54:01 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-b7b4e127-4a75-420e-88cd-a81c8dd90f22 tempest-VolumeDependencyTests-2054620824 None] Lock "cinder-quobyte-794a766c-d221-45ff-b609-b3342e00de15" released by "_copy_volume_from_snapshot" :: held 8.879s {{(pid=87444) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 04:54:02 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-b7b4e127-4a75-420e-88cd-a81c8dd90f22 tempest-VolumeDependencyTests-2054620824 None] Lock "cinder-quobyte-92218a8a-04cf-41f9-b1ab-85508b375c69-794a766c-d221-45ff-b609-b3342e00de15" released by "_create_volume_from_snapshot" :: held 8.923s {{(pid=87444) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 04:54:02 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-b7b4e127-4a75-420e-88cd-a81c8dd90f22 tempest-VolumeDependencyTests-2054620824 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 8.956s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 04:54:02 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-b8e92057-a062-4fd6-a681-5107d912f569 tempest-VolumeImageDependencyTests-2146091144 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 8.736s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 04:54:02 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-b8e92057-a062-4fd6-a681-5107d912f569 tempest-VolumeImageDependencyTests-2146091144 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T02:53:49Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fdbeaa65-057f-49d9-8c6a-836a39956e47,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c3a161ac220741e4a10764dea998083c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T02:53:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T02:53:49Z,use_quota=True,user_id='71f947d3bb634ad5a35d00d3321ae508',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(317e369e-1e06-434d-ae95-a335f0e6c903),volume_type_id=317e369e-1e06-434d-ae95-a335f0e6c903)}" {{(pid=87444) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 04:54:02 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.remotefs [None req-b8e92057-a062-4fd6-a681-5107d912f569 tempest-VolumeImageDependencyTests-2146091144 None] Creating volume fdbeaa65-057f-49d9-8c6a-836a39956e47 {{(pid=87444) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 04:54:02 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-b8e92057-a062-4fd6-a681-5107d912f569 tempest-VolumeImageDependencyTests-2146091144 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 04:54:02 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-b8e92057-a062-4fd6-a681-5107d912f569 tempest-VolumeImageDependencyTests-2146091144 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 04:54:02 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-b8e92057-a062-4fd6-a681-5107d912f569 tempest-VolumeImageDependencyTests-2146091144 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922': None} {{(pid=87444) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 04:54:02 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-b8e92057-a062-4fd6-a681-5107d912f569 tempest-VolumeImageDependencyTests-2146091144 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922'] {{(pid=87444) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 04:54:02 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-b8e92057-a062-4fd6-a681-5107d912f569 tempest-VolumeImageDependencyTests-2146091144 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 04:54:02 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-b8e92057-a062-4fd6-a681-5107d912f569 tempest-VolumeImageDependencyTests-2146091144 None] Selected osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922 as target Quobyte volume. {{(pid=87444) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 04:54:02 devstack cinder-volume[87444]: INFO cinder.volume.drivers.remotefs [None req-b8e92057-a062-4fd6-a681-5107d912f569 tempest-VolumeImageDependencyTests-2146091144 None] casted to osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922 Jul 10 04:54:02 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-b8e92057-a062-4fd6-a681-5107d912f569 tempest-VolumeImageDependencyTests-2146091144 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-fdbeaa65-057f-49d9-8c6a-836a39956e47 1073741824 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:54:02 devstack sudo[105604]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-fdbeaa65-057f-49d9-8c6a-836a39956e47 1073741824 Jul 10 04:54:02 devstack sudo[105604]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:54:02 devstack sudo[105596]: pam_unix(sudo:session): session closed for user root Jul 10 04:54:02 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-b7b4e127-4a75-420e-88cd-a81c8dd90f22 tempest-VolumeDependencyTests-2054620824 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (67621b1a-434e-4627-baf7-7999d677f237) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-794a766c-d221-45ff-b609-b3342e00de15', 'volume_size': 1, 'snapshot_id': '92218a8a-04cf-41f9-b1ab-85508b375c69'}' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:54:02 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-b7b4e127-4a75-420e-88cd-a81c8dd90f22 tempest-VolumeDependencyTests-2054620824 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (72ceb727-a48a-4620-9193-4e6230405543) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:54:02 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-4fc92d34-87b0-41d9-a59c-e9411fec083f tempest-CreateVolumesFromSnapshotTest-1643372015 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-6a52692c-d463-4776-aa0a-2fdfb275e2ef.b77fe7ba-a1f2-4180-9db0-1010d17e6a32" returned: 0 in 0.774s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:54:02 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.remotefs [None req-4fc92d34-87b0-41d9-a59c-e9411fec083f tempest-CreateVolumesFromSnapshotTest-1643372015 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6a52692c-d463-4776-aa0a-2fdfb275e2ef(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87444) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 10 04:54:02 devstack cinder-volume[87444]: INFO cinder.volume.flows.manager.create_volume [None req-b7b4e127-4a75-420e-88cd-a81c8dd90f22 tempest-VolumeDependencyTests-2054620824 None] Volume volume-794a766c-d221-45ff-b609-b3342e00de15 (794a766c-d221-45ff-b609-b3342e00de15): created successfully Jul 10 04:54:02 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-b7b4e127-4a75-420e-88cd-a81c8dd90f22 tempest-VolumeDependencyTests-2054620824 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (72ceb727-a48a-4620-9193-4e6230405543) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:54:02 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-b7b4e127-4a75-420e-88cd-a81c8dd90f22 tempest-VolumeDependencyTests-2054620824 None] Flow 'volume_create_manager' (ef3e8077-ab51-4af1-9dbe-1c83b0b69422) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87444) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 04:54:02 devstack cinder-volume[87444]: DEBUG oslo.privsep.daemon [-] privsep: reply[01daaed4-9143-4334-a9c3-adfe1c338518]: (4, 'qcow2') {{(pid=88499) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 04:54:02 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-4fc92d34-87b0-41d9-a59c-e9411fec083f tempest-CreateVolumesFromSnapshotTest-1643372015 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-6a52692c-d463-4776-aa0a-2fdfb275e2ef {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:54:02 devstack cinder-volume[87444]: INFO cinder.volume.manager [None req-b7b4e127-4a75-420e-88cd-a81c8dd90f22 tempest-VolumeDependencyTests-2054620824 None] Created volume successfully. Jul 10 04:54:02 devstack sudo[105606]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-6a52692c-d463-4776-aa0a-2fdfb275e2ef Jul 10 04:54:02 devstack sudo[105606]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:54:02 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-72bf1d03-4bcd-4163-bbf2-33a1e8a710a0 tempest-VolumeDependencyTests-2054620824 None] Acquiring lock "cinder-92218a8a-04cf-41f9-b1ab-85508b375c69-delete_snapshot" by "delete_snapshot" {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 04:54:02 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-72bf1d03-4bcd-4163-bbf2-33a1e8a710a0 tempest-VolumeDependencyTests-2054620824 None] Lock "cinder-92218a8a-04cf-41f9-b1ab-85508b375c69-delete_snapshot" acquired by "delete_snapshot" :: waited 0.016s {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 04:54:02 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-72bf1d03-4bcd-4163-bbf2-33a1e8a710a0 tempest-VolumeDependencyTests-2054620824 None] Acquiring lock "cinder-quobyte-c9291bec-53ee-4b51-8bdf-8b3ea5eefacd" by "delete_snapshot" {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 04:54:02 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-72bf1d03-4bcd-4163-bbf2-33a1e8a710a0 tempest-VolumeDependencyTests-2054620824 None] Lock "cinder-quobyte-c9291bec-53ee-4b51-8bdf-8b3ea5eefacd" acquired by "delete_snapshot" :: waited 0.014s {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 04:54:02 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-72bf1d03-4bcd-4163-bbf2-33a1e8a710a0 tempest-VolumeDependencyTests-2054620824 None] Acquiring lock "cinder-quobyte-92218a8a-04cf-41f9-b1ab-85508b375c69" by "_delete_snapshot" {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 04:54:02 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-72bf1d03-4bcd-4163-bbf2-33a1e8a710a0 tempest-VolumeDependencyTests-2054620824 None] Lock "cinder-quobyte-92218a8a-04cf-41f9-b1ab-85508b375c69" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 04:54:02 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.remotefs [None req-72bf1d03-4bcd-4163-bbf2-33a1e8a710a0 tempest-VolumeDependencyTests-2054620824 None] Deleting offline snapshot 92218a8a-04cf-41f9-b1ab-85508b375c69 of volume c9291bec-53ee-4b51-8bdf-8b3ea5eefacd {{(pid=87444) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 10 04:54:02 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.remotefs [None req-72bf1d03-4bcd-4163-bbf2-33a1e8a710a0 tempest-VolumeDependencyTests-2054620824 None] snapshot_file for this snap is: volume-c9291bec-53ee-4b51-8bdf-8b3ea5eefacd.92218a8a-04cf-41f9-b1ab-85508b375c69 {{(pid=87444) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 10 04:54:02 devstack cinder-volume[87444]: DEBUG oslo.privsep.daemon [-] privsep: reply[f451fc94-1e73-4432-ba09-57d95d91de98]: (4, 'qcow2') {{(pid=88499) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 04:54:02 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-72bf1d03-4bcd-4163-bbf2-33a1e8a710a0 tempest-VolumeDependencyTests-2054620824 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-c9291bec-53ee-4b51-8bdf-8b3ea5eefacd.92218a8a-04cf-41f9-b1ab-85508b375c69 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:54:02 devstack sudo[105604]: pam_unix(sudo:session): session closed for user root Jul 10 04:54:02 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-b8e92057-a062-4fd6-a681-5107d912f569 tempest-VolumeImageDependencyTests-2146091144 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-fdbeaa65-057f-49d9-8c6a-836a39956e47 1073741824" returned: 0 in 0.895s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:54:02 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-b8e92057-a062-4fd6-a681-5107d912f569 tempest-VolumeImageDependencyTests-2146091144 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-fdbeaa65-057f-49d9-8c6a-836a39956e47 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:54:02 devstack sudo[105606]: pam_unix(sudo:session): session closed for user root Jul 10 04:54:02 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-4fc92d34-87b0-41d9-a59c-e9411fec083f tempest-CreateVolumesFromSnapshotTest-1643372015 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-6a52692c-d463-4776-aa0a-2fdfb275e2ef" returned: 0 in 0.844s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:54:02 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-4fc92d34-87b0-41d9-a59c-e9411fec083f tempest-CreateVolumesFromSnapshotTest-1643372015 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-6a52692c-d463-4776-aa0a-2fdfb275e2ef.b77fe7ba-a1f2-4180-9db0-1010d17e6a32 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:54:02 devstack sudo[105618]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-fdbeaa65-057f-49d9-8c6a-836a39956e47 Jul 10 04:54:02 devstack sudo[105618]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:54:02 devstack sudo[105619]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-6a52692c-d463-4776-aa0a-2fdfb275e2ef.b77fe7ba-a1f2-4180-9db0-1010d17e6a32 Jul 10 04:54:02 devstack sudo[105619]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:54:02 devstack sudo[105617]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-c9291bec-53ee-4b51-8bdf-8b3ea5eefacd.92218a8a-04cf-41f9-b1ab-85508b375c69 Jul 10 04:54:02 devstack sudo[105617]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:54:03 devstack sudo[105618]: pam_unix(sudo:session): session closed for user root Jul 10 04:54:03 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-b8e92057-a062-4fd6-a681-5107d912f569 tempest-VolumeImageDependencyTests-2146091144 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-fdbeaa65-057f-49d9-8c6a-836a39956e47" returned: 0 in 0.658s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:54:03 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-b8e92057-a062-4fd6-a681-5107d912f569 tempest-VolumeImageDependencyTests-2146091144 None] <== create_volume: return (1595ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922'} {{(pid=87444) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 04:54:03 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-b8e92057-a062-4fd6-a681-5107d912f569 tempest-VolumeImageDependencyTests-2146091144 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.599s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 04:54:03 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-3cba9d21-8e8f-46aa-91ef-e5d18446807a tempest-CinderUnicodeTest-973446373 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 9.271s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 04:54:03 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-3cba9d21-8e8f-46aa-91ef-e5d18446807a tempest-CinderUnicodeTest-973446373 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T02:53:54Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1330564285',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c3059c57-3952-4b3b-a43f-88ab14f29952,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8d7f6fd0a13d429c87a6594f91c7475d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T02:53:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T02:53:54Z,use_quota=True,user_id='9271ef5b15fa4893a4aaff48d719045d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(317e369e-1e06-434d-ae95-a335f0e6c903),volume_type_id=317e369e-1e06-434d-ae95-a335f0e6c903)}" {{(pid=87444) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 04:54:03 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.remotefs [None req-3cba9d21-8e8f-46aa-91ef-e5d18446807a tempest-CinderUnicodeTest-973446373 None] Creating volume c3059c57-3952-4b3b-a43f-88ab14f29952 {{(pid=87444) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 04:54:03 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-3cba9d21-8e8f-46aa-91ef-e5d18446807a tempest-CinderUnicodeTest-973446373 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 04:54:03 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-3cba9d21-8e8f-46aa-91ef-e5d18446807a tempest-CinderUnicodeTest-973446373 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 04:54:03 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-3cba9d21-8e8f-46aa-91ef-e5d18446807a tempest-CinderUnicodeTest-973446373 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922': None} {{(pid=87444) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 04:54:03 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-3cba9d21-8e8f-46aa-91ef-e5d18446807a tempest-CinderUnicodeTest-973446373 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922'] {{(pid=87444) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 04:54:03 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-3cba9d21-8e8f-46aa-91ef-e5d18446807a tempest-CinderUnicodeTest-973446373 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 04:54:03 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-3cba9d21-8e8f-46aa-91ef-e5d18446807a tempest-CinderUnicodeTest-973446373 None] Selected osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922 as target Quobyte volume. {{(pid=87444) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 04:54:03 devstack cinder-volume[87444]: INFO cinder.volume.drivers.remotefs [None req-3cba9d21-8e8f-46aa-91ef-e5d18446807a tempest-CinderUnicodeTest-973446373 None] casted to osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922 Jul 10 04:54:03 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-3cba9d21-8e8f-46aa-91ef-e5d18446807a tempest-CinderUnicodeTest-973446373 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-c3059c57-3952-4b3b-a43f-88ab14f29952 1073741824 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:54:03 devstack sudo[105631]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-c3059c57-3952-4b3b-a43f-88ab14f29952 1073741824 Jul 10 04:54:03 devstack sudo[105631]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:54:03 devstack cinder-volume[87444]: DEBUG cinder.volume.volume_utils [None req-b8e92057-a062-4fd6-a681-5107d912f569 tempest-VolumeImageDependencyTests-2146091144 None] Attempting download of d2551751-8a61-40ac-88de-2f8910f6fc78 ((None, [{'url': 'file:///opt/stack/data/glance/images/d2551751-8a61-40ac-88de-2f8910f6fc78', 'metadata': {}}])) to volume fdbeaa65-057f-49d9-8c6a-836a39956e47. {{(pid=87444) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jul 10 04:54:03 devstack sudo[105617]: pam_unix(sudo:session): session closed for user root Jul 10 04:54:03 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-72bf1d03-4bcd-4163-bbf2-33a1e8a710a0 tempest-VolumeDependencyTests-2054620824 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-c9291bec-53ee-4b51-8bdf-8b3ea5eefacd.92218a8a-04cf-41f9-b1ab-85508b375c69" returned: 0 in 0.828s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:54:03 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.remotefs [None req-72bf1d03-4bcd-4163-bbf2-33a1e8a710a0 tempest-VolumeDependencyTests-2054620824 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c9291bec-53ee-4b51-8bdf-8b3ea5eefacd(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87444) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 10 04:54:03 devstack cinder-volume[87444]: DEBUG oslo.privsep.daemon [-] privsep: reply[6fc46257-58f2-4631-b907-75e39b1d6263]: (4, 'qcow2') {{(pid=88499) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 04:54:03 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-72bf1d03-4bcd-4163-bbf2-33a1e8a710a0 tempest-VolumeDependencyTests-2054620824 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-c9291bec-53ee-4b51-8bdf-8b3ea5eefacd {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:54:03 devstack cinder-volume[87444]: DEBUG oslo.privsep.daemon [-] privsep: reply[071ea547-9613-45c3-80f0-2d1655a1ead0]: (4, 'raw') {{(pid=88499) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 04:54:03 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-b8e92057-a062-4fd6-a681-5107d912f569 tempest-VolumeImageDependencyTests-2146091144 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_d2551751-8a61-40ac-88de-2f8910f6fc78_ovtdh4n2 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:54:03 devstack sudo[105619]: pam_unix(sudo:session): session closed for user root Jul 10 04:54:03 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-4fc92d34-87b0-41d9-a59c-e9411fec083f tempest-CreateVolumesFromSnapshotTest-1643372015 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-6a52692c-d463-4776-aa0a-2fdfb275e2ef.b77fe7ba-a1f2-4180-9db0-1010d17e6a32" returned: 0 in 0.802s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:54:03 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-4fc92d34-87b0-41d9-a59c-e9411fec083f tempest-CreateVolumesFromSnapshotTest-1643372015 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-6a52692c-d463-4776-aa0a-2fdfb275e2ef.b77fe7ba-a1f2-4180-9db0-1010d17e6a32 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:54:03 devstack sudo[105635]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-6a52692c-d463-4776-aa0a-2fdfb275e2ef.b77fe7ba-a1f2-4180-9db0-1010d17e6a32 Jul 10 04:54:03 devstack sudo[105635]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:54:03 devstack sudo[105633]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-c9291bec-53ee-4b51-8bdf-8b3ea5eefacd Jul 10 04:54:03 devstack sudo[105633]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:54:03 devstack sudo[105634]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_d2551751-8a61-40ac-88de-2f8910f6fc78_ovtdh4n2 Jul 10 04:54:03 devstack sudo[105634]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:54:04 devstack sudo[105631]: pam_unix(sudo:session): session closed for user root Jul 10 04:54:04 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-3cba9d21-8e8f-46aa-91ef-e5d18446807a tempest-CinderUnicodeTest-973446373 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-c3059c57-3952-4b3b-a43f-88ab14f29952 1073741824" returned: 0 in 0.931s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:54:04 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-3cba9d21-8e8f-46aa-91ef-e5d18446807a tempest-CinderUnicodeTest-973446373 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-c3059c57-3952-4b3b-a43f-88ab14f29952 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:54:04 devstack sudo[105635]: pam_unix(sudo:session): session closed for user root Jul 10 04:54:04 devstack sudo[105634]: pam_unix(sudo:session): session closed for user root Jul 10 04:54:04 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-b8e92057-a062-4fd6-a681-5107d912f569 tempest-VolumeImageDependencyTests-2146091144 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_d2551751-8a61-40ac-88de-2f8910f6fc78_ovtdh4n2" returned: 0 in 0.856s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:54:04 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-4fc92d34-87b0-41d9-a59c-e9411fec083f tempest-CreateVolumesFromSnapshotTest-1643372015 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-6a52692c-d463-4776-aa0a-2fdfb275e2ef.b77fe7ba-a1f2-4180-9db0-1010d17e6a32" returned: 0 in 0.842s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:54:04 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-b8e92057-a062-4fd6-a681-5107d912f569 tempest-VolumeImageDependencyTests-2146091144 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_d2551751-8a61-40ac-88de-2f8910f6fc78_ovtdh4n2 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:54:04 devstack sudo[105633]: pam_unix(sudo:session): session closed for user root Jul 10 04:54:04 devstack sudo[105649]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-c3059c57-3952-4b3b-a43f-88ab14f29952 Jul 10 04:54:04 devstack sudo[105649]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:54:04 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-72bf1d03-4bcd-4163-bbf2-33a1e8a710a0 tempest-VolumeDependencyTests-2054620824 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-c9291bec-53ee-4b51-8bdf-8b3ea5eefacd" returned: 0 in 0.903s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:54:04 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-72bf1d03-4bcd-4163-bbf2-33a1e8a710a0 tempest-VolumeDependencyTests-2054620824 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-c9291bec-53ee-4b51-8bdf-8b3ea5eefacd.92218a8a-04cf-41f9-b1ab-85508b375c69 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:54:04 devstack sudo[105652]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-c9291bec-53ee-4b51-8bdf-8b3ea5eefacd.92218a8a-04cf-41f9-b1ab-85508b375c69 Jul 10 04:54:04 devstack sudo[105652]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:54:04 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-4fc92d34-87b0-41d9-a59c-e9411fec083f tempest-CreateVolumesFromSnapshotTest-1643372015 None] Lock "cinder-quobyte-b77fe7ba-a1f2-4180-9db0-1010d17e6a32" released by "_delete_snapshot" :: held 3.420s {{(pid=87444) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 04:54:04 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-4fc92d34-87b0-41d9-a59c-e9411fec083f tempest-CreateVolumesFromSnapshotTest-1643372015 None] Lock "cinder-quobyte-6a52692c-d463-4776-aa0a-2fdfb275e2ef" released by "delete_snapshot" :: held 3.450s {{(pid=87444) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 04:54:04 devstack sudo[105650]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_d2551751-8a61-40ac-88de-2f8910f6fc78_ovtdh4n2 Jul 10 04:54:04 devstack sudo[105650]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:54:04 devstack cinder-volume[87444]: DEBUG cinder.quota [None req-4fc92d34-87b0-41d9-a59c-e9411fec083f tempest-CreateVolumesFromSnapshotTest-1643372015 None] Created reservations ['1979d2a0-4753-4557-9fa8-d3750df1b344', '16edfd87-e8bd-4bb5-b2ae-f1d73bfd4e66', '5d9f5c70-abc8-40f7-a78a-99b82e66c69a', '5461b29e-18bd-4051-a232-49e258238482'] {{(pid=87444) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 04:54:04 devstack cinder-volume[87444]: INFO cinder.volume.manager [None req-4fc92d34-87b0-41d9-a59c-e9411fec083f tempest-CreateVolumesFromSnapshotTest-1643372015 None] Delete snapshot completed successfully. Jul 10 04:54:04 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-4fc92d34-87b0-41d9-a59c-e9411fec083f tempest-CreateVolumesFromSnapshotTest-1643372015 None] Lock "cinder-b77fe7ba-a1f2-4180-9db0-1010d17e6a32-delete_snapshot" released by "delete_snapshot" :: held 3.613s {{(pid=87444) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 04:54:05 devstack sudo[105649]: pam_unix(sudo:session): session closed for user root Jul 10 04:54:05 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-3cba9d21-8e8f-46aa-91ef-e5d18446807a tempest-CinderUnicodeTest-973446373 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-c3059c57-3952-4b3b-a43f-88ab14f29952" returned: 0 in 0.725s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:54:05 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-3cba9d21-8e8f-46aa-91ef-e5d18446807a tempest-CinderUnicodeTest-973446373 None] <== create_volume: return (1700ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922'} {{(pid=87444) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 04:54:05 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-3cba9d21-8e8f-46aa-91ef-e5d18446807a tempest-CinderUnicodeTest-973446373 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.704s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 04:54:05 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-3cba9d21-8e8f-46aa-91ef-e5d18446807a tempest-CinderUnicodeTest-973446373 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (96f6c8b5-b9dd-4d67-8cfb-3b62f644a960) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c3059c57-3952-4b3b-a43f-88ab14f29952', 'volume_size': 1}' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:54:05 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-3cba9d21-8e8f-46aa-91ef-e5d18446807a tempest-CinderUnicodeTest-973446373 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1fab1f4b-b523-430b-a6f0-dd7f295a30bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:54:05 devstack cinder-volume[87444]: INFO cinder.volume.flows.manager.create_volume [None req-3cba9d21-8e8f-46aa-91ef-e5d18446807a tempest-CinderUnicodeTest-973446373 None] Volume volume-c3059c57-3952-4b3b-a43f-88ab14f29952 (c3059c57-3952-4b3b-a43f-88ab14f29952): created successfully Jul 10 04:54:05 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-3cba9d21-8e8f-46aa-91ef-e5d18446807a tempest-CinderUnicodeTest-973446373 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1fab1f4b-b523-430b-a6f0-dd7f295a30bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:54:05 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-3cba9d21-8e8f-46aa-91ef-e5d18446807a tempest-CinderUnicodeTest-973446373 None] Flow 'volume_create_manager' (775d4e12-41ad-410c-bfc3-f2e9d6ef8c18) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87444) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 04:54:05 devstack sudo[105652]: pam_unix(sudo:session): session closed for user root Jul 10 04:54:05 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-72bf1d03-4bcd-4163-bbf2-33a1e8a710a0 tempest-VolumeDependencyTests-2054620824 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-c9291bec-53ee-4b51-8bdf-8b3ea5eefacd.92218a8a-04cf-41f9-b1ab-85508b375c69" returned: 0 in 0.746s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:54:05 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-72bf1d03-4bcd-4163-bbf2-33a1e8a710a0 tempest-VolumeDependencyTests-2054620824 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-c9291bec-53ee-4b51-8bdf-8b3ea5eefacd.92218a8a-04cf-41f9-b1ab-85508b375c69 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:54:05 devstack cinder-volume[87444]: INFO cinder.volume.manager [None req-3cba9d21-8e8f-46aa-91ef-e5d18446807a tempest-CinderUnicodeTest-973446373 None] Created volume successfully. Jul 10 04:54:05 devstack sudo[105650]: pam_unix(sudo:session): session closed for user root Jul 10 04:54:05 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-b8e92057-a062-4fd6-a681-5107d912f569 tempest-VolumeImageDependencyTests-2146091144 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_d2551751-8a61-40ac-88de-2f8910f6fc78_ovtdh4n2" returned: 1 in 0.796s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:54:05 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-b8e92057-a062-4fd6-a681-5107d912f569 tempest-VolumeImageDependencyTests-2146091144 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_d2551751-8a61-40ac-88de-2f8910f6fc78_ovtdh4n2' failed. Not Retrying. {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 10 04:54:05 devstack cinder-volume[87444]: DEBUG oslo.privsep.daemon [-] privsep: reply[2372bc95-cd4a-4952-95f4-c4f23efc749f]: (4, 'raw') {{(pid=88499) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 04:54:05 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-b8e92057-a062-4fd6-a681-5107d912f569 tempest-VolumeImageDependencyTests-2146091144 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_d2551751-8a61-40ac-88de-2f8910f6fc78_mfspowf9devstack@QuobyteHD {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:54:05 devstack sudo[105662]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-c9291bec-53ee-4b51-8bdf-8b3ea5eefacd.92218a8a-04cf-41f9-b1ab-85508b375c69 Jul 10 04:54:05 devstack sudo[105662]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:54:05 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-2fc9e5e0-1e33-4a8f-9c4f-12da8af6d496 tempest-CreateVolumesFromSnapshotTest-1643372015 None] Acquiring lock "cinder-6a52692c-d463-4776-aa0a-2fdfb275e2ef-delete_volume" by "delete_volume" {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 04:54:05 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-2fc9e5e0-1e33-4a8f-9c4f-12da8af6d496 tempest-CreateVolumesFromSnapshotTest-1643372015 None] Lock "cinder-6a52692c-d463-4776-aa0a-2fdfb275e2ef-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 04:54:05 devstack sudo[105664]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_d2551751-8a61-40ac-88de-2f8910f6fc78_mfspowf9devstack@QuobyteHD Jul 10 04:54:05 devstack sudo[105664]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:54:05 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-2fc9e5e0-1e33-4a8f-9c4f-12da8af6d496 tempest-CreateVolumesFromSnapshotTest-1643372015 None] Acquiring lock "cinder-quobyte-6a52692c-d463-4776-aa0a-2fdfb275e2ef" by "delete_volume" {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 04:54:05 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-2fc9e5e0-1e33-4a8f-9c4f-12da8af6d496 tempest-CreateVolumesFromSnapshotTest-1643372015 None] Lock "cinder-quobyte-6a52692c-d463-4776-aa0a-2fdfb275e2ef" acquired by "delete_volume" :: waited 0.015s {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 04:54:05 devstack cinder-volume[87444]: DEBUG oslo.privsep.daemon [-] privsep: reply[32cde08f-7797-4fa2-9be1-1ed1b5f269ec]: (4, 'qcow2') {{(pid=88499) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 04:54:05 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-2fc9e5e0-1e33-4a8f-9c4f-12da8af6d496 tempest-CreateVolumesFromSnapshotTest-1643372015 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-6a52692c-d463-4776-aa0a-2fdfb275e2ef {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:54:05 devstack sudo[105666]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-6a52692c-d463-4776-aa0a-2fdfb275e2ef Jul 10 04:54:05 devstack sudo[105666]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:54:06 devstack sudo[105662]: pam_unix(sudo:session): session closed for user root Jul 10 04:54:06 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-72bf1d03-4bcd-4163-bbf2-33a1e8a710a0 tempest-VolumeDependencyTests-2054620824 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-c9291bec-53ee-4b51-8bdf-8b3ea5eefacd.92218a8a-04cf-41f9-b1ab-85508b375c69" returned: 0 in 0.704s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:54:06 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-72bf1d03-4bcd-4163-bbf2-33a1e8a710a0 tempest-VolumeDependencyTests-2054620824 None] Lock "cinder-quobyte-92218a8a-04cf-41f9-b1ab-85508b375c69" released by "_delete_snapshot" :: held 3.323s {{(pid=87444) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 04:54:06 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-72bf1d03-4bcd-4163-bbf2-33a1e8a710a0 tempest-VolumeDependencyTests-2054620824 None] Lock "cinder-quobyte-c9291bec-53ee-4b51-8bdf-8b3ea5eefacd" released by "delete_snapshot" :: held 3.349s {{(pid=87444) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 04:54:06 devstack sudo[105664]: pam_unix(sudo:session): session closed for user root Jul 10 04:54:06 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-b8e92057-a062-4fd6-a681-5107d912f569 tempest-VolumeImageDependencyTests-2146091144 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_d2551751-8a61-40ac-88de-2f8910f6fc78_mfspowf9devstack@QuobyteHD" returned: 0 in 0.771s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:54:06 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-b8e92057-a062-4fd6-a681-5107d912f569 tempest-VolumeImageDependencyTests-2146091144 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_d2551751-8a61-40ac-88de-2f8910f6fc78_mfspowf9devstack@QuobyteHD {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:54:06 devstack cinder-volume[87444]: DEBUG cinder.quota [None req-72bf1d03-4bcd-4163-bbf2-33a1e8a710a0 tempest-VolumeDependencyTests-2054620824 None] Created reservations ['3e1d6357-e9ae-41fe-858d-77beea02fae7', '39b14b32-ff74-4c1c-bd99-4601f8892fb5', '10081734-0da1-4069-96c2-94773c579770', '6a842a1d-039a-4deb-965d-0797931af90b'] {{(pid=87444) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 04:54:06 devstack sudo[105671]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_d2551751-8a61-40ac-88de-2f8910f6fc78_mfspowf9devstack@QuobyteHD Jul 10 04:54:06 devstack sudo[105671]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:54:06 devstack cinder-volume[87444]: INFO cinder.volume.manager [None req-72bf1d03-4bcd-4163-bbf2-33a1e8a710a0 tempest-VolumeDependencyTests-2054620824 None] Delete snapshot completed successfully. Jul 10 04:54:06 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-72bf1d03-4bcd-4163-bbf2-33a1e8a710a0 tempest-VolumeDependencyTests-2054620824 None] Lock "cinder-92218a8a-04cf-41f9-b1ab-85508b375c69-delete_snapshot" released by "delete_snapshot" :: held 3.542s {{(pid=87444) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 04:54:06 devstack sudo[105666]: pam_unix(sudo:session): session closed for user root Jul 10 04:54:06 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-2fc9e5e0-1e33-4a8f-9c4f-12da8af6d496 tempest-CreateVolumesFromSnapshotTest-1643372015 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-6a52692c-d463-4776-aa0a-2fdfb275e2ef" returned: 0 in 0.842s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:54:06 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-2fc9e5e0-1e33-4a8f-9c4f-12da8af6d496 tempest-CreateVolumesFromSnapshotTest-1643372015 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-6a52692c-d463-4776-aa0a-2fdfb275e2ef {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:54:06 devstack sudo[105676]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-6a52692c-d463-4776-aa0a-2fdfb275e2ef Jul 10 04:54:06 devstack sudo[105676]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:54:06 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-a200c39c-5f34-4201-b588-e31b4e56162a tempest-CinderUnicodeTest-973446373 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 04:54:06 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-a200c39c-5f34-4201-b588-e31b4e56162a tempest-CinderUnicodeTest-973446373 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 04:54:06 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.remotefs [None req-a200c39c-5f34-4201-b588-e31b4e56162a tempest-CinderUnicodeTest-973446373 None] Creating offline snapshot c9ceee47-b0ff-4832-946b-06e0025b9037 of volume c3059c57-3952-4b3b-a43f-88ab14f29952 {{(pid=87444) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 10 04:54:06 devstack cinder-volume[87444]: DEBUG oslo.privsep.daemon [-] privsep: reply[bdf42109-bee4-4e5b-b050-4eb44206ee7c]: (4, 'qcow2') {{(pid=88499) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 04:54:06 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-a200c39c-5f34-4201-b588-e31b4e56162a tempest-CinderUnicodeTest-973446373 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-c3059c57-3952-4b3b-a43f-88ab14f29952 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:54:06 devstack sudo[105678]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-c3059c57-3952-4b3b-a43f-88ab14f29952 Jul 10 04:54:06 devstack sudo[105678]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:54:07 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-465e7969-b268-4782-9a47-337b102b934e tempest-VolumeDependencyTests-2054620824 None] Acquiring lock "cinder-c9291bec-53ee-4b51-8bdf-8b3ea5eefacd-delete_volume" by "delete_volume" {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 04:54:07 devstack sudo[105671]: pam_unix(sudo:session): session closed for user root Jul 10 04:54:07 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-b8e92057-a062-4fd6-a681-5107d912f569 tempest-VolumeImageDependencyTests-2146091144 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_d2551751-8a61-40ac-88de-2f8910f6fc78_mfspowf9devstack@QuobyteHD" returned: 1 in 0.889s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:54:07 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-b8e92057-a062-4fd6-a681-5107d912f569 tempest-VolumeImageDependencyTests-2146091144 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_d2551751-8a61-40ac-88de-2f8910f6fc78_mfspowf9devstack@QuobyteHD' failed. Not Retrying. {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 10 04:54:07 devstack cinder-volume[87444]: DEBUG cinder.image.image_utils [None req-b8e92057-a062-4fd6-a681-5107d912f569 tempest-VolumeImageDependencyTests-2146091144 None] d2551751-8a61-40ac-88de-2f8910f6fc78 was raw, converting to raw {{(pid=87444) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1153}} Jul 10 04:54:07 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-b8e92057-a062-4fd6-a681-5107d912f569 tempest-VolumeImageDependencyTests-2146091144 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_d2551751-8a61-40ac-88de-2f8910f6fc78_mfspowf9devstack@QuobyteHD /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-fdbeaa65-057f-49d9-8c6a-836a39956e47 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:54:07 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-465e7969-b268-4782-9a47-337b102b934e tempest-VolumeDependencyTests-2054620824 None] Lock "cinder-c9291bec-53ee-4b51-8bdf-8b3ea5eefacd-delete_volume" acquired by "delete_volume" :: waited 0.050s {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 04:54:07 devstack sudo[105683]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_d2551751-8a61-40ac-88de-2f8910f6fc78_mfspowf9devstack@QuobyteHD /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-fdbeaa65-057f-49d9-8c6a-836a39956e47 Jul 10 04:54:07 devstack sudo[105683]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:54:07 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-465e7969-b268-4782-9a47-337b102b934e tempest-VolumeDependencyTests-2054620824 None] Acquiring lock "cinder-quobyte-c9291bec-53ee-4b51-8bdf-8b3ea5eefacd" by "delete_volume" {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 04:54:07 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-465e7969-b268-4782-9a47-337b102b934e tempest-VolumeDependencyTests-2054620824 None] Lock "cinder-quobyte-c9291bec-53ee-4b51-8bdf-8b3ea5eefacd" acquired by "delete_volume" :: waited 0.020s {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 04:54:07 devstack cinder-volume[87444]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e1b0411-d950-4624-8c63-1d25b046e7b6]: (4, 'qcow2') {{(pid=88499) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 04:54:07 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-465e7969-b268-4782-9a47-337b102b934e tempest-VolumeDependencyTests-2054620824 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-c9291bec-53ee-4b51-8bdf-8b3ea5eefacd {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:54:07 devstack sudo[105676]: pam_unix(sudo:session): session closed for user root Jul 10 04:54:07 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-2fc9e5e0-1e33-4a8f-9c4f-12da8af6d496 tempest-CreateVolumesFromSnapshotTest-1643372015 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-6a52692c-d463-4776-aa0a-2fdfb275e2ef" returned: 0 in 0.755s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:54:07 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-2fc9e5e0-1e33-4a8f-9c4f-12da8af6d496 tempest-CreateVolumesFromSnapshotTest-1643372015 None] Lock "cinder-quobyte-6a52692c-d463-4776-aa0a-2fdfb275e2ef" released by "delete_volume" :: held 1.661s {{(pid=87444) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 04:54:07 devstack cinder-volume[87444]: DEBUG cinder.quota [None req-2fc9e5e0-1e33-4a8f-9c4f-12da8af6d496 tempest-CreateVolumesFromSnapshotTest-1643372015 None] Created reservations ['25bc5c5d-8f77-440a-b8e9-2afdb0449db0', 'e67b2239-7e97-4014-aa0d-7d65a9e56742', '0780bd17-4467-4836-b045-9d3d9042da88', 'fd08787a-9bfc-4ae3-a1e0-1f8330ff84ca'] {{(pid=87444) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 04:54:07 devstack sudo[105686]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-c9291bec-53ee-4b51-8bdf-8b3ea5eefacd Jul 10 04:54:07 devstack sudo[105686]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:54:07 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-2fc9e5e0-1e33-4a8f-9c4f-12da8af6d496 tempest-CreateVolumesFromSnapshotTest-1643372015 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 04:54:07 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-2fc9e5e0-1e33-4a8f-9c4f-12da8af6d496 tempest-CreateVolumesFromSnapshotTest-1643372015 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 04:54:07 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-2fc9e5e0-1e33-4a8f-9c4f-12da8af6d496 tempest-CreateVolumesFromSnapshotTest-1643372015 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922': None} {{(pid=87444) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 04:54:07 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-2fc9e5e0-1e33-4a8f-9c4f-12da8af6d496 tempest-CreateVolumesFromSnapshotTest-1643372015 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922'] {{(pid=87444) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 04:54:07 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-2fc9e5e0-1e33-4a8f-9c4f-12da8af6d496 tempest-CreateVolumesFromSnapshotTest-1643372015 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 04:54:07 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-2fc9e5e0-1e33-4a8f-9c4f-12da8af6d496 tempest-CreateVolumesFromSnapshotTest-1643372015 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:54:07 devstack sudo[105691]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097 Jul 10 04:54:07 devstack sudo[105691]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:54:07 devstack sudo[105678]: pam_unix(sudo:session): session closed for user root Jul 10 04:54:07 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-a200c39c-5f34-4201-b588-e31b4e56162a tempest-CinderUnicodeTest-973446373 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-c3059c57-3952-4b3b-a43f-88ab14f29952" returned: 0 in 0.924s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:54:07 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-a200c39c-5f34-4201-b588-e31b4e56162a tempest-CinderUnicodeTest-973446373 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-c3059c57-3952-4b3b-a43f-88ab14f29952,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-c3059c57-3952-4b3b-a43f-88ab14f29952.c9ceee47-b0ff-4832-946b-06e0025b9037 1G {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:54:07 devstack sudo[105693]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-c3059c57-3952-4b3b-a43f-88ab14f29952,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-c3059c57-3952-4b3b-a43f-88ab14f29952.c9ceee47-b0ff-4832-946b-06e0025b9037 1G Jul 10 04:54:07 devstack sudo[105693]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:54:08 devstack sudo[105683]: pam_unix(sudo:session): session closed for user root Jul 10 04:54:08 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-b8e92057-a062-4fd6-a681-5107d912f569 tempest-VolumeImageDependencyTests-2146091144 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_d2551751-8a61-40ac-88de-2f8910f6fc78_mfspowf9devstack@QuobyteHD /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-fdbeaa65-057f-49d9-8c6a-836a39956e47" returned: 0 in 0.954s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:54:08 devstack cinder-volume[87444]: DEBUG cinder.image.image_utils [None req-b8e92057-a062-4fd6-a681-5107d912f569 tempest-VolumeImageDependencyTests-2146091144 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_d2551751-8a61-40ac-88de-2f8910f6fc78_mfspowf9devstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-fdbeaa65-057f-49d9-8c6a-836a39956e47 {{(pid=87444) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:561}} Jul 10 04:54:08 devstack cinder-volume[87444]: INFO cinder.image.image_utils [None req-b8e92057-a062-4fd6-a681-5107d912f569 tempest-VolumeImageDependencyTests-2146091144 None] Converted 0.00 MB image at 0.00 MB/s Jul 10 04:54:08 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-b8e92057-a062-4fd6-a681-5107d912f569 tempest-VolumeImageDependencyTests-2146091144 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-fdbeaa65-057f-49d9-8c6a-836a39956e47 1G {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:54:08 devstack sudo[105698]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-fdbeaa65-057f-49d9-8c6a-836a39956e47 1G Jul 10 04:54:08 devstack sudo[105698]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:54:08 devstack sudo[105691]: pam_unix(sudo:session): session closed for user root Jul 10 04:54:08 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-2fc9e5e0-1e33-4a8f-9c4f-12da8af6d496 tempest-CreateVolumesFromSnapshotTest-1643372015 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097" returned: 0 in 0.806s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:54:08 devstack cinder-volume[87444]: DEBUG cinder.manager [None req-2fc9e5e0-1e33-4a8f-9c4f-12da8af6d496 tempest-CreateVolumesFromSnapshotTest-1643372015 None] Notifying Schedulers of capabilities ... {{(pid=87444) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 04:54:08 devstack cinder-volume[87444]: INFO cinder.volume.manager [None req-2fc9e5e0-1e33-4a8f-9c4f-12da8af6d496 tempest-CreateVolumesFromSnapshotTest-1643372015 None] Deleted volume successfully. Jul 10 04:54:08 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-2fc9e5e0-1e33-4a8f-9c4f-12da8af6d496 tempest-CreateVolumesFromSnapshotTest-1643372015 None] Lock "cinder-6a52692c-d463-4776-aa0a-2fdfb275e2ef-delete_volume" released by "delete_volume" :: held 2.746s {{(pid=87444) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 04:54:08 devstack sudo[105686]: pam_unix(sudo:session): session closed for user root Jul 10 04:54:08 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-465e7969-b268-4782-9a47-337b102b934e tempest-VolumeDependencyTests-2054620824 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-c9291bec-53ee-4b51-8bdf-8b3ea5eefacd" returned: 0 in 1.104s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:54:08 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-465e7969-b268-4782-9a47-337b102b934e tempest-VolumeDependencyTests-2054620824 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-c9291bec-53ee-4b51-8bdf-8b3ea5eefacd {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:54:08 devstack sudo[105707]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-c9291bec-53ee-4b51-8bdf-8b3ea5eefacd Jul 10 04:54:08 devstack sudo[105707]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:54:08 devstack sudo[105693]: pam_unix(sudo:session): session closed for user root Jul 10 04:54:08 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-a200c39c-5f34-4201-b588-e31b4e56162a tempest-CinderUnicodeTest-973446373 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-c3059c57-3952-4b3b-a43f-88ab14f29952,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-c3059c57-3952-4b3b-a43f-88ab14f29952.c9ceee47-b0ff-4832-946b-06e0025b9037 1G" returned: 0 in 0.988s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:54:08 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-a200c39c-5f34-4201-b588-e31b4e56162a tempest-CinderUnicodeTest-973446373 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c3059c57-3952-4b3b-a43f-88ab14f29952 -F qcow2 /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-c3059c57-3952-4b3b-a43f-88ab14f29952.c9ceee47-b0ff-4832-946b-06e0025b9037 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:54:08 devstack sudo[105709]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c3059c57-3952-4b3b-a43f-88ab14f29952 -F qcow2 /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-c3059c57-3952-4b3b-a43f-88ab14f29952.c9ceee47-b0ff-4832-946b-06e0025b9037 Jul 10 04:54:08 devstack sudo[105709]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:54:08 devstack sudo[105698]: pam_unix(sudo:session): session closed for user root Jul 10 04:54:08 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-b8e92057-a062-4fd6-a681-5107d912f569 tempest-VolumeImageDependencyTests-2146091144 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-fdbeaa65-057f-49d9-8c6a-836a39956e47 1G" returned: 0 in 0.923s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:54:09 devstack cinder-volume[87444]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f5e0524-c238-4c0c-ba83-4b45f4d89bae]: (4, 'raw') {{(pid=88499) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 04:54:09 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-b8e92057-a062-4fd6-a681-5107d912f569 tempest-VolumeImageDependencyTests-2146091144 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-fdbeaa65-057f-49d9-8c6a-836a39956e47 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:54:09 devstack sudo[105707]: pam_unix(sudo:session): session closed for user root Jul 10 04:54:09 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-465e7969-b268-4782-9a47-337b102b934e tempest-VolumeDependencyTests-2054620824 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-c9291bec-53ee-4b51-8bdf-8b3ea5eefacd" returned: 0 in 0.764s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:54:09 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-465e7969-b268-4782-9a47-337b102b934e tempest-VolumeDependencyTests-2054620824 None] Lock "cinder-quobyte-c9291bec-53ee-4b51-8bdf-8b3ea5eefacd" released by "delete_volume" :: held 1.949s {{(pid=87444) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 04:54:09 devstack sudo[105715]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-fdbeaa65-057f-49d9-8c6a-836a39956e47 Jul 10 04:54:09 devstack sudo[105715]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:54:09 devstack cinder-volume[87444]: DEBUG cinder.quota [None req-465e7969-b268-4782-9a47-337b102b934e tempest-VolumeDependencyTests-2054620824 None] Created reservations ['92d4a500-6ff0-4b6d-847d-32f10048ec2f', '40b63f97-c8b5-42b6-9777-1bcfe487e0b9', '6ac12e74-2b1f-4303-8220-485e8e943f0a', 'e18325e1-cc47-4092-81d9-9dd8055d7681'] {{(pid=87444) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 04:54:09 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-465e7969-b268-4782-9a47-337b102b934e tempest-VolumeDependencyTests-2054620824 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 04:54:09 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-465e7969-b268-4782-9a47-337b102b934e tempest-VolumeDependencyTests-2054620824 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 04:54:09 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-465e7969-b268-4782-9a47-337b102b934e tempest-VolumeDependencyTests-2054620824 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922': None} {{(pid=87444) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 04:54:09 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-465e7969-b268-4782-9a47-337b102b934e tempest-VolumeDependencyTests-2054620824 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922'] {{(pid=87444) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 04:54:09 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-465e7969-b268-4782-9a47-337b102b934e tempest-VolumeDependencyTests-2054620824 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 04:54:09 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-465e7969-b268-4782-9a47-337b102b934e tempest-VolumeDependencyTests-2054620824 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:54:09 devstack sudo[105719]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097 Jul 10 04:54:09 devstack sudo[105719]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:54:09 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-680ec6a5-617b-4b6b-8356-3e07bc5a75d7 tempest-VolumeDependencyTests-2054620824 None] Acquiring lock "cinder-794a766c-d221-45ff-b609-b3342e00de15-delete_volume" by "delete_volume" {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 04:54:09 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-680ec6a5-617b-4b6b-8356-3e07bc5a75d7 tempest-VolumeDependencyTests-2054620824 None] Lock "cinder-794a766c-d221-45ff-b609-b3342e00de15-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 04:54:09 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-680ec6a5-617b-4b6b-8356-3e07bc5a75d7 tempest-VolumeDependencyTests-2054620824 None] Acquiring lock "cinder-quobyte-794a766c-d221-45ff-b609-b3342e00de15" by "delete_volume" {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 04:54:09 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-680ec6a5-617b-4b6b-8356-3e07bc5a75d7 tempest-VolumeDependencyTests-2054620824 None] Lock "cinder-quobyte-794a766c-d221-45ff-b609-b3342e00de15" acquired by "delete_volume" :: waited 0.022s {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 04:54:09 devstack cinder-volume[87444]: DEBUG oslo.privsep.daemon [-] privsep: reply[286a2b14-ce0a-4f04-8974-6d01907555e9]: (4, 'qcow2') {{(pid=88499) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 04:54:09 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-680ec6a5-617b-4b6b-8356-3e07bc5a75d7 tempest-VolumeDependencyTests-2054620824 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-794a766c-d221-45ff-b609-b3342e00de15 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:54:09 devstack sudo[105709]: pam_unix(sudo:session): session closed for user root Jul 10 04:54:09 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-a200c39c-5f34-4201-b588-e31b4e56162a tempest-CinderUnicodeTest-973446373 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c3059c57-3952-4b3b-a43f-88ab14f29952 -F qcow2 /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-c3059c57-3952-4b3b-a43f-88ab14f29952.c9ceee47-b0ff-4832-946b-06e0025b9037" returned: 0 in 1.078s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:54:09 devstack cinder-volume[87444]: WARNING cinder.volume.drivers.remotefs [None req-a200c39c-5f34-4201-b588-e31b4e56162a tempest-CinderUnicodeTest-973446373 None] /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-c3059c57-3952-4b3b-a43f-88ab14f29952.c9ceee47-b0ff-4832-946b-06e0025b9037 is being set with open permissions: ugo+rw Jul 10 04:54:09 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-a200c39c-5f34-4201-b588-e31b4e56162a tempest-CinderUnicodeTest-973446373 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-c3059c57-3952-4b3b-a43f-88ab14f29952.c9ceee47-b0ff-4832-946b-06e0025b9037 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:54:09 devstack sudo[105724]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-c3059c57-3952-4b3b-a43f-88ab14f29952.c9ceee47-b0ff-4832-946b-06e0025b9037 Jul 10 04:54:09 devstack sudo[105724]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:54:09 devstack sudo[105723]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-794a766c-d221-45ff-b609-b3342e00de15 Jul 10 04:54:09 devstack sudo[105723]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:54:10 devstack sudo[105715]: pam_unix(sudo:session): session closed for user root Jul 10 04:54:10 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-b8e92057-a062-4fd6-a681-5107d912f569 tempest-VolumeImageDependencyTests-2146091144 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-fdbeaa65-057f-49d9-8c6a-836a39956e47" returned: 0 in 1.024s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:54:10 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-b8e92057-a062-4fd6-a681-5107d912f569 tempest-VolumeImageDependencyTests-2146091144 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-fdbeaa65-057f-49d9-8c6a-836a39956e47 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:54:10 devstack sudo[105729]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-fdbeaa65-057f-49d9-8c6a-836a39956e47 Jul 10 04:54:10 devstack sudo[105729]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:54:10 devstack sudo[105719]: pam_unix(sudo:session): session closed for user root Jul 10 04:54:10 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-465e7969-b268-4782-9a47-337b102b934e tempest-VolumeDependencyTests-2054620824 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097" returned: 0 in 1.094s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:54:10 devstack cinder-volume[87444]: DEBUG cinder.manager [None req-465e7969-b268-4782-9a47-337b102b934e tempest-VolumeDependencyTests-2054620824 None] Notifying Schedulers of capabilities ... {{(pid=87444) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 04:54:10 devstack cinder-volume[87444]: INFO cinder.volume.manager [None req-465e7969-b268-4782-9a47-337b102b934e tempest-VolumeDependencyTests-2054620824 None] Deleted volume successfully. Jul 10 04:54:10 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-465e7969-b268-4782-9a47-337b102b934e tempest-VolumeDependencyTests-2054620824 None] Lock "cinder-c9291bec-53ee-4b51-8bdf-8b3ea5eefacd-delete_volume" released by "delete_volume" :: held 3.360s {{(pid=87444) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 04:54:10 devstack sudo[105724]: pam_unix(sudo:session): session closed for user root Jul 10 04:54:10 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-a200c39c-5f34-4201-b588-e31b4e56162a tempest-CinderUnicodeTest-973446373 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-c3059c57-3952-4b3b-a43f-88ab14f29952.c9ceee47-b0ff-4832-946b-06e0025b9037" returned: 0 in 0.902s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:54:10 devstack sudo[105723]: pam_unix(sudo:session): session closed for user root Jul 10 04:54:10 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-680ec6a5-617b-4b6b-8356-3e07bc5a75d7 tempest-VolumeDependencyTests-2054620824 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-794a766c-d221-45ff-b609-b3342e00de15" returned: 0 in 0.952s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:54:10 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-680ec6a5-617b-4b6b-8356-3e07bc5a75d7 tempest-VolumeDependencyTests-2054620824 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-794a766c-d221-45ff-b609-b3342e00de15 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:54:10 devstack sudo[105737]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-794a766c-d221-45ff-b609-b3342e00de15 Jul 10 04:54:10 devstack sudo[105737]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:54:10 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-a200c39c-5f34-4201-b588-e31b4e56162a tempest-CinderUnicodeTest-973446373 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-c3059c57-3952-4b3b-a43f-88ab14f29952.info {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:54:10 devstack sudo[105739]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-c3059c57-3952-4b3b-a43f-88ab14f29952.info Jul 10 04:54:10 devstack sudo[105739]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:54:10 devstack sudo[105729]: pam_unix(sudo:session): session closed for user root Jul 10 04:54:10 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-b8e92057-a062-4fd6-a681-5107d912f569 tempest-VolumeImageDependencyTests-2146091144 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-fdbeaa65-057f-49d9-8c6a-836a39956e47" returned: 1 in 0.885s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:54:10 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-b8e92057-a062-4fd6-a681-5107d912f569 tempest-VolumeImageDependencyTests-2146091144 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-fdbeaa65-057f-49d9-8c6a-836a39956e47' failed. Not Retrying. {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 10 04:54:10 devstack cinder-volume[87444]: DEBUG cinder.volume.volume_utils [None req-b8e92057-a062-4fd6-a681-5107d912f569 tempest-VolumeImageDependencyTests-2146091144 None] Downloaded image d2551751-8a61-40ac-88de-2f8910f6fc78 ((None, [{'url': 'file:///opt/stack/data/glance/images/d2551751-8a61-40ac-88de-2f8910f6fc78', 'metadata': {}}])) to volume fdbeaa65-057f-49d9-8c6a-836a39956e47 successfully. {{(pid=87444) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jul 10 04:54:10 devstack cinder-volume[87444]: DEBUG cinder.image.image_utils [None req-b8e92057-a062-4fd6-a681-5107d912f569 tempest-VolumeImageDependencyTests-2146091144 None] Temporary image d2551751-8a61-40ac-88de-2f8910f6fc78 for user 71f947d3bb634ad5a35d00d3321ae508 is deleted. {{(pid=87444) fetch /opt/stack/cinder/cinder/image/image_utils.py:1468}} Jul 10 04:54:10 devstack cinder-volume[87444]: DEBUG cinder.volume.volume_utils [None req-b8e92057-a062-4fd6-a681-5107d912f569 tempest-VolumeImageDependencyTests-2146091144 None] Marking volume fdbeaa65-057f-49d9-8c6a-836a39956e47 as bootable. {{(pid=87444) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jul 10 04:54:10 devstack cinder-volume[87444]: DEBUG cinder.volume.flows.manager.create_volume [None req-b8e92057-a062-4fd6-a681-5107d912f569 tempest-VolumeImageDependencyTests-2146091144 None] Copying metadata from image d2551751-8a61-40ac-88de-2f8910f6fc78 to fdbeaa65-057f-49d9-8c6a-836a39956e47. {{(pid=87444) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jul 10 04:54:10 devstack cinder-volume[87444]: DEBUG cinder.volume.flows.manager.create_volume [None req-b8e92057-a062-4fd6-a681-5107d912f569 tempest-VolumeImageDependencyTests-2146091144 None] Creating volume glance metadata for volume fdbeaa65-057f-49d9-8c6a-836a39956e47 backed by image d2551751-8a61-40ac-88de-2f8910f6fc78 with: {'image_id': 'd2551751-8a61-40ac-88de-2f8910f6fc78', 'image_name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'checksum': 'ff2def80f4d9193a53cf1655603f6faf', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=87444) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jul 10 04:54:11 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-b8e92057-a062-4fd6-a681-5107d912f569 tempest-VolumeImageDependencyTests-2146091144 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (01848fc3-109d-4ffc-830e-b1ce8f6a6358) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fdbeaa65-057f-49d9-8c6a-836a39956e47', 'volume_size': 1, 'image_id': 'd2551751-8a61-40ac-88de-2f8910f6fc78', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/d2551751-8a61-40ac-88de-2f8910f6fc78', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'ff2def80f4d9193a53cf1655603f6faf', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'c3a161ac220741e4a10764dea998083c', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'b7a8f232467ada123df98e6d320c4e6e32f63400542d97c02d1a6312724019ce66c990d237d28c7612a07d7fd55d6f44e3fb211d0c2d526542080ebabf22bc35', 'id': 'd2551751-8a61-40ac-88de-2f8910f6fc78', 'created_at': datetime.datetime(2026, 7, 10, 2, 53, 47, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 10, 2, 53, 48, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/d2551751-8a61-40ac-88de-2f8910f6fc78/file', 'properties': {}}, 'image_service': }' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:54:11 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-b8e92057-a062-4fd6-a681-5107d912f569 tempest-VolumeImageDependencyTests-2146091144 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cee3fae5-fdcf-4fb1-8535-c8f5ad8b6aec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:54:11 devstack cinder-volume[87444]: INFO cinder.volume.flows.manager.create_volume [None req-b8e92057-a062-4fd6-a681-5107d912f569 tempest-VolumeImageDependencyTests-2146091144 None] Volume volume-fdbeaa65-057f-49d9-8c6a-836a39956e47 (fdbeaa65-057f-49d9-8c6a-836a39956e47): created successfully Jul 10 04:54:11 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-b8e92057-a062-4fd6-a681-5107d912f569 tempest-VolumeImageDependencyTests-2146091144 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cee3fae5-fdcf-4fb1-8535-c8f5ad8b6aec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:54:11 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-b8e92057-a062-4fd6-a681-5107d912f569 tempest-VolumeImageDependencyTests-2146091144 None] Flow 'volume_create_manager' (532b48e9-df57-4f64-a887-59b9b2ca62d4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87444) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 04:54:11 devstack cinder-volume[87444]: INFO cinder.volume.manager [None req-b8e92057-a062-4fd6-a681-5107d912f569 tempest-VolumeImageDependencyTests-2146091144 None] Created volume successfully. Jul 10 04:54:11 devstack sudo[105739]: pam_unix(sudo:session): session closed for user root Jul 10 04:54:11 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-a200c39c-5f34-4201-b588-e31b4e56162a tempest-CinderUnicodeTest-973446373 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-c3059c57-3952-4b3b-a43f-88ab14f29952.info" returned: 0 in 0.730s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:54:11 devstack cinder-volume[87444]: WARNING cinder.volume.drivers.remotefs [None req-a200c39c-5f34-4201-b588-e31b4e56162a tempest-CinderUnicodeTest-973446373 None] /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-c3059c57-3952-4b3b-a43f-88ab14f29952.info is being set with open permissions: ugo+rw Jul 10 04:54:11 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-a200c39c-5f34-4201-b588-e31b4e56162a tempest-CinderUnicodeTest-973446373 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-c3059c57-3952-4b3b-a43f-88ab14f29952.info {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:54:11 devstack sudo[105737]: pam_unix(sudo:session): session closed for user root Jul 10 04:54:11 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-680ec6a5-617b-4b6b-8356-3e07bc5a75d7 tempest-VolumeDependencyTests-2054620824 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-794a766c-d221-45ff-b609-b3342e00de15" returned: 0 in 0.805s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:54:11 devstack sudo[105746]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-c3059c57-3952-4b3b-a43f-88ab14f29952.info Jul 10 04:54:11 devstack sudo[105746]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:54:11 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-680ec6a5-617b-4b6b-8356-3e07bc5a75d7 tempest-VolumeDependencyTests-2054620824 None] Lock "cinder-quobyte-794a766c-d221-45ff-b609-b3342e00de15" released by "delete_volume" :: held 1.810s {{(pid=87444) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 04:54:11 devstack cinder-volume[87444]: DEBUG cinder.quota [None req-680ec6a5-617b-4b6b-8356-3e07bc5a75d7 tempest-VolumeDependencyTests-2054620824 None] Created reservations ['97878df0-231d-4532-ab5f-27ef6279f751', '59879f28-2e86-4249-b716-b89b7c4ec9a0', '38c485fc-ce0a-4b83-b3e5-e2cb45983884', 'a7dafcc9-23e2-4917-94bc-178498fad9bf'] {{(pid=87444) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 04:54:11 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-680ec6a5-617b-4b6b-8356-3e07bc5a75d7 tempest-VolumeDependencyTests-2054620824 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 04:54:11 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-680ec6a5-617b-4b6b-8356-3e07bc5a75d7 tempest-VolumeDependencyTests-2054620824 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 04:54:11 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-680ec6a5-617b-4b6b-8356-3e07bc5a75d7 tempest-VolumeDependencyTests-2054620824 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922': None} {{(pid=87444) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 04:54:11 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-680ec6a5-617b-4b6b-8356-3e07bc5a75d7 tempest-VolumeDependencyTests-2054620824 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922'] {{(pid=87444) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 04:54:11 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-680ec6a5-617b-4b6b-8356-3e07bc5a75d7 tempest-VolumeDependencyTests-2054620824 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 04:54:11 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-680ec6a5-617b-4b6b-8356-3e07bc5a75d7 tempest-VolumeDependencyTests-2054620824 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:54:11 devstack sudo[105748]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097 Jul 10 04:54:11 devstack sudo[105748]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:54:11 devstack sudo[105746]: pam_unix(sudo:session): session closed for user root Jul 10 04:54:12 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-a200c39c-5f34-4201-b588-e31b4e56162a tempest-CinderUnicodeTest-973446373 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-c3059c57-3952-4b3b-a43f-88ab14f29952.info" returned: 0 in 0.699s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:54:12 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-a200c39c-5f34-4201-b588-e31b4e56162a tempest-CinderUnicodeTest-973446373 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.472s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 04:54:12 devstack cinder-volume[87444]: INFO cinder.volume.manager [None req-a200c39c-5f34-4201-b588-e31b4e56162a tempest-CinderUnicodeTest-973446373 None] Create snapshot completed successfully Jul 10 04:54:12 devstack sudo[105748]: pam_unix(sudo:session): session closed for user root Jul 10 04:54:12 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-680ec6a5-617b-4b6b-8356-3e07bc5a75d7 tempest-VolumeDependencyTests-2054620824 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097" returned: 0 in 0.792s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:54:12 devstack cinder-volume[87444]: DEBUG cinder.manager [None req-680ec6a5-617b-4b6b-8356-3e07bc5a75d7 tempest-VolumeDependencyTests-2054620824 None] Notifying Schedulers of capabilities ... {{(pid=87444) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 04:54:12 devstack cinder-volume[87444]: INFO cinder.volume.manager [None req-680ec6a5-617b-4b6b-8356-3e07bc5a75d7 tempest-VolumeDependencyTests-2054620824 None] Deleted volume successfully. Jul 10 04:54:12 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-680ec6a5-617b-4b6b-8356-3e07bc5a75d7 tempest-VolumeDependencyTests-2054620824 None] Lock "cinder-794a766c-d221-45ff-b609-b3342e00de15-delete_volume" released by "delete_volume" :: held 2.884s {{(pid=87444) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 04:54:12 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-80dc9931-66d5-42b8-9366-f7bde3e9567b tempest-VolumeImageDependencyTests-2146091144 None] Acquiring lock "cinder-fdbeaa65-057f-49d9-8c6a-836a39956e47-delete_volume" by "delete_volume" {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 04:54:12 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-80dc9931-66d5-42b8-9366-f7bde3e9567b tempest-VolumeImageDependencyTests-2146091144 None] Lock "cinder-fdbeaa65-057f-49d9-8c6a-836a39956e47-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 04:54:12 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-80dc9931-66d5-42b8-9366-f7bde3e9567b tempest-VolumeImageDependencyTests-2146091144 None] Acquiring lock "cinder-quobyte-fdbeaa65-057f-49d9-8c6a-836a39956e47" by "delete_volume" {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 04:54:12 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-80dc9931-66d5-42b8-9366-f7bde3e9567b tempest-VolumeImageDependencyTests-2146091144 None] Lock "cinder-quobyte-fdbeaa65-057f-49d9-8c6a-836a39956e47" acquired by "delete_volume" :: waited 0.019s {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 04:54:12 devstack cinder-volume[87444]: DEBUG cinder.volume.flows.manager.create_volume [None req-aff5be57-2623-4de6-9e19-6e4590de84d4 tempest-ProjectReaderTests-860343347 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87444) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 04:54:12 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-aff5be57-2623-4de6-9e19-6e4590de84d4 tempest-ProjectReaderTests-860343347 None] Flow 'volume_create_manager' (05709690-01df-4ff0-9c30-c64276dd0b10) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 04:54:12 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-aff5be57-2623-4de6-9e19-6e4590de84d4 tempest-ProjectReaderTests-860343347 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c0ab8d73-6ce9-47d3-8507-0671f21eede1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:54:12 devstack cinder-volume[87444]: DEBUG oslo.privsep.daemon [-] privsep: reply[93494b11-2ebd-45c7-a200-b447fbad59a0]: (4, 'raw') {{(pid=88499) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 04:54:12 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-80dc9931-66d5-42b8-9366-f7bde3e9567b tempest-VolumeImageDependencyTests-2146091144 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-fdbeaa65-057f-49d9-8c6a-836a39956e47 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:54:12 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-aff5be57-2623-4de6-9e19-6e4590de84d4 tempest-ProjectReaderTests-860343347 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c0ab8d73-6ce9-47d3-8507-0671f21eede1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T02:54:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-300408562',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f3280c60-0b63-4351-8a2d-f1eafc703dcb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='181feec0fe8f488b8b6345b78eb67c5c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T02:54:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T02:54:12Z,use_quota=True,user_id='c9a1d6a7ee0a44ff83a1bceb660b8015',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(317e369e-1e06-434d-ae95-a335f0e6c903),volume_type_id=317e369e-1e06-434d-ae95-a335f0e6c903)' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:54:12 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-aff5be57-2623-4de6-9e19-6e4590de84d4 tempest-ProjectReaderTests-860343347 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1500b4a3-b3ab-4393-875f-1811191d1c8c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:54:12 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-aff5be57-2623-4de6-9e19-6e4590de84d4 tempest-ProjectReaderTests-860343347 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1500b4a3-b3ab-4393-875f-1811191d1c8c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:54:12 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-aff5be57-2623-4de6-9e19-6e4590de84d4 tempest-ProjectReaderTests-860343347 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ae41de42-f299-4bb3-a41c-6711e2e506ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:54:12 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-aff5be57-2623-4de6-9e19-6e4590de84d4 tempest-ProjectReaderTests-860343347 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ae41de42-f299-4bb3-a41c-6711e2e506ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f3280c60-0b63-4351-8a2d-f1eafc703dcb', 'volume_name': 'volume-f3280c60-0b63-4351-8a2d-f1eafc703dcb', 'volume_size': 1}' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:54:12 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-aff5be57-2623-4de6-9e19-6e4590de84d4 tempest-ProjectReaderTests-860343347 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (75a11409-dddc-4d94-b48b-bda6b78747c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:54:12 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-aff5be57-2623-4de6-9e19-6e4590de84d4 tempest-ProjectReaderTests-860343347 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (75a11409-dddc-4d94-b48b-bda6b78747c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:54:12 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-aff5be57-2623-4de6-9e19-6e4590de84d4 tempest-ProjectReaderTests-860343347 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9176f5af-85a1-4bf8-883f-ea1fc1363fea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:54:12 devstack cinder-volume[87444]: INFO cinder.volume.flows.manager.create_volume [None req-aff5be57-2623-4de6-9e19-6e4590de84d4 tempest-ProjectReaderTests-860343347 None] Volume f3280c60-0b63-4351-8a2d-f1eafc703dcb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f3280c60-0b63-4351-8a2d-f1eafc703dcb', 'volume_size': 1} Jul 10 04:54:12 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-aff5be57-2623-4de6-9e19-6e4590de84d4 tempest-ProjectReaderTests-860343347 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 04:54:12 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-aff5be57-2623-4de6-9e19-6e4590de84d4 tempest-ProjectReaderTests-860343347 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 04:54:12 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-aff5be57-2623-4de6-9e19-6e4590de84d4 tempest-ProjectReaderTests-860343347 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T02:54:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-300408562',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f3280c60-0b63-4351-8a2d-f1eafc703dcb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='181feec0fe8f488b8b6345b78eb67c5c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T02:54:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T02:54:12Z,use_quota=True,user_id='c9a1d6a7ee0a44ff83a1bceb660b8015',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(317e369e-1e06-434d-ae95-a335f0e6c903),volume_type_id=317e369e-1e06-434d-ae95-a335f0e6c903)}" {{(pid=87444) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 04:54:12 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.remotefs [None req-aff5be57-2623-4de6-9e19-6e4590de84d4 tempest-ProjectReaderTests-860343347 None] Creating volume f3280c60-0b63-4351-8a2d-f1eafc703dcb {{(pid=87444) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 04:54:12 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-aff5be57-2623-4de6-9e19-6e4590de84d4 tempest-ProjectReaderTests-860343347 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 04:54:12 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-aff5be57-2623-4de6-9e19-6e4590de84d4 tempest-ProjectReaderTests-860343347 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 04:54:12 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-aff5be57-2623-4de6-9e19-6e4590de84d4 tempest-ProjectReaderTests-860343347 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922': None} {{(pid=87444) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 04:54:12 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-aff5be57-2623-4de6-9e19-6e4590de84d4 tempest-ProjectReaderTests-860343347 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922'] {{(pid=87444) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 04:54:12 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-aff5be57-2623-4de6-9e19-6e4590de84d4 tempest-ProjectReaderTests-860343347 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 04:54:12 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-aff5be57-2623-4de6-9e19-6e4590de84d4 tempest-ProjectReaderTests-860343347 None] Selected osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922 as target Quobyte volume. {{(pid=87444) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 04:54:12 devstack cinder-volume[87444]: INFO cinder.volume.drivers.remotefs [None req-aff5be57-2623-4de6-9e19-6e4590de84d4 tempest-ProjectReaderTests-860343347 None] casted to osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922 Jul 10 04:54:12 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-aff5be57-2623-4de6-9e19-6e4590de84d4 tempest-ProjectReaderTests-860343347 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-f3280c60-0b63-4351-8a2d-f1eafc703dcb 1073741824 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:54:12 devstack sudo[105753]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-f3280c60-0b63-4351-8a2d-f1eafc703dcb 1073741824 Jul 10 04:54:12 devstack sudo[105753]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:54:12 devstack sudo[105752]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-fdbeaa65-057f-49d9-8c6a-836a39956e47 Jul 10 04:54:12 devstack sudo[105752]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:54:12 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-33bce7a5-9562-473d-ad31-bd2c54f4a0a4 tempest-CinderUnicodeTest-973446373 None] Acquiring lock "cinder-c9ceee47-b0ff-4832-946b-06e0025b9037-delete_snapshot" by "delete_snapshot" {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 04:54:12 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-33bce7a5-9562-473d-ad31-bd2c54f4a0a4 tempest-CinderUnicodeTest-973446373 None] Lock "cinder-c9ceee47-b0ff-4832-946b-06e0025b9037-delete_snapshot" acquired by "delete_snapshot" :: waited 0.027s {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 04:54:12 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-33bce7a5-9562-473d-ad31-bd2c54f4a0a4 tempest-CinderUnicodeTest-973446373 None] Acquiring lock "cinder-quobyte-c3059c57-3952-4b3b-a43f-88ab14f29952" by "delete_snapshot" {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 04:54:13 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-33bce7a5-9562-473d-ad31-bd2c54f4a0a4 tempest-CinderUnicodeTest-973446373 None] Lock "cinder-quobyte-c3059c57-3952-4b3b-a43f-88ab14f29952" acquired by "delete_snapshot" :: waited 0.023s {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 04:54:13 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-33bce7a5-9562-473d-ad31-bd2c54f4a0a4 tempest-CinderUnicodeTest-973446373 None] Acquiring lock "cinder-quobyte-c9ceee47-b0ff-4832-946b-06e0025b9037" by "_delete_snapshot" {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 04:54:13 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-33bce7a5-9562-473d-ad31-bd2c54f4a0a4 tempest-CinderUnicodeTest-973446373 None] Lock "cinder-quobyte-c9ceee47-b0ff-4832-946b-06e0025b9037" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 04:54:13 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.remotefs [None req-33bce7a5-9562-473d-ad31-bd2c54f4a0a4 tempest-CinderUnicodeTest-973446373 None] Deleting offline snapshot c9ceee47-b0ff-4832-946b-06e0025b9037 of volume c3059c57-3952-4b3b-a43f-88ab14f29952 {{(pid=87444) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 10 04:54:13 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.remotefs [None req-33bce7a5-9562-473d-ad31-bd2c54f4a0a4 tempest-CinderUnicodeTest-973446373 None] snapshot_file for this snap is: volume-c3059c57-3952-4b3b-a43f-88ab14f29952.c9ceee47-b0ff-4832-946b-06e0025b9037 {{(pid=87444) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 10 04:54:13 devstack cinder-volume[87444]: DEBUG oslo.privsep.daemon [-] privsep: reply[99b4aa3a-39a2-43c5-8cbf-37b5c66f1107]: (4, 'qcow2') {{(pid=88499) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 04:54:13 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-33bce7a5-9562-473d-ad31-bd2c54f4a0a4 tempest-CinderUnicodeTest-973446373 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-c3059c57-3952-4b3b-a43f-88ab14f29952.c9ceee47-b0ff-4832-946b-06e0025b9037 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:54:13 devstack sudo[105756]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-c3059c57-3952-4b3b-a43f-88ab14f29952.c9ceee47-b0ff-4832-946b-06e0025b9037 Jul 10 04:54:13 devstack sudo[105756]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:54:13 devstack sudo[105752]: pam_unix(sudo:session): session closed for user root Jul 10 04:54:13 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-80dc9931-66d5-42b8-9366-f7bde3e9567b tempest-VolumeImageDependencyTests-2146091144 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-fdbeaa65-057f-49d9-8c6a-836a39956e47" returned: 0 in 1.012s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:54:13 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-80dc9931-66d5-42b8-9366-f7bde3e9567b tempest-VolumeImageDependencyTests-2146091144 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-fdbeaa65-057f-49d9-8c6a-836a39956e47 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:54:13 devstack sudo[105764]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-fdbeaa65-057f-49d9-8c6a-836a39956e47 Jul 10 04:54:13 devstack sudo[105764]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:54:13 devstack sudo[105753]: pam_unix(sudo:session): session closed for user root Jul 10 04:54:13 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-aff5be57-2623-4de6-9e19-6e4590de84d4 tempest-ProjectReaderTests-860343347 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-f3280c60-0b63-4351-8a2d-f1eafc703dcb 1073741824" returned: 0 in 1.109s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:54:13 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-aff5be57-2623-4de6-9e19-6e4590de84d4 tempest-ProjectReaderTests-860343347 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-f3280c60-0b63-4351-8a2d-f1eafc703dcb {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:54:13 devstack sudo[105767]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-f3280c60-0b63-4351-8a2d-f1eafc703dcb Jul 10 04:54:13 devstack sudo[105767]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:54:14 devstack sudo[105756]: pam_unix(sudo:session): session closed for user root Jul 10 04:54:14 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-33bce7a5-9562-473d-ad31-bd2c54f4a0a4 tempest-CinderUnicodeTest-973446373 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-c3059c57-3952-4b3b-a43f-88ab14f29952.c9ceee47-b0ff-4832-946b-06e0025b9037" returned: 0 in 0.946s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:54:14 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.remotefs [None req-33bce7a5-9562-473d-ad31-bd2c54f4a0a4 tempest-CinderUnicodeTest-973446373 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c3059c57-3952-4b3b-a43f-88ab14f29952(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87444) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 10 04:54:14 devstack cinder-volume[87444]: DEBUG oslo.privsep.daemon [-] privsep: reply[52e1a8db-9557-4e13-8d03-cfd50ff7c3bf]: (4, 'qcow2') {{(pid=88499) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 04:54:14 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-33bce7a5-9562-473d-ad31-bd2c54f4a0a4 tempest-CinderUnicodeTest-973446373 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-c3059c57-3952-4b3b-a43f-88ab14f29952 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:54:14 devstack sudo[105773]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-c3059c57-3952-4b3b-a43f-88ab14f29952 Jul 10 04:54:14 devstack sudo[105773]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:54:14 devstack sudo[105764]: pam_unix(sudo:session): session closed for user root Jul 10 04:54:14 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-80dc9931-66d5-42b8-9366-f7bde3e9567b tempest-VolumeImageDependencyTests-2146091144 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-fdbeaa65-057f-49d9-8c6a-836a39956e47" returned: 1 in 0.953s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:54:14 devstack sudo[105767]: pam_unix(sudo:session): session closed for user root Jul 10 04:54:14 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-80dc9931-66d5-42b8-9366-f7bde3e9567b tempest-VolumeImageDependencyTests-2146091144 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-fdbeaa65-057f-49d9-8c6a-836a39956e47' failed. Not Retrying. {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 10 04:54:14 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-80dc9931-66d5-42b8-9366-f7bde3e9567b tempest-VolumeImageDependencyTests-2146091144 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-fdbeaa65-057f-49d9-8c6a-836a39956e47 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:54:14 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-aff5be57-2623-4de6-9e19-6e4590de84d4 tempest-ProjectReaderTests-860343347 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-f3280c60-0b63-4351-8a2d-f1eafc703dcb" returned: 0 in 0.765s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:54:14 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-aff5be57-2623-4de6-9e19-6e4590de84d4 tempest-ProjectReaderTests-860343347 None] <== create_volume: return (1923ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922'} {{(pid=87444) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 04:54:14 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-aff5be57-2623-4de6-9e19-6e4590de84d4 tempest-ProjectReaderTests-860343347 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.926s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 04:54:14 devstack sudo[105779]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-fdbeaa65-057f-49d9-8c6a-836a39956e47 Jul 10 04:54:14 devstack sudo[105779]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:54:14 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-aff5be57-2623-4de6-9e19-6e4590de84d4 tempest-ProjectReaderTests-860343347 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9176f5af-85a1-4bf8-883f-ea1fc1363fea) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f3280c60-0b63-4351-8a2d-f1eafc703dcb', 'volume_size': 1}' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:54:14 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-aff5be57-2623-4de6-9e19-6e4590de84d4 tempest-ProjectReaderTests-860343347 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c1bd3203-5079-4687-a65e-35e24039c3c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:54:14 devstack cinder-volume[87444]: INFO cinder.volume.flows.manager.create_volume [None req-aff5be57-2623-4de6-9e19-6e4590de84d4 tempest-ProjectReaderTests-860343347 None] Volume volume-f3280c60-0b63-4351-8a2d-f1eafc703dcb (f3280c60-0b63-4351-8a2d-f1eafc703dcb): created successfully Jul 10 04:54:14 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-aff5be57-2623-4de6-9e19-6e4590de84d4 tempest-ProjectReaderTests-860343347 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c1bd3203-5079-4687-a65e-35e24039c3c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:54:14 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-aff5be57-2623-4de6-9e19-6e4590de84d4 tempest-ProjectReaderTests-860343347 None] Flow 'volume_create_manager' (05709690-01df-4ff0-9c30-c64276dd0b10) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87444) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 04:54:14 devstack cinder-volume[87444]: INFO cinder.volume.manager [None req-aff5be57-2623-4de6-9e19-6e4590de84d4 tempest-ProjectReaderTests-860343347 None] Created volume successfully. Jul 10 04:54:14 devstack sudo[105773]: pam_unix(sudo:session): session closed for user root Jul 10 04:54:14 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-33bce7a5-9562-473d-ad31-bd2c54f4a0a4 tempest-CinderUnicodeTest-973446373 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-c3059c57-3952-4b3b-a43f-88ab14f29952" returned: 0 in 0.844s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:54:14 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-33bce7a5-9562-473d-ad31-bd2c54f4a0a4 tempest-CinderUnicodeTest-973446373 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-c3059c57-3952-4b3b-a43f-88ab14f29952.c9ceee47-b0ff-4832-946b-06e0025b9037 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:54:14 devstack sudo[105784]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-c3059c57-3952-4b3b-a43f-88ab14f29952.c9ceee47-b0ff-4832-946b-06e0025b9037 Jul 10 04:54:14 devstack sudo[105784]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:54:15 devstack sudo[105779]: pam_unix(sudo:session): session closed for user root Jul 10 04:54:15 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-80dc9931-66d5-42b8-9366-f7bde3e9567b tempest-VolumeImageDependencyTests-2146091144 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-fdbeaa65-057f-49d9-8c6a-836a39956e47" returned: 0 in 0.717s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:54:15 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-80dc9931-66d5-42b8-9366-f7bde3e9567b tempest-VolumeImageDependencyTests-2146091144 None] Lock "cinder-quobyte-fdbeaa65-057f-49d9-8c6a-836a39956e47" released by "delete_volume" :: held 2.806s {{(pid=87444) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 04:54:15 devstack cinder-volume[87444]: DEBUG cinder.quota [None req-80dc9931-66d5-42b8-9366-f7bde3e9567b tempest-VolumeImageDependencyTests-2146091144 None] Created reservations ['63061553-15c8-4b89-aeea-1cf3b4e2ce1a', '76321c1a-64ec-4f59-a09e-9df0fd64d348', '18db7364-69c4-4ad1-8e98-6d3eaf2d41ba', '4a52b602-df60-4e4d-a033-6836acb9c56e'] {{(pid=87444) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 04:54:15 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-80dc9931-66d5-42b8-9366-f7bde3e9567b tempest-VolumeImageDependencyTests-2146091144 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 04:54:15 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-80dc9931-66d5-42b8-9366-f7bde3e9567b tempest-VolumeImageDependencyTests-2146091144 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 04:54:15 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-80dc9931-66d5-42b8-9366-f7bde3e9567b tempest-VolumeImageDependencyTests-2146091144 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922': None} {{(pid=87444) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 04:54:15 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-80dc9931-66d5-42b8-9366-f7bde3e9567b tempest-VolumeImageDependencyTests-2146091144 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922'] {{(pid=87444) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 04:54:15 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-80dc9931-66d5-42b8-9366-f7bde3e9567b tempest-VolumeImageDependencyTests-2146091144 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 04:54:15 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-80dc9931-66d5-42b8-9366-f7bde3e9567b tempest-VolumeImageDependencyTests-2146091144 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:54:15 devstack sudo[105787]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097 Jul 10 04:54:15 devstack sudo[105787]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:54:15 devstack sudo[105784]: pam_unix(sudo:session): session closed for user root Jul 10 04:54:15 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-b24c08c9-293e-4d12-b256-b49715ba54e9 tempest-ProjectReaderTests-860343347 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 04:54:15 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-b24c08c9-293e-4d12-b256-b49715ba54e9 tempest-ProjectReaderTests-860343347 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.003s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 04:54:15 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-33bce7a5-9562-473d-ad31-bd2c54f4a0a4 tempest-CinderUnicodeTest-973446373 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-c3059c57-3952-4b3b-a43f-88ab14f29952.c9ceee47-b0ff-4832-946b-06e0025b9037" returned: 0 in 0.885s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:54:15 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-33bce7a5-9562-473d-ad31-bd2c54f4a0a4 tempest-CinderUnicodeTest-973446373 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-c3059c57-3952-4b3b-a43f-88ab14f29952.c9ceee47-b0ff-4832-946b-06e0025b9037 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:54:15 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.remotefs [None req-b24c08c9-293e-4d12-b256-b49715ba54e9 tempest-ProjectReaderTests-860343347 None] Creating offline snapshot 9b4070c0-541d-46a9-bab1-3555b22722a9 of volume f3280c60-0b63-4351-8a2d-f1eafc703dcb {{(pid=87444) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 10 04:54:15 devstack sudo[105792]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-c3059c57-3952-4b3b-a43f-88ab14f29952.c9ceee47-b0ff-4832-946b-06e0025b9037 Jul 10 04:54:15 devstack sudo[105792]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:54:15 devstack cinder-volume[87444]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2dfafd7-504e-406a-8589-590f1fd241b7]: (4, 'qcow2') {{(pid=88499) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 04:54:15 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-b24c08c9-293e-4d12-b256-b49715ba54e9 tempest-ProjectReaderTests-860343347 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-f3280c60-0b63-4351-8a2d-f1eafc703dcb {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:54:15 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-ffe224ee-0a09-447a-9824-e992862c04c1 tempest-ProjectAdminTests-1434845842 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.7577743530273, 'free_capacity_gb': 1775.7577743530273, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=87444) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Jul 10 04:54:15 devstack sudo[105794]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-f3280c60-0b63-4351-8a2d-f1eafc703dcb Jul 10 04:54:16 devstack sudo[105794]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:54:16 devstack sudo[105787]: pam_unix(sudo:session): session closed for user root Jul 10 04:54:16 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-80dc9931-66d5-42b8-9366-f7bde3e9567b tempest-VolumeImageDependencyTests-2146091144 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097" returned: 0 in 0.811s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:54:16 devstack cinder-volume[87444]: DEBUG cinder.manager [None req-80dc9931-66d5-42b8-9366-f7bde3e9567b tempest-VolumeImageDependencyTests-2146091144 None] Notifying Schedulers of capabilities ... {{(pid=87444) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 04:54:16 devstack cinder-volume[87444]: INFO cinder.volume.manager [None req-80dc9931-66d5-42b8-9366-f7bde3e9567b tempest-VolumeImageDependencyTests-2146091144 None] Deleted volume successfully. Jul 10 04:54:16 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-80dc9931-66d5-42b8-9366-f7bde3e9567b tempest-VolumeImageDependencyTests-2146091144 None] Lock "cinder-fdbeaa65-057f-49d9-8c6a-836a39956e47-delete_volume" released by "delete_volume" :: held 3.879s {{(pid=87444) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 04:54:16 devstack sudo[105792]: pam_unix(sudo:session): session closed for user root Jul 10 04:54:16 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-33bce7a5-9562-473d-ad31-bd2c54f4a0a4 tempest-CinderUnicodeTest-973446373 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-c3059c57-3952-4b3b-a43f-88ab14f29952.c9ceee47-b0ff-4832-946b-06e0025b9037" returned: 0 in 1.005s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:54:16 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-33bce7a5-9562-473d-ad31-bd2c54f4a0a4 tempest-CinderUnicodeTest-973446373 None] Lock "cinder-quobyte-c9ceee47-b0ff-4832-946b-06e0025b9037" released by "_delete_snapshot" :: held 3.830s {{(pid=87444) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 04:54:16 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-33bce7a5-9562-473d-ad31-bd2c54f4a0a4 tempest-CinderUnicodeTest-973446373 None] Lock "cinder-quobyte-c3059c57-3952-4b3b-a43f-88ab14f29952" released by "delete_snapshot" :: held 3.865s {{(pid=87444) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 04:54:16 devstack cinder-volume[87444]: DEBUG cinder.quota [None req-33bce7a5-9562-473d-ad31-bd2c54f4a0a4 tempest-CinderUnicodeTest-973446373 None] Created reservations ['bdbb9e32-42c0-4d7c-b24f-85da2bf9c47d', 'f8ea44f6-78ac-452c-a283-d84ed64c1313', '30c71628-99aa-4f2c-989b-62df17a83e2a', '6d13cfbd-867c-4b54-811c-2db6f6a5bfd1'] {{(pid=87444) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 04:54:16 devstack sudo[105794]: pam_unix(sudo:session): session closed for user root Jul 10 04:54:16 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-b24c08c9-293e-4d12-b256-b49715ba54e9 tempest-ProjectReaderTests-860343347 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-f3280c60-0b63-4351-8a2d-f1eafc703dcb" returned: 0 in 1.143s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:54:16 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-b24c08c9-293e-4d12-b256-b49715ba54e9 tempest-ProjectReaderTests-860343347 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-f3280c60-0b63-4351-8a2d-f1eafc703dcb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-f3280c60-0b63-4351-8a2d-f1eafc703dcb.9b4070c0-541d-46a9-bab1-3555b22722a9 1G {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:54:17 devstack sudo[105803]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-f3280c60-0b63-4351-8a2d-f1eafc703dcb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-f3280c60-0b63-4351-8a2d-f1eafc703dcb.9b4070c0-541d-46a9-bab1-3555b22722a9 1G Jul 10 04:54:17 devstack sudo[105803]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:54:17 devstack cinder-volume[87444]: INFO cinder.volume.manager [None req-33bce7a5-9562-473d-ad31-bd2c54f4a0a4 tempest-CinderUnicodeTest-973446373 None] Delete snapshot completed successfully. Jul 10 04:54:17 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-33bce7a5-9562-473d-ad31-bd2c54f4a0a4 tempest-CinderUnicodeTest-973446373 None] Lock "cinder-c9ceee47-b0ff-4832-946b-06e0025b9037-delete_snapshot" released by "delete_snapshot" :: held 4.102s {{(pid=87444) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 04:54:17 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-11d5c2ee-de04-4dec-8a49-e19878302361 tempest-CinderUnicodeTest-973446373 None] Acquiring lock "cinder-c3059c57-3952-4b3b-a43f-88ab14f29952-delete_volume" by "delete_volume" {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 04:54:17 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-11d5c2ee-de04-4dec-8a49-e19878302361 tempest-CinderUnicodeTest-973446373 None] Lock "cinder-c3059c57-3952-4b3b-a43f-88ab14f29952-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 04:54:17 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-11d5c2ee-de04-4dec-8a49-e19878302361 tempest-CinderUnicodeTest-973446373 None] Acquiring lock "cinder-quobyte-c3059c57-3952-4b3b-a43f-88ab14f29952" by "delete_volume" {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 04:54:17 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-11d5c2ee-de04-4dec-8a49-e19878302361 tempest-CinderUnicodeTest-973446373 None] Lock "cinder-quobyte-c3059c57-3952-4b3b-a43f-88ab14f29952" acquired by "delete_volume" :: waited 0.031s {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 04:54:17 devstack cinder-volume[87444]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2df1e75-4ff9-4bad-8565-8d45005c1bd2]: (4, 'qcow2') {{(pid=88499) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 04:54:17 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-11d5c2ee-de04-4dec-8a49-e19878302361 tempest-CinderUnicodeTest-973446373 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-c3059c57-3952-4b3b-a43f-88ab14f29952 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:54:17 devstack sudo[105805]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-c3059c57-3952-4b3b-a43f-88ab14f29952 Jul 10 04:54:17 devstack sudo[105805]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:54:18 devstack sudo[105803]: pam_unix(sudo:session): session closed for user root Jul 10 04:54:18 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-b24c08c9-293e-4d12-b256-b49715ba54e9 tempest-ProjectReaderTests-860343347 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-f3280c60-0b63-4351-8a2d-f1eafc703dcb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-f3280c60-0b63-4351-8a2d-f1eafc703dcb.9b4070c0-541d-46a9-bab1-3555b22722a9 1G" returned: 0 in 1.028s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:54:18 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-b24c08c9-293e-4d12-b256-b49715ba54e9 tempest-ProjectReaderTests-860343347 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f3280c60-0b63-4351-8a2d-f1eafc703dcb -F qcow2 /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-f3280c60-0b63-4351-8a2d-f1eafc703dcb.9b4070c0-541d-46a9-bab1-3555b22722a9 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:54:18 devstack sudo[105810]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f3280c60-0b63-4351-8a2d-f1eafc703dcb -F qcow2 /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-f3280c60-0b63-4351-8a2d-f1eafc703dcb.9b4070c0-541d-46a9-bab1-3555b22722a9 Jul 10 04:54:18 devstack sudo[105810]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:54:18 devstack sudo[105805]: pam_unix(sudo:session): session closed for user root Jul 10 04:54:18 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-11d5c2ee-de04-4dec-8a49-e19878302361 tempest-CinderUnicodeTest-973446373 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-c3059c57-3952-4b3b-a43f-88ab14f29952" returned: 0 in 1.059s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:54:18 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-11d5c2ee-de04-4dec-8a49-e19878302361 tempest-CinderUnicodeTest-973446373 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-c3059c57-3952-4b3b-a43f-88ab14f29952 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:54:18 devstack sudo[105816]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-c3059c57-3952-4b3b-a43f-88ab14f29952 Jul 10 04:54:18 devstack sudo[105816]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:54:18 devstack sudo[105810]: pam_unix(sudo:session): session closed for user root Jul 10 04:54:18 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-b24c08c9-293e-4d12-b256-b49715ba54e9 tempest-ProjectReaderTests-860343347 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f3280c60-0b63-4351-8a2d-f1eafc703dcb -F qcow2 /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-f3280c60-0b63-4351-8a2d-f1eafc703dcb.9b4070c0-541d-46a9-bab1-3555b22722a9" returned: 0 in 0.870s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:54:18 devstack cinder-volume[87444]: WARNING cinder.volume.drivers.remotefs [None req-b24c08c9-293e-4d12-b256-b49715ba54e9 tempest-ProjectReaderTests-860343347 None] /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-f3280c60-0b63-4351-8a2d-f1eafc703dcb.9b4070c0-541d-46a9-bab1-3555b22722a9 is being set with open permissions: ugo+rw Jul 10 04:54:18 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-b24c08c9-293e-4d12-b256-b49715ba54e9 tempest-ProjectReaderTests-860343347 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-f3280c60-0b63-4351-8a2d-f1eafc703dcb.9b4070c0-541d-46a9-bab1-3555b22722a9 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:54:18 devstack sudo[105821]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-f3280c60-0b63-4351-8a2d-f1eafc703dcb.9b4070c0-541d-46a9-bab1-3555b22722a9 Jul 10 04:54:18 devstack sudo[105821]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:54:19 devstack sudo[105816]: pam_unix(sudo:session): session closed for user root Jul 10 04:54:19 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-11d5c2ee-de04-4dec-8a49-e19878302361 tempest-CinderUnicodeTest-973446373 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-c3059c57-3952-4b3b-a43f-88ab14f29952" returned: 0 in 0.810s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:54:19 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-11d5c2ee-de04-4dec-8a49-e19878302361 tempest-CinderUnicodeTest-973446373 None] Lock "cinder-quobyte-c3059c57-3952-4b3b-a43f-88ab14f29952" released by "delete_volume" :: held 1.952s {{(pid=87444) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 04:54:19 devstack cinder-volume[87444]: DEBUG cinder.quota [None req-11d5c2ee-de04-4dec-8a49-e19878302361 tempest-CinderUnicodeTest-973446373 None] Created reservations ['75dbcebe-c3e2-4fc0-855e-4f4f95a94ec8', '73c0b38d-4fcc-4b1e-81f7-c0a57195831e', '111c425a-cd4e-4507-b8e9-341f60a7b144', 'f1f2a3c4-c3a3-40bf-a596-a17176f840c2'] {{(pid=87444) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 04:54:19 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-11d5c2ee-de04-4dec-8a49-e19878302361 tempest-CinderUnicodeTest-973446373 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 04:54:19 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-11d5c2ee-de04-4dec-8a49-e19878302361 tempest-CinderUnicodeTest-973446373 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 04:54:19 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-11d5c2ee-de04-4dec-8a49-e19878302361 tempest-CinderUnicodeTest-973446373 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922': None} {{(pid=87444) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 04:54:19 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-11d5c2ee-de04-4dec-8a49-e19878302361 tempest-CinderUnicodeTest-973446373 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922'] {{(pid=87444) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 04:54:19 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-11d5c2ee-de04-4dec-8a49-e19878302361 tempest-CinderUnicodeTest-973446373 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 04:54:19 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-11d5c2ee-de04-4dec-8a49-e19878302361 tempest-CinderUnicodeTest-973446373 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:54:19 devstack sudo[105824]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097 Jul 10 04:54:19 devstack sudo[105824]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:54:19 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-4c42edb3-9440-402c-a57e-30a1a011283e tempest-CinderUnicodeTest-973446373 None] Acquiring lock "cinder-1fc1c39b-736a-48e4-ad7d-95706dee36f8-delete_volume" by "delete_volume" {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 04:54:19 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-4c42edb3-9440-402c-a57e-30a1a011283e tempest-CinderUnicodeTest-973446373 None] Lock "cinder-1fc1c39b-736a-48e4-ad7d-95706dee36f8-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 04:54:19 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-4c42edb3-9440-402c-a57e-30a1a011283e tempest-CinderUnicodeTest-973446373 None] Acquiring lock "cinder-quobyte-1fc1c39b-736a-48e4-ad7d-95706dee36f8" by "delete_volume" {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 04:54:19 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-4c42edb3-9440-402c-a57e-30a1a011283e tempest-CinderUnicodeTest-973446373 None] Lock "cinder-quobyte-1fc1c39b-736a-48e4-ad7d-95706dee36f8" acquired by "delete_volume" :: waited 0.019s {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 04:54:19 devstack cinder-volume[87444]: DEBUG oslo.privsep.daemon [-] privsep: reply[dcf7274c-3065-4538-a709-bf5964ec2ea3]: (4, 'qcow2') {{(pid=88499) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 04:54:19 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-4c42edb3-9440-402c-a57e-30a1a011283e tempest-CinderUnicodeTest-973446373 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-1fc1c39b-736a-48e4-ad7d-95706dee36f8 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:54:19 devstack sudo[105821]: pam_unix(sudo:session): session closed for user root Jul 10 04:54:19 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-b24c08c9-293e-4d12-b256-b49715ba54e9 tempest-ProjectReaderTests-860343347 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-f3280c60-0b63-4351-8a2d-f1eafc703dcb.9b4070c0-541d-46a9-bab1-3555b22722a9" returned: 0 in 0.845s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:54:19 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-b24c08c9-293e-4d12-b256-b49715ba54e9 tempest-ProjectReaderTests-860343347 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-f3280c60-0b63-4351-8a2d-f1eafc703dcb.info {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:54:19 devstack sudo[105828]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-f3280c60-0b63-4351-8a2d-f1eafc703dcb.info Jul 10 04:54:19 devstack sudo[105828]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:54:19 devstack sudo[105827]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-1fc1c39b-736a-48e4-ad7d-95706dee36f8 Jul 10 04:54:19 devstack sudo[105827]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:54:20 devstack sudo[105824]: pam_unix(sudo:session): session closed for user root Jul 10 04:54:20 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-11d5c2ee-de04-4dec-8a49-e19878302361 tempest-CinderUnicodeTest-973446373 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097" returned: 0 in 0.974s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:54:20 devstack cinder-volume[87444]: DEBUG cinder.manager [None req-11d5c2ee-de04-4dec-8a49-e19878302361 tempest-CinderUnicodeTest-973446373 None] Notifying Schedulers of capabilities ... {{(pid=87444) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 04:54:20 devstack cinder-volume[87444]: INFO cinder.volume.manager [None req-11d5c2ee-de04-4dec-8a49-e19878302361 tempest-CinderUnicodeTest-973446373 None] Deleted volume successfully. Jul 10 04:54:20 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-11d5c2ee-de04-4dec-8a49-e19878302361 tempest-CinderUnicodeTest-973446373 None] Lock "cinder-c3059c57-3952-4b3b-a43f-88ab14f29952-delete_volume" released by "delete_volume" :: held 3.213s {{(pid=87444) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 04:54:20 devstack sudo[105828]: pam_unix(sudo:session): session closed for user root Jul 10 04:54:20 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-b24c08c9-293e-4d12-b256-b49715ba54e9 tempest-ProjectReaderTests-860343347 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-f3280c60-0b63-4351-8a2d-f1eafc703dcb.info" returned: 0 in 0.881s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:54:20 devstack cinder-volume[87444]: WARNING cinder.volume.drivers.remotefs [None req-b24c08c9-293e-4d12-b256-b49715ba54e9 tempest-ProjectReaderTests-860343347 None] /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-f3280c60-0b63-4351-8a2d-f1eafc703dcb.info is being set with open permissions: ugo+rw Jul 10 04:54:20 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-b24c08c9-293e-4d12-b256-b49715ba54e9 tempest-ProjectReaderTests-860343347 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-f3280c60-0b63-4351-8a2d-f1eafc703dcb.info {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:54:20 devstack sudo[105836]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-f3280c60-0b63-4351-8a2d-f1eafc703dcb.info Jul 10 04:54:20 devstack sudo[105836]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:54:20 devstack sudo[105827]: pam_unix(sudo:session): session closed for user root Jul 10 04:54:20 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-4c42edb3-9440-402c-a57e-30a1a011283e tempest-CinderUnicodeTest-973446373 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-1fc1c39b-736a-48e4-ad7d-95706dee36f8" returned: 0 in 1.078s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:54:20 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-4c42edb3-9440-402c-a57e-30a1a011283e tempest-CinderUnicodeTest-973446373 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-1fc1c39b-736a-48e4-ad7d-95706dee36f8 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:54:20 devstack sudo[105838]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-1fc1c39b-736a-48e4-ad7d-95706dee36f8 Jul 10 04:54:20 devstack sudo[105838]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:54:21 devstack sudo[105836]: pam_unix(sudo:session): session closed for user root Jul 10 04:54:21 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-b24c08c9-293e-4d12-b256-b49715ba54e9 tempest-ProjectReaderTests-860343347 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-f3280c60-0b63-4351-8a2d-f1eafc703dcb.info" returned: 0 in 0.756s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:54:21 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-b24c08c9-293e-4d12-b256-b49715ba54e9 tempest-ProjectReaderTests-860343347 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.656s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 04:54:21 devstack sudo[105838]: pam_unix(sudo:session): session closed for user root Jul 10 04:54:21 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-4c42edb3-9440-402c-a57e-30a1a011283e tempest-CinderUnicodeTest-973446373 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-1fc1c39b-736a-48e4-ad7d-95706dee36f8" returned: 0 in 0.704s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:54:21 devstack cinder-volume[87444]: INFO cinder.volume.manager [None req-b24c08c9-293e-4d12-b256-b49715ba54e9 tempest-ProjectReaderTests-860343347 None] Create snapshot completed successfully Jul 10 04:54:21 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-4c42edb3-9440-402c-a57e-30a1a011283e tempest-CinderUnicodeTest-973446373 None] Lock "cinder-quobyte-1fc1c39b-736a-48e4-ad7d-95706dee36f8" released by "delete_volume" :: held 1.839s {{(pid=87444) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 04:54:21 devstack cinder-volume[87444]: DEBUG cinder.quota [None req-4c42edb3-9440-402c-a57e-30a1a011283e tempest-CinderUnicodeTest-973446373 None] Created reservations ['8cc668ab-7cd4-4907-9cc8-c458b3562600', '7598117c-99cd-4a13-96f5-78b23399770d', '7e2a9662-fb31-4236-a676-4870fd7c4dd2', '0361f1cb-cf50-4c9a-abbb-7b5a74d0d9b4'] {{(pid=87444) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 04:54:21 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-4c42edb3-9440-402c-a57e-30a1a011283e tempest-CinderUnicodeTest-973446373 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 04:54:21 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-4c42edb3-9440-402c-a57e-30a1a011283e tempest-CinderUnicodeTest-973446373 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 04:54:21 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-4c42edb3-9440-402c-a57e-30a1a011283e tempest-CinderUnicodeTest-973446373 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922': None} {{(pid=87444) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 04:54:21 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-4c42edb3-9440-402c-a57e-30a1a011283e tempest-CinderUnicodeTest-973446373 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922'] {{(pid=87444) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 04:54:21 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-4c42edb3-9440-402c-a57e-30a1a011283e tempest-CinderUnicodeTest-973446373 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 04:54:21 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-4c42edb3-9440-402c-a57e-30a1a011283e tempest-CinderUnicodeTest-973446373 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:54:21 devstack sudo[105842]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097 Jul 10 04:54:21 devstack sudo[105842]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:54:22 devstack sudo[105842]: pam_unix(sudo:session): session closed for user root Jul 10 04:54:22 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-4c42edb3-9440-402c-a57e-30a1a011283e tempest-CinderUnicodeTest-973446373 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097" returned: 0 in 0.678s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:54:22 devstack cinder-volume[87444]: DEBUG cinder.manager [None req-4c42edb3-9440-402c-a57e-30a1a011283e tempest-CinderUnicodeTest-973446373 None] Notifying Schedulers of capabilities ... {{(pid=87444) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 04:54:22 devstack cinder-volume[87444]: INFO cinder.volume.manager [None req-4c42edb3-9440-402c-a57e-30a1a011283e tempest-CinderUnicodeTest-973446373 None] Deleted volume successfully. Jul 10 04:54:22 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-4c42edb3-9440-402c-a57e-30a1a011283e tempest-CinderUnicodeTest-973446373 None] Lock "cinder-1fc1c39b-736a-48e4-ad7d-95706dee36f8-delete_volume" released by "delete_volume" :: held 2.780s {{(pid=87444) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 04:54:22 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-6d4285a5-7c76-4c3f-be0c-6174c32c5941 tempest-ProjectReaderTests-860343347 None] Acquiring lock "cinder-9b4070c0-541d-46a9-bab1-3555b22722a9-delete_snapshot" by "delete_snapshot" {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 04:54:22 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-6d4285a5-7c76-4c3f-be0c-6174c32c5941 tempest-ProjectReaderTests-860343347 None] Lock "cinder-9b4070c0-541d-46a9-bab1-3555b22722a9-delete_snapshot" acquired by "delete_snapshot" :: waited 0.031s {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 04:54:22 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-6d4285a5-7c76-4c3f-be0c-6174c32c5941 tempest-ProjectReaderTests-860343347 None] Acquiring lock "cinder-quobyte-f3280c60-0b63-4351-8a2d-f1eafc703dcb" by "delete_snapshot" {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 04:54:22 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-6d4285a5-7c76-4c3f-be0c-6174c32c5941 tempest-ProjectReaderTests-860343347 None] Lock "cinder-quobyte-f3280c60-0b63-4351-8a2d-f1eafc703dcb" acquired by "delete_snapshot" :: waited 0.029s {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 04:54:22 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-6d4285a5-7c76-4c3f-be0c-6174c32c5941 tempest-ProjectReaderTests-860343347 None] Acquiring lock "cinder-quobyte-9b4070c0-541d-46a9-bab1-3555b22722a9" by "_delete_snapshot" {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 04:54:22 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-6d4285a5-7c76-4c3f-be0c-6174c32c5941 tempest-ProjectReaderTests-860343347 None] Lock "cinder-quobyte-9b4070c0-541d-46a9-bab1-3555b22722a9" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 04:54:22 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.remotefs [None req-6d4285a5-7c76-4c3f-be0c-6174c32c5941 tempest-ProjectReaderTests-860343347 None] Deleting offline snapshot 9b4070c0-541d-46a9-bab1-3555b22722a9 of volume f3280c60-0b63-4351-8a2d-f1eafc703dcb {{(pid=87444) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 10 04:54:22 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.remotefs [None req-6d4285a5-7c76-4c3f-be0c-6174c32c5941 tempest-ProjectReaderTests-860343347 None] snapshot_file for this snap is: volume-f3280c60-0b63-4351-8a2d-f1eafc703dcb.9b4070c0-541d-46a9-bab1-3555b22722a9 {{(pid=87444) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 10 04:54:22 devstack cinder-volume[87444]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f033213-8ae7-4273-81cc-536bcb95c1a6]: (4, 'qcow2') {{(pid=88499) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 04:54:22 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-6d4285a5-7c76-4c3f-be0c-6174c32c5941 tempest-ProjectReaderTests-860343347 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-f3280c60-0b63-4351-8a2d-f1eafc703dcb.9b4070c0-541d-46a9-bab1-3555b22722a9 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:54:22 devstack sudo[105845]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-f3280c60-0b63-4351-8a2d-f1eafc703dcb.9b4070c0-541d-46a9-bab1-3555b22722a9 Jul 10 04:54:22 devstack sudo[105845]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:54:23 devstack sudo[105845]: pam_unix(sudo:session): session closed for user root Jul 10 04:54:23 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-6d4285a5-7c76-4c3f-be0c-6174c32c5941 tempest-ProjectReaderTests-860343347 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-f3280c60-0b63-4351-8a2d-f1eafc703dcb.9b4070c0-541d-46a9-bab1-3555b22722a9" returned: 0 in 0.950s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:54:23 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.remotefs [None req-6d4285a5-7c76-4c3f-be0c-6174c32c5941 tempest-ProjectReaderTests-860343347 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f3280c60-0b63-4351-8a2d-f1eafc703dcb(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87444) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 10 04:54:23 devstack cinder-volume[87444]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1216bfb-669e-4f37-9c67-1bfbc845a8d7]: (4, 'qcow2') {{(pid=88499) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 04:54:23 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-6d4285a5-7c76-4c3f-be0c-6174c32c5941 tempest-ProjectReaderTests-860343347 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-f3280c60-0b63-4351-8a2d-f1eafc703dcb {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:54:23 devstack sudo[105853]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-f3280c60-0b63-4351-8a2d-f1eafc703dcb Jul 10 04:54:23 devstack sudo[105853]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:54:24 devstack sudo[105853]: pam_unix(sudo:session): session closed for user root Jul 10 04:54:24 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-6d4285a5-7c76-4c3f-be0c-6174c32c5941 tempest-ProjectReaderTests-860343347 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-f3280c60-0b63-4351-8a2d-f1eafc703dcb" returned: 0 in 1.089s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:54:24 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-6d4285a5-7c76-4c3f-be0c-6174c32c5941 tempest-ProjectReaderTests-860343347 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-f3280c60-0b63-4351-8a2d-f1eafc703dcb.9b4070c0-541d-46a9-bab1-3555b22722a9 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:54:24 devstack sudo[105858]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-f3280c60-0b63-4351-8a2d-f1eafc703dcb.9b4070c0-541d-46a9-bab1-3555b22722a9 Jul 10 04:54:24 devstack sudo[105858]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:54:25 devstack sudo[105858]: pam_unix(sudo:session): session closed for user root Jul 10 04:54:25 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-6d4285a5-7c76-4c3f-be0c-6174c32c5941 tempest-ProjectReaderTests-860343347 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-f3280c60-0b63-4351-8a2d-f1eafc703dcb.9b4070c0-541d-46a9-bab1-3555b22722a9" returned: 0 in 0.864s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:54:25 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-6d4285a5-7c76-4c3f-be0c-6174c32c5941 tempest-ProjectReaderTests-860343347 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-f3280c60-0b63-4351-8a2d-f1eafc703dcb.9b4070c0-541d-46a9-bab1-3555b22722a9 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:54:25 devstack sudo[105863]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-f3280c60-0b63-4351-8a2d-f1eafc703dcb.9b4070c0-541d-46a9-bab1-3555b22722a9 Jul 10 04:54:25 devstack sudo[105863]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:54:26 devstack sudo[105863]: pam_unix(sudo:session): session closed for user root Jul 10 04:54:26 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-6d4285a5-7c76-4c3f-be0c-6174c32c5941 tempest-ProjectReaderTests-860343347 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-f3280c60-0b63-4351-8a2d-f1eafc703dcb.9b4070c0-541d-46a9-bab1-3555b22722a9" returned: 0 in 0.694s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:54:26 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-6d4285a5-7c76-4c3f-be0c-6174c32c5941 tempest-ProjectReaderTests-860343347 None] Lock "cinder-quobyte-9b4070c0-541d-46a9-bab1-3555b22722a9" released by "_delete_snapshot" :: held 3.753s {{(pid=87444) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 04:54:26 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-6d4285a5-7c76-4c3f-be0c-6174c32c5941 tempest-ProjectReaderTests-860343347 None] Lock "cinder-quobyte-f3280c60-0b63-4351-8a2d-f1eafc703dcb" released by "delete_snapshot" :: held 3.791s {{(pid=87444) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 04:54:26 devstack cinder-volume[87444]: DEBUG cinder.quota [None req-6d4285a5-7c76-4c3f-be0c-6174c32c5941 tempest-ProjectReaderTests-860343347 None] Created reservations ['84ca0053-63a0-46ba-8336-e76edc3ac8c3', '58da95fb-beb1-4031-ae05-b2e4578ada07', 'ca3bfd9e-4102-4c21-95e1-d6420e304f74', 'ba3c3b71-6fa4-47d4-9ff4-7ebdb7390584'] {{(pid=87444) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 04:54:26 devstack cinder-volume[87444]: INFO cinder.volume.manager [None req-6d4285a5-7c76-4c3f-be0c-6174c32c5941 tempest-ProjectReaderTests-860343347 None] Delete snapshot completed successfully. Jul 10 04:54:26 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-6d4285a5-7c76-4c3f-be0c-6174c32c5941 tempest-ProjectReaderTests-860343347 None] Lock "cinder-9b4070c0-541d-46a9-bab1-3555b22722a9-delete_snapshot" released by "delete_snapshot" :: held 3.975s {{(pid=87444) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 04:54:26 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-da09d24d-5cb3-4399-909a-d9528aa0baad tempest-ProjectReaderTests-860343347 None] Acquiring lock "cinder-f3280c60-0b63-4351-8a2d-f1eafc703dcb-delete_volume" by "delete_volume" {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 04:54:26 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-da09d24d-5cb3-4399-909a-d9528aa0baad tempest-ProjectReaderTests-860343347 None] Lock "cinder-f3280c60-0b63-4351-8a2d-f1eafc703dcb-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 04:54:27 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-da09d24d-5cb3-4399-909a-d9528aa0baad tempest-ProjectReaderTests-860343347 None] Acquiring lock "cinder-quobyte-f3280c60-0b63-4351-8a2d-f1eafc703dcb" by "delete_volume" {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 04:54:27 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-da09d24d-5cb3-4399-909a-d9528aa0baad tempest-ProjectReaderTests-860343347 None] Lock "cinder-quobyte-f3280c60-0b63-4351-8a2d-f1eafc703dcb" acquired by "delete_volume" :: waited 0.023s {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 04:54:27 devstack cinder-volume[87444]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a01d13d-9089-44fd-b4c4-5354944767bb]: (4, 'qcow2') {{(pid=88499) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 04:54:27 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-da09d24d-5cb3-4399-909a-d9528aa0baad tempest-ProjectReaderTests-860343347 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-f3280c60-0b63-4351-8a2d-f1eafc703dcb {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:54:27 devstack cinder-volume[87444]: DEBUG cinder.volume.flows.manager.create_volume [None req-60552a76-10f9-4314-88df-31f88919c546 tempest-ProjectMemberTests-1806793813 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87444) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 04:54:27 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-60552a76-10f9-4314-88df-31f88919c546 tempest-ProjectMemberTests-1806793813 None] Flow 'volume_create_manager' (eef47541-029e-4571-9a09-e8aa83414a89) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 04:54:27 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-60552a76-10f9-4314-88df-31f88919c546 tempest-ProjectMemberTests-1806793813 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a5b394d2-c249-4c4a-a878-c7530767e116) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:54:27 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-60552a76-10f9-4314-88df-31f88919c546 tempest-ProjectMemberTests-1806793813 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a5b394d2-c249-4c4a-a878-c7530767e116) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T02:54:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1757931831',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=35abcbff-ee5f-44a4-aa51-ddacce19e852,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cadbf6455bcb4ed48f08a3c15f1d84e3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T02:54:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T02:54:27Z,use_quota=True,user_id='2aceae1efa264e87bd2696a5a256f622',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(317e369e-1e06-434d-ae95-a335f0e6c903),volume_type_id=317e369e-1e06-434d-ae95-a335f0e6c903)' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:54:27 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-60552a76-10f9-4314-88df-31f88919c546 tempest-ProjectMemberTests-1806793813 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d860f13b-5706-43a8-ae54-29cf5096fb6d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:54:27 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-60552a76-10f9-4314-88df-31f88919c546 tempest-ProjectMemberTests-1806793813 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d860f13b-5706-43a8-ae54-29cf5096fb6d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:54:27 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-60552a76-10f9-4314-88df-31f88919c546 tempest-ProjectMemberTests-1806793813 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a4b3bed4-4b22-4b95-91b3-ba3f00eb6d40) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:54:27 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-60552a76-10f9-4314-88df-31f88919c546 tempest-ProjectMemberTests-1806793813 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a4b3bed4-4b22-4b95-91b3-ba3f00eb6d40) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '35abcbff-ee5f-44a4-aa51-ddacce19e852', 'volume_name': 'volume-35abcbff-ee5f-44a4-aa51-ddacce19e852', 'volume_size': 1}' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:54:27 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-60552a76-10f9-4314-88df-31f88919c546 tempest-ProjectMemberTests-1806793813 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f7942901-7e69-4b15-ab43-9a1004ff60ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:54:27 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-60552a76-10f9-4314-88df-31f88919c546 tempest-ProjectMemberTests-1806793813 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f7942901-7e69-4b15-ab43-9a1004ff60ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:54:27 devstack sudo[105866]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-f3280c60-0b63-4351-8a2d-f1eafc703dcb Jul 10 04:54:27 devstack sudo[105866]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:54:27 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-60552a76-10f9-4314-88df-31f88919c546 tempest-ProjectMemberTests-1806793813 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (95e53343-9d02-4ed8-88a9-ca3d2c50c8d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:54:27 devstack cinder-volume[87444]: INFO cinder.volume.flows.manager.create_volume [None req-60552a76-10f9-4314-88df-31f88919c546 tempest-ProjectMemberTests-1806793813 None] Volume 35abcbff-ee5f-44a4-aa51-ddacce19e852: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-35abcbff-ee5f-44a4-aa51-ddacce19e852', 'volume_size': 1} Jul 10 04:54:27 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-60552a76-10f9-4314-88df-31f88919c546 tempest-ProjectMemberTests-1806793813 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 04:54:27 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-60552a76-10f9-4314-88df-31f88919c546 tempest-ProjectMemberTests-1806793813 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 04:54:27 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-60552a76-10f9-4314-88df-31f88919c546 tempest-ProjectMemberTests-1806793813 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T02:54:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1757931831',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=35abcbff-ee5f-44a4-aa51-ddacce19e852,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cadbf6455bcb4ed48f08a3c15f1d84e3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T02:54:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T02:54:27Z,use_quota=True,user_id='2aceae1efa264e87bd2696a5a256f622',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(317e369e-1e06-434d-ae95-a335f0e6c903),volume_type_id=317e369e-1e06-434d-ae95-a335f0e6c903)}" {{(pid=87444) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 04:54:27 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.remotefs [None req-60552a76-10f9-4314-88df-31f88919c546 tempest-ProjectMemberTests-1806793813 None] Creating volume 35abcbff-ee5f-44a4-aa51-ddacce19e852 {{(pid=87444) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 04:54:27 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-60552a76-10f9-4314-88df-31f88919c546 tempest-ProjectMemberTests-1806793813 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 04:54:27 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-60552a76-10f9-4314-88df-31f88919c546 tempest-ProjectMemberTests-1806793813 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 04:54:27 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-60552a76-10f9-4314-88df-31f88919c546 tempest-ProjectMemberTests-1806793813 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922': None} {{(pid=87444) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 04:54:27 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-60552a76-10f9-4314-88df-31f88919c546 tempest-ProjectMemberTests-1806793813 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922'] {{(pid=87444) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 04:54:27 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-60552a76-10f9-4314-88df-31f88919c546 tempest-ProjectMemberTests-1806793813 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 04:54:27 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-60552a76-10f9-4314-88df-31f88919c546 tempest-ProjectMemberTests-1806793813 None] Selected osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922 as target Quobyte volume. {{(pid=87444) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 04:54:27 devstack cinder-volume[87444]: INFO cinder.volume.drivers.remotefs [None req-60552a76-10f9-4314-88df-31f88919c546 tempest-ProjectMemberTests-1806793813 None] casted to osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922 Jul 10 04:54:27 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-60552a76-10f9-4314-88df-31f88919c546 tempest-ProjectMemberTests-1806793813 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-35abcbff-ee5f-44a4-aa51-ddacce19e852 1073741824 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:54:27 devstack sudo[105868]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-35abcbff-ee5f-44a4-aa51-ddacce19e852 1073741824 Jul 10 04:54:27 devstack sudo[105868]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:54:28 devstack sudo[105866]: pam_unix(sudo:session): session closed for user root Jul 10 04:54:28 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-da09d24d-5cb3-4399-909a-d9528aa0baad tempest-ProjectReaderTests-860343347 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-f3280c60-0b63-4351-8a2d-f1eafc703dcb" returned: 0 in 0.897s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:54:28 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-da09d24d-5cb3-4399-909a-d9528aa0baad tempest-ProjectReaderTests-860343347 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-f3280c60-0b63-4351-8a2d-f1eafc703dcb {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:54:28 devstack sudo[105875]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-f3280c60-0b63-4351-8a2d-f1eafc703dcb Jul 10 04:54:28 devstack sudo[105875]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:54:28 devstack cinder-volume[87444]: DEBUG cinder.volume.flows.manager.create_volume [None req-e70ad265-bf99-4d63-a1bb-ed1bef1e79d6 tempest-ProjectReaderTests-2038494182 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87444) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 04:54:28 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-e70ad265-bf99-4d63-a1bb-ed1bef1e79d6 tempest-ProjectReaderTests-2038494182 None] Flow 'volume_create_manager' (5d6d5ede-e6eb-41f0-9a89-72baca4650c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 04:54:28 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-e70ad265-bf99-4d63-a1bb-ed1bef1e79d6 tempest-ProjectReaderTests-2038494182 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e9fbe07f-7b4d-4196-a34e-9f1d2d441606) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:54:28 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-e70ad265-bf99-4d63-a1bb-ed1bef1e79d6 tempest-ProjectReaderTests-2038494182 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e9fbe07f-7b4d-4196-a34e-9f1d2d441606) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T02:54:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1959743699',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=62876fed-36a5-4af5-812c-0f5d4ba84c38,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='744b84b726234b0eaf68963b2911195c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T02:54:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T02:54:28Z,use_quota=True,user_id='622ec2abfd1c4c3f977a20d6f717b821',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(317e369e-1e06-434d-ae95-a335f0e6c903),volume_type_id=317e369e-1e06-434d-ae95-a335f0e6c903)' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:54:28 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-e70ad265-bf99-4d63-a1bb-ed1bef1e79d6 tempest-ProjectReaderTests-2038494182 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3b840e1f-c9c8-472a-8d1c-60b5f428a34e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:54:28 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-e70ad265-bf99-4d63-a1bb-ed1bef1e79d6 tempest-ProjectReaderTests-2038494182 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3b840e1f-c9c8-472a-8d1c-60b5f428a34e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:54:28 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-e70ad265-bf99-4d63-a1bb-ed1bef1e79d6 tempest-ProjectReaderTests-2038494182 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eb9ca36d-a4fa-4474-9003-1921cfdc2075) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:54:28 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-e70ad265-bf99-4d63-a1bb-ed1bef1e79d6 tempest-ProjectReaderTests-2038494182 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eb9ca36d-a4fa-4474-9003-1921cfdc2075) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '62876fed-36a5-4af5-812c-0f5d4ba84c38', 'volume_name': 'volume-62876fed-36a5-4af5-812c-0f5d4ba84c38', 'volume_size': 1}' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:54:28 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-e70ad265-bf99-4d63-a1bb-ed1bef1e79d6 tempest-ProjectReaderTests-2038494182 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3d1c67c0-0958-4e29-9b47-ab790ffdf4f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:54:28 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-e70ad265-bf99-4d63-a1bb-ed1bef1e79d6 tempest-ProjectReaderTests-2038494182 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3d1c67c0-0958-4e29-9b47-ab790ffdf4f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:54:28 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-e70ad265-bf99-4d63-a1bb-ed1bef1e79d6 tempest-ProjectReaderTests-2038494182 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0b0e8954-7a34-42df-91e4-cf29976065d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:54:28 devstack cinder-volume[87444]: INFO cinder.volume.flows.manager.create_volume [None req-e70ad265-bf99-4d63-a1bb-ed1bef1e79d6 tempest-ProjectReaderTests-2038494182 None] Volume 62876fed-36a5-4af5-812c-0f5d4ba84c38: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-62876fed-36a5-4af5-812c-0f5d4ba84c38', 'volume_size': 1} Jul 10 04:54:28 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-e70ad265-bf99-4d63-a1bb-ed1bef1e79d6 tempest-ProjectReaderTests-2038494182 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 04:54:28 devstack sudo[105868]: pam_unix(sudo:session): session closed for user root Jul 10 04:54:28 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-60552a76-10f9-4314-88df-31f88919c546 tempest-ProjectMemberTests-1806793813 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-35abcbff-ee5f-44a4-aa51-ddacce19e852 1073741824" returned: 0 in 1.078s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:54:28 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-60552a76-10f9-4314-88df-31f88919c546 tempest-ProjectMemberTests-1806793813 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-35abcbff-ee5f-44a4-aa51-ddacce19e852 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:54:28 devstack sudo[105880]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-35abcbff-ee5f-44a4-aa51-ddacce19e852 Jul 10 04:54:28 devstack sudo[105880]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:54:28 devstack sudo[105875]: pam_unix(sudo:session): session closed for user root Jul 10 04:54:28 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-da09d24d-5cb3-4399-909a-d9528aa0baad tempest-ProjectReaderTests-860343347 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-f3280c60-0b63-4351-8a2d-f1eafc703dcb" returned: 0 in 0.711s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:54:28 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-da09d24d-5cb3-4399-909a-d9528aa0baad tempest-ProjectReaderTests-860343347 None] Lock "cinder-quobyte-f3280c60-0b63-4351-8a2d-f1eafc703dcb" released by "delete_volume" :: held 1.692s {{(pid=87444) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 04:54:28 devstack cinder-volume[87444]: DEBUG cinder.quota [None req-da09d24d-5cb3-4399-909a-d9528aa0baad tempest-ProjectReaderTests-860343347 None] Created reservations ['c810e1a6-777d-4eae-9c83-32a7dde104f3', 'dccc40ec-474f-45f7-bdeb-336422f57396', '284d7507-1a1b-4148-80f3-f0060848fba2', 'f061de81-f559-48c0-aa24-b2de5432fdf7'] {{(pid=87444) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 04:54:28 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-da09d24d-5cb3-4399-909a-d9528aa0baad tempest-ProjectReaderTests-860343347 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 04:54:28 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-da09d24d-5cb3-4399-909a-d9528aa0baad tempest-ProjectReaderTests-860343347 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 04:54:28 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-da09d24d-5cb3-4399-909a-d9528aa0baad tempest-ProjectReaderTests-860343347 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922': None} {{(pid=87444) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 04:54:28 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-da09d24d-5cb3-4399-909a-d9528aa0baad tempest-ProjectReaderTests-860343347 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922'] {{(pid=87444) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 04:54:28 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-da09d24d-5cb3-4399-909a-d9528aa0baad tempest-ProjectReaderTests-860343347 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 04:54:28 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-da09d24d-5cb3-4399-909a-d9528aa0baad tempest-ProjectReaderTests-860343347 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:54:28 devstack sudo[105883]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097 Jul 10 04:54:28 devstack sudo[105883]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:54:29 devstack sudo[105880]: pam_unix(sudo:session): session closed for user root Jul 10 04:54:29 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-60552a76-10f9-4314-88df-31f88919c546 tempest-ProjectMemberTests-1806793813 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-35abcbff-ee5f-44a4-aa51-ddacce19e852" returned: 0 in 0.686s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:54:29 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-60552a76-10f9-4314-88df-31f88919c546 tempest-ProjectMemberTests-1806793813 None] <== create_volume: return (1806ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922'} {{(pid=87444) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 04:54:29 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-60552a76-10f9-4314-88df-31f88919c546 tempest-ProjectMemberTests-1806793813 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.808s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 04:54:29 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-e70ad265-bf99-4d63-a1bb-ed1bef1e79d6 tempest-ProjectReaderTests-2038494182 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.766s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 04:54:29 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-e70ad265-bf99-4d63-a1bb-ed1bef1e79d6 tempest-ProjectReaderTests-2038494182 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T02:54:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1959743699',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=62876fed-36a5-4af5-812c-0f5d4ba84c38,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='744b84b726234b0eaf68963b2911195c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T02:54:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T02:54:28Z,use_quota=True,user_id='622ec2abfd1c4c3f977a20d6f717b821',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(317e369e-1e06-434d-ae95-a335f0e6c903),volume_type_id=317e369e-1e06-434d-ae95-a335f0e6c903)}" {{(pid=87444) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 04:54:29 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.remotefs [None req-e70ad265-bf99-4d63-a1bb-ed1bef1e79d6 tempest-ProjectReaderTests-2038494182 None] Creating volume 62876fed-36a5-4af5-812c-0f5d4ba84c38 {{(pid=87444) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 04:54:29 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-e70ad265-bf99-4d63-a1bb-ed1bef1e79d6 tempest-ProjectReaderTests-2038494182 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 04:54:29 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-e70ad265-bf99-4d63-a1bb-ed1bef1e79d6 tempest-ProjectReaderTests-2038494182 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 04:54:29 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-e70ad265-bf99-4d63-a1bb-ed1bef1e79d6 tempest-ProjectReaderTests-2038494182 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922': None} {{(pid=87444) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 04:54:29 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-e70ad265-bf99-4d63-a1bb-ed1bef1e79d6 tempest-ProjectReaderTests-2038494182 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922'] {{(pid=87444) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 04:54:29 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-e70ad265-bf99-4d63-a1bb-ed1bef1e79d6 tempest-ProjectReaderTests-2038494182 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 04:54:29 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-e70ad265-bf99-4d63-a1bb-ed1bef1e79d6 tempest-ProjectReaderTests-2038494182 None] Selected osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922 as target Quobyte volume. {{(pid=87444) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 04:54:29 devstack cinder-volume[87444]: INFO cinder.volume.drivers.remotefs [None req-e70ad265-bf99-4d63-a1bb-ed1bef1e79d6 tempest-ProjectReaderTests-2038494182 None] casted to osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922 Jul 10 04:54:29 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-e70ad265-bf99-4d63-a1bb-ed1bef1e79d6 tempest-ProjectReaderTests-2038494182 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-62876fed-36a5-4af5-812c-0f5d4ba84c38 1073741824 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:54:29 devstack sudo[105886]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-62876fed-36a5-4af5-812c-0f5d4ba84c38 1073741824 Jul 10 04:54:29 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-60552a76-10f9-4314-88df-31f88919c546 tempest-ProjectMemberTests-1806793813 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (95e53343-9d02-4ed8-88a9-ca3d2c50c8d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-35abcbff-ee5f-44a4-aa51-ddacce19e852', 'volume_size': 1}' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:54:29 devstack sudo[105886]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:54:29 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-60552a76-10f9-4314-88df-31f88919c546 tempest-ProjectMemberTests-1806793813 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bcbb8c6e-8f65-4389-b763-66f1e1f2a3ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:54:29 devstack cinder-volume[87444]: INFO cinder.volume.flows.manager.create_volume [None req-60552a76-10f9-4314-88df-31f88919c546 tempest-ProjectMemberTests-1806793813 None] Volume volume-35abcbff-ee5f-44a4-aa51-ddacce19e852 (35abcbff-ee5f-44a4-aa51-ddacce19e852): created successfully Jul 10 04:54:29 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-60552a76-10f9-4314-88df-31f88919c546 tempest-ProjectMemberTests-1806793813 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bcbb8c6e-8f65-4389-b763-66f1e1f2a3ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:54:29 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-60552a76-10f9-4314-88df-31f88919c546 tempest-ProjectMemberTests-1806793813 None] Flow 'volume_create_manager' (eef47541-029e-4571-9a09-e8aa83414a89) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87444) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 04:54:29 devstack cinder-volume[87444]: INFO cinder.volume.manager [None req-60552a76-10f9-4314-88df-31f88919c546 tempest-ProjectMemberTests-1806793813 None] Created volume successfully. Jul 10 04:54:29 devstack sudo[105883]: pam_unix(sudo:session): session closed for user root Jul 10 04:54:29 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-da09d24d-5cb3-4399-909a-d9528aa0baad tempest-ProjectReaderTests-860343347 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097" returned: 0 in 0.801s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:54:29 devstack cinder-volume[87444]: DEBUG cinder.manager [None req-da09d24d-5cb3-4399-909a-d9528aa0baad tempest-ProjectReaderTests-860343347 None] Notifying Schedulers of capabilities ... {{(pid=87444) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 04:54:29 devstack cinder-volume[87444]: INFO cinder.volume.manager [None req-da09d24d-5cb3-4399-909a-d9528aa0baad tempest-ProjectReaderTests-860343347 None] Deleted volume successfully. Jul 10 04:54:29 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-da09d24d-5cb3-4399-909a-d9528aa0baad tempest-ProjectReaderTests-860343347 None] Lock "cinder-f3280c60-0b63-4351-8a2d-f1eafc703dcb-delete_volume" released by "delete_volume" :: held 2.743s {{(pid=87444) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 04:54:30 devstack cinder-volume[87444]: DEBUG cinder.volume.flows.manager.create_volume [None req-6e290097-f002-4f64-a482-cec7e351c201 tempest-ProjectReaderTests-860343347 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87444) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 04:54:30 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-6e290097-f002-4f64-a482-cec7e351c201 tempest-ProjectReaderTests-860343347 None] Flow 'volume_create_manager' (a53b2303-2d2e-4bd9-9333-9a182d5c0fd7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 04:54:30 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-6e290097-f002-4f64-a482-cec7e351c201 tempest-ProjectReaderTests-860343347 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a5c0b59c-b8a0-4e7d-952a-6162e63f3a48) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:54:30 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-6e290097-f002-4f64-a482-cec7e351c201 tempest-ProjectReaderTests-860343347 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a5c0b59c-b8a0-4e7d-952a-6162e63f3a48) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T02:54:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1907130106',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=eb55c4cd-e620-471c-a91d-be486be43a51,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='181feec0fe8f488b8b6345b78eb67c5c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T02:54:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T02:54:30Z,use_quota=True,user_id='c9a1d6a7ee0a44ff83a1bceb660b8015',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(317e369e-1e06-434d-ae95-a335f0e6c903),volume_type_id=317e369e-1e06-434d-ae95-a335f0e6c903)' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:54:30 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-6e290097-f002-4f64-a482-cec7e351c201 tempest-ProjectReaderTests-860343347 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (300c5867-e8ac-418d-84e0-aae5452830b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:54:30 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-6e290097-f002-4f64-a482-cec7e351c201 tempest-ProjectReaderTests-860343347 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (300c5867-e8ac-418d-84e0-aae5452830b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:54:30 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-6e290097-f002-4f64-a482-cec7e351c201 tempest-ProjectReaderTests-860343347 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e4b7f38c-b0ae-44bc-bc60-2f91a8ca743e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:54:30 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-6e290097-f002-4f64-a482-cec7e351c201 tempest-ProjectReaderTests-860343347 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e4b7f38c-b0ae-44bc-bc60-2f91a8ca743e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'eb55c4cd-e620-471c-a91d-be486be43a51', 'volume_name': 'volume-eb55c4cd-e620-471c-a91d-be486be43a51', 'volume_size': 1}' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:54:30 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-6e290097-f002-4f64-a482-cec7e351c201 tempest-ProjectReaderTests-860343347 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (131dd90c-c2ef-40d9-a7ed-b100d696db3b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:54:30 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-6e290097-f002-4f64-a482-cec7e351c201 tempest-ProjectReaderTests-860343347 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (131dd90c-c2ef-40d9-a7ed-b100d696db3b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:54:30 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-6e290097-f002-4f64-a482-cec7e351c201 tempest-ProjectReaderTests-860343347 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f2a92b4a-2039-4ec1-b7de-55c68078eaea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:54:30 devstack cinder-volume[87444]: INFO cinder.volume.flows.manager.create_volume [None req-6e290097-f002-4f64-a482-cec7e351c201 tempest-ProjectReaderTests-860343347 None] Volume eb55c4cd-e620-471c-a91d-be486be43a51: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-eb55c4cd-e620-471c-a91d-be486be43a51', 'volume_size': 1} Jul 10 04:54:30 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-6e290097-f002-4f64-a482-cec7e351c201 tempest-ProjectReaderTests-860343347 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 04:54:30 devstack sudo[105886]: pam_unix(sudo:session): session closed for user root Jul 10 04:54:30 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-e70ad265-bf99-4d63-a1bb-ed1bef1e79d6 tempest-ProjectReaderTests-2038494182 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-62876fed-36a5-4af5-812c-0f5d4ba84c38 1073741824" returned: 0 in 1.038s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:54:30 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-e70ad265-bf99-4d63-a1bb-ed1bef1e79d6 tempest-ProjectReaderTests-2038494182 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-62876fed-36a5-4af5-812c-0f5d4ba84c38 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:54:30 devstack sudo[105893]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-62876fed-36a5-4af5-812c-0f5d4ba84c38 Jul 10 04:54:30 devstack sudo[105893]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:54:30 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-7ea179b9-3e11-43a2-9b24-c4343c021711 tempest-ProjectMemberTests-1806793813 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 04:54:30 devstack sudo[105893]: pam_unix(sudo:session): session closed for user root Jul 10 04:54:30 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-e70ad265-bf99-4d63-a1bb-ed1bef1e79d6 tempest-ProjectReaderTests-2038494182 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-62876fed-36a5-4af5-812c-0f5d4ba84c38" returned: 0 in 0.671s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:54:30 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-e70ad265-bf99-4d63-a1bb-ed1bef1e79d6 tempest-ProjectReaderTests-2038494182 None] <== create_volume: return (1749ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922'} {{(pid=87444) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 04:54:30 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-e70ad265-bf99-4d63-a1bb-ed1bef1e79d6 tempest-ProjectReaderTests-2038494182 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.751s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 04:54:30 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-6e290097-f002-4f64-a482-cec7e351c201 tempest-ProjectReaderTests-860343347 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.742s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 04:54:30 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-6e290097-f002-4f64-a482-cec7e351c201 tempest-ProjectReaderTests-860343347 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T02:54:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1907130106',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=eb55c4cd-e620-471c-a91d-be486be43a51,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='181feec0fe8f488b8b6345b78eb67c5c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T02:54:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T02:54:30Z,use_quota=True,user_id='c9a1d6a7ee0a44ff83a1bceb660b8015',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(317e369e-1e06-434d-ae95-a335f0e6c903),volume_type_id=317e369e-1e06-434d-ae95-a335f0e6c903)}" {{(pid=87444) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 04:54:30 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.remotefs [None req-6e290097-f002-4f64-a482-cec7e351c201 tempest-ProjectReaderTests-860343347 None] Creating volume eb55c4cd-e620-471c-a91d-be486be43a51 {{(pid=87444) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 04:54:30 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-6e290097-f002-4f64-a482-cec7e351c201 tempest-ProjectReaderTests-860343347 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 04:54:30 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-6e290097-f002-4f64-a482-cec7e351c201 tempest-ProjectReaderTests-860343347 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 04:54:30 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-6e290097-f002-4f64-a482-cec7e351c201 tempest-ProjectReaderTests-860343347 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922': None} {{(pid=87444) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 04:54:30 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-6e290097-f002-4f64-a482-cec7e351c201 tempest-ProjectReaderTests-860343347 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922'] {{(pid=87444) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 04:54:30 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-6e290097-f002-4f64-a482-cec7e351c201 tempest-ProjectReaderTests-860343347 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 04:54:30 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-6e290097-f002-4f64-a482-cec7e351c201 tempest-ProjectReaderTests-860343347 None] Selected osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922 as target Quobyte volume. {{(pid=87444) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 04:54:30 devstack cinder-volume[87444]: INFO cinder.volume.drivers.remotefs [None req-6e290097-f002-4f64-a482-cec7e351c201 tempest-ProjectReaderTests-860343347 None] casted to osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922 Jul 10 04:54:30 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-6e290097-f002-4f64-a482-cec7e351c201 tempest-ProjectReaderTests-860343347 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-eb55c4cd-e620-471c-a91d-be486be43a51 1073741824 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:54:30 devstack sudo[105896]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-eb55c4cd-e620-471c-a91d-be486be43a51 1073741824 Jul 10 04:54:30 devstack sudo[105896]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:54:30 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-e70ad265-bf99-4d63-a1bb-ed1bef1e79d6 tempest-ProjectReaderTests-2038494182 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0b0e8954-7a34-42df-91e4-cf29976065d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-62876fed-36a5-4af5-812c-0f5d4ba84c38', 'volume_size': 1}' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:54:30 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-e70ad265-bf99-4d63-a1bb-ed1bef1e79d6 tempest-ProjectReaderTests-2038494182 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (42af4f86-1db2-4702-b756-5a7c580a898b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:54:30 devstack cinder-volume[87444]: INFO cinder.volume.flows.manager.create_volume [None req-e70ad265-bf99-4d63-a1bb-ed1bef1e79d6 tempest-ProjectReaderTests-2038494182 None] Volume volume-62876fed-36a5-4af5-812c-0f5d4ba84c38 (62876fed-36a5-4af5-812c-0f5d4ba84c38): created successfully Jul 10 04:54:30 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-e70ad265-bf99-4d63-a1bb-ed1bef1e79d6 tempest-ProjectReaderTests-2038494182 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (42af4f86-1db2-4702-b756-5a7c580a898b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:54:30 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-e70ad265-bf99-4d63-a1bb-ed1bef1e79d6 tempest-ProjectReaderTests-2038494182 None] Flow 'volume_create_manager' (5d6d5ede-e6eb-41f0-9a89-72baca4650c4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87444) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 04:54:30 devstack cinder-volume[87444]: INFO cinder.volume.manager [None req-e70ad265-bf99-4d63-a1bb-ed1bef1e79d6 tempest-ProjectReaderTests-2038494182 None] Created volume successfully. Jul 10 04:54:31 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-67799df4-72a7-4d21-bf08-2b3bde02a90e tempest-ProjectReaderTests-2038494182 None] Acquiring lock "cinder-62876fed-36a5-4af5-812c-0f5d4ba84c38-delete_volume" by "delete_volume" {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 04:54:31 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-67799df4-72a7-4d21-bf08-2b3bde02a90e tempest-ProjectReaderTests-2038494182 None] Lock "cinder-62876fed-36a5-4af5-812c-0f5d4ba84c38-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 04:54:31 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-67799df4-72a7-4d21-bf08-2b3bde02a90e tempest-ProjectReaderTests-2038494182 None] Acquiring lock "cinder-quobyte-62876fed-36a5-4af5-812c-0f5d4ba84c38" by "delete_volume" {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 04:54:31 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-67799df4-72a7-4d21-bf08-2b3bde02a90e tempest-ProjectReaderTests-2038494182 None] Lock "cinder-quobyte-62876fed-36a5-4af5-812c-0f5d4ba84c38" acquired by "delete_volume" :: waited 0.014s {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 04:54:31 devstack cinder-volume[87444]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ac56bac-11f3-4e10-b2b1-22e72404ca68]: (4, 'qcow2') {{(pid=88499) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 04:54:31 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-67799df4-72a7-4d21-bf08-2b3bde02a90e tempest-ProjectReaderTests-2038494182 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-62876fed-36a5-4af5-812c-0f5d4ba84c38 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:54:31 devstack sudo[105898]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-62876fed-36a5-4af5-812c-0f5d4ba84c38 Jul 10 04:54:31 devstack sudo[105898]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:54:31 devstack sudo[105896]: pam_unix(sudo:session): session closed for user root Jul 10 04:54:31 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-6e290097-f002-4f64-a482-cec7e351c201 tempest-ProjectReaderTests-860343347 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-eb55c4cd-e620-471c-a91d-be486be43a51 1073741824" returned: 0 in 0.988s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:54:31 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-6e290097-f002-4f64-a482-cec7e351c201 tempest-ProjectReaderTests-860343347 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-eb55c4cd-e620-471c-a91d-be486be43a51 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:54:31 devstack sudo[105903]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-eb55c4cd-e620-471c-a91d-be486be43a51 Jul 10 04:54:31 devstack sudo[105903]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:54:32 devstack sudo[105898]: pam_unix(sudo:session): session closed for user root Jul 10 04:54:32 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-67799df4-72a7-4d21-bf08-2b3bde02a90e tempest-ProjectReaderTests-2038494182 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-62876fed-36a5-4af5-812c-0f5d4ba84c38" returned: 0 in 0.812s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:54:32 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-67799df4-72a7-4d21-bf08-2b3bde02a90e tempest-ProjectReaderTests-2038494182 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-62876fed-36a5-4af5-812c-0f5d4ba84c38 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:54:32 devstack sudo[105908]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-62876fed-36a5-4af5-812c-0f5d4ba84c38 Jul 10 04:54:32 devstack sudo[105908]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:54:32 devstack sudo[105903]: pam_unix(sudo:session): session closed for user root Jul 10 04:54:32 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-6e290097-f002-4f64-a482-cec7e351c201 tempest-ProjectReaderTests-860343347 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-eb55c4cd-e620-471c-a91d-be486be43a51" returned: 0 in 0.677s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:54:32 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-6e290097-f002-4f64-a482-cec7e351c201 tempest-ProjectReaderTests-860343347 None] <== create_volume: return (1708ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922'} {{(pid=87444) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 04:54:32 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-6e290097-f002-4f64-a482-cec7e351c201 tempest-ProjectReaderTests-860343347 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.712s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 04:54:32 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-7ea179b9-3e11-43a2-9b24-c4343c021711 tempest-ProjectMemberTests-1806793813 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.954s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 04:54:32 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-6e290097-f002-4f64-a482-cec7e351c201 tempest-ProjectReaderTests-860343347 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f2a92b4a-2039-4ec1-b7de-55c68078eaea) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-eb55c4cd-e620-471c-a91d-be486be43a51', 'volume_size': 1}' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:54:32 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-6e290097-f002-4f64-a482-cec7e351c201 tempest-ProjectReaderTests-860343347 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (652d879f-ca37-4340-a9b5-4102fec6c60b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:54:32 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.remotefs [None req-7ea179b9-3e11-43a2-9b24-c4343c021711 tempest-ProjectMemberTests-1806793813 None] Creating offline snapshot 32173bf8-3c18-4263-8146-a4f1cf1e37a3 of volume 35abcbff-ee5f-44a4-aa51-ddacce19e852 {{(pid=87444) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 10 04:54:32 devstack cinder-volume[87444]: INFO cinder.volume.flows.manager.create_volume [None req-6e290097-f002-4f64-a482-cec7e351c201 tempest-ProjectReaderTests-860343347 None] Volume volume-eb55c4cd-e620-471c-a91d-be486be43a51 (eb55c4cd-e620-471c-a91d-be486be43a51): created successfully Jul 10 04:54:32 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-6e290097-f002-4f64-a482-cec7e351c201 tempest-ProjectReaderTests-860343347 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (652d879f-ca37-4340-a9b5-4102fec6c60b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:54:32 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-6e290097-f002-4f64-a482-cec7e351c201 tempest-ProjectReaderTests-860343347 None] Flow 'volume_create_manager' (a53b2303-2d2e-4bd9-9333-9a182d5c0fd7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87444) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 04:54:32 devstack cinder-volume[87444]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2ba0800-a246-4477-ac38-a84cd744596e]: (4, 'qcow2') {{(pid=88499) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 04:54:32 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-7ea179b9-3e11-43a2-9b24-c4343c021711 tempest-ProjectMemberTests-1806793813 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-35abcbff-ee5f-44a4-aa51-ddacce19e852 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:54:32 devstack cinder-volume[87444]: INFO cinder.volume.manager [None req-6e290097-f002-4f64-a482-cec7e351c201 tempest-ProjectReaderTests-860343347 None] Created volume successfully. Jul 10 04:54:32 devstack sudo[105911]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-35abcbff-ee5f-44a4-aa51-ddacce19e852 Jul 10 04:54:32 devstack sudo[105911]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:54:32 devstack sudo[105908]: pam_unix(sudo:session): session closed for user root Jul 10 04:54:32 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-67799df4-72a7-4d21-bf08-2b3bde02a90e tempest-ProjectReaderTests-2038494182 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-62876fed-36a5-4af5-812c-0f5d4ba84c38" returned: 0 in 0.751s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:54:33 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-67799df4-72a7-4d21-bf08-2b3bde02a90e tempest-ProjectReaderTests-2038494182 None] Lock "cinder-quobyte-62876fed-36a5-4af5-812c-0f5d4ba84c38" released by "delete_volume" :: held 1.617s {{(pid=87444) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 04:54:33 devstack cinder-volume[87444]: DEBUG oslo_service.periodic_task [None req-01f0ce3e-6850-4e14-881d-e40d3c4ad6e5 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87444) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 10 04:54:33 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-01f0ce3e-6850-4e14-881d-e40d3c4ad6e5 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 04:54:33 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-01f0ce3e-6850-4e14-881d-e40d3c4ad6e5 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 04:54:33 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-01f0ce3e-6850-4e14-881d-e40d3c4ad6e5 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922': None} {{(pid=87444) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 04:54:33 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-01f0ce3e-6850-4e14-881d-e40d3c4ad6e5 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922'] {{(pid=87444) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 04:54:33 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-01f0ce3e-6850-4e14-881d-e40d3c4ad6e5 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 04:54:33 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-01f0ce3e-6850-4e14-881d-e40d3c4ad6e5 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:54:33 devstack sudo[105914]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097 Jul 10 04:54:33 devstack sudo[105914]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:54:33 devstack cinder-volume[87444]: DEBUG cinder.quota [None req-67799df4-72a7-4d21-bf08-2b3bde02a90e tempest-ProjectReaderTests-2038494182 None] Created reservations ['88b54757-93c0-45d0-ba3e-31b74343ddbe', 'c0ba886f-8433-4126-8861-de6a009cc9fd', 'd55dd910-0c34-4010-b54c-e427b25edc2a', 'ef5556e5-bcbd-4ad0-874b-60bc93c563b6'] {{(pid=87444) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 04:54:33 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-a65bcdfe-334c-470e-8d6b-762e2c766a9e tempest-ProjectReaderTests-860343347 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 04:54:33 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-67799df4-72a7-4d21-bf08-2b3bde02a90e tempest-ProjectReaderTests-2038494182 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 04:54:33 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-67799df4-72a7-4d21-bf08-2b3bde02a90e tempest-ProjectReaderTests-2038494182 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 04:54:33 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-67799df4-72a7-4d21-bf08-2b3bde02a90e tempest-ProjectReaderTests-2038494182 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922': None} {{(pid=87444) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 04:54:33 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-67799df4-72a7-4d21-bf08-2b3bde02a90e tempest-ProjectReaderTests-2038494182 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922'] {{(pid=87444) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 04:54:33 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-67799df4-72a7-4d21-bf08-2b3bde02a90e tempest-ProjectReaderTests-2038494182 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 04:54:33 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-67799df4-72a7-4d21-bf08-2b3bde02a90e tempest-ProjectReaderTests-2038494182 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:54:33 devstack sudo[105916]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097 Jul 10 04:54:33 devstack sudo[105916]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:54:33 devstack sudo[105911]: pam_unix(sudo:session): session closed for user root Jul 10 04:54:33 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-7ea179b9-3e11-43a2-9b24-c4343c021711 tempest-ProjectMemberTests-1806793813 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-35abcbff-ee5f-44a4-aa51-ddacce19e852" returned: 0 in 0.884s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:54:33 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-7ea179b9-3e11-43a2-9b24-c4343c021711 tempest-ProjectMemberTests-1806793813 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-35abcbff-ee5f-44a4-aa51-ddacce19e852,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-35abcbff-ee5f-44a4-aa51-ddacce19e852.32173bf8-3c18-4263-8146-a4f1cf1e37a3 1G {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:54:33 devstack sudo[105921]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-35abcbff-ee5f-44a4-aa51-ddacce19e852,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-35abcbff-ee5f-44a4-aa51-ddacce19e852.32173bf8-3c18-4263-8146-a4f1cf1e37a3 1G Jul 10 04:54:33 devstack sudo[105921]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:54:34 devstack sudo[105914]: pam_unix(sudo:session): session closed for user root Jul 10 04:54:34 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-01f0ce3e-6850-4e14-881d-e40d3c4ad6e5 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097" returned: 0 in 1.049s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:54:34 devstack cinder-volume[87444]: DEBUG cinder.manager [None req-01f0ce3e-6850-4e14-881d-e40d3c4ad6e5 None None] Notifying Schedulers of capabilities ... {{(pid=87444) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 04:54:34 devstack cinder-volume[87444]: DEBUG oslo_service.periodic_task [None req-01f0ce3e-6850-4e14-881d-e40d3c4ad6e5 None None] Running periodic task VolumeManager._thread_info {{(pid=87444) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 10 04:54:34 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-01f0ce3e-6850-4e14-881d-e40d3c4ad6e5 None None] thread count: 28 {{(pid=87444) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 10 04:54:34 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-01f0ce3e-6850-4e14-881d-e40d3c4ad6e5 None None] thread info: [<_MainThread(MainThread, started 126839257915520)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87444) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 10 04:54:34 devstack sudo[105916]: pam_unix(sudo:session): session closed for user root Jul 10 04:54:34 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-67799df4-72a7-4d21-bf08-2b3bde02a90e tempest-ProjectReaderTests-2038494182 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097" returned: 0 in 0.862s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:54:34 devstack cinder-volume[87444]: DEBUG cinder.manager [None req-67799df4-72a7-4d21-bf08-2b3bde02a90e tempest-ProjectReaderTests-2038494182 None] Notifying Schedulers of capabilities ... {{(pid=87444) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 04:54:34 devstack cinder-volume[87444]: INFO cinder.volume.manager [None req-67799df4-72a7-4d21-bf08-2b3bde02a90e tempest-ProjectReaderTests-2038494182 None] Deleted volume successfully. Jul 10 04:54:34 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-67799df4-72a7-4d21-bf08-2b3bde02a90e tempest-ProjectReaderTests-2038494182 None] Lock "cinder-62876fed-36a5-4af5-812c-0f5d4ba84c38-delete_volume" released by "delete_volume" :: held 2.867s {{(pid=87444) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 04:54:34 devstack cinder-volume[87444]: DEBUG cinder.volume.flows.manager.create_volume [None req-daf28b37-dddf-46c6-bba1-90baf8d1152a tempest-ProjectReaderTests-2038494182 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87444) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 04:54:34 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-daf28b37-dddf-46c6-bba1-90baf8d1152a tempest-ProjectReaderTests-2038494182 None] Flow 'volume_create_manager' (ec37d2b1-2c3d-45cb-9d98-83c7deb030fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 04:54:34 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-daf28b37-dddf-46c6-bba1-90baf8d1152a tempest-ProjectReaderTests-2038494182 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (23ed3432-c251-42b6-8e40-56cee2ec0daf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:54:34 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-daf28b37-dddf-46c6-bba1-90baf8d1152a tempest-ProjectReaderTests-2038494182 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (23ed3432-c251-42b6-8e40-56cee2ec0daf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T02:54:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-543458150',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e8d3be5f-dcdc-407f-a404-f0ef74b969ee,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='744b84b726234b0eaf68963b2911195c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T02:54:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T02:54:34Z,use_quota=True,user_id='622ec2abfd1c4c3f977a20d6f717b821',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(317e369e-1e06-434d-ae95-a335f0e6c903),volume_type_id=317e369e-1e06-434d-ae95-a335f0e6c903)' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:54:34 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-daf28b37-dddf-46c6-bba1-90baf8d1152a tempest-ProjectReaderTests-2038494182 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e7946374-ac02-458b-936a-23421f7f02f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:54:34 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-daf28b37-dddf-46c6-bba1-90baf8d1152a tempest-ProjectReaderTests-2038494182 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e7946374-ac02-458b-936a-23421f7f02f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:54:34 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-daf28b37-dddf-46c6-bba1-90baf8d1152a tempest-ProjectReaderTests-2038494182 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (92d94313-8852-4aa2-b586-18f03cb4cfd9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:54:34 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-daf28b37-dddf-46c6-bba1-90baf8d1152a tempest-ProjectReaderTests-2038494182 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (92d94313-8852-4aa2-b586-18f03cb4cfd9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e8d3be5f-dcdc-407f-a404-f0ef74b969ee', 'volume_name': 'volume-e8d3be5f-dcdc-407f-a404-f0ef74b969ee', 'volume_size': 1}' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:54:34 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-daf28b37-dddf-46c6-bba1-90baf8d1152a tempest-ProjectReaderTests-2038494182 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8755e5a3-4bf8-46c0-9a32-daf9e88f8da5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:54:34 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-daf28b37-dddf-46c6-bba1-90baf8d1152a tempest-ProjectReaderTests-2038494182 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8755e5a3-4bf8-46c0-9a32-daf9e88f8da5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:54:34 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-daf28b37-dddf-46c6-bba1-90baf8d1152a tempest-ProjectReaderTests-2038494182 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5040936e-53ae-462b-99d8-f0b17ec68ae1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:54:34 devstack cinder-volume[87444]: INFO cinder.volume.flows.manager.create_volume [None req-daf28b37-dddf-46c6-bba1-90baf8d1152a tempest-ProjectReaderTests-2038494182 None] Volume e8d3be5f-dcdc-407f-a404-f0ef74b969ee: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e8d3be5f-dcdc-407f-a404-f0ef74b969ee', 'volume_size': 1} Jul 10 04:54:34 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-daf28b37-dddf-46c6-bba1-90baf8d1152a tempest-ProjectReaderTests-2038494182 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 04:54:34 devstack sudo[105921]: pam_unix(sudo:session): session closed for user root Jul 10 04:54:34 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-7ea179b9-3e11-43a2-9b24-c4343c021711 tempest-ProjectMemberTests-1806793813 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-35abcbff-ee5f-44a4-aa51-ddacce19e852,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-35abcbff-ee5f-44a4-aa51-ddacce19e852.32173bf8-3c18-4263-8146-a4f1cf1e37a3 1G" returned: 0 in 1.022s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:54:34 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-7ea179b9-3e11-43a2-9b24-c4343c021711 tempest-ProjectMemberTests-1806793813 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-35abcbff-ee5f-44a4-aa51-ddacce19e852 -F qcow2 /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-35abcbff-ee5f-44a4-aa51-ddacce19e852.32173bf8-3c18-4263-8146-a4f1cf1e37a3 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:54:34 devstack sudo[105931]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-35abcbff-ee5f-44a4-aa51-ddacce19e852 -F qcow2 /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-35abcbff-ee5f-44a4-aa51-ddacce19e852.32173bf8-3c18-4263-8146-a4f1cf1e37a3 Jul 10 04:54:34 devstack sudo[105931]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:54:35 devstack sudo[105931]: pam_unix(sudo:session): session closed for user root Jul 10 04:54:35 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-7ea179b9-3e11-43a2-9b24-c4343c021711 tempest-ProjectMemberTests-1806793813 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-35abcbff-ee5f-44a4-aa51-ddacce19e852 -F qcow2 /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-35abcbff-ee5f-44a4-aa51-ddacce19e852.32173bf8-3c18-4263-8146-a4f1cf1e37a3" returned: 0 in 0.744s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:54:35 devstack cinder-volume[87444]: WARNING cinder.volume.drivers.remotefs [None req-7ea179b9-3e11-43a2-9b24-c4343c021711 tempest-ProjectMemberTests-1806793813 None] /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-35abcbff-ee5f-44a4-aa51-ddacce19e852.32173bf8-3c18-4263-8146-a4f1cf1e37a3 is being set with open permissions: ugo+rw Jul 10 04:54:35 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-7ea179b9-3e11-43a2-9b24-c4343c021711 tempest-ProjectMemberTests-1806793813 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-35abcbff-ee5f-44a4-aa51-ddacce19e852.32173bf8-3c18-4263-8146-a4f1cf1e37a3 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:54:35 devstack sudo[105936]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-35abcbff-ee5f-44a4-aa51-ddacce19e852.32173bf8-3c18-4263-8146-a4f1cf1e37a3 Jul 10 04:54:35 devstack sudo[105936]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:54:35 devstack sudo[105936]: pam_unix(sudo:session): session closed for user root Jul 10 04:54:35 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-7ea179b9-3e11-43a2-9b24-c4343c021711 tempest-ProjectMemberTests-1806793813 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-35abcbff-ee5f-44a4-aa51-ddacce19e852.32173bf8-3c18-4263-8146-a4f1cf1e37a3" returned: 0 in 0.659s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:54:35 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-7ea179b9-3e11-43a2-9b24-c4343c021711 tempest-ProjectMemberTests-1806793813 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-35abcbff-ee5f-44a4-aa51-ddacce19e852.info {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:54:35 devstack sudo[105939]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-35abcbff-ee5f-44a4-aa51-ddacce19e852.info Jul 10 04:54:35 devstack sudo[105939]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:54:36 devstack sudo[105939]: pam_unix(sudo:session): session closed for user root Jul 10 04:54:36 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-7ea179b9-3e11-43a2-9b24-c4343c021711 tempest-ProjectMemberTests-1806793813 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-35abcbff-ee5f-44a4-aa51-ddacce19e852.info" returned: 0 in 0.679s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:54:36 devstack cinder-volume[87444]: WARNING cinder.volume.drivers.remotefs [None req-7ea179b9-3e11-43a2-9b24-c4343c021711 tempest-ProjectMemberTests-1806793813 None] /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-35abcbff-ee5f-44a4-aa51-ddacce19e852.info is being set with open permissions: ugo+rw Jul 10 04:54:36 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-7ea179b9-3e11-43a2-9b24-c4343c021711 tempest-ProjectMemberTests-1806793813 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-35abcbff-ee5f-44a4-aa51-ddacce19e852.info {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:54:36 devstack sudo[105942]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-35abcbff-ee5f-44a4-aa51-ddacce19e852.info Jul 10 04:54:36 devstack sudo[105942]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:54:37 devstack sudo[105942]: pam_unix(sudo:session): session closed for user root Jul 10 04:54:37 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-7ea179b9-3e11-43a2-9b24-c4343c021711 tempest-ProjectMemberTests-1806793813 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-35abcbff-ee5f-44a4-aa51-ddacce19e852.info" returned: 0 in 0.681s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:54:37 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-7ea179b9-3e11-43a2-9b24-c4343c021711 tempest-ProjectMemberTests-1806793813 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.810s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 04:54:37 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-a65bcdfe-334c-470e-8d6b-762e2c766a9e tempest-ProjectReaderTests-860343347 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 4.163s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 04:54:37 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.remotefs [None req-a65bcdfe-334c-470e-8d6b-762e2c766a9e tempest-ProjectReaderTests-860343347 None] Creating offline snapshot 8b9223f6-6a9f-49a9-8a15-bde4f67b0b84 of volume eb55c4cd-e620-471c-a91d-be486be43a51 {{(pid=87444) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 10 04:54:37 devstack cinder-volume[87444]: INFO cinder.volume.manager [None req-7ea179b9-3e11-43a2-9b24-c4343c021711 tempest-ProjectMemberTests-1806793813 None] Create snapshot completed successfully Jul 10 04:54:37 devstack cinder-volume[87444]: DEBUG oslo.privsep.daemon [-] privsep: reply[81c7a76d-8bc0-4451-baaf-5e7225da4db9]: (4, 'qcow2') {{(pid=88499) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 04:54:37 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-a65bcdfe-334c-470e-8d6b-762e2c766a9e tempest-ProjectReaderTests-860343347 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-eb55c4cd-e620-471c-a91d-be486be43a51 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:54:37 devstack sudo[105945]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-eb55c4cd-e620-471c-a91d-be486be43a51 Jul 10 04:54:37 devstack sudo[105945]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:54:37 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-2e2dd762-d3f7-4942-9b23-37e2a8f8951e tempest-ProjectMemberTests-1806793813 None] Acquiring lock "cinder-32173bf8-3c18-4263-8146-a4f1cf1e37a3-delete_snapshot" by "delete_snapshot" {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 04:54:37 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-2e2dd762-d3f7-4942-9b23-37e2a8f8951e tempest-ProjectMemberTests-1806793813 None] Lock "cinder-32173bf8-3c18-4263-8146-a4f1cf1e37a3-delete_snapshot" acquired by "delete_snapshot" :: waited 0.024s {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 04:54:37 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-2e2dd762-d3f7-4942-9b23-37e2a8f8951e tempest-ProjectMemberTests-1806793813 None] Acquiring lock "cinder-quobyte-35abcbff-ee5f-44a4-aa51-ddacce19e852" by "delete_snapshot" {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 04:54:38 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-2e2dd762-d3f7-4942-9b23-37e2a8f8951e tempest-ProjectMemberTests-1806793813 None] Lock "cinder-quobyte-35abcbff-ee5f-44a4-aa51-ddacce19e852" acquired by "delete_snapshot" :: waited 0.019s {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 04:54:38 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-2e2dd762-d3f7-4942-9b23-37e2a8f8951e tempest-ProjectMemberTests-1806793813 None] Acquiring lock "cinder-quobyte-32173bf8-3c18-4263-8146-a4f1cf1e37a3" by "_delete_snapshot" {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 04:54:38 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-2e2dd762-d3f7-4942-9b23-37e2a8f8951e tempest-ProjectMemberTests-1806793813 None] Lock "cinder-quobyte-32173bf8-3c18-4263-8146-a4f1cf1e37a3" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 04:54:38 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.remotefs [None req-2e2dd762-d3f7-4942-9b23-37e2a8f8951e tempest-ProjectMemberTests-1806793813 None] Deleting offline snapshot 32173bf8-3c18-4263-8146-a4f1cf1e37a3 of volume 35abcbff-ee5f-44a4-aa51-ddacce19e852 {{(pid=87444) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 10 04:54:38 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.remotefs [None req-2e2dd762-d3f7-4942-9b23-37e2a8f8951e tempest-ProjectMemberTests-1806793813 None] snapshot_file for this snap is: volume-35abcbff-ee5f-44a4-aa51-ddacce19e852.32173bf8-3c18-4263-8146-a4f1cf1e37a3 {{(pid=87444) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 10 04:54:38 devstack cinder-volume[87444]: DEBUG oslo.privsep.daemon [-] privsep: reply[44401653-8646-40ec-bde1-6706b9c77e0f]: (4, 'qcow2') {{(pid=88499) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 04:54:38 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-2e2dd762-d3f7-4942-9b23-37e2a8f8951e tempest-ProjectMemberTests-1806793813 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-35abcbff-ee5f-44a4-aa51-ddacce19e852.32173bf8-3c18-4263-8146-a4f1cf1e37a3 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:54:38 devstack sudo[105947]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-35abcbff-ee5f-44a4-aa51-ddacce19e852.32173bf8-3c18-4263-8146-a4f1cf1e37a3 Jul 10 04:54:38 devstack sudo[105947]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:54:38 devstack sudo[105945]: pam_unix(sudo:session): session closed for user root Jul 10 04:54:38 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-a65bcdfe-334c-470e-8d6b-762e2c766a9e tempest-ProjectReaderTests-860343347 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-eb55c4cd-e620-471c-a91d-be486be43a51" returned: 0 in 0.831s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:54:38 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-a65bcdfe-334c-470e-8d6b-762e2c766a9e tempest-ProjectReaderTests-860343347 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-eb55c4cd-e620-471c-a91d-be486be43a51,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-eb55c4cd-e620-471c-a91d-be486be43a51.8b9223f6-6a9f-49a9-8a15-bde4f67b0b84 1G {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:54:38 devstack sudo[105952]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-eb55c4cd-e620-471c-a91d-be486be43a51,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-eb55c4cd-e620-471c-a91d-be486be43a51.8b9223f6-6a9f-49a9-8a15-bde4f67b0b84 1G Jul 10 04:54:38 devstack sudo[105952]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:54:38 devstack sudo[105947]: pam_unix(sudo:session): session closed for user root Jul 10 04:54:38 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-2e2dd762-d3f7-4942-9b23-37e2a8f8951e tempest-ProjectMemberTests-1806793813 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-35abcbff-ee5f-44a4-aa51-ddacce19e852.32173bf8-3c18-4263-8146-a4f1cf1e37a3" returned: 0 in 0.857s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:54:38 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.remotefs [None req-2e2dd762-d3f7-4942-9b23-37e2a8f8951e tempest-ProjectMemberTests-1806793813 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-35abcbff-ee5f-44a4-aa51-ddacce19e852(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87444) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 10 04:54:38 devstack cinder-volume[87444]: DEBUG oslo.privsep.daemon [-] privsep: reply[fea3bf75-e510-4e0a-a027-2cddac54750c]: (4, 'qcow2') {{(pid=88499) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 04:54:38 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-2e2dd762-d3f7-4942-9b23-37e2a8f8951e tempest-ProjectMemberTests-1806793813 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-35abcbff-ee5f-44a4-aa51-ddacce19e852 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:54:39 devstack sudo[105960]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-35abcbff-ee5f-44a4-aa51-ddacce19e852 Jul 10 04:54:39 devstack sudo[105960]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:54:39 devstack sudo[105952]: pam_unix(sudo:session): session closed for user root Jul 10 04:54:39 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-a65bcdfe-334c-470e-8d6b-762e2c766a9e tempest-ProjectReaderTests-860343347 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-eb55c4cd-e620-471c-a91d-be486be43a51,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-eb55c4cd-e620-471c-a91d-be486be43a51.8b9223f6-6a9f-49a9-8a15-bde4f67b0b84 1G" returned: 0 in 0.971s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:54:39 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-a65bcdfe-334c-470e-8d6b-762e2c766a9e tempest-ProjectReaderTests-860343347 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-eb55c4cd-e620-471c-a91d-be486be43a51 -F qcow2 /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-eb55c4cd-e620-471c-a91d-be486be43a51.8b9223f6-6a9f-49a9-8a15-bde4f67b0b84 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:54:39 devstack sudo[105963]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-eb55c4cd-e620-471c-a91d-be486be43a51 -F qcow2 /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-eb55c4cd-e620-471c-a91d-be486be43a51.8b9223f6-6a9f-49a9-8a15-bde4f67b0b84 Jul 10 04:54:39 devstack sudo[105963]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:54:39 devstack sudo[105960]: pam_unix(sudo:session): session closed for user root Jul 10 04:54:39 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-2e2dd762-d3f7-4942-9b23-37e2a8f8951e tempest-ProjectMemberTests-1806793813 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-35abcbff-ee5f-44a4-aa51-ddacce19e852" returned: 0 in 0.824s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:54:39 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-2e2dd762-d3f7-4942-9b23-37e2a8f8951e tempest-ProjectMemberTests-1806793813 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-35abcbff-ee5f-44a4-aa51-ddacce19e852.32173bf8-3c18-4263-8146-a4f1cf1e37a3 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:54:39 devstack sudo[105968]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-35abcbff-ee5f-44a4-aa51-ddacce19e852.32173bf8-3c18-4263-8146-a4f1cf1e37a3 Jul 10 04:54:39 devstack sudo[105968]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:54:40 devstack sudo[105963]: pam_unix(sudo:session): session closed for user root Jul 10 04:54:40 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-a65bcdfe-334c-470e-8d6b-762e2c766a9e tempest-ProjectReaderTests-860343347 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-eb55c4cd-e620-471c-a91d-be486be43a51 -F qcow2 /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-eb55c4cd-e620-471c-a91d-be486be43a51.8b9223f6-6a9f-49a9-8a15-bde4f67b0b84" returned: 0 in 0.774s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:54:40 devstack cinder-volume[87444]: WARNING cinder.volume.drivers.remotefs [None req-a65bcdfe-334c-470e-8d6b-762e2c766a9e tempest-ProjectReaderTests-860343347 None] /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-eb55c4cd-e620-471c-a91d-be486be43a51.8b9223f6-6a9f-49a9-8a15-bde4f67b0b84 is being set with open permissions: ugo+rw Jul 10 04:54:40 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-a65bcdfe-334c-470e-8d6b-762e2c766a9e tempest-ProjectReaderTests-860343347 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-eb55c4cd-e620-471c-a91d-be486be43a51.8b9223f6-6a9f-49a9-8a15-bde4f67b0b84 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:54:40 devstack sudo[105973]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-eb55c4cd-e620-471c-a91d-be486be43a51.8b9223f6-6a9f-49a9-8a15-bde4f67b0b84 Jul 10 04:54:40 devstack sudo[105973]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:54:40 devstack sudo[105968]: pam_unix(sudo:session): session closed for user root Jul 10 04:54:40 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-2e2dd762-d3f7-4942-9b23-37e2a8f8951e tempest-ProjectMemberTests-1806793813 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-35abcbff-ee5f-44a4-aa51-ddacce19e852.32173bf8-3c18-4263-8146-a4f1cf1e37a3" returned: 0 in 0.800s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:54:40 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-2e2dd762-d3f7-4942-9b23-37e2a8f8951e tempest-ProjectMemberTests-1806793813 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-35abcbff-ee5f-44a4-aa51-ddacce19e852.32173bf8-3c18-4263-8146-a4f1cf1e37a3 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:54:40 devstack sudo[105992]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-35abcbff-ee5f-44a4-aa51-ddacce19e852.32173bf8-3c18-4263-8146-a4f1cf1e37a3 Jul 10 04:54:40 devstack sudo[105992]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:54:40 devstack sudo[105973]: pam_unix(sudo:session): session closed for user root Jul 10 04:54:40 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-a65bcdfe-334c-470e-8d6b-762e2c766a9e tempest-ProjectReaderTests-860343347 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-eb55c4cd-e620-471c-a91d-be486be43a51.8b9223f6-6a9f-49a9-8a15-bde4f67b0b84" returned: 0 in 0.735s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:54:40 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-a65bcdfe-334c-470e-8d6b-762e2c766a9e tempest-ProjectReaderTests-860343347 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-eb55c4cd-e620-471c-a91d-be486be43a51.info {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:54:40 devstack sudo[106015]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-eb55c4cd-e620-471c-a91d-be486be43a51.info Jul 10 04:54:40 devstack sudo[106015]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:54:41 devstack sudo[105992]: pam_unix(sudo:session): session closed for user root Jul 10 04:54:41 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-2e2dd762-d3f7-4942-9b23-37e2a8f8951e tempest-ProjectMemberTests-1806793813 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-35abcbff-ee5f-44a4-aa51-ddacce19e852.32173bf8-3c18-4263-8146-a4f1cf1e37a3" returned: 0 in 0.764s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:54:41 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-2e2dd762-d3f7-4942-9b23-37e2a8f8951e tempest-ProjectMemberTests-1806793813 None] Lock "cinder-quobyte-32173bf8-3c18-4263-8146-a4f1cf1e37a3" released by "_delete_snapshot" :: held 3.378s {{(pid=87444) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 04:54:41 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-2e2dd762-d3f7-4942-9b23-37e2a8f8951e tempest-ProjectMemberTests-1806793813 None] Lock "cinder-quobyte-35abcbff-ee5f-44a4-aa51-ddacce19e852" released by "delete_snapshot" :: held 3.402s {{(pid=87444) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 04:54:41 devstack cinder-volume[87444]: DEBUG cinder.quota [None req-2e2dd762-d3f7-4942-9b23-37e2a8f8951e tempest-ProjectMemberTests-1806793813 None] Created reservations ['c3654bb7-af23-408e-8f19-9685d0a0e34d', '634354ac-885b-4f0e-834e-7bfbd3385eaf', '8ed77537-fc45-4df7-a683-f5a8c1b3c6f7', '71990171-2b23-47a5-893a-bc6cd4bd0441'] {{(pid=87444) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 04:54:41 devstack sudo[106015]: pam_unix(sudo:session): session closed for user root Jul 10 04:54:41 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-a65bcdfe-334c-470e-8d6b-762e2c766a9e tempest-ProjectReaderTests-860343347 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-eb55c4cd-e620-471c-a91d-be486be43a51.info" returned: 0 in 0.705s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:54:41 devstack cinder-volume[87444]: WARNING cinder.volume.drivers.remotefs [None req-a65bcdfe-334c-470e-8d6b-762e2c766a9e tempest-ProjectReaderTests-860343347 None] /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-eb55c4cd-e620-471c-a91d-be486be43a51.info is being set with open permissions: ugo+rw Jul 10 04:54:41 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-a65bcdfe-334c-470e-8d6b-762e2c766a9e tempest-ProjectReaderTests-860343347 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-eb55c4cd-e620-471c-a91d-be486be43a51.info {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:54:41 devstack sudo[106021]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-eb55c4cd-e620-471c-a91d-be486be43a51.info Jul 10 04:54:41 devstack sudo[106021]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:54:41 devstack cinder-volume[87444]: INFO cinder.volume.manager [None req-2e2dd762-d3f7-4942-9b23-37e2a8f8951e tempest-ProjectMemberTests-1806793813 None] Delete snapshot completed successfully. Jul 10 04:54:41 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-2e2dd762-d3f7-4942-9b23-37e2a8f8951e tempest-ProjectMemberTests-1806793813 None] Lock "cinder-32173bf8-3c18-4263-8146-a4f1cf1e37a3-delete_snapshot" released by "delete_snapshot" :: held 3.593s {{(pid=87444) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 04:54:42 devstack sudo[106021]: pam_unix(sudo:session): session closed for user root Jul 10 04:54:42 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-a65bcdfe-334c-470e-8d6b-762e2c766a9e tempest-ProjectReaderTests-860343347 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-eb55c4cd-e620-471c-a91d-be486be43a51.info" returned: 0 in 0.675s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:54:42 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-a65bcdfe-334c-470e-8d6b-762e2c766a9e tempest-ProjectReaderTests-860343347 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.830s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 04:54:42 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-daf28b37-dddf-46c6-bba1-90baf8d1152a tempest-ProjectReaderTests-2038494182 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.812s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 04:54:42 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-daf28b37-dddf-46c6-bba1-90baf8d1152a tempest-ProjectReaderTests-2038494182 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T02:54:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-543458150',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e8d3be5f-dcdc-407f-a404-f0ef74b969ee,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='744b84b726234b0eaf68963b2911195c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T02:54:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T02:54:34Z,use_quota=True,user_id='622ec2abfd1c4c3f977a20d6f717b821',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(317e369e-1e06-434d-ae95-a335f0e6c903),volume_type_id=317e369e-1e06-434d-ae95-a335f0e6c903)}" {{(pid=87444) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 04:54:42 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.remotefs [None req-daf28b37-dddf-46c6-bba1-90baf8d1152a tempest-ProjectReaderTests-2038494182 None] Creating volume e8d3be5f-dcdc-407f-a404-f0ef74b969ee {{(pid=87444) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 04:54:42 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-daf28b37-dddf-46c6-bba1-90baf8d1152a tempest-ProjectReaderTests-2038494182 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 04:54:42 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-daf28b37-dddf-46c6-bba1-90baf8d1152a tempest-ProjectReaderTests-2038494182 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 04:54:42 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-daf28b37-dddf-46c6-bba1-90baf8d1152a tempest-ProjectReaderTests-2038494182 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922': None} {{(pid=87444) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 04:54:42 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-daf28b37-dddf-46c6-bba1-90baf8d1152a tempest-ProjectReaderTests-2038494182 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922'] {{(pid=87444) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 04:54:42 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-daf28b37-dddf-46c6-bba1-90baf8d1152a tempest-ProjectReaderTests-2038494182 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 04:54:42 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-daf28b37-dddf-46c6-bba1-90baf8d1152a tempest-ProjectReaderTests-2038494182 None] Selected osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922 as target Quobyte volume. {{(pid=87444) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 04:54:42 devstack cinder-volume[87444]: INFO cinder.volume.drivers.remotefs [None req-daf28b37-dddf-46c6-bba1-90baf8d1152a tempest-ProjectReaderTests-2038494182 None] casted to osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922 Jul 10 04:54:42 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-daf28b37-dddf-46c6-bba1-90baf8d1152a tempest-ProjectReaderTests-2038494182 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-e8d3be5f-dcdc-407f-a404-f0ef74b969ee 1073741824 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:54:42 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-38139779-7dcc-47dc-9114-6e015cb30e58 tempest-ProjectMemberTests-1806793813 None] Acquiring lock "cinder-35abcbff-ee5f-44a4-aa51-ddacce19e852-delete_volume" by "delete_volume" {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 04:54:42 devstack sudo[106024]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-e8d3be5f-dcdc-407f-a404-f0ef74b969ee 1073741824 Jul 10 04:54:42 devstack sudo[106024]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:54:42 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-38139779-7dcc-47dc-9114-6e015cb30e58 tempest-ProjectMemberTests-1806793813 None] Lock "cinder-35abcbff-ee5f-44a4-aa51-ddacce19e852-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 04:54:42 devstack cinder-volume[87444]: INFO cinder.volume.manager [None req-a65bcdfe-334c-470e-8d6b-762e2c766a9e tempest-ProjectReaderTests-860343347 None] Create snapshot completed successfully Jul 10 04:54:42 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-38139779-7dcc-47dc-9114-6e015cb30e58 tempest-ProjectMemberTests-1806793813 None] Acquiring lock "cinder-quobyte-35abcbff-ee5f-44a4-aa51-ddacce19e852" by "delete_volume" {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 04:54:42 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-38139779-7dcc-47dc-9114-6e015cb30e58 tempest-ProjectMemberTests-1806793813 None] Lock "cinder-quobyte-35abcbff-ee5f-44a4-aa51-ddacce19e852" acquired by "delete_volume" :: waited 0.016s {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 04:54:42 devstack cinder-volume[87444]: DEBUG oslo.privsep.daemon [-] privsep: reply[914beaf3-bf0a-44a7-8764-42273bbd453b]: (4, 'qcow2') {{(pid=88499) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 04:54:42 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-38139779-7dcc-47dc-9114-6e015cb30e58 tempest-ProjectMemberTests-1806793813 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-35abcbff-ee5f-44a4-aa51-ddacce19e852 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:54:42 devstack sudo[106026]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-35abcbff-ee5f-44a4-aa51-ddacce19e852 Jul 10 04:54:42 devstack sudo[106026]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:54:42 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-4921da9c-bd66-4faa-a67f-a8e218328ac4 tempest-ProjectReaderTests-860343347 None] Acquiring lock "cinder-8b9223f6-6a9f-49a9-8a15-bde4f67b0b84-delete_snapshot" by "delete_snapshot" {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 04:54:42 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-4921da9c-bd66-4faa-a67f-a8e218328ac4 tempest-ProjectReaderTests-860343347 None] Lock "cinder-8b9223f6-6a9f-49a9-8a15-bde4f67b0b84-delete_snapshot" acquired by "delete_snapshot" :: waited 0.033s {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 04:54:42 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-4921da9c-bd66-4faa-a67f-a8e218328ac4 tempest-ProjectReaderTests-860343347 None] Acquiring lock "cinder-quobyte-eb55c4cd-e620-471c-a91d-be486be43a51" by "delete_snapshot" {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 04:54:42 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-4921da9c-bd66-4faa-a67f-a8e218328ac4 tempest-ProjectReaderTests-860343347 None] Lock "cinder-quobyte-eb55c4cd-e620-471c-a91d-be486be43a51" acquired by "delete_snapshot" :: waited 0.028s {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 04:54:42 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-4921da9c-bd66-4faa-a67f-a8e218328ac4 tempest-ProjectReaderTests-860343347 None] Acquiring lock "cinder-quobyte-8b9223f6-6a9f-49a9-8a15-bde4f67b0b84" by "_delete_snapshot" {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 04:54:42 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-4921da9c-bd66-4faa-a67f-a8e218328ac4 tempest-ProjectReaderTests-860343347 None] Lock "cinder-quobyte-8b9223f6-6a9f-49a9-8a15-bde4f67b0b84" acquired by "_delete_snapshot" :: waited 0.036s {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 04:54:42 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.remotefs [None req-4921da9c-bd66-4faa-a67f-a8e218328ac4 tempest-ProjectReaderTests-860343347 None] Deleting offline snapshot 8b9223f6-6a9f-49a9-8a15-bde4f67b0b84 of volume eb55c4cd-e620-471c-a91d-be486be43a51 {{(pid=87444) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 10 04:54:42 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.remotefs [None req-4921da9c-bd66-4faa-a67f-a8e218328ac4 tempest-ProjectReaderTests-860343347 None] snapshot_file for this snap is: volume-eb55c4cd-e620-471c-a91d-be486be43a51.8b9223f6-6a9f-49a9-8a15-bde4f67b0b84 {{(pid=87444) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 10 04:54:42 devstack cinder-volume[87444]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7653b17-32bf-4f63-9638-73695c64cf5f]: (4, 'qcow2') {{(pid=88499) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 04:54:42 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-4921da9c-bd66-4faa-a67f-a8e218328ac4 tempest-ProjectReaderTests-860343347 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-eb55c4cd-e620-471c-a91d-be486be43a51.8b9223f6-6a9f-49a9-8a15-bde4f67b0b84 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:54:42 devstack sudo[106028]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-eb55c4cd-e620-471c-a91d-be486be43a51.8b9223f6-6a9f-49a9-8a15-bde4f67b0b84 Jul 10 04:54:42 devstack sudo[106028]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:54:43 devstack sudo[106024]: pam_unix(sudo:session): session closed for user root Jul 10 04:54:43 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-daf28b37-dddf-46c6-bba1-90baf8d1152a tempest-ProjectReaderTests-2038494182 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-e8d3be5f-dcdc-407f-a404-f0ef74b969ee 1073741824" returned: 0 in 1.055s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:54:43 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-daf28b37-dddf-46c6-bba1-90baf8d1152a tempest-ProjectReaderTests-2038494182 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-e8d3be5f-dcdc-407f-a404-f0ef74b969ee {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:54:43 devstack sudo[106026]: pam_unix(sudo:session): session closed for user root Jul 10 04:54:43 devstack sudo[106037]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-e8d3be5f-dcdc-407f-a404-f0ef74b969ee Jul 10 04:54:43 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-38139779-7dcc-47dc-9114-6e015cb30e58 tempest-ProjectMemberTests-1806793813 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-35abcbff-ee5f-44a4-aa51-ddacce19e852" returned: 0 in 0.965s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:54:43 devstack sudo[106037]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:54:43 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-38139779-7dcc-47dc-9114-6e015cb30e58 tempest-ProjectMemberTests-1806793813 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-35abcbff-ee5f-44a4-aa51-ddacce19e852 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:54:43 devstack sudo[106039]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-35abcbff-ee5f-44a4-aa51-ddacce19e852 Jul 10 04:54:43 devstack sudo[106039]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:54:43 devstack sudo[106028]: pam_unix(sudo:session): session closed for user root Jul 10 04:54:43 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-4921da9c-bd66-4faa-a67f-a8e218328ac4 tempest-ProjectReaderTests-860343347 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-eb55c4cd-e620-471c-a91d-be486be43a51.8b9223f6-6a9f-49a9-8a15-bde4f67b0b84" returned: 0 in 0.897s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:54:43 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.remotefs [None req-4921da9c-bd66-4faa-a67f-a8e218328ac4 tempest-ProjectReaderTests-860343347 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-eb55c4cd-e620-471c-a91d-be486be43a51(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87444) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 10 04:54:43 devstack cinder-volume[87444]: DEBUG oslo.privsep.daemon [-] privsep: reply[56c5a763-dd81-4f6e-b4bd-40119fd5a50e]: (4, 'qcow2') {{(pid=88499) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 04:54:43 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-4921da9c-bd66-4faa-a67f-a8e218328ac4 tempest-ProjectReaderTests-860343347 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-eb55c4cd-e620-471c-a91d-be486be43a51 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:54:43 devstack sudo[106045]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-eb55c4cd-e620-471c-a91d-be486be43a51 Jul 10 04:54:43 devstack sudo[106045]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:54:44 devstack sudo[106037]: pam_unix(sudo:session): session closed for user root Jul 10 04:54:44 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-daf28b37-dddf-46c6-bba1-90baf8d1152a tempest-ProjectReaderTests-2038494182 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-e8d3be5f-dcdc-407f-a404-f0ef74b969ee" returned: 0 in 0.781s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:54:44 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-daf28b37-dddf-46c6-bba1-90baf8d1152a tempest-ProjectReaderTests-2038494182 None] <== create_volume: return (1900ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922'} {{(pid=87444) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 04:54:44 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-daf28b37-dddf-46c6-bba1-90baf8d1152a tempest-ProjectReaderTests-2038494182 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.903s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 04:54:44 devstack sudo[106039]: pam_unix(sudo:session): session closed for user root Jul 10 04:54:44 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-daf28b37-dddf-46c6-bba1-90baf8d1152a tempest-ProjectReaderTests-2038494182 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5040936e-53ae-462b-99d8-f0b17ec68ae1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e8d3be5f-dcdc-407f-a404-f0ef74b969ee', 'volume_size': 1}' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:54:44 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-daf28b37-dddf-46c6-bba1-90baf8d1152a tempest-ProjectReaderTests-2038494182 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d6cc9332-7ab4-42a4-9062-961c1fb78791) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:54:44 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-38139779-7dcc-47dc-9114-6e015cb30e58 tempest-ProjectMemberTests-1806793813 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-35abcbff-ee5f-44a4-aa51-ddacce19e852" returned: 0 in 0.767s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:54:44 devstack cinder-volume[87444]: INFO cinder.volume.flows.manager.create_volume [None req-daf28b37-dddf-46c6-bba1-90baf8d1152a tempest-ProjectReaderTests-2038494182 None] Volume volume-e8d3be5f-dcdc-407f-a404-f0ef74b969ee (e8d3be5f-dcdc-407f-a404-f0ef74b969ee): created successfully Jul 10 04:54:44 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-daf28b37-dddf-46c6-bba1-90baf8d1152a tempest-ProjectReaderTests-2038494182 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d6cc9332-7ab4-42a4-9062-961c1fb78791) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:54:44 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-daf28b37-dddf-46c6-bba1-90baf8d1152a tempest-ProjectReaderTests-2038494182 None] Flow 'volume_create_manager' (ec37d2b1-2c3d-45cb-9d98-83c7deb030fd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87444) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 04:54:44 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-38139779-7dcc-47dc-9114-6e015cb30e58 tempest-ProjectMemberTests-1806793813 None] Lock "cinder-quobyte-35abcbff-ee5f-44a4-aa51-ddacce19e852" released by "delete_volume" :: held 1.833s {{(pid=87444) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 04:54:44 devstack cinder-volume[87444]: INFO cinder.volume.manager [None req-daf28b37-dddf-46c6-bba1-90baf8d1152a tempest-ProjectReaderTests-2038494182 None] Created volume successfully. Jul 10 04:54:44 devstack cinder-volume[87444]: DEBUG cinder.quota [None req-38139779-7dcc-47dc-9114-6e015cb30e58 tempest-ProjectMemberTests-1806793813 None] Created reservations ['297454d4-9482-4484-90bf-1b371911df84', 'd25c229b-f864-4a4c-b40c-9ee1402de594', 'a878097a-a75c-4342-a411-9e7c1fcff84c', '20c4fa70-de23-4c70-903c-c65d9d52d49f'] {{(pid=87444) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 04:54:44 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-38139779-7dcc-47dc-9114-6e015cb30e58 tempest-ProjectMemberTests-1806793813 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 04:54:44 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-38139779-7dcc-47dc-9114-6e015cb30e58 tempest-ProjectMemberTests-1806793813 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 04:54:44 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-38139779-7dcc-47dc-9114-6e015cb30e58 tempest-ProjectMemberTests-1806793813 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922': None} {{(pid=87444) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 04:54:44 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-38139779-7dcc-47dc-9114-6e015cb30e58 tempest-ProjectMemberTests-1806793813 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922'] {{(pid=87444) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 04:54:44 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-38139779-7dcc-47dc-9114-6e015cb30e58 tempest-ProjectMemberTests-1806793813 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 04:54:44 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-38139779-7dcc-47dc-9114-6e015cb30e58 tempest-ProjectMemberTests-1806793813 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:54:44 devstack sudo[106049]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097 Jul 10 04:54:44 devstack sudo[106049]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:54:44 devstack sudo[106045]: pam_unix(sudo:session): session closed for user root Jul 10 04:54:44 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-4921da9c-bd66-4faa-a67f-a8e218328ac4 tempest-ProjectReaderTests-860343347 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-eb55c4cd-e620-471c-a91d-be486be43a51" returned: 0 in 0.978s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:54:44 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-4921da9c-bd66-4faa-a67f-a8e218328ac4 tempest-ProjectReaderTests-860343347 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-eb55c4cd-e620-471c-a91d-be486be43a51.8b9223f6-6a9f-49a9-8a15-bde4f67b0b84 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:54:44 devstack sudo[106055]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-eb55c4cd-e620-471c-a91d-be486be43a51.8b9223f6-6a9f-49a9-8a15-bde4f67b0b84 Jul 10 04:54:44 devstack sudo[106055]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:54:45 devstack cinder-volume[87444]: DEBUG cinder.volume.flows.manager.create_volume [None req-d49c0a82-33ed-4db0-bc5f-2a3816524bc4 tempest-ProjectMemberTests-1806793813 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87444) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 04:54:45 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-d49c0a82-33ed-4db0-bc5f-2a3816524bc4 tempest-ProjectMemberTests-1806793813 None] Flow 'volume_create_manager' (e278f30a-f4d5-469f-bdee-e7803abff0a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 04:54:45 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-d49c0a82-33ed-4db0-bc5f-2a3816524bc4 tempest-ProjectMemberTests-1806793813 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (426ab29a-2657-48f0-910c-2ed86788b8b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:54:45 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-11b53a41-047b-4f90-8fca-93954316840e tempest-ProjectReaderTests-2038494182 None] Acquiring lock "cinder-e8d3be5f-dcdc-407f-a404-f0ef74b969ee-delete_volume" by "delete_volume" {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 04:54:45 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-d49c0a82-33ed-4db0-bc5f-2a3816524bc4 tempest-ProjectMemberTests-1806793813 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (426ab29a-2657-48f0-910c-2ed86788b8b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T02:54:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-579043243',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8e00186b-8f9c-41d3-ae32-7234df970c22,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cadbf6455bcb4ed48f08a3c15f1d84e3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T02:54:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T02:54:45Z,use_quota=True,user_id='2aceae1efa264e87bd2696a5a256f622',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(317e369e-1e06-434d-ae95-a335f0e6c903),volume_type_id=317e369e-1e06-434d-ae95-a335f0e6c903)' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:54:45 devstack sudo[106049]: pam_unix(sudo:session): session closed for user root Jul 10 04:54:45 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-d49c0a82-33ed-4db0-bc5f-2a3816524bc4 tempest-ProjectMemberTests-1806793813 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9ab53a61-8c76-409a-ae02-7450836959ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:54:45 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-d49c0a82-33ed-4db0-bc5f-2a3816524bc4 tempest-ProjectMemberTests-1806793813 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9ab53a61-8c76-409a-ae02-7450836959ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:54:45 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-d49c0a82-33ed-4db0-bc5f-2a3816524bc4 tempest-ProjectMemberTests-1806793813 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2c71a0bb-45ea-49c2-8f98-fea086fa9ae6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:54:45 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-d49c0a82-33ed-4db0-bc5f-2a3816524bc4 tempest-ProjectMemberTests-1806793813 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2c71a0bb-45ea-49c2-8f98-fea086fa9ae6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8e00186b-8f9c-41d3-ae32-7234df970c22', 'volume_name': 'volume-8e00186b-8f9c-41d3-ae32-7234df970c22', 'volume_size': 1}' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:54:45 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-d49c0a82-33ed-4db0-bc5f-2a3816524bc4 tempest-ProjectMemberTests-1806793813 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f99e738c-9fb8-41f5-93f5-bbf45a1e09ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:54:45 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-d49c0a82-33ed-4db0-bc5f-2a3816524bc4 tempest-ProjectMemberTests-1806793813 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f99e738c-9fb8-41f5-93f5-bbf45a1e09ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:54:45 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-d49c0a82-33ed-4db0-bc5f-2a3816524bc4 tempest-ProjectMemberTests-1806793813 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (32a7b6cc-9886-40c2-b224-3938bcffd929) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:54:45 devstack cinder-volume[87444]: INFO cinder.volume.flows.manager.create_volume [None req-d49c0a82-33ed-4db0-bc5f-2a3816524bc4 tempest-ProjectMemberTests-1806793813 None] Volume 8e00186b-8f9c-41d3-ae32-7234df970c22: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8e00186b-8f9c-41d3-ae32-7234df970c22', 'volume_size': 1} Jul 10 04:54:45 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-d49c0a82-33ed-4db0-bc5f-2a3816524bc4 tempest-ProjectMemberTests-1806793813 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 04:54:45 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-d49c0a82-33ed-4db0-bc5f-2a3816524bc4 tempest-ProjectMemberTests-1806793813 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 04:54:45 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-d49c0a82-33ed-4db0-bc5f-2a3816524bc4 tempest-ProjectMemberTests-1806793813 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T02:54:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-579043243',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8e00186b-8f9c-41d3-ae32-7234df970c22,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cadbf6455bcb4ed48f08a3c15f1d84e3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T02:54:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T02:54:45Z,use_quota=True,user_id='2aceae1efa264e87bd2696a5a256f622',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(317e369e-1e06-434d-ae95-a335f0e6c903),volume_type_id=317e369e-1e06-434d-ae95-a335f0e6c903)}" {{(pid=87444) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 04:54:45 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.remotefs [None req-d49c0a82-33ed-4db0-bc5f-2a3816524bc4 tempest-ProjectMemberTests-1806793813 None] Creating volume 8e00186b-8f9c-41d3-ae32-7234df970c22 {{(pid=87444) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 04:54:45 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-d49c0a82-33ed-4db0-bc5f-2a3816524bc4 tempest-ProjectMemberTests-1806793813 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 04:54:45 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-d49c0a82-33ed-4db0-bc5f-2a3816524bc4 tempest-ProjectMemberTests-1806793813 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 04:54:45 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-d49c0a82-33ed-4db0-bc5f-2a3816524bc4 tempest-ProjectMemberTests-1806793813 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922': None} {{(pid=87444) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 04:54:45 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-d49c0a82-33ed-4db0-bc5f-2a3816524bc4 tempest-ProjectMemberTests-1806793813 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922'] {{(pid=87444) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 04:54:45 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-d49c0a82-33ed-4db0-bc5f-2a3816524bc4 tempest-ProjectMemberTests-1806793813 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 04:54:45 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-d49c0a82-33ed-4db0-bc5f-2a3816524bc4 tempest-ProjectMemberTests-1806793813 None] Selected osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922 as target Quobyte volume. {{(pid=87444) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 04:54:45 devstack cinder-volume[87444]: INFO cinder.volume.drivers.remotefs [None req-d49c0a82-33ed-4db0-bc5f-2a3816524bc4 tempest-ProjectMemberTests-1806793813 None] casted to osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922 Jul 10 04:54:45 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-d49c0a82-33ed-4db0-bc5f-2a3816524bc4 tempest-ProjectMemberTests-1806793813 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-8e00186b-8f9c-41d3-ae32-7234df970c22 1073741824 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:54:45 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-11b53a41-047b-4f90-8fca-93954316840e tempest-ProjectReaderTests-2038494182 None] Lock "cinder-e8d3be5f-dcdc-407f-a404-f0ef74b969ee-delete_volume" acquired by "delete_volume" :: waited 0.089s {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 04:54:45 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-38139779-7dcc-47dc-9114-6e015cb30e58 tempest-ProjectMemberTests-1806793813 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097" returned: 0 in 0.867s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:54:45 devstack cinder-volume[87444]: DEBUG cinder.manager [None req-38139779-7dcc-47dc-9114-6e015cb30e58 tempest-ProjectMemberTests-1806793813 None] Notifying Schedulers of capabilities ... {{(pid=87444) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 04:54:45 devstack sudo[106058]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-8e00186b-8f9c-41d3-ae32-7234df970c22 1073741824 Jul 10 04:54:45 devstack sudo[106058]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:54:45 devstack cinder-volume[87444]: INFO cinder.volume.manager [None req-38139779-7dcc-47dc-9114-6e015cb30e58 tempest-ProjectMemberTests-1806793813 None] Deleted volume successfully. Jul 10 04:54:45 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-38139779-7dcc-47dc-9114-6e015cb30e58 tempest-ProjectMemberTests-1806793813 None] Lock "cinder-35abcbff-ee5f-44a4-aa51-ddacce19e852-delete_volume" released by "delete_volume" :: held 2.965s {{(pid=87444) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 04:54:45 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-11b53a41-047b-4f90-8fca-93954316840e tempest-ProjectReaderTests-2038494182 None] Acquiring lock "cinder-quobyte-e8d3be5f-dcdc-407f-a404-f0ef74b969ee" by "delete_volume" {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 04:54:45 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-11b53a41-047b-4f90-8fca-93954316840e tempest-ProjectReaderTests-2038494182 None] Lock "cinder-quobyte-e8d3be5f-dcdc-407f-a404-f0ef74b969ee" acquired by "delete_volume" :: waited 0.014s {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 04:54:45 devstack cinder-volume[87444]: DEBUG oslo.privsep.daemon [-] privsep: reply[98333d2c-9e4e-4eab-87aa-aabe67452781]: (4, 'qcow2') {{(pid=88499) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 04:54:45 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-11b53a41-047b-4f90-8fca-93954316840e tempest-ProjectReaderTests-2038494182 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-e8d3be5f-dcdc-407f-a404-f0ef74b969ee {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:54:45 devstack sudo[106060]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-e8d3be5f-dcdc-407f-a404-f0ef74b969ee Jul 10 04:54:45 devstack sudo[106060]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:54:45 devstack sudo[106055]: pam_unix(sudo:session): session closed for user root Jul 10 04:54:45 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-4921da9c-bd66-4faa-a67f-a8e218328ac4 tempest-ProjectReaderTests-860343347 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-eb55c4cd-e620-471c-a91d-be486be43a51.8b9223f6-6a9f-49a9-8a15-bde4f67b0b84" returned: 0 in 0.887s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:54:45 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-4921da9c-bd66-4faa-a67f-a8e218328ac4 tempest-ProjectReaderTests-860343347 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-eb55c4cd-e620-471c-a91d-be486be43a51.8b9223f6-6a9f-49a9-8a15-bde4f67b0b84 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:54:45 devstack sudo[106065]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-eb55c4cd-e620-471c-a91d-be486be43a51.8b9223f6-6a9f-49a9-8a15-bde4f67b0b84 Jul 10 04:54:45 devstack sudo[106065]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:54:46 devstack sudo[106058]: pam_unix(sudo:session): session closed for user root Jul 10 04:54:46 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-d49c0a82-33ed-4db0-bc5f-2a3816524bc4 tempest-ProjectMemberTests-1806793813 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-8e00186b-8f9c-41d3-ae32-7234df970c22 1073741824" returned: 0 in 0.850s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:54:46 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-d49c0a82-33ed-4db0-bc5f-2a3816524bc4 tempest-ProjectMemberTests-1806793813 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-8e00186b-8f9c-41d3-ae32-7234df970c22 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:54:46 devstack sudo[106074]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-8e00186b-8f9c-41d3-ae32-7234df970c22 Jul 10 04:54:46 devstack sudo[106074]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:54:46 devstack sudo[106060]: pam_unix(sudo:session): session closed for user root Jul 10 04:54:46 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-11b53a41-047b-4f90-8fca-93954316840e tempest-ProjectReaderTests-2038494182 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-e8d3be5f-dcdc-407f-a404-f0ef74b969ee" returned: 0 in 0.873s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:54:46 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-11b53a41-047b-4f90-8fca-93954316840e tempest-ProjectReaderTests-2038494182 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-e8d3be5f-dcdc-407f-a404-f0ef74b969ee {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:54:46 devstack sudo[106076]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-e8d3be5f-dcdc-407f-a404-f0ef74b969ee Jul 10 04:54:46 devstack sudo[106076]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:54:46 devstack sudo[106065]: pam_unix(sudo:session): session closed for user root Jul 10 04:54:46 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-4921da9c-bd66-4faa-a67f-a8e218328ac4 tempest-ProjectReaderTests-860343347 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-eb55c4cd-e620-471c-a91d-be486be43a51.8b9223f6-6a9f-49a9-8a15-bde4f67b0b84" returned: 0 in 0.687s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:54:46 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-4921da9c-bd66-4faa-a67f-a8e218328ac4 tempest-ProjectReaderTests-860343347 None] Lock "cinder-quobyte-8b9223f6-6a9f-49a9-8a15-bde4f67b0b84" released by "_delete_snapshot" :: held 3.597s {{(pid=87444) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 04:54:46 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-4921da9c-bd66-4faa-a67f-a8e218328ac4 tempest-ProjectReaderTests-860343347 None] Lock "cinder-quobyte-eb55c4cd-e620-471c-a91d-be486be43a51" released by "delete_snapshot" :: held 3.653s {{(pid=87444) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 04:54:46 devstack cinder-volume[87444]: DEBUG cinder.quota [None req-4921da9c-bd66-4faa-a67f-a8e218328ac4 tempest-ProjectReaderTests-860343347 None] Created reservations ['90d52f68-db2e-465d-a595-9c1e32cfd867', 'c68981e4-3757-4597-8d5a-5b559607cb4d', '9ff943e1-0a3e-4a38-93ba-875c875ea961', 'e144e54f-5c3b-4ab4-b665-c6e95af6b22d'] {{(pid=87444) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 04:54:46 devstack cinder-volume[87444]: INFO cinder.volume.manager [None req-4921da9c-bd66-4faa-a67f-a8e218328ac4 tempest-ProjectReaderTests-860343347 None] Delete snapshot completed successfully. Jul 10 04:54:46 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-4921da9c-bd66-4faa-a67f-a8e218328ac4 tempest-ProjectReaderTests-860343347 None] Lock "cinder-8b9223f6-6a9f-49a9-8a15-bde4f67b0b84-delete_snapshot" released by "delete_snapshot" :: held 3.805s {{(pid=87444) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 04:54:46 devstack sudo[106074]: pam_unix(sudo:session): session closed for user root Jul 10 04:54:46 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-d49c0a82-33ed-4db0-bc5f-2a3816524bc4 tempest-ProjectMemberTests-1806793813 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-8e00186b-8f9c-41d3-ae32-7234df970c22" returned: 0 in 0.684s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:54:46 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-d49c0a82-33ed-4db0-bc5f-2a3816524bc4 tempest-ProjectMemberTests-1806793813 None] <== create_volume: return (1578ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922'} {{(pid=87444) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 04:54:46 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-d49c0a82-33ed-4db0-bc5f-2a3816524bc4 tempest-ProjectMemberTests-1806793813 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.581s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 04:54:46 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-d49c0a82-33ed-4db0-bc5f-2a3816524bc4 tempest-ProjectMemberTests-1806793813 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (32a7b6cc-9886-40c2-b224-3938bcffd929) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8e00186b-8f9c-41d3-ae32-7234df970c22', 'volume_size': 1}' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:54:46 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-d49c0a82-33ed-4db0-bc5f-2a3816524bc4 tempest-ProjectMemberTests-1806793813 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cbaac8b0-49dc-4536-b535-5a9da4a6262b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:54:46 devstack cinder-volume[87444]: INFO cinder.volume.flows.manager.create_volume [None req-d49c0a82-33ed-4db0-bc5f-2a3816524bc4 tempest-ProjectMemberTests-1806793813 None] Volume volume-8e00186b-8f9c-41d3-ae32-7234df970c22 (8e00186b-8f9c-41d3-ae32-7234df970c22): created successfully Jul 10 04:54:46 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-d49c0a82-33ed-4db0-bc5f-2a3816524bc4 tempest-ProjectMemberTests-1806793813 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cbaac8b0-49dc-4536-b535-5a9da4a6262b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:54:46 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-d49c0a82-33ed-4db0-bc5f-2a3816524bc4 tempest-ProjectMemberTests-1806793813 None] Flow 'volume_create_manager' (e278f30a-f4d5-469f-bdee-e7803abff0a5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87444) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 04:54:46 devstack cinder-volume[87444]: INFO cinder.volume.manager [None req-d49c0a82-33ed-4db0-bc5f-2a3816524bc4 tempest-ProjectMemberTests-1806793813 None] Created volume successfully. Jul 10 04:54:46 devstack sudo[106076]: pam_unix(sudo:session): session closed for user root Jul 10 04:54:46 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-11b53a41-047b-4f90-8fca-93954316840e tempest-ProjectReaderTests-2038494182 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-e8d3be5f-dcdc-407f-a404-f0ef74b969ee" returned: 0 in 0.679s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:54:46 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-11b53a41-047b-4f90-8fca-93954316840e tempest-ProjectReaderTests-2038494182 None] Lock "cinder-quobyte-e8d3be5f-dcdc-407f-a404-f0ef74b969ee" released by "delete_volume" :: held 1.593s {{(pid=87444) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 04:54:46 devstack cinder-volume[87444]: DEBUG cinder.quota [None req-11b53a41-047b-4f90-8fca-93954316840e tempest-ProjectReaderTests-2038494182 None] Created reservations ['fbfef694-aaff-48c2-91ab-9b865ef504c0', '6ab73548-8786-4a56-992d-59df9b87e28a', 'aabc9552-5a06-42ad-8325-76d2c3214315', 'd5af67e6-e7ed-4a3d-8c47-3273e937473a'] {{(pid=87444) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 04:54:46 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-11b53a41-047b-4f90-8fca-93954316840e tempest-ProjectReaderTests-2038494182 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 04:54:46 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-11b53a41-047b-4f90-8fca-93954316840e tempest-ProjectReaderTests-2038494182 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 04:54:46 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-11b53a41-047b-4f90-8fca-93954316840e tempest-ProjectReaderTests-2038494182 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922': None} {{(pid=87444) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 04:54:46 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-11b53a41-047b-4f90-8fca-93954316840e tempest-ProjectReaderTests-2038494182 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922'] {{(pid=87444) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 04:54:46 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-11b53a41-047b-4f90-8fca-93954316840e tempest-ProjectReaderTests-2038494182 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 04:54:46 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-11b53a41-047b-4f90-8fca-93954316840e tempest-ProjectReaderTests-2038494182 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:54:47 devstack sudo[106087]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097 Jul 10 04:54:47 devstack sudo[106087]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:54:47 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-c82b18ef-480d-490f-bbbb-5a86b21492c1 tempest-ProjectReaderTests-860343347 None] Acquiring lock "cinder-eb55c4cd-e620-471c-a91d-be486be43a51-delete_volume" by "delete_volume" {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 04:54:47 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-c82b18ef-480d-490f-bbbb-5a86b21492c1 tempest-ProjectReaderTests-860343347 None] Lock "cinder-eb55c4cd-e620-471c-a91d-be486be43a51-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 04:54:47 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-c82b18ef-480d-490f-bbbb-5a86b21492c1 tempest-ProjectReaderTests-860343347 None] Acquiring lock "cinder-quobyte-eb55c4cd-e620-471c-a91d-be486be43a51" by "delete_volume" {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 04:54:47 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-c82b18ef-480d-490f-bbbb-5a86b21492c1 tempest-ProjectReaderTests-860343347 None] Lock "cinder-quobyte-eb55c4cd-e620-471c-a91d-be486be43a51" acquired by "delete_volume" :: waited 0.028s {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 04:54:47 devstack cinder-volume[87444]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8372252-2d27-494d-b509-cfc2a5aa9d56]: (4, 'qcow2') {{(pid=88499) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 04:54:47 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-c82b18ef-480d-490f-bbbb-5a86b21492c1 tempest-ProjectReaderTests-860343347 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-eb55c4cd-e620-471c-a91d-be486be43a51 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:54:47 devstack sudo[106089]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-eb55c4cd-e620-471c-a91d-be486be43a51 Jul 10 04:54:47 devstack sudo[106089]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:54:47 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-e37916c0-e3b3-4353-b265-38d597cb45e7 tempest-ProjectMemberTests-1806793813 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 04:54:47 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-e37916c0-e3b3-4353-b265-38d597cb45e7 tempest-ProjectMemberTests-1806793813 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 04:54:47 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.remotefs [None req-e37916c0-e3b3-4353-b265-38d597cb45e7 tempest-ProjectMemberTests-1806793813 None] Creating offline snapshot 78183950-9f5f-4237-b141-b0b9224cddee of volume 8e00186b-8f9c-41d3-ae32-7234df970c22 {{(pid=87444) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 10 04:54:47 devstack cinder-volume[87444]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee7d0f04-720e-45ca-9577-7bf1e8ce0f1a]: (4, 'qcow2') {{(pid=88499) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 04:54:47 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-e37916c0-e3b3-4353-b265-38d597cb45e7 tempest-ProjectMemberTests-1806793813 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-8e00186b-8f9c-41d3-ae32-7234df970c22 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:54:47 devstack sudo[106091]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-8e00186b-8f9c-41d3-ae32-7234df970c22 Jul 10 04:54:47 devstack sudo[106091]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:54:47 devstack sudo[106087]: pam_unix(sudo:session): session closed for user root Jul 10 04:54:47 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-11b53a41-047b-4f90-8fca-93954316840e tempest-ProjectReaderTests-2038494182 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097" returned: 0 in 0.874s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:54:47 devstack cinder-volume[87444]: DEBUG cinder.manager [None req-11b53a41-047b-4f90-8fca-93954316840e tempest-ProjectReaderTests-2038494182 None] Notifying Schedulers of capabilities ... {{(pid=87444) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 04:54:47 devstack cinder-volume[87444]: INFO cinder.volume.manager [None req-11b53a41-047b-4f90-8fca-93954316840e tempest-ProjectReaderTests-2038494182 None] Deleted volume successfully. Jul 10 04:54:47 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-11b53a41-047b-4f90-8fca-93954316840e tempest-ProjectReaderTests-2038494182 None] Lock "cinder-e8d3be5f-dcdc-407f-a404-f0ef74b969ee-delete_volume" released by "delete_volume" :: held 2.698s {{(pid=87444) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 04:54:48 devstack sudo[106089]: pam_unix(sudo:session): session closed for user root Jul 10 04:54:48 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-c82b18ef-480d-490f-bbbb-5a86b21492c1 tempest-ProjectReaderTests-860343347 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-eb55c4cd-e620-471c-a91d-be486be43a51" returned: 0 in 0.897s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:54:48 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-c82b18ef-480d-490f-bbbb-5a86b21492c1 tempest-ProjectReaderTests-860343347 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-eb55c4cd-e620-471c-a91d-be486be43a51 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:54:48 devstack sudo[106099]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-eb55c4cd-e620-471c-a91d-be486be43a51 Jul 10 04:54:48 devstack sudo[106099]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:54:48 devstack sudo[106091]: pam_unix(sudo:session): session closed for user root Jul 10 04:54:48 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-e37916c0-e3b3-4353-b265-38d597cb45e7 tempest-ProjectMemberTests-1806793813 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-8e00186b-8f9c-41d3-ae32-7234df970c22" returned: 0 in 0.899s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:54:48 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-e37916c0-e3b3-4353-b265-38d597cb45e7 tempest-ProjectMemberTests-1806793813 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-8e00186b-8f9c-41d3-ae32-7234df970c22,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-8e00186b-8f9c-41d3-ae32-7234df970c22.78183950-9f5f-4237-b141-b0b9224cddee 1G {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:54:48 devstack sudo[106104]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-8e00186b-8f9c-41d3-ae32-7234df970c22,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-8e00186b-8f9c-41d3-ae32-7234df970c22.78183950-9f5f-4237-b141-b0b9224cddee 1G Jul 10 04:54:48 devstack sudo[106104]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:54:48 devstack sudo[106099]: pam_unix(sudo:session): session closed for user root Jul 10 04:54:48 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-c82b18ef-480d-490f-bbbb-5a86b21492c1 tempest-ProjectReaderTests-860343347 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-eb55c4cd-e620-471c-a91d-be486be43a51" returned: 0 in 0.741s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:54:48 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-c82b18ef-480d-490f-bbbb-5a86b21492c1 tempest-ProjectReaderTests-860343347 None] Lock "cinder-quobyte-eb55c4cd-e620-471c-a91d-be486be43a51" released by "delete_volume" :: held 1.716s {{(pid=87444) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 04:54:48 devstack cinder-volume[87444]: DEBUG cinder.quota [None req-c82b18ef-480d-490f-bbbb-5a86b21492c1 tempest-ProjectReaderTests-860343347 None] Created reservations ['26a36eef-55e3-44c7-a676-ae07ce453e31', 'b0044ba3-03e7-4106-930e-d5dbaccc0223', '2d01dceb-98ce-473a-83c2-2007faf714b8', '94ee0943-0860-4630-9143-23367c77c02a'] {{(pid=87444) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 04:54:49 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-c82b18ef-480d-490f-bbbb-5a86b21492c1 tempest-ProjectReaderTests-860343347 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 04:54:49 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-c82b18ef-480d-490f-bbbb-5a86b21492c1 tempest-ProjectReaderTests-860343347 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 04:54:49 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-c82b18ef-480d-490f-bbbb-5a86b21492c1 tempest-ProjectReaderTests-860343347 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922': None} {{(pid=87444) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 04:54:49 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-c82b18ef-480d-490f-bbbb-5a86b21492c1 tempest-ProjectReaderTests-860343347 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922'] {{(pid=87444) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 04:54:49 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-c82b18ef-480d-490f-bbbb-5a86b21492c1 tempest-ProjectReaderTests-860343347 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 04:54:49 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-c82b18ef-480d-490f-bbbb-5a86b21492c1 tempest-ProjectReaderTests-860343347 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:54:49 devstack sudo[106110]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097 Jul 10 04:54:49 devstack sudo[106110]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:54:49 devstack sudo[106104]: pam_unix(sudo:session): session closed for user root Jul 10 04:54:49 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-e37916c0-e3b3-4353-b265-38d597cb45e7 tempest-ProjectMemberTests-1806793813 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-8e00186b-8f9c-41d3-ae32-7234df970c22,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-8e00186b-8f9c-41d3-ae32-7234df970c22.78183950-9f5f-4237-b141-b0b9224cddee 1G" returned: 0 in 0.937s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:54:49 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-e37916c0-e3b3-4353-b265-38d597cb45e7 tempest-ProjectMemberTests-1806793813 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8e00186b-8f9c-41d3-ae32-7234df970c22 -F qcow2 /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-8e00186b-8f9c-41d3-ae32-7234df970c22.78183950-9f5f-4237-b141-b0b9224cddee {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:54:49 devstack sudo[106113]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8e00186b-8f9c-41d3-ae32-7234df970c22 -F qcow2 /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-8e00186b-8f9c-41d3-ae32-7234df970c22.78183950-9f5f-4237-b141-b0b9224cddee Jul 10 04:54:49 devstack sudo[106113]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:54:49 devstack sudo[106110]: pam_unix(sudo:session): session closed for user root Jul 10 04:54:49 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-c82b18ef-480d-490f-bbbb-5a86b21492c1 tempest-ProjectReaderTests-860343347 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097" returned: 0 in 0.752s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:54:49 devstack cinder-volume[87444]: DEBUG cinder.manager [None req-c82b18ef-480d-490f-bbbb-5a86b21492c1 tempest-ProjectReaderTests-860343347 None] Notifying Schedulers of capabilities ... {{(pid=87444) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 04:54:49 devstack cinder-volume[87444]: INFO cinder.volume.manager [None req-c82b18ef-480d-490f-bbbb-5a86b21492c1 tempest-ProjectReaderTests-860343347 None] Deleted volume successfully. Jul 10 04:54:49 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-c82b18ef-480d-490f-bbbb-5a86b21492c1 tempest-ProjectReaderTests-860343347 None] Lock "cinder-eb55c4cd-e620-471c-a91d-be486be43a51-delete_volume" released by "delete_volume" :: held 2.737s {{(pid=87444) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 04:54:49 devstack cinder-volume[87444]: DEBUG cinder.volume.flows.manager.create_volume [None req-24a2435b-75a1-4ef3-91d7-26dc2c7a6083 tempest-ProjectReaderTests-860343347 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87444) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 04:54:49 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-24a2435b-75a1-4ef3-91d7-26dc2c7a6083 tempest-ProjectReaderTests-860343347 None] Flow 'volume_create_manager' (98c8b0e4-6433-4837-959d-76f5d96d8fb5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 04:54:49 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-24a2435b-75a1-4ef3-91d7-26dc2c7a6083 tempest-ProjectReaderTests-860343347 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (19c23ff4-94ae-4bd1-8d21-d95e2571d259) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:54:49 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-24a2435b-75a1-4ef3-91d7-26dc2c7a6083 tempest-ProjectReaderTests-860343347 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (19c23ff4-94ae-4bd1-8d21-d95e2571d259) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T02:54:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-443150130',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f541394b-09c3-43fd-86f9-d1c03dcb6025,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='181feec0fe8f488b8b6345b78eb67c5c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T02:54:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T02:54:50Z,use_quota=True,user_id='c9a1d6a7ee0a44ff83a1bceb660b8015',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(317e369e-1e06-434d-ae95-a335f0e6c903),volume_type_id=317e369e-1e06-434d-ae95-a335f0e6c903)' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:54:49 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-24a2435b-75a1-4ef3-91d7-26dc2c7a6083 tempest-ProjectReaderTests-860343347 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ced4b8d5-e02e-44e4-b424-d70689bba3a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:54:49 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-24a2435b-75a1-4ef3-91d7-26dc2c7a6083 tempest-ProjectReaderTests-860343347 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ced4b8d5-e02e-44e4-b424-d70689bba3a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:54:49 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-24a2435b-75a1-4ef3-91d7-26dc2c7a6083 tempest-ProjectReaderTests-860343347 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (47f1ffb3-037d-4ae8-afe1-b53578e6f5fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:54:49 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-24a2435b-75a1-4ef3-91d7-26dc2c7a6083 tempest-ProjectReaderTests-860343347 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (47f1ffb3-037d-4ae8-afe1-b53578e6f5fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f541394b-09c3-43fd-86f9-d1c03dcb6025', 'volume_name': 'volume-f541394b-09c3-43fd-86f9-d1c03dcb6025', 'volume_size': 1}' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:54:49 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-24a2435b-75a1-4ef3-91d7-26dc2c7a6083 tempest-ProjectReaderTests-860343347 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c3fe745b-32f1-41fe-9b9c-886a00fec713) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:54:49 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-24a2435b-75a1-4ef3-91d7-26dc2c7a6083 tempest-ProjectReaderTests-860343347 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c3fe745b-32f1-41fe-9b9c-886a00fec713) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:54:49 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-24a2435b-75a1-4ef3-91d7-26dc2c7a6083 tempest-ProjectReaderTests-860343347 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (72c5fe5f-3ab5-4c53-ae58-1c35399ff0ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:54:49 devstack cinder-volume[87444]: INFO cinder.volume.flows.manager.create_volume [None req-24a2435b-75a1-4ef3-91d7-26dc2c7a6083 tempest-ProjectReaderTests-860343347 None] Volume f541394b-09c3-43fd-86f9-d1c03dcb6025: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f541394b-09c3-43fd-86f9-d1c03dcb6025', 'volume_size': 1} Jul 10 04:54:49 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-24a2435b-75a1-4ef3-91d7-26dc2c7a6083 tempest-ProjectReaderTests-860343347 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 04:54:50 devstack sudo[106113]: pam_unix(sudo:session): session closed for user root Jul 10 04:54:50 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-e37916c0-e3b3-4353-b265-38d597cb45e7 tempest-ProjectMemberTests-1806793813 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8e00186b-8f9c-41d3-ae32-7234df970c22 -F qcow2 /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-8e00186b-8f9c-41d3-ae32-7234df970c22.78183950-9f5f-4237-b141-b0b9224cddee" returned: 0 in 0.779s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:54:50 devstack cinder-volume[87444]: WARNING cinder.volume.drivers.remotefs [None req-e37916c0-e3b3-4353-b265-38d597cb45e7 tempest-ProjectMemberTests-1806793813 None] /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-8e00186b-8f9c-41d3-ae32-7234df970c22.78183950-9f5f-4237-b141-b0b9224cddee is being set with open permissions: ugo+rw Jul 10 04:54:50 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-e37916c0-e3b3-4353-b265-38d597cb45e7 tempest-ProjectMemberTests-1806793813 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-8e00186b-8f9c-41d3-ae32-7234df970c22.78183950-9f5f-4237-b141-b0b9224cddee {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:54:50 devstack sudo[106119]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-8e00186b-8f9c-41d3-ae32-7234df970c22.78183950-9f5f-4237-b141-b0b9224cddee Jul 10 04:54:50 devstack sudo[106119]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:54:50 devstack sudo[106119]: pam_unix(sudo:session): session closed for user root Jul 10 04:54:50 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-e37916c0-e3b3-4353-b265-38d597cb45e7 tempest-ProjectMemberTests-1806793813 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-8e00186b-8f9c-41d3-ae32-7234df970c22.78183950-9f5f-4237-b141-b0b9224cddee" returned: 0 in 0.627s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:54:50 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-e37916c0-e3b3-4353-b265-38d597cb45e7 tempest-ProjectMemberTests-1806793813 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-8e00186b-8f9c-41d3-ae32-7234df970c22.info {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:54:50 devstack sudo[106122]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-8e00186b-8f9c-41d3-ae32-7234df970c22.info Jul 10 04:54:50 devstack sudo[106122]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:54:51 devstack sudo[106122]: pam_unix(sudo:session): session closed for user root Jul 10 04:54:51 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-e37916c0-e3b3-4353-b265-38d597cb45e7 tempest-ProjectMemberTests-1806793813 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-8e00186b-8f9c-41d3-ae32-7234df970c22.info" returned: 0 in 0.642s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:54:51 devstack cinder-volume[87444]: WARNING cinder.volume.drivers.remotefs [None req-e37916c0-e3b3-4353-b265-38d597cb45e7 tempest-ProjectMemberTests-1806793813 None] /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-8e00186b-8f9c-41d3-ae32-7234df970c22.info is being set with open permissions: ugo+rw Jul 10 04:54:51 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-e37916c0-e3b3-4353-b265-38d597cb45e7 tempest-ProjectMemberTests-1806793813 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-8e00186b-8f9c-41d3-ae32-7234df970c22.info {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:54:51 devstack sudo[106125]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-8e00186b-8f9c-41d3-ae32-7234df970c22.info Jul 10 04:54:51 devstack sudo[106125]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:54:51 devstack sudo[106125]: pam_unix(sudo:session): session closed for user root Jul 10 04:54:51 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-e37916c0-e3b3-4353-b265-38d597cb45e7 tempest-ProjectMemberTests-1806793813 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-8e00186b-8f9c-41d3-ae32-7234df970c22.info" returned: 0 in 0.628s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:54:51 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-e37916c0-e3b3-4353-b265-38d597cb45e7 tempest-ProjectMemberTests-1806793813 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.614s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 04:54:51 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-24a2435b-75a1-4ef3-91d7-26dc2c7a6083 tempest-ProjectReaderTests-860343347 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.001s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 04:54:51 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-24a2435b-75a1-4ef3-91d7-26dc2c7a6083 tempest-ProjectReaderTests-860343347 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T02:54:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-443150130',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f541394b-09c3-43fd-86f9-d1c03dcb6025,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='181feec0fe8f488b8b6345b78eb67c5c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T02:54:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T02:54:50Z,use_quota=True,user_id='c9a1d6a7ee0a44ff83a1bceb660b8015',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(317e369e-1e06-434d-ae95-a335f0e6c903),volume_type_id=317e369e-1e06-434d-ae95-a335f0e6c903)}" {{(pid=87444) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 04:54:51 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.remotefs [None req-24a2435b-75a1-4ef3-91d7-26dc2c7a6083 tempest-ProjectReaderTests-860343347 None] Creating volume f541394b-09c3-43fd-86f9-d1c03dcb6025 {{(pid=87444) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 04:54:51 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-24a2435b-75a1-4ef3-91d7-26dc2c7a6083 tempest-ProjectReaderTests-860343347 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 04:54:51 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-24a2435b-75a1-4ef3-91d7-26dc2c7a6083 tempest-ProjectReaderTests-860343347 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 04:54:51 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-24a2435b-75a1-4ef3-91d7-26dc2c7a6083 tempest-ProjectReaderTests-860343347 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922': None} {{(pid=87444) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 04:54:51 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-24a2435b-75a1-4ef3-91d7-26dc2c7a6083 tempest-ProjectReaderTests-860343347 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922'] {{(pid=87444) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 04:54:51 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-24a2435b-75a1-4ef3-91d7-26dc2c7a6083 tempest-ProjectReaderTests-860343347 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 04:54:51 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-24a2435b-75a1-4ef3-91d7-26dc2c7a6083 tempest-ProjectReaderTests-860343347 None] Selected osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922 as target Quobyte volume. {{(pid=87444) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 04:54:51 devstack cinder-volume[87444]: INFO cinder.volume.drivers.remotefs [None req-24a2435b-75a1-4ef3-91d7-26dc2c7a6083 tempest-ProjectReaderTests-860343347 None] casted to osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922 Jul 10 04:54:51 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-24a2435b-75a1-4ef3-91d7-26dc2c7a6083 tempest-ProjectReaderTests-860343347 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-f541394b-09c3-43fd-86f9-d1c03dcb6025 1073741824 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:54:52 devstack sudo[106128]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-f541394b-09c3-43fd-86f9-d1c03dcb6025 1073741824 Jul 10 04:54:52 devstack sudo[106128]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:54:52 devstack cinder-volume[87444]: INFO cinder.volume.manager [None req-e37916c0-e3b3-4353-b265-38d597cb45e7 tempest-ProjectMemberTests-1806793813 None] Create snapshot completed successfully Jul 10 04:54:52 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-bdf63559-03e7-4693-9a83-4860c0e0a748 tempest-ProjectMemberTests-1806793813 None] Acquiring lock "cinder-78183950-9f5f-4237-b141-b0b9224cddee-delete_snapshot" by "delete_snapshot" {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 04:54:52 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-bdf63559-03e7-4693-9a83-4860c0e0a748 tempest-ProjectMemberTests-1806793813 None] Lock "cinder-78183950-9f5f-4237-b141-b0b9224cddee-delete_snapshot" acquired by "delete_snapshot" :: waited 0.018s {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 04:54:52 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-bdf63559-03e7-4693-9a83-4860c0e0a748 tempest-ProjectMemberTests-1806793813 None] Acquiring lock "cinder-quobyte-8e00186b-8f9c-41d3-ae32-7234df970c22" by "delete_snapshot" {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 04:54:52 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-bdf63559-03e7-4693-9a83-4860c0e0a748 tempest-ProjectMemberTests-1806793813 None] Lock "cinder-quobyte-8e00186b-8f9c-41d3-ae32-7234df970c22" acquired by "delete_snapshot" :: waited 0.017s {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 04:54:52 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-bdf63559-03e7-4693-9a83-4860c0e0a748 tempest-ProjectMemberTests-1806793813 None] Acquiring lock "cinder-quobyte-78183950-9f5f-4237-b141-b0b9224cddee" by "_delete_snapshot" {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 04:54:52 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-bdf63559-03e7-4693-9a83-4860c0e0a748 tempest-ProjectMemberTests-1806793813 None] Lock "cinder-quobyte-78183950-9f5f-4237-b141-b0b9224cddee" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 04:54:52 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.remotefs [None req-bdf63559-03e7-4693-9a83-4860c0e0a748 tempest-ProjectMemberTests-1806793813 None] Deleting offline snapshot 78183950-9f5f-4237-b141-b0b9224cddee of volume 8e00186b-8f9c-41d3-ae32-7234df970c22 {{(pid=87444) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 10 04:54:52 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.remotefs [None req-bdf63559-03e7-4693-9a83-4860c0e0a748 tempest-ProjectMemberTests-1806793813 None] snapshot_file for this snap is: volume-8e00186b-8f9c-41d3-ae32-7234df970c22.78183950-9f5f-4237-b141-b0b9224cddee {{(pid=87444) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 10 04:54:52 devstack cinder-volume[87444]: DEBUG oslo.privsep.daemon [-] privsep: reply[23c70716-ff41-4831-b6a9-a2341bd13238]: (4, 'qcow2') {{(pid=88499) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 04:54:52 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-bdf63559-03e7-4693-9a83-4860c0e0a748 tempest-ProjectMemberTests-1806793813 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-8e00186b-8f9c-41d3-ae32-7234df970c22.78183950-9f5f-4237-b141-b0b9224cddee {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:54:52 devstack sudo[106134]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-8e00186b-8f9c-41d3-ae32-7234df970c22.78183950-9f5f-4237-b141-b0b9224cddee Jul 10 04:54:52 devstack sudo[106134]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:54:52 devstack sudo[106128]: pam_unix(sudo:session): session closed for user root Jul 10 04:54:52 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-24a2435b-75a1-4ef3-91d7-26dc2c7a6083 tempest-ProjectReaderTests-860343347 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-f541394b-09c3-43fd-86f9-d1c03dcb6025 1073741824" returned: 0 in 0.826s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:54:52 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-24a2435b-75a1-4ef3-91d7-26dc2c7a6083 tempest-ProjectReaderTests-860343347 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-f541394b-09c3-43fd-86f9-d1c03dcb6025 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:54:52 devstack sudo[106137]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-f541394b-09c3-43fd-86f9-d1c03dcb6025 Jul 10 04:54:52 devstack sudo[106137]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:54:53 devstack sudo[106134]: pam_unix(sudo:session): session closed for user root Jul 10 04:54:53 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-bdf63559-03e7-4693-9a83-4860c0e0a748 tempest-ProjectMemberTests-1806793813 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-8e00186b-8f9c-41d3-ae32-7234df970c22.78183950-9f5f-4237-b141-b0b9224cddee" returned: 0 in 0.802s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:54:53 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.remotefs [None req-bdf63559-03e7-4693-9a83-4860c0e0a748 tempest-ProjectMemberTests-1806793813 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8e00186b-8f9c-41d3-ae32-7234df970c22(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87444) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 10 04:54:53 devstack sudo[106137]: pam_unix(sudo:session): session closed for user root Jul 10 04:54:53 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-24a2435b-75a1-4ef3-91d7-26dc2c7a6083 tempest-ProjectReaderTests-860343347 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-f541394b-09c3-43fd-86f9-d1c03dcb6025" returned: 0 in 0.657s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:54:53 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-24a2435b-75a1-4ef3-91d7-26dc2c7a6083 tempest-ProjectReaderTests-860343347 None] <== create_volume: return (1522ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922'} {{(pid=87444) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 04:54:53 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-24a2435b-75a1-4ef3-91d7-26dc2c7a6083 tempest-ProjectReaderTests-860343347 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.525s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 04:54:53 devstack cinder-volume[87444]: DEBUG oslo.privsep.daemon [-] privsep: reply[13eb49ed-c382-460d-a668-18a72e96481f]: (4, 'qcow2') {{(pid=88499) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 04:54:53 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-bdf63559-03e7-4693-9a83-4860c0e0a748 tempest-ProjectMemberTests-1806793813 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-8e00186b-8f9c-41d3-ae32-7234df970c22 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:54:53 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-24a2435b-75a1-4ef3-91d7-26dc2c7a6083 tempest-ProjectReaderTests-860343347 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (72c5fe5f-3ab5-4c53-ae58-1c35399ff0ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f541394b-09c3-43fd-86f9-d1c03dcb6025', 'volume_size': 1}' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:54:53 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-24a2435b-75a1-4ef3-91d7-26dc2c7a6083 tempest-ProjectReaderTests-860343347 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c340ece0-be73-4dab-a224-8b5afd2db8c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:54:53 devstack cinder-volume[87444]: INFO cinder.volume.flows.manager.create_volume [None req-24a2435b-75a1-4ef3-91d7-26dc2c7a6083 tempest-ProjectReaderTests-860343347 None] Volume volume-f541394b-09c3-43fd-86f9-d1c03dcb6025 (f541394b-09c3-43fd-86f9-d1c03dcb6025): created successfully Jul 10 04:54:53 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-24a2435b-75a1-4ef3-91d7-26dc2c7a6083 tempest-ProjectReaderTests-860343347 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c340ece0-be73-4dab-a224-8b5afd2db8c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:54:53 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-24a2435b-75a1-4ef3-91d7-26dc2c7a6083 tempest-ProjectReaderTests-860343347 None] Flow 'volume_create_manager' (98c8b0e4-6433-4837-959d-76f5d96d8fb5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87444) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 04:54:53 devstack cinder-volume[87444]: INFO cinder.volume.manager [None req-24a2435b-75a1-4ef3-91d7-26dc2c7a6083 tempest-ProjectReaderTests-860343347 None] Created volume successfully. Jul 10 04:54:53 devstack sudo[106143]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-8e00186b-8f9c-41d3-ae32-7234df970c22 Jul 10 04:54:53 devstack sudo[106143]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:54:54 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-547f64af-e690-4f41-9e5d-1eeb647cc5d2 tempest-ProjectReaderTests-860343347 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 04:54:54 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-547f64af-e690-4f41-9e5d-1eeb647cc5d2 tempest-ProjectReaderTests-860343347 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 04:54:54 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.remotefs [None req-547f64af-e690-4f41-9e5d-1eeb647cc5d2 tempest-ProjectReaderTests-860343347 None] Creating offline snapshot 8cadb8e5-4b39-4c5b-a557-5c5163c751a0 of volume f541394b-09c3-43fd-86f9-d1c03dcb6025 {{(pid=87444) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 10 04:54:54 devstack cinder-volume[87444]: DEBUG oslo.privsep.daemon [-] privsep: reply[315a5fb2-971f-407e-b30c-3c8b02e8649f]: (4, 'qcow2') {{(pid=88499) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 04:54:54 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-547f64af-e690-4f41-9e5d-1eeb647cc5d2 tempest-ProjectReaderTests-860343347 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-f541394b-09c3-43fd-86f9-d1c03dcb6025 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:54:54 devstack sudo[106143]: pam_unix(sudo:session): session closed for user root Jul 10 04:54:54 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-bdf63559-03e7-4693-9a83-4860c0e0a748 tempest-ProjectMemberTests-1806793813 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-8e00186b-8f9c-41d3-ae32-7234df970c22" returned: 0 in 0.811s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:54:54 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-bdf63559-03e7-4693-9a83-4860c0e0a748 tempest-ProjectMemberTests-1806793813 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-8e00186b-8f9c-41d3-ae32-7234df970c22.78183950-9f5f-4237-b141-b0b9224cddee {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:54:54 devstack sudo[106151]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-8e00186b-8f9c-41d3-ae32-7234df970c22.78183950-9f5f-4237-b141-b0b9224cddee Jul 10 04:54:54 devstack sudo[106151]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:54:54 devstack sudo[106150]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-f541394b-09c3-43fd-86f9-d1c03dcb6025 Jul 10 04:54:54 devstack sudo[106150]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:54:55 devstack sudo[106150]: pam_unix(sudo:session): session closed for user root Jul 10 04:54:55 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-547f64af-e690-4f41-9e5d-1eeb647cc5d2 tempest-ProjectReaderTests-860343347 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-f541394b-09c3-43fd-86f9-d1c03dcb6025" returned: 0 in 0.774s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:54:55 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-547f64af-e690-4f41-9e5d-1eeb647cc5d2 tempest-ProjectReaderTests-860343347 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-f541394b-09c3-43fd-86f9-d1c03dcb6025,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-f541394b-09c3-43fd-86f9-d1c03dcb6025.8cadb8e5-4b39-4c5b-a557-5c5163c751a0 1G {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:54:55 devstack sudo[106151]: pam_unix(sudo:session): session closed for user root Jul 10 04:54:55 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-bdf63559-03e7-4693-9a83-4860c0e0a748 tempest-ProjectMemberTests-1806793813 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-8e00186b-8f9c-41d3-ae32-7234df970c22.78183950-9f5f-4237-b141-b0b9224cddee" returned: 0 in 0.741s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:54:55 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-bdf63559-03e7-4693-9a83-4860c0e0a748 tempest-ProjectMemberTests-1806793813 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-8e00186b-8f9c-41d3-ae32-7234df970c22.78183950-9f5f-4237-b141-b0b9224cddee {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:54:55 devstack sudo[106160]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-f541394b-09c3-43fd-86f9-d1c03dcb6025,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-f541394b-09c3-43fd-86f9-d1c03dcb6025.8cadb8e5-4b39-4c5b-a557-5c5163c751a0 1G Jul 10 04:54:55 devstack sudo[106160]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:54:55 devstack sudo[106161]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-8e00186b-8f9c-41d3-ae32-7234df970c22.78183950-9f5f-4237-b141-b0b9224cddee Jul 10 04:54:55 devstack sudo[106161]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:54:55 devstack sudo[106161]: pam_unix(sudo:session): session closed for user root Jul 10 04:54:55 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-bdf63559-03e7-4693-9a83-4860c0e0a748 tempest-ProjectMemberTests-1806793813 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-8e00186b-8f9c-41d3-ae32-7234df970c22.78183950-9f5f-4237-b141-b0b9224cddee" returned: 0 in 0.674s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:54:55 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-bdf63559-03e7-4693-9a83-4860c0e0a748 tempest-ProjectMemberTests-1806793813 None] Lock "cinder-quobyte-78183950-9f5f-4237-b141-b0b9224cddee" released by "_delete_snapshot" :: held 3.138s {{(pid=87444) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 04:54:55 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-bdf63559-03e7-4693-9a83-4860c0e0a748 tempest-ProjectMemberTests-1806793813 None] Lock "cinder-quobyte-8e00186b-8f9c-41d3-ae32-7234df970c22" released by "delete_snapshot" :: held 3.163s {{(pid=87444) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 04:54:55 devstack cinder-volume[87444]: DEBUG cinder.quota [None req-bdf63559-03e7-4693-9a83-4860c0e0a748 tempest-ProjectMemberTests-1806793813 None] Created reservations ['c73a7894-4ef9-4faf-90a1-0f7fdf694ad0', 'f6096280-321c-49e8-8a0f-59160b126b84', '6129fb3f-4953-4a0c-92f2-5942305697c3', '902de105-00ea-4470-8deb-0b8918c18ec1'] {{(pid=87444) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 04:54:55 devstack sudo[106160]: pam_unix(sudo:session): session closed for user root Jul 10 04:54:55 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-547f64af-e690-4f41-9e5d-1eeb647cc5d2 tempest-ProjectReaderTests-860343347 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-f541394b-09c3-43fd-86f9-d1c03dcb6025,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-f541394b-09c3-43fd-86f9-d1c03dcb6025.8cadb8e5-4b39-4c5b-a557-5c5163c751a0 1G" returned: 0 in 0.834s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:54:55 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-547f64af-e690-4f41-9e5d-1eeb647cc5d2 tempest-ProjectReaderTests-860343347 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f541394b-09c3-43fd-86f9-d1c03dcb6025 -F qcow2 /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-f541394b-09c3-43fd-86f9-d1c03dcb6025.8cadb8e5-4b39-4c5b-a557-5c5163c751a0 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:54:55 devstack cinder-volume[87444]: INFO cinder.volume.manager [None req-bdf63559-03e7-4693-9a83-4860c0e0a748 tempest-ProjectMemberTests-1806793813 None] Delete snapshot completed successfully. Jul 10 04:54:55 devstack sudo[106169]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f541394b-09c3-43fd-86f9-d1c03dcb6025 -F qcow2 /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-f541394b-09c3-43fd-86f9-d1c03dcb6025.8cadb8e5-4b39-4c5b-a557-5c5163c751a0 Jul 10 04:54:55 devstack sudo[106169]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:54:55 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-bdf63559-03e7-4693-9a83-4860c0e0a748 tempest-ProjectMemberTests-1806793813 None] Lock "cinder-78183950-9f5f-4237-b141-b0b9224cddee-delete_snapshot" released by "delete_snapshot" :: held 3.319s {{(pid=87444) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 04:54:56 devstack sudo[106169]: pam_unix(sudo:session): session closed for user root Jul 10 04:54:56 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-547f64af-e690-4f41-9e5d-1eeb647cc5d2 tempest-ProjectReaderTests-860343347 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f541394b-09c3-43fd-86f9-d1c03dcb6025 -F qcow2 /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-f541394b-09c3-43fd-86f9-d1c03dcb6025.8cadb8e5-4b39-4c5b-a557-5c5163c751a0" returned: 0 in 0.719s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:54:56 devstack cinder-volume[87444]: WARNING cinder.volume.drivers.remotefs [None req-547f64af-e690-4f41-9e5d-1eeb647cc5d2 tempest-ProjectReaderTests-860343347 None] /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-f541394b-09c3-43fd-86f9-d1c03dcb6025.8cadb8e5-4b39-4c5b-a557-5c5163c751a0 is being set with open permissions: ugo+rw Jul 10 04:54:56 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-547f64af-e690-4f41-9e5d-1eeb647cc5d2 tempest-ProjectReaderTests-860343347 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-f541394b-09c3-43fd-86f9-d1c03dcb6025.8cadb8e5-4b39-4c5b-a557-5c5163c751a0 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:54:56 devstack sudo[106174]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-f541394b-09c3-43fd-86f9-d1c03dcb6025.8cadb8e5-4b39-4c5b-a557-5c5163c751a0 Jul 10 04:54:56 devstack sudo[106174]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:54:56 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-787f5202-46dc-4f8d-b49f-24ace3d05f26 tempest-ProjectMemberTests-1806793813 None] Acquiring lock "cinder-8e00186b-8f9c-41d3-ae32-7234df970c22-delete_volume" by "delete_volume" {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 04:54:56 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-787f5202-46dc-4f8d-b49f-24ace3d05f26 tempest-ProjectMemberTests-1806793813 None] Lock "cinder-8e00186b-8f9c-41d3-ae32-7234df970c22-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 04:54:56 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-787f5202-46dc-4f8d-b49f-24ace3d05f26 tempest-ProjectMemberTests-1806793813 None] Acquiring lock "cinder-quobyte-8e00186b-8f9c-41d3-ae32-7234df970c22" by "delete_volume" {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 04:54:56 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-787f5202-46dc-4f8d-b49f-24ace3d05f26 tempest-ProjectMemberTests-1806793813 None] Lock "cinder-quobyte-8e00186b-8f9c-41d3-ae32-7234df970c22" acquired by "delete_volume" :: waited 0.014s {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 04:54:56 devstack cinder-volume[87444]: DEBUG oslo.privsep.daemon [-] privsep: reply[80c6f173-1ab9-4933-9b1c-057f7cf30bba]: (4, 'qcow2') {{(pid=88499) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 04:54:56 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-787f5202-46dc-4f8d-b49f-24ace3d05f26 tempest-ProjectMemberTests-1806793813 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-8e00186b-8f9c-41d3-ae32-7234df970c22 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:54:57 devstack sudo[106176]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-8e00186b-8f9c-41d3-ae32-7234df970c22 Jul 10 04:54:57 devstack sudo[106176]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:54:57 devstack sudo[106174]: pam_unix(sudo:session): session closed for user root Jul 10 04:54:57 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-547f64af-e690-4f41-9e5d-1eeb647cc5d2 tempest-ProjectReaderTests-860343347 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-f541394b-09c3-43fd-86f9-d1c03dcb6025.8cadb8e5-4b39-4c5b-a557-5c5163c751a0" returned: 0 in 0.650s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:54:57 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-547f64af-e690-4f41-9e5d-1eeb647cc5d2 tempest-ProjectReaderTests-860343347 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-f541394b-09c3-43fd-86f9-d1c03dcb6025.info {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:54:57 devstack sudo[106179]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-f541394b-09c3-43fd-86f9-d1c03dcb6025.info Jul 10 04:54:57 devstack sudo[106179]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:54:57 devstack sudo[106176]: pam_unix(sudo:session): session closed for user root Jul 10 04:54:57 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-787f5202-46dc-4f8d-b49f-24ace3d05f26 tempest-ProjectMemberTests-1806793813 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-8e00186b-8f9c-41d3-ae32-7234df970c22" returned: 0 in 0.777s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:54:57 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-787f5202-46dc-4f8d-b49f-24ace3d05f26 tempest-ProjectMemberTests-1806793813 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-8e00186b-8f9c-41d3-ae32-7234df970c22 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:54:57 devstack sudo[106184]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-8e00186b-8f9c-41d3-ae32-7234df970c22 Jul 10 04:54:57 devstack sudo[106184]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:54:57 devstack sudo[106179]: pam_unix(sudo:session): session closed for user root Jul 10 04:54:57 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-547f64af-e690-4f41-9e5d-1eeb647cc5d2 tempest-ProjectReaderTests-860343347 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-f541394b-09c3-43fd-86f9-d1c03dcb6025.info" returned: 0 in 0.674s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:54:57 devstack cinder-volume[87444]: WARNING cinder.volume.drivers.remotefs [None req-547f64af-e690-4f41-9e5d-1eeb647cc5d2 tempest-ProjectReaderTests-860343347 None] /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-f541394b-09c3-43fd-86f9-d1c03dcb6025.info is being set with open permissions: ugo+rw Jul 10 04:54:57 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-547f64af-e690-4f41-9e5d-1eeb647cc5d2 tempest-ProjectReaderTests-860343347 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-f541394b-09c3-43fd-86f9-d1c03dcb6025.info {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:54:58 devstack sudo[106187]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-f541394b-09c3-43fd-86f9-d1c03dcb6025.info Jul 10 04:54:58 devstack sudo[106187]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:54:58 devstack sudo[106184]: pam_unix(sudo:session): session closed for user root Jul 10 04:54:58 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-787f5202-46dc-4f8d-b49f-24ace3d05f26 tempest-ProjectMemberTests-1806793813 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-8e00186b-8f9c-41d3-ae32-7234df970c22" returned: 0 in 0.653s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:54:58 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-787f5202-46dc-4f8d-b49f-24ace3d05f26 tempest-ProjectMemberTests-1806793813 None] Lock "cinder-quobyte-8e00186b-8f9c-41d3-ae32-7234df970c22" released by "delete_volume" :: held 1.486s {{(pid=87444) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 04:54:58 devstack cinder-volume[87444]: DEBUG cinder.quota [None req-787f5202-46dc-4f8d-b49f-24ace3d05f26 tempest-ProjectMemberTests-1806793813 None] Created reservations ['a84860e1-dd73-447b-ab49-65208f239741', '92d66fb8-a03c-4815-9b6a-21b6c5e422ca', 'f0fa9427-2c7a-46bd-a428-a67dd96e1efa', '68d7dd12-47a8-4daf-8087-d3f129452d6f'] {{(pid=87444) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 04:54:58 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-787f5202-46dc-4f8d-b49f-24ace3d05f26 tempest-ProjectMemberTests-1806793813 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 04:54:58 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-787f5202-46dc-4f8d-b49f-24ace3d05f26 tempest-ProjectMemberTests-1806793813 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 04:54:58 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-787f5202-46dc-4f8d-b49f-24ace3d05f26 tempest-ProjectMemberTests-1806793813 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922': None} {{(pid=87444) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 04:54:58 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-787f5202-46dc-4f8d-b49f-24ace3d05f26 tempest-ProjectMemberTests-1806793813 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922'] {{(pid=87444) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 04:54:58 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-787f5202-46dc-4f8d-b49f-24ace3d05f26 tempest-ProjectMemberTests-1806793813 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 04:54:58 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-787f5202-46dc-4f8d-b49f-24ace3d05f26 tempest-ProjectMemberTests-1806793813 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:54:58 devstack sudo[106191]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097 Jul 10 04:54:58 devstack sudo[106191]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:54:58 devstack sudo[106187]: pam_unix(sudo:session): session closed for user root Jul 10 04:54:58 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-547f64af-e690-4f41-9e5d-1eeb647cc5d2 tempest-ProjectReaderTests-860343347 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-f541394b-09c3-43fd-86f9-d1c03dcb6025.info" returned: 0 in 0.681s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:54:58 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-547f64af-e690-4f41-9e5d-1eeb647cc5d2 tempest-ProjectReaderTests-860343347 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.432s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 04:54:58 devstack cinder-volume[87444]: INFO cinder.volume.manager [None req-547f64af-e690-4f41-9e5d-1eeb647cc5d2 tempest-ProjectReaderTests-860343347 None] Create snapshot completed successfully Jul 10 04:54:59 devstack sudo[106191]: pam_unix(sudo:session): session closed for user root Jul 10 04:54:59 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-787f5202-46dc-4f8d-b49f-24ace3d05f26 tempest-ProjectMemberTests-1806793813 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097" returned: 0 in 0.673s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:54:59 devstack cinder-volume[87444]: DEBUG cinder.manager [None req-787f5202-46dc-4f8d-b49f-24ace3d05f26 tempest-ProjectMemberTests-1806793813 None] Notifying Schedulers of capabilities ... {{(pid=87444) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 04:54:59 devstack cinder-volume[87444]: INFO cinder.volume.manager [None req-787f5202-46dc-4f8d-b49f-24ace3d05f26 tempest-ProjectMemberTests-1806793813 None] Deleted volume successfully. Jul 10 04:54:59 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-787f5202-46dc-4f8d-b49f-24ace3d05f26 tempest-ProjectMemberTests-1806793813 None] Lock "cinder-8e00186b-8f9c-41d3-ae32-7234df970c22-delete_volume" released by "delete_volume" :: held 2.366s {{(pid=87444) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 04:54:59 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-58f32bb1-a655-4489-b2ed-6f5c66160e3c tempest-ProjectReaderTests-860343347 None] Acquiring lock "cinder-8cadb8e5-4b39-4c5b-a557-5c5163c751a0-delete_snapshot" by "delete_snapshot" {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 04:54:59 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-58f32bb1-a655-4489-b2ed-6f5c66160e3c tempest-ProjectReaderTests-860343347 None] Lock "cinder-8cadb8e5-4b39-4c5b-a557-5c5163c751a0-delete_snapshot" acquired by "delete_snapshot" :: waited 0.023s {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 04:54:59 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-58f32bb1-a655-4489-b2ed-6f5c66160e3c tempest-ProjectReaderTests-860343347 None] Acquiring lock "cinder-quobyte-f541394b-09c3-43fd-86f9-d1c03dcb6025" by "delete_snapshot" {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 04:54:59 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-58f32bb1-a655-4489-b2ed-6f5c66160e3c tempest-ProjectReaderTests-860343347 None] Lock "cinder-quobyte-f541394b-09c3-43fd-86f9-d1c03dcb6025" acquired by "delete_snapshot" :: waited 0.020s {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 04:54:59 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-58f32bb1-a655-4489-b2ed-6f5c66160e3c tempest-ProjectReaderTests-860343347 None] Acquiring lock "cinder-quobyte-8cadb8e5-4b39-4c5b-a557-5c5163c751a0" by "_delete_snapshot" {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 04:54:59 devstack cinder-volume[87444]: DEBUG cinder.volume.flows.manager.create_volume [None req-347e6a87-70e2-4db6-9444-eb97df10a5f7 tempest-ProjectMemberTests-1806793813 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87444) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 04:54:59 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-347e6a87-70e2-4db6-9444-eb97df10a5f7 tempest-ProjectMemberTests-1806793813 None] Flow 'volume_create_manager' (35cd9a7a-6096-4466-b225-2daa628c4512) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 04:54:59 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-347e6a87-70e2-4db6-9444-eb97df10a5f7 tempest-ProjectMemberTests-1806793813 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (20db0b17-9d34-4036-9f58-e061deec500c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:54:59 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-58f32bb1-a655-4489-b2ed-6f5c66160e3c tempest-ProjectReaderTests-860343347 None] Lock "cinder-quobyte-8cadb8e5-4b39-4c5b-a557-5c5163c751a0" acquired by "_delete_snapshot" :: waited 0.041s {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 04:54:59 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.remotefs [None req-58f32bb1-a655-4489-b2ed-6f5c66160e3c tempest-ProjectReaderTests-860343347 None] Deleting offline snapshot 8cadb8e5-4b39-4c5b-a557-5c5163c751a0 of volume f541394b-09c3-43fd-86f9-d1c03dcb6025 {{(pid=87444) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 10 04:54:59 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.remotefs [None req-58f32bb1-a655-4489-b2ed-6f5c66160e3c tempest-ProjectReaderTests-860343347 None] snapshot_file for this snap is: volume-f541394b-09c3-43fd-86f9-d1c03dcb6025.8cadb8e5-4b39-4c5b-a557-5c5163c751a0 {{(pid=87444) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 10 04:54:59 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-347e6a87-70e2-4db6-9444-eb97df10a5f7 tempest-ProjectMemberTests-1806793813 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (20db0b17-9d34-4036-9f58-e061deec500c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T02:54:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-659932274',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=96f36236-f6df-4bf6-aafe-9a0c900ad91c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cadbf6455bcb4ed48f08a3c15f1d84e3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T02:54:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T02:54:59Z,use_quota=True,user_id='2aceae1efa264e87bd2696a5a256f622',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(317e369e-1e06-434d-ae95-a335f0e6c903),volume_type_id=317e369e-1e06-434d-ae95-a335f0e6c903)' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:54:59 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-347e6a87-70e2-4db6-9444-eb97df10a5f7 tempest-ProjectMemberTests-1806793813 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b20740cf-d737-48a9-8d4b-67edddc4deb2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:54:59 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-347e6a87-70e2-4db6-9444-eb97df10a5f7 tempest-ProjectMemberTests-1806793813 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b20740cf-d737-48a9-8d4b-67edddc4deb2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:54:59 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-347e6a87-70e2-4db6-9444-eb97df10a5f7 tempest-ProjectMemberTests-1806793813 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (38214c03-440a-4d61-85c8-b644506b498c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:54:59 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-347e6a87-70e2-4db6-9444-eb97df10a5f7 tempest-ProjectMemberTests-1806793813 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (38214c03-440a-4d61-85c8-b644506b498c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '96f36236-f6df-4bf6-aafe-9a0c900ad91c', 'volume_name': 'volume-96f36236-f6df-4bf6-aafe-9a0c900ad91c', 'volume_size': 1}' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:54:59 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-347e6a87-70e2-4db6-9444-eb97df10a5f7 tempest-ProjectMemberTests-1806793813 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fdf60ad8-fa2d-4763-9fe2-e0767581157d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:54:59 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-347e6a87-70e2-4db6-9444-eb97df10a5f7 tempest-ProjectMemberTests-1806793813 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fdf60ad8-fa2d-4763-9fe2-e0767581157d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:54:59 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-347e6a87-70e2-4db6-9444-eb97df10a5f7 tempest-ProjectMemberTests-1806793813 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7bc1c427-caba-480f-9329-c03ffe68ca78) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:54:59 devstack cinder-volume[87444]: INFO cinder.volume.flows.manager.create_volume [None req-347e6a87-70e2-4db6-9444-eb97df10a5f7 tempest-ProjectMemberTests-1806793813 None] Volume 96f36236-f6df-4bf6-aafe-9a0c900ad91c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-96f36236-f6df-4bf6-aafe-9a0c900ad91c', 'volume_size': 1} Jul 10 04:54:59 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-347e6a87-70e2-4db6-9444-eb97df10a5f7 tempest-ProjectMemberTests-1806793813 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 04:54:59 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-347e6a87-70e2-4db6-9444-eb97df10a5f7 tempest-ProjectMemberTests-1806793813 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 04:54:59 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-347e6a87-70e2-4db6-9444-eb97df10a5f7 tempest-ProjectMemberTests-1806793813 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T02:54:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-659932274',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=96f36236-f6df-4bf6-aafe-9a0c900ad91c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cadbf6455bcb4ed48f08a3c15f1d84e3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T02:54:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T02:54:59Z,use_quota=True,user_id='2aceae1efa264e87bd2696a5a256f622',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(317e369e-1e06-434d-ae95-a335f0e6c903),volume_type_id=317e369e-1e06-434d-ae95-a335f0e6c903)}" {{(pid=87444) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 04:54:59 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.remotefs [None req-347e6a87-70e2-4db6-9444-eb97df10a5f7 tempest-ProjectMemberTests-1806793813 None] Creating volume 96f36236-f6df-4bf6-aafe-9a0c900ad91c {{(pid=87444) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 04:54:59 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-347e6a87-70e2-4db6-9444-eb97df10a5f7 tempest-ProjectMemberTests-1806793813 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 04:54:59 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-347e6a87-70e2-4db6-9444-eb97df10a5f7 tempest-ProjectMemberTests-1806793813 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 04:54:59 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-347e6a87-70e2-4db6-9444-eb97df10a5f7 tempest-ProjectMemberTests-1806793813 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922': None} {{(pid=87444) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 04:54:59 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-347e6a87-70e2-4db6-9444-eb97df10a5f7 tempest-ProjectMemberTests-1806793813 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922'] {{(pid=87444) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 04:54:59 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-347e6a87-70e2-4db6-9444-eb97df10a5f7 tempest-ProjectMemberTests-1806793813 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 04:54:59 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-347e6a87-70e2-4db6-9444-eb97df10a5f7 tempest-ProjectMemberTests-1806793813 None] Selected osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922 as target Quobyte volume. {{(pid=87444) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 04:54:59 devstack cinder-volume[87444]: INFO cinder.volume.drivers.remotefs [None req-347e6a87-70e2-4db6-9444-eb97df10a5f7 tempest-ProjectMemberTests-1806793813 None] casted to osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922 Jul 10 04:54:59 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-347e6a87-70e2-4db6-9444-eb97df10a5f7 tempest-ProjectMemberTests-1806793813 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-96f36236-f6df-4bf6-aafe-9a0c900ad91c 1073741824 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:54:59 devstack cinder-volume[87444]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf598b5a-2a51-4dde-add4-a3c911b86ead]: (4, 'qcow2') {{(pid=88499) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 04:54:59 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-58f32bb1-a655-4489-b2ed-6f5c66160e3c tempest-ProjectReaderTests-860343347 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-f541394b-09c3-43fd-86f9-d1c03dcb6025.8cadb8e5-4b39-4c5b-a557-5c5163c751a0 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:54:59 devstack sudo[106194]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-96f36236-f6df-4bf6-aafe-9a0c900ad91c 1073741824 Jul 10 04:54:59 devstack sudo[106194]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:54:59 devstack sudo[106195]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-f541394b-09c3-43fd-86f9-d1c03dcb6025.8cadb8e5-4b39-4c5b-a557-5c5163c751a0 Jul 10 04:54:59 devstack sudo[106195]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:55:00 devstack sudo[106195]: pam_unix(sudo:session): session closed for user root Jul 10 04:55:00 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-58f32bb1-a655-4489-b2ed-6f5c66160e3c tempest-ProjectReaderTests-860343347 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-f541394b-09c3-43fd-86f9-d1c03dcb6025.8cadb8e5-4b39-4c5b-a557-5c5163c751a0" returned: 0 in 0.780s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:55:00 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.remotefs [None req-58f32bb1-a655-4489-b2ed-6f5c66160e3c tempest-ProjectReaderTests-860343347 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f541394b-09c3-43fd-86f9-d1c03dcb6025(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87444) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 10 04:55:00 devstack sudo[106194]: pam_unix(sudo:session): session closed for user root Jul 10 04:55:00 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-347e6a87-70e2-4db6-9444-eb97df10a5f7 tempest-ProjectMemberTests-1806793813 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-96f36236-f6df-4bf6-aafe-9a0c900ad91c 1073741824" returned: 0 in 0.833s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:55:00 devstack cinder-volume[87444]: DEBUG dbcounter [-] [87444] Writing DB stats cinder:INSERT=45,cinder:UPDATE=185,cinder:SELECT=128,cinder:DELETE=16 {{(pid=87444) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 10 04:55:00 devstack cinder-volume[87444]: DEBUG dbcounter [-] [87444] Writing DB stats cinder:SELECT=150,cinder:INSERT=58,cinder:UPDATE=177,cinder:DELETE=13 {{(pid=87444) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 10 04:55:00 devstack cinder-volume[87444]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d02e131-2482-43f0-9967-b250b6aa8e68]: (4, 'qcow2') {{(pid=88499) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 04:55:00 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-58f32bb1-a655-4489-b2ed-6f5c66160e3c tempest-ProjectReaderTests-860343347 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-f541394b-09c3-43fd-86f9-d1c03dcb6025 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:55:00 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-347e6a87-70e2-4db6-9444-eb97df10a5f7 tempest-ProjectMemberTests-1806793813 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-96f36236-f6df-4bf6-aafe-9a0c900ad91c {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:55:00 devstack sudo[106207]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-96f36236-f6df-4bf6-aafe-9a0c900ad91c Jul 10 04:55:00 devstack sudo[106207]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:55:00 devstack sudo[106206]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-f541394b-09c3-43fd-86f9-d1c03dcb6025 Jul 10 04:55:00 devstack sudo[106206]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:55:01 devstack sudo[106207]: pam_unix(sudo:session): session closed for user root Jul 10 04:55:01 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-347e6a87-70e2-4db6-9444-eb97df10a5f7 tempest-ProjectMemberTests-1806793813 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-96f36236-f6df-4bf6-aafe-9a0c900ad91c" returned: 0 in 0.646s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:55:01 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-347e6a87-70e2-4db6-9444-eb97df10a5f7 tempest-ProjectMemberTests-1806793813 None] <== create_volume: return (1550ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922'} {{(pid=87444) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 04:55:01 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-347e6a87-70e2-4db6-9444-eb97df10a5f7 tempest-ProjectMemberTests-1806793813 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.552s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 04:55:01 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-347e6a87-70e2-4db6-9444-eb97df10a5f7 tempest-ProjectMemberTests-1806793813 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7bc1c427-caba-480f-9329-c03ffe68ca78) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-96f36236-f6df-4bf6-aafe-9a0c900ad91c', 'volume_size': 1}' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:55:01 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-347e6a87-70e2-4db6-9444-eb97df10a5f7 tempest-ProjectMemberTests-1806793813 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e612a88b-a5d5-40b8-acac-4a2ad39f2b83) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:55:01 devstack cinder-volume[87444]: INFO cinder.volume.flows.manager.create_volume [None req-347e6a87-70e2-4db6-9444-eb97df10a5f7 tempest-ProjectMemberTests-1806793813 None] Volume volume-96f36236-f6df-4bf6-aafe-9a0c900ad91c (96f36236-f6df-4bf6-aafe-9a0c900ad91c): created successfully Jul 10 04:55:01 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-347e6a87-70e2-4db6-9444-eb97df10a5f7 tempest-ProjectMemberTests-1806793813 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e612a88b-a5d5-40b8-acac-4a2ad39f2b83) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:55:01 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-347e6a87-70e2-4db6-9444-eb97df10a5f7 tempest-ProjectMemberTests-1806793813 None] Flow 'volume_create_manager' (35cd9a7a-6096-4466-b225-2daa628c4512) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87444) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 04:55:01 devstack cinder-volume[87444]: INFO cinder.volume.manager [None req-347e6a87-70e2-4db6-9444-eb97df10a5f7 tempest-ProjectMemberTests-1806793813 None] Created volume successfully. Jul 10 04:55:01 devstack sudo[106206]: pam_unix(sudo:session): session closed for user root Jul 10 04:55:01 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-58f32bb1-a655-4489-b2ed-6f5c66160e3c tempest-ProjectReaderTests-860343347 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-f541394b-09c3-43fd-86f9-d1c03dcb6025" returned: 0 in 0.769s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:55:01 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-58f32bb1-a655-4489-b2ed-6f5c66160e3c tempest-ProjectReaderTests-860343347 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-f541394b-09c3-43fd-86f9-d1c03dcb6025.8cadb8e5-4b39-4c5b-a557-5c5163c751a0 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:55:01 devstack sudo[106214]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-f541394b-09c3-43fd-86f9-d1c03dcb6025.8cadb8e5-4b39-4c5b-a557-5c5163c751a0 Jul 10 04:55:01 devstack sudo[106214]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:55:01 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-81f8d006-d68d-4dce-bf6b-9f71a2fd89e1 tempest-ProjectMemberTests-1806793813 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 04:55:01 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-81f8d006-d68d-4dce-bf6b-9f71a2fd89e1 tempest-ProjectMemberTests-1806793813 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 04:55:01 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.remotefs [None req-81f8d006-d68d-4dce-bf6b-9f71a2fd89e1 tempest-ProjectMemberTests-1806793813 None] Creating offline snapshot 9b51b252-32d3-4af8-936f-1e2b315e1e16 of volume 96f36236-f6df-4bf6-aafe-9a0c900ad91c {{(pid=87444) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 10 04:55:01 devstack cinder-volume[87444]: DEBUG oslo.privsep.daemon [-] privsep: reply[25fe3f4a-fbb2-41be-8889-ded39cb5f63c]: (4, 'qcow2') {{(pid=88499) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 04:55:01 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-81f8d006-d68d-4dce-bf6b-9f71a2fd89e1 tempest-ProjectMemberTests-1806793813 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-96f36236-f6df-4bf6-aafe-9a0c900ad91c {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:55:01 devstack sudo[106216]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-96f36236-f6df-4bf6-aafe-9a0c900ad91c Jul 10 04:55:01 devstack sudo[106216]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:55:02 devstack sudo[106214]: pam_unix(sudo:session): session closed for user root Jul 10 04:55:02 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-58f32bb1-a655-4489-b2ed-6f5c66160e3c tempest-ProjectReaderTests-860343347 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-f541394b-09c3-43fd-86f9-d1c03dcb6025.8cadb8e5-4b39-4c5b-a557-5c5163c751a0" returned: 0 in 0.738s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:55:02 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-58f32bb1-a655-4489-b2ed-6f5c66160e3c tempest-ProjectReaderTests-860343347 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-f541394b-09c3-43fd-86f9-d1c03dcb6025.8cadb8e5-4b39-4c5b-a557-5c5163c751a0 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:55:02 devstack sudo[106224]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-f541394b-09c3-43fd-86f9-d1c03dcb6025.8cadb8e5-4b39-4c5b-a557-5c5163c751a0 Jul 10 04:55:02 devstack sudo[106224]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:55:02 devstack sudo[106216]: pam_unix(sudo:session): session closed for user root Jul 10 04:55:02 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-81f8d006-d68d-4dce-bf6b-9f71a2fd89e1 tempest-ProjectMemberTests-1806793813 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-96f36236-f6df-4bf6-aafe-9a0c900ad91c" returned: 0 in 0.752s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:55:02 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-81f8d006-d68d-4dce-bf6b-9f71a2fd89e1 tempest-ProjectMemberTests-1806793813 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-96f36236-f6df-4bf6-aafe-9a0c900ad91c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-96f36236-f6df-4bf6-aafe-9a0c900ad91c.9b51b252-32d3-4af8-936f-1e2b315e1e16 1G {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:55:02 devstack sudo[106231]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-96f36236-f6df-4bf6-aafe-9a0c900ad91c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-96f36236-f6df-4bf6-aafe-9a0c900ad91c.9b51b252-32d3-4af8-936f-1e2b315e1e16 1G Jul 10 04:55:02 devstack sudo[106231]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:55:02 devstack sudo[106224]: pam_unix(sudo:session): session closed for user root Jul 10 04:55:02 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-58f32bb1-a655-4489-b2ed-6f5c66160e3c tempest-ProjectReaderTests-860343347 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-f541394b-09c3-43fd-86f9-d1c03dcb6025.8cadb8e5-4b39-4c5b-a557-5c5163c751a0" returned: 0 in 0.668s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:55:02 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-58f32bb1-a655-4489-b2ed-6f5c66160e3c tempest-ProjectReaderTests-860343347 None] Lock "cinder-quobyte-8cadb8e5-4b39-4c5b-a557-5c5163c751a0" released by "_delete_snapshot" :: held 3.130s {{(pid=87444) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 04:55:02 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-58f32bb1-a655-4489-b2ed-6f5c66160e3c tempest-ProjectReaderTests-860343347 None] Lock "cinder-quobyte-f541394b-09c3-43fd-86f9-d1c03dcb6025" released by "delete_snapshot" :: held 3.179s {{(pid=87444) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 04:55:02 devstack cinder-volume[87444]: DEBUG cinder.quota [None req-58f32bb1-a655-4489-b2ed-6f5c66160e3c tempest-ProjectReaderTests-860343347 None] Created reservations ['7225d16d-0425-42e0-bc9a-8c0b6d9181f8', '4680cddb-aeb4-4447-8f2b-e2a12ca94c79', '64f2e2cc-08f3-489a-a32e-2833ed945747', '3de5bc00-cb1e-41db-96d2-c992ec8cbe0d'] {{(pid=87444) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 04:55:02 devstack cinder-volume[87444]: INFO cinder.volume.manager [None req-58f32bb1-a655-4489-b2ed-6f5c66160e3c tempest-ProjectReaderTests-860343347 None] Delete snapshot completed successfully. Jul 10 04:55:02 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-58f32bb1-a655-4489-b2ed-6f5c66160e3c tempest-ProjectReaderTests-860343347 None] Lock "cinder-8cadb8e5-4b39-4c5b-a557-5c5163c751a0-delete_snapshot" released by "delete_snapshot" :: held 3.326s {{(pid=87444) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 04:55:03 devstack sudo[106231]: pam_unix(sudo:session): session closed for user root Jul 10 04:55:03 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-81f8d006-d68d-4dce-bf6b-9f71a2fd89e1 tempest-ProjectMemberTests-1806793813 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-96f36236-f6df-4bf6-aafe-9a0c900ad91c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-96f36236-f6df-4bf6-aafe-9a0c900ad91c.9b51b252-32d3-4af8-936f-1e2b315e1e16 1G" returned: 0 in 0.810s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:55:03 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-81f8d006-d68d-4dce-bf6b-9f71a2fd89e1 tempest-ProjectMemberTests-1806793813 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-96f36236-f6df-4bf6-aafe-9a0c900ad91c -F qcow2 /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-96f36236-f6df-4bf6-aafe-9a0c900ad91c.9b51b252-32d3-4af8-936f-1e2b315e1e16 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:55:03 devstack sudo[106237]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-96f36236-f6df-4bf6-aafe-9a0c900ad91c -F qcow2 /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-96f36236-f6df-4bf6-aafe-9a0c900ad91c.9b51b252-32d3-4af8-936f-1e2b315e1e16 Jul 10 04:55:03 devstack sudo[106237]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:55:03 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-62034bfa-a7f4-4d57-b66f-efd2a303c62e tempest-ProjectReaderTests-860343347 None] Acquiring lock "cinder-f541394b-09c3-43fd-86f9-d1c03dcb6025-delete_volume" by "delete_volume" {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 04:55:03 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-62034bfa-a7f4-4d57-b66f-efd2a303c62e tempest-ProjectReaderTests-860343347 None] Lock "cinder-f541394b-09c3-43fd-86f9-d1c03dcb6025-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 04:55:03 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-62034bfa-a7f4-4d57-b66f-efd2a303c62e tempest-ProjectReaderTests-860343347 None] Acquiring lock "cinder-quobyte-f541394b-09c3-43fd-86f9-d1c03dcb6025" by "delete_volume" {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 04:55:03 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-62034bfa-a7f4-4d57-b66f-efd2a303c62e tempest-ProjectReaderTests-860343347 None] Lock "cinder-quobyte-f541394b-09c3-43fd-86f9-d1c03dcb6025" acquired by "delete_volume" :: waited 0.016s {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 04:55:03 devstack cinder-volume[87444]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8414a93-bd07-43fe-b2d9-5e2a7b9a2e49]: (4, 'qcow2') {{(pid=88499) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 04:55:03 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-62034bfa-a7f4-4d57-b66f-efd2a303c62e tempest-ProjectReaderTests-860343347 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-f541394b-09c3-43fd-86f9-d1c03dcb6025 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:55:03 devstack sudo[106240]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-f541394b-09c3-43fd-86f9-d1c03dcb6025 Jul 10 04:55:03 devstack sudo[106240]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:55:04 devstack sudo[106237]: pam_unix(sudo:session): session closed for user root Jul 10 04:55:04 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-81f8d006-d68d-4dce-bf6b-9f71a2fd89e1 tempest-ProjectMemberTests-1806793813 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-96f36236-f6df-4bf6-aafe-9a0c900ad91c -F qcow2 /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-96f36236-f6df-4bf6-aafe-9a0c900ad91c.9b51b252-32d3-4af8-936f-1e2b315e1e16" returned: 0 in 0.723s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:55:04 devstack cinder-volume[87444]: WARNING cinder.volume.drivers.remotefs [None req-81f8d006-d68d-4dce-bf6b-9f71a2fd89e1 tempest-ProjectMemberTests-1806793813 None] /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-96f36236-f6df-4bf6-aafe-9a0c900ad91c.9b51b252-32d3-4af8-936f-1e2b315e1e16 is being set with open permissions: ugo+rw Jul 10 04:55:04 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-81f8d006-d68d-4dce-bf6b-9f71a2fd89e1 tempest-ProjectMemberTests-1806793813 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-96f36236-f6df-4bf6-aafe-9a0c900ad91c.9b51b252-32d3-4af8-936f-1e2b315e1e16 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:55:04 devstack sudo[106245]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-96f36236-f6df-4bf6-aafe-9a0c900ad91c.9b51b252-32d3-4af8-936f-1e2b315e1e16 Jul 10 04:55:04 devstack sudo[106245]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:55:04 devstack sudo[106240]: pam_unix(sudo:session): session closed for user root Jul 10 04:55:04 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-62034bfa-a7f4-4d57-b66f-efd2a303c62e tempest-ProjectReaderTests-860343347 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-f541394b-09c3-43fd-86f9-d1c03dcb6025" returned: 0 in 0.792s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:55:04 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-62034bfa-a7f4-4d57-b66f-efd2a303c62e tempest-ProjectReaderTests-860343347 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-f541394b-09c3-43fd-86f9-d1c03dcb6025 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:55:04 devstack sudo[106251]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-f541394b-09c3-43fd-86f9-d1c03dcb6025 Jul 10 04:55:04 devstack sudo[106251]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:55:04 devstack sudo[106245]: pam_unix(sudo:session): session closed for user root Jul 10 04:55:04 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-81f8d006-d68d-4dce-bf6b-9f71a2fd89e1 tempest-ProjectMemberTests-1806793813 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-96f36236-f6df-4bf6-aafe-9a0c900ad91c.9b51b252-32d3-4af8-936f-1e2b315e1e16" returned: 0 in 0.629s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:55:04 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-81f8d006-d68d-4dce-bf6b-9f71a2fd89e1 tempest-ProjectMemberTests-1806793813 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-96f36236-f6df-4bf6-aafe-9a0c900ad91c.info {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:55:04 devstack sudo[106253]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-96f36236-f6df-4bf6-aafe-9a0c900ad91c.info Jul 10 04:55:04 devstack sudo[106253]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:55:05 devstack sudo[106251]: pam_unix(sudo:session): session closed for user root Jul 10 04:55:05 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-62034bfa-a7f4-4d57-b66f-efd2a303c62e tempest-ProjectReaderTests-860343347 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-f541394b-09c3-43fd-86f9-d1c03dcb6025" returned: 0 in 0.645s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:55:05 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-62034bfa-a7f4-4d57-b66f-efd2a303c62e tempest-ProjectReaderTests-860343347 None] Lock "cinder-quobyte-f541394b-09c3-43fd-86f9-d1c03dcb6025" released by "delete_volume" :: held 1.498s {{(pid=87444) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 04:55:05 devstack cinder-volume[87444]: DEBUG cinder.quota [None req-62034bfa-a7f4-4d57-b66f-efd2a303c62e tempest-ProjectReaderTests-860343347 None] Created reservations ['1f95f8e8-9caf-4349-b4e3-1004ce3bd617', 'f8c65dbe-effc-4ceb-8890-9d39a65eadac', 'd7432ae3-72d7-4809-9505-9c24cc2771cd', '35c328f6-c46d-4cb2-92ce-03f0bf71adb7'] {{(pid=87444) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 04:55:05 devstack sudo[106253]: pam_unix(sudo:session): session closed for user root Jul 10 04:55:05 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-81f8d006-d68d-4dce-bf6b-9f71a2fd89e1 tempest-ProjectMemberTests-1806793813 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-96f36236-f6df-4bf6-aafe-9a0c900ad91c.info" returned: 0 in 0.698s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:55:05 devstack cinder-volume[87444]: WARNING cinder.volume.drivers.remotefs [None req-81f8d006-d68d-4dce-bf6b-9f71a2fd89e1 tempest-ProjectMemberTests-1806793813 None] /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-96f36236-f6df-4bf6-aafe-9a0c900ad91c.info is being set with open permissions: ugo+rw Jul 10 04:55:05 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-81f8d006-d68d-4dce-bf6b-9f71a2fd89e1 tempest-ProjectMemberTests-1806793813 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-96f36236-f6df-4bf6-aafe-9a0c900ad91c.info {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:55:05 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-62034bfa-a7f4-4d57-b66f-efd2a303c62e tempest-ProjectReaderTests-860343347 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 04:55:05 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-62034bfa-a7f4-4d57-b66f-efd2a303c62e tempest-ProjectReaderTests-860343347 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 04:55:05 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-62034bfa-a7f4-4d57-b66f-efd2a303c62e tempest-ProjectReaderTests-860343347 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922': None} {{(pid=87444) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 04:55:05 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-62034bfa-a7f4-4d57-b66f-efd2a303c62e tempest-ProjectReaderTests-860343347 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922'] {{(pid=87444) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 04:55:05 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-62034bfa-a7f4-4d57-b66f-efd2a303c62e tempest-ProjectReaderTests-860343347 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 04:55:05 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-62034bfa-a7f4-4d57-b66f-efd2a303c62e tempest-ProjectReaderTests-860343347 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:55:05 devstack sudo[106257]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-96f36236-f6df-4bf6-aafe-9a0c900ad91c.info Jul 10 04:55:05 devstack sudo[106257]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:55:05 devstack sudo[106259]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097 Jul 10 04:55:05 devstack sudo[106259]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:55:06 devstack sudo[106257]: pam_unix(sudo:session): session closed for user root Jul 10 04:55:06 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-81f8d006-d68d-4dce-bf6b-9f71a2fd89e1 tempest-ProjectMemberTests-1806793813 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-96f36236-f6df-4bf6-aafe-9a0c900ad91c.info" returned: 0 in 0.666s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:55:06 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-81f8d006-d68d-4dce-bf6b-9f71a2fd89e1 tempest-ProjectMemberTests-1806793813 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.367s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 04:55:06 devstack sudo[106259]: pam_unix(sudo:session): session closed for user root Jul 10 04:55:06 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-62034bfa-a7f4-4d57-b66f-efd2a303c62e tempest-ProjectReaderTests-860343347 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097" returned: 0 in 0.673s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:55:06 devstack cinder-volume[87444]: DEBUG cinder.manager [None req-62034bfa-a7f4-4d57-b66f-efd2a303c62e tempest-ProjectReaderTests-860343347 None] Notifying Schedulers of capabilities ... {{(pid=87444) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 04:55:06 devstack cinder-volume[87444]: INFO cinder.volume.manager [None req-62034bfa-a7f4-4d57-b66f-efd2a303c62e tempest-ProjectReaderTests-860343347 None] Deleted volume successfully. Jul 10 04:55:06 devstack cinder-volume[87444]: INFO cinder.volume.manager [None req-81f8d006-d68d-4dce-bf6b-9f71a2fd89e1 tempest-ProjectMemberTests-1806793813 None] Create snapshot completed successfully Jul 10 04:55:06 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-62034bfa-a7f4-4d57-b66f-efd2a303c62e tempest-ProjectReaderTests-860343347 None] Lock "cinder-f541394b-09c3-43fd-86f9-d1c03dcb6025-delete_volume" released by "delete_volume" :: held 2.423s {{(pid=87444) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 04:55:06 devstack cinder-volume[87444]: DEBUG cinder.volume.flows.manager.create_volume [None req-611c2038-37ce-4076-9376-36a51c795a9c tempest-ProjectReaderTests-860343347 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87444) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 04:55:06 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-611c2038-37ce-4076-9376-36a51c795a9c tempest-ProjectReaderTests-860343347 None] Flow 'volume_create_manager' (d372d56a-bb73-4fb8-ac81-92ae1c3dba3c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 04:55:06 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-611c2038-37ce-4076-9376-36a51c795a9c tempest-ProjectReaderTests-860343347 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dd5a1854-432c-47b5-9f6a-02685050f806) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:55:06 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-611c2038-37ce-4076-9376-36a51c795a9c tempest-ProjectReaderTests-860343347 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dd5a1854-432c-47b5-9f6a-02685050f806) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T02:55:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1838467197',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=276892c2-e3b5-4401-86fb-224df177008f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='181feec0fe8f488b8b6345b78eb67c5c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T02:55:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T02:55:06Z,use_quota=True,user_id='c9a1d6a7ee0a44ff83a1bceb660b8015',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(317e369e-1e06-434d-ae95-a335f0e6c903),volume_type_id=317e369e-1e06-434d-ae95-a335f0e6c903)' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:55:06 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-611c2038-37ce-4076-9376-36a51c795a9c tempest-ProjectReaderTests-860343347 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bf416324-6876-482c-a021-dc746abfa99f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:55:06 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-611c2038-37ce-4076-9376-36a51c795a9c tempest-ProjectReaderTests-860343347 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bf416324-6876-482c-a021-dc746abfa99f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:55:06 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-611c2038-37ce-4076-9376-36a51c795a9c tempest-ProjectReaderTests-860343347 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b316eb5d-b528-4058-bdb4-3e3cba00cb5f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:55:06 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-611c2038-37ce-4076-9376-36a51c795a9c tempest-ProjectReaderTests-860343347 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b316eb5d-b528-4058-bdb4-3e3cba00cb5f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '276892c2-e3b5-4401-86fb-224df177008f', 'volume_name': 'volume-276892c2-e3b5-4401-86fb-224df177008f', 'volume_size': 1}' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:55:06 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-611c2038-37ce-4076-9376-36a51c795a9c tempest-ProjectReaderTests-860343347 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b5922e6e-7bea-4382-8b14-3b759bc6ae2e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:55:06 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-611c2038-37ce-4076-9376-36a51c795a9c tempest-ProjectReaderTests-860343347 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b5922e6e-7bea-4382-8b14-3b759bc6ae2e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:55:06 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-611c2038-37ce-4076-9376-36a51c795a9c tempest-ProjectReaderTests-860343347 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6e35de29-c969-4317-a667-e72c83a40128) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:55:06 devstack cinder-volume[87444]: INFO cinder.volume.flows.manager.create_volume [None req-611c2038-37ce-4076-9376-36a51c795a9c tempest-ProjectReaderTests-860343347 None] Volume 276892c2-e3b5-4401-86fb-224df177008f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-276892c2-e3b5-4401-86fb-224df177008f', 'volume_size': 1} Jul 10 04:55:06 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-611c2038-37ce-4076-9376-36a51c795a9c tempest-ProjectReaderTests-860343347 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 04:55:06 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-611c2038-37ce-4076-9376-36a51c795a9c tempest-ProjectReaderTests-860343347 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 04:55:06 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-611c2038-37ce-4076-9376-36a51c795a9c tempest-ProjectReaderTests-860343347 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T02:55:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1838467197',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=276892c2-e3b5-4401-86fb-224df177008f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='181feec0fe8f488b8b6345b78eb67c5c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T02:55:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T02:55:06Z,use_quota=True,user_id='c9a1d6a7ee0a44ff83a1bceb660b8015',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(317e369e-1e06-434d-ae95-a335f0e6c903),volume_type_id=317e369e-1e06-434d-ae95-a335f0e6c903)}" {{(pid=87444) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 04:55:06 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.remotefs [None req-611c2038-37ce-4076-9376-36a51c795a9c tempest-ProjectReaderTests-860343347 None] Creating volume 276892c2-e3b5-4401-86fb-224df177008f {{(pid=87444) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 04:55:06 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-611c2038-37ce-4076-9376-36a51c795a9c tempest-ProjectReaderTests-860343347 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 04:55:06 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-611c2038-37ce-4076-9376-36a51c795a9c tempest-ProjectReaderTests-860343347 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 04:55:06 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-611c2038-37ce-4076-9376-36a51c795a9c tempest-ProjectReaderTests-860343347 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922': None} {{(pid=87444) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 04:55:06 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-611c2038-37ce-4076-9376-36a51c795a9c tempest-ProjectReaderTests-860343347 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922'] {{(pid=87444) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 04:55:06 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-611c2038-37ce-4076-9376-36a51c795a9c tempest-ProjectReaderTests-860343347 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 04:55:06 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-611c2038-37ce-4076-9376-36a51c795a9c tempest-ProjectReaderTests-860343347 None] Selected osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922 as target Quobyte volume. {{(pid=87444) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 04:55:06 devstack cinder-volume[87444]: INFO cinder.volume.drivers.remotefs [None req-611c2038-37ce-4076-9376-36a51c795a9c tempest-ProjectReaderTests-860343347 None] casted to osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922 Jul 10 04:55:06 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-611c2038-37ce-4076-9376-36a51c795a9c tempest-ProjectReaderTests-860343347 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-276892c2-e3b5-4401-86fb-224df177008f 1073741824 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:55:06 devstack sudo[106263]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-276892c2-e3b5-4401-86fb-224df177008f 1073741824 Jul 10 04:55:06 devstack sudo[106263]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:55:07 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-274bcb03-e8f1-4a31-a187-9e81973bf2cb tempest-ProjectMemberTests-1806793813 None] Acquiring lock "cinder-9b51b252-32d3-4af8-936f-1e2b315e1e16-delete_snapshot" by "delete_snapshot" {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 04:55:07 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-274bcb03-e8f1-4a31-a187-9e81973bf2cb tempest-ProjectMemberTests-1806793813 None] Lock "cinder-9b51b252-32d3-4af8-936f-1e2b315e1e16-delete_snapshot" acquired by "delete_snapshot" :: waited 0.025s {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 04:55:07 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-274bcb03-e8f1-4a31-a187-9e81973bf2cb tempest-ProjectMemberTests-1806793813 None] Acquiring lock "cinder-quobyte-96f36236-f6df-4bf6-aafe-9a0c900ad91c" by "delete_snapshot" {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 04:55:07 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-274bcb03-e8f1-4a31-a187-9e81973bf2cb tempest-ProjectMemberTests-1806793813 None] Lock "cinder-quobyte-96f36236-f6df-4bf6-aafe-9a0c900ad91c" acquired by "delete_snapshot" :: waited 0.021s {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 04:55:07 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-274bcb03-e8f1-4a31-a187-9e81973bf2cb tempest-ProjectMemberTests-1806793813 None] Acquiring lock "cinder-quobyte-9b51b252-32d3-4af8-936f-1e2b315e1e16" by "_delete_snapshot" {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 04:55:07 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-274bcb03-e8f1-4a31-a187-9e81973bf2cb tempest-ProjectMemberTests-1806793813 None] Lock "cinder-quobyte-9b51b252-32d3-4af8-936f-1e2b315e1e16" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 04:55:07 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.remotefs [None req-274bcb03-e8f1-4a31-a187-9e81973bf2cb tempest-ProjectMemberTests-1806793813 None] Deleting offline snapshot 9b51b252-32d3-4af8-936f-1e2b315e1e16 of volume 96f36236-f6df-4bf6-aafe-9a0c900ad91c {{(pid=87444) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 10 04:55:07 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.remotefs [None req-274bcb03-e8f1-4a31-a187-9e81973bf2cb tempest-ProjectMemberTests-1806793813 None] snapshot_file for this snap is: volume-96f36236-f6df-4bf6-aafe-9a0c900ad91c.9b51b252-32d3-4af8-936f-1e2b315e1e16 {{(pid=87444) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 10 04:55:07 devstack cinder-volume[87444]: DEBUG oslo.privsep.daemon [-] privsep: reply[25e740a9-32e6-4570-a713-14f2abba2ff4]: (4, 'qcow2') {{(pid=88499) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 04:55:07 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-274bcb03-e8f1-4a31-a187-9e81973bf2cb tempest-ProjectMemberTests-1806793813 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-96f36236-f6df-4bf6-aafe-9a0c900ad91c.9b51b252-32d3-4af8-936f-1e2b315e1e16 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:55:07 devstack sudo[106268]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-96f36236-f6df-4bf6-aafe-9a0c900ad91c.9b51b252-32d3-4af8-936f-1e2b315e1e16 Jul 10 04:55:07 devstack sudo[106268]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:55:07 devstack sudo[106263]: pam_unix(sudo:session): session closed for user root Jul 10 04:55:07 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-611c2038-37ce-4076-9376-36a51c795a9c tempest-ProjectReaderTests-860343347 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-276892c2-e3b5-4401-86fb-224df177008f 1073741824" returned: 0 in 0.839s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:55:07 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-611c2038-37ce-4076-9376-36a51c795a9c tempest-ProjectReaderTests-860343347 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-276892c2-e3b5-4401-86fb-224df177008f {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:55:07 devstack sudo[106270]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-276892c2-e3b5-4401-86fb-224df177008f Jul 10 04:55:07 devstack sudo[106270]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:55:07 devstack sudo[106268]: pam_unix(sudo:session): session closed for user root Jul 10 04:55:07 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-274bcb03-e8f1-4a31-a187-9e81973bf2cb tempest-ProjectMemberTests-1806793813 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-96f36236-f6df-4bf6-aafe-9a0c900ad91c.9b51b252-32d3-4af8-936f-1e2b315e1e16" returned: 0 in 0.776s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:55:07 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.remotefs [None req-274bcb03-e8f1-4a31-a187-9e81973bf2cb tempest-ProjectMemberTests-1806793813 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-96f36236-f6df-4bf6-aafe-9a0c900ad91c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87444) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 10 04:55:07 devstack cinder-volume[87444]: DEBUG oslo.privsep.daemon [-] privsep: reply[7461860d-a707-4821-94e6-fcf283450633]: (4, 'qcow2') {{(pid=88499) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 04:55:07 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-274bcb03-e8f1-4a31-a187-9e81973bf2cb tempest-ProjectMemberTests-1806793813 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-96f36236-f6df-4bf6-aafe-9a0c900ad91c {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:55:08 devstack sudo[106275]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-96f36236-f6df-4bf6-aafe-9a0c900ad91c Jul 10 04:55:08 devstack sudo[106275]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:55:08 devstack sudo[106270]: pam_unix(sudo:session): session closed for user root Jul 10 04:55:08 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-611c2038-37ce-4076-9376-36a51c795a9c tempest-ProjectReaderTests-860343347 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-276892c2-e3b5-4401-86fb-224df177008f" returned: 0 in 0.659s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:55:08 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-611c2038-37ce-4076-9376-36a51c795a9c tempest-ProjectReaderTests-860343347 None] <== create_volume: return (1559ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922'} {{(pid=87444) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 04:55:08 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-611c2038-37ce-4076-9376-36a51c795a9c tempest-ProjectReaderTests-860343347 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.562s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 04:55:08 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-611c2038-37ce-4076-9376-36a51c795a9c tempest-ProjectReaderTests-860343347 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6e35de29-c969-4317-a667-e72c83a40128) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-276892c2-e3b5-4401-86fb-224df177008f', 'volume_size': 1}' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:55:08 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-611c2038-37ce-4076-9376-36a51c795a9c tempest-ProjectReaderTests-860343347 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4b3a9eda-6b3f-4a97-940c-67c6622e6e30) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:55:08 devstack cinder-volume[87444]: INFO cinder.volume.flows.manager.create_volume [None req-611c2038-37ce-4076-9376-36a51c795a9c tempest-ProjectReaderTests-860343347 None] Volume volume-276892c2-e3b5-4401-86fb-224df177008f (276892c2-e3b5-4401-86fb-224df177008f): created successfully Jul 10 04:55:08 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-611c2038-37ce-4076-9376-36a51c795a9c tempest-ProjectReaderTests-860343347 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4b3a9eda-6b3f-4a97-940c-67c6622e6e30) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:55:08 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-611c2038-37ce-4076-9376-36a51c795a9c tempest-ProjectReaderTests-860343347 None] Flow 'volume_create_manager' (d372d56a-bb73-4fb8-ac81-92ae1c3dba3c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87444) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 04:55:08 devstack cinder-volume[87444]: INFO cinder.volume.manager [None req-611c2038-37ce-4076-9376-36a51c795a9c tempest-ProjectReaderTests-860343347 None] Created volume successfully. Jul 10 04:55:08 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-45362e16-0be5-444a-b741-2a0c81dbac1a tempest-ProjectReaderTests-860343347 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 04:55:08 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-45362e16-0be5-444a-b741-2a0c81dbac1a tempest-ProjectReaderTests-860343347 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 04:55:08 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.remotefs [None req-45362e16-0be5-444a-b741-2a0c81dbac1a tempest-ProjectReaderTests-860343347 None] Creating offline snapshot f0353d0d-2df6-4a66-b81f-23325cb33bc0 of volume 276892c2-e3b5-4401-86fb-224df177008f {{(pid=87444) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 10 04:55:08 devstack sudo[106275]: pam_unix(sudo:session): session closed for user root Jul 10 04:55:08 devstack cinder-volume[87444]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e10ab4d-f481-4b5d-b3bb-8352b4a3cba9]: (4, 'qcow2') {{(pid=88499) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 04:55:08 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-45362e16-0be5-444a-b741-2a0c81dbac1a tempest-ProjectReaderTests-860343347 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-276892c2-e3b5-4401-86fb-224df177008f {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:55:08 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-274bcb03-e8f1-4a31-a187-9e81973bf2cb tempest-ProjectMemberTests-1806793813 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-96f36236-f6df-4bf6-aafe-9a0c900ad91c" returned: 0 in 0.813s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:55:08 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-274bcb03-e8f1-4a31-a187-9e81973bf2cb tempest-ProjectMemberTests-1806793813 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-96f36236-f6df-4bf6-aafe-9a0c900ad91c.9b51b252-32d3-4af8-936f-1e2b315e1e16 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:55:08 devstack sudo[106282]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-96f36236-f6df-4bf6-aafe-9a0c900ad91c.9b51b252-32d3-4af8-936f-1e2b315e1e16 Jul 10 04:55:08 devstack sudo[106282]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:55:08 devstack sudo[106281]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-276892c2-e3b5-4401-86fb-224df177008f Jul 10 04:55:08 devstack sudo[106281]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:55:09 devstack sudo[106281]: pam_unix(sudo:session): session closed for user root Jul 10 04:55:09 devstack sudo[106282]: pam_unix(sudo:session): session closed for user root Jul 10 04:55:09 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-45362e16-0be5-444a-b741-2a0c81dbac1a tempest-ProjectReaderTests-860343347 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-276892c2-e3b5-4401-86fb-224df177008f" returned: 0 in 0.740s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:55:09 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-45362e16-0be5-444a-b741-2a0c81dbac1a tempest-ProjectReaderTests-860343347 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-276892c2-e3b5-4401-86fb-224df177008f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-276892c2-e3b5-4401-86fb-224df177008f.f0353d0d-2df6-4a66-b81f-23325cb33bc0 1G {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:55:09 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-274bcb03-e8f1-4a31-a187-9e81973bf2cb tempest-ProjectMemberTests-1806793813 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-96f36236-f6df-4bf6-aafe-9a0c900ad91c.9b51b252-32d3-4af8-936f-1e2b315e1e16" returned: 0 in 0.738s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:55:09 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-274bcb03-e8f1-4a31-a187-9e81973bf2cb tempest-ProjectMemberTests-1806793813 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-96f36236-f6df-4bf6-aafe-9a0c900ad91c.9b51b252-32d3-4af8-936f-1e2b315e1e16 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:55:09 devstack sudo[106291]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-276892c2-e3b5-4401-86fb-224df177008f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-276892c2-e3b5-4401-86fb-224df177008f.f0353d0d-2df6-4a66-b81f-23325cb33bc0 1G Jul 10 04:55:09 devstack sudo[106291]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:55:09 devstack sudo[106292]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-96f36236-f6df-4bf6-aafe-9a0c900ad91c.9b51b252-32d3-4af8-936f-1e2b315e1e16 Jul 10 04:55:09 devstack sudo[106292]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:55:10 devstack sudo[106292]: pam_unix(sudo:session): session closed for user root Jul 10 04:55:10 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-274bcb03-e8f1-4a31-a187-9e81973bf2cb tempest-ProjectMemberTests-1806793813 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-96f36236-f6df-4bf6-aafe-9a0c900ad91c.9b51b252-32d3-4af8-936f-1e2b315e1e16" returned: 0 in 0.658s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:55:10 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-274bcb03-e8f1-4a31-a187-9e81973bf2cb tempest-ProjectMemberTests-1806793813 None] Lock "cinder-quobyte-9b51b252-32d3-4af8-936f-1e2b315e1e16" released by "_delete_snapshot" :: held 3.082s {{(pid=87444) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 04:55:10 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-274bcb03-e8f1-4a31-a187-9e81973bf2cb tempest-ProjectMemberTests-1806793813 None] Lock "cinder-quobyte-96f36236-f6df-4bf6-aafe-9a0c900ad91c" released by "delete_snapshot" :: held 3.105s {{(pid=87444) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 04:55:10 devstack cinder-volume[87444]: DEBUG cinder.quota [None req-274bcb03-e8f1-4a31-a187-9e81973bf2cb tempest-ProjectMemberTests-1806793813 None] Created reservations ['cefa7f81-54d1-4d96-9ace-b6719dd86587', 'b02b2666-0381-457c-8c2a-4498204f2668', 'a4e520a3-4599-4d15-b0d9-5b6e7f21658e', '9a432ab6-7aad-42ae-8f2b-f057a7d36faa'] {{(pid=87444) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 04:55:10 devstack sudo[106291]: pam_unix(sudo:session): session closed for user root Jul 10 04:55:10 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-45362e16-0be5-444a-b741-2a0c81dbac1a tempest-ProjectReaderTests-860343347 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-276892c2-e3b5-4401-86fb-224df177008f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-276892c2-e3b5-4401-86fb-224df177008f.f0353d0d-2df6-4a66-b81f-23325cb33bc0 1G" returned: 0 in 0.811s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:55:10 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-45362e16-0be5-444a-b741-2a0c81dbac1a tempest-ProjectReaderTests-860343347 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-276892c2-e3b5-4401-86fb-224df177008f -F qcow2 /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-276892c2-e3b5-4401-86fb-224df177008f.f0353d0d-2df6-4a66-b81f-23325cb33bc0 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:55:10 devstack cinder-volume[87444]: INFO cinder.volume.manager [None req-274bcb03-e8f1-4a31-a187-9e81973bf2cb tempest-ProjectMemberTests-1806793813 None] Delete snapshot completed successfully. Jul 10 04:55:10 devstack sudo[106300]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-276892c2-e3b5-4401-86fb-224df177008f -F qcow2 /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-276892c2-e3b5-4401-86fb-224df177008f.f0353d0d-2df6-4a66-b81f-23325cb33bc0 Jul 10 04:55:10 devstack sudo[106300]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:55:10 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-274bcb03-e8f1-4a31-a187-9e81973bf2cb tempest-ProjectMemberTests-1806793813 None] Lock "cinder-9b51b252-32d3-4af8-936f-1e2b315e1e16-delete_snapshot" released by "delete_snapshot" :: held 3.257s {{(pid=87444) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 04:55:10 devstack sudo[106300]: pam_unix(sudo:session): session closed for user root Jul 10 04:55:10 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-45362e16-0be5-444a-b741-2a0c81dbac1a tempest-ProjectReaderTests-860343347 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-276892c2-e3b5-4401-86fb-224df177008f -F qcow2 /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-276892c2-e3b5-4401-86fb-224df177008f.f0353d0d-2df6-4a66-b81f-23325cb33bc0" returned: 0 in 0.685s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:55:10 devstack cinder-volume[87444]: WARNING cinder.volume.drivers.remotefs [None req-45362e16-0be5-444a-b741-2a0c81dbac1a tempest-ProjectReaderTests-860343347 None] /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-276892c2-e3b5-4401-86fb-224df177008f.f0353d0d-2df6-4a66-b81f-23325cb33bc0 is being set with open permissions: ugo+rw Jul 10 04:55:10 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-45362e16-0be5-444a-b741-2a0c81dbac1a tempest-ProjectReaderTests-860343347 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-276892c2-e3b5-4401-86fb-224df177008f.f0353d0d-2df6-4a66-b81f-23325cb33bc0 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:55:10 devstack sudo[106305]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-276892c2-e3b5-4401-86fb-224df177008f.f0353d0d-2df6-4a66-b81f-23325cb33bc0 Jul 10 04:55:10 devstack sudo[106305]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:55:11 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-2d9c0fc1-dfaf-49f6-b532-121afd37576e tempest-ProjectMemberTests-1806793813 None] Acquiring lock "cinder-96f36236-f6df-4bf6-aafe-9a0c900ad91c-delete_volume" by "delete_volume" {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 04:55:11 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-2d9c0fc1-dfaf-49f6-b532-121afd37576e tempest-ProjectMemberTests-1806793813 None] Lock "cinder-96f36236-f6df-4bf6-aafe-9a0c900ad91c-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 04:55:11 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-2d9c0fc1-dfaf-49f6-b532-121afd37576e tempest-ProjectMemberTests-1806793813 None] Acquiring lock "cinder-quobyte-96f36236-f6df-4bf6-aafe-9a0c900ad91c" by "delete_volume" {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 04:55:11 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-2d9c0fc1-dfaf-49f6-b532-121afd37576e tempest-ProjectMemberTests-1806793813 None] Lock "cinder-quobyte-96f36236-f6df-4bf6-aafe-9a0c900ad91c" acquired by "delete_volume" :: waited 0.014s {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 04:55:11 devstack cinder-volume[87444]: DEBUG oslo.privsep.daemon [-] privsep: reply[1337a8e8-ea08-4a88-8332-59db3defef03]: (4, 'qcow2') {{(pid=88499) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 04:55:11 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-2d9c0fc1-dfaf-49f6-b532-121afd37576e tempest-ProjectMemberTests-1806793813 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-96f36236-f6df-4bf6-aafe-9a0c900ad91c {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:55:11 devstack sudo[106307]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-96f36236-f6df-4bf6-aafe-9a0c900ad91c Jul 10 04:55:11 devstack sudo[106307]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:55:11 devstack sudo[106305]: pam_unix(sudo:session): session closed for user root Jul 10 04:55:11 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-45362e16-0be5-444a-b741-2a0c81dbac1a tempest-ProjectReaderTests-860343347 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-276892c2-e3b5-4401-86fb-224df177008f.f0353d0d-2df6-4a66-b81f-23325cb33bc0" returned: 0 in 0.658s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:55:11 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-45362e16-0be5-444a-b741-2a0c81dbac1a tempest-ProjectReaderTests-860343347 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-276892c2-e3b5-4401-86fb-224df177008f.info {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:55:11 devstack sudo[106310]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-276892c2-e3b5-4401-86fb-224df177008f.info Jul 10 04:55:11 devstack sudo[106310]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:55:12 devstack sudo[106307]: pam_unix(sudo:session): session closed for user root Jul 10 04:55:12 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-2d9c0fc1-dfaf-49f6-b532-121afd37576e tempest-ProjectMemberTests-1806793813 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-96f36236-f6df-4bf6-aafe-9a0c900ad91c" returned: 0 in 0.752s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:55:12 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-2d9c0fc1-dfaf-49f6-b532-121afd37576e tempest-ProjectMemberTests-1806793813 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-96f36236-f6df-4bf6-aafe-9a0c900ad91c {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:55:12 devstack sudo[106315]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-96f36236-f6df-4bf6-aafe-9a0c900ad91c Jul 10 04:55:12 devstack sudo[106315]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:55:12 devstack sudo[106310]: pam_unix(sudo:session): session closed for user root Jul 10 04:55:12 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-45362e16-0be5-444a-b741-2a0c81dbac1a tempest-ProjectReaderTests-860343347 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-276892c2-e3b5-4401-86fb-224df177008f.info" returned: 0 in 0.666s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:55:12 devstack cinder-volume[87444]: WARNING cinder.volume.drivers.remotefs [None req-45362e16-0be5-444a-b741-2a0c81dbac1a tempest-ProjectReaderTests-860343347 None] /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-276892c2-e3b5-4401-86fb-224df177008f.info is being set with open permissions: ugo+rw Jul 10 04:55:12 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-45362e16-0be5-444a-b741-2a0c81dbac1a tempest-ProjectReaderTests-860343347 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-276892c2-e3b5-4401-86fb-224df177008f.info {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:55:12 devstack sudo[106318]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-276892c2-e3b5-4401-86fb-224df177008f.info Jul 10 04:55:12 devstack sudo[106318]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:55:12 devstack sudo[106315]: pam_unix(sudo:session): session closed for user root Jul 10 04:55:12 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-2d9c0fc1-dfaf-49f6-b532-121afd37576e tempest-ProjectMemberTests-1806793813 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-96f36236-f6df-4bf6-aafe-9a0c900ad91c" returned: 0 in 0.690s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:55:12 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-2d9c0fc1-dfaf-49f6-b532-121afd37576e tempest-ProjectMemberTests-1806793813 None] Lock "cinder-quobyte-96f36236-f6df-4bf6-aafe-9a0c900ad91c" released by "delete_volume" :: held 1.500s {{(pid=87444) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 04:55:12 devstack cinder-volume[87444]: DEBUG cinder.quota [None req-2d9c0fc1-dfaf-49f6-b532-121afd37576e tempest-ProjectMemberTests-1806793813 None] Created reservations ['f3272963-0661-41ad-9376-dc4358e6de1b', 'ecfec553-1bfa-401c-875c-e5cfc68bf34a', 'cb8029ca-b3e9-4c15-bdab-b7092531a8ee', '31e3891f-65b7-4b96-91c9-77b0e869cc36'] {{(pid=87444) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 04:55:12 devstack sudo[106318]: pam_unix(sudo:session): session closed for user root Jul 10 04:55:12 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-45362e16-0be5-444a-b741-2a0c81dbac1a tempest-ProjectReaderTests-860343347 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-276892c2-e3b5-4401-86fb-224df177008f.info" returned: 0 in 0.628s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:55:12 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-45362e16-0be5-444a-b741-2a0c81dbac1a tempest-ProjectReaderTests-860343347 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.279s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 04:55:12 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-2d9c0fc1-dfaf-49f6-b532-121afd37576e tempest-ProjectMemberTests-1806793813 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 04:55:12 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-2d9c0fc1-dfaf-49f6-b532-121afd37576e tempest-ProjectMemberTests-1806793813 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 04:55:12 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-2d9c0fc1-dfaf-49f6-b532-121afd37576e tempest-ProjectMemberTests-1806793813 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922': None} {{(pid=87444) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 04:55:12 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-2d9c0fc1-dfaf-49f6-b532-121afd37576e tempest-ProjectMemberTests-1806793813 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922'] {{(pid=87444) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 04:55:12 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-2d9c0fc1-dfaf-49f6-b532-121afd37576e tempest-ProjectMemberTests-1806793813 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 04:55:12 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-2d9c0fc1-dfaf-49f6-b532-121afd37576e tempest-ProjectMemberTests-1806793813 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:55:12 devstack sudo[106322]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097 Jul 10 04:55:12 devstack sudo[106322]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:55:13 devstack cinder-volume[87444]: INFO cinder.volume.manager [None req-45362e16-0be5-444a-b741-2a0c81dbac1a tempest-ProjectReaderTests-860343347 None] Create snapshot completed successfully Jul 10 04:55:13 devstack sudo[106322]: pam_unix(sudo:session): session closed for user root Jul 10 04:55:13 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-2d9c0fc1-dfaf-49f6-b532-121afd37576e tempest-ProjectMemberTests-1806793813 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097" returned: 0 in 0.647s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:55:13 devstack cinder-volume[87444]: DEBUG cinder.manager [None req-2d9c0fc1-dfaf-49f6-b532-121afd37576e tempest-ProjectMemberTests-1806793813 None] Notifying Schedulers of capabilities ... {{(pid=87444) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 04:55:13 devstack cinder-volume[87444]: INFO cinder.volume.manager [None req-2d9c0fc1-dfaf-49f6-b532-121afd37576e tempest-ProjectMemberTests-1806793813 None] Deleted volume successfully. Jul 10 04:55:13 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-2d9c0fc1-dfaf-49f6-b532-121afd37576e tempest-ProjectMemberTests-1806793813 None] Lock "cinder-96f36236-f6df-4bf6-aafe-9a0c900ad91c-delete_volume" released by "delete_volume" :: held 2.374s {{(pid=87444) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 04:55:13 devstack cinder-volume[87444]: DEBUG cinder.volume.flows.manager.create_volume [None req-48920267-d9ef-46ac-bb62-904893f98ab0 tempest-ProjectMemberTests-1806793813 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87444) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 04:55:13 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-48920267-d9ef-46ac-bb62-904893f98ab0 tempest-ProjectMemberTests-1806793813 None] Flow 'volume_create_manager' (387f3a20-a67f-435c-8263-5f50b08cc5c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 04:55:13 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-48920267-d9ef-46ac-bb62-904893f98ab0 tempest-ProjectMemberTests-1806793813 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f13b31e0-304b-477e-870a-c6d3aa2f245a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:55:13 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-9ff710b3-4e05-4749-9608-96ec85af2030 tempest-ProjectReaderTests-860343347 None] Acquiring lock "cinder-f0353d0d-2df6-4a66-b81f-23325cb33bc0-delete_snapshot" by "delete_snapshot" {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 04:55:13 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-48920267-d9ef-46ac-bb62-904893f98ab0 tempest-ProjectMemberTests-1806793813 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f13b31e0-304b-477e-870a-c6d3aa2f245a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T02:55:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2060946265',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6406a8a7-81e7-4d65-9e67-ebcdd4c998a8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cadbf6455bcb4ed48f08a3c15f1d84e3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T02:55:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T02:55:14Z,use_quota=True,user_id='2aceae1efa264e87bd2696a5a256f622',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(317e369e-1e06-434d-ae95-a335f0e6c903),volume_type_id=317e369e-1e06-434d-ae95-a335f0e6c903)' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:55:13 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-48920267-d9ef-46ac-bb62-904893f98ab0 tempest-ProjectMemberTests-1806793813 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c3d543e2-755b-47e0-8b9f-4088952c33c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:55:13 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-48920267-d9ef-46ac-bb62-904893f98ab0 tempest-ProjectMemberTests-1806793813 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c3d543e2-755b-47e0-8b9f-4088952c33c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:55:13 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-48920267-d9ef-46ac-bb62-904893f98ab0 tempest-ProjectMemberTests-1806793813 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5a2e19e7-93bf-45f7-9bdf-0e9b079fac48) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:55:13 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-48920267-d9ef-46ac-bb62-904893f98ab0 tempest-ProjectMemberTests-1806793813 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5a2e19e7-93bf-45f7-9bdf-0e9b079fac48) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6406a8a7-81e7-4d65-9e67-ebcdd4c998a8', 'volume_name': 'volume-6406a8a7-81e7-4d65-9e67-ebcdd4c998a8', 'volume_size': 1}' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:55:13 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-48920267-d9ef-46ac-bb62-904893f98ab0 tempest-ProjectMemberTests-1806793813 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5fc96795-fc4d-4b73-a805-f27b9fc426f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:55:13 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-48920267-d9ef-46ac-bb62-904893f98ab0 tempest-ProjectMemberTests-1806793813 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5fc96795-fc4d-4b73-a805-f27b9fc426f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:55:13 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-48920267-d9ef-46ac-bb62-904893f98ab0 tempest-ProjectMemberTests-1806793813 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (636b2a87-30d7-45fe-8731-2cb5c334b3d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:55:13 devstack cinder-volume[87444]: INFO cinder.volume.flows.manager.create_volume [None req-48920267-d9ef-46ac-bb62-904893f98ab0 tempest-ProjectMemberTests-1806793813 None] Volume 6406a8a7-81e7-4d65-9e67-ebcdd4c998a8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6406a8a7-81e7-4d65-9e67-ebcdd4c998a8', 'volume_size': 1} Jul 10 04:55:13 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-48920267-d9ef-46ac-bb62-904893f98ab0 tempest-ProjectMemberTests-1806793813 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 04:55:13 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-48920267-d9ef-46ac-bb62-904893f98ab0 tempest-ProjectMemberTests-1806793813 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 04:55:13 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-48920267-d9ef-46ac-bb62-904893f98ab0 tempest-ProjectMemberTests-1806793813 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T02:55:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2060946265',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6406a8a7-81e7-4d65-9e67-ebcdd4c998a8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cadbf6455bcb4ed48f08a3c15f1d84e3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T02:55:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T02:55:14Z,use_quota=True,user_id='2aceae1efa264e87bd2696a5a256f622',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(317e369e-1e06-434d-ae95-a335f0e6c903),volume_type_id=317e369e-1e06-434d-ae95-a335f0e6c903)}" {{(pid=87444) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 04:55:13 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.remotefs [None req-48920267-d9ef-46ac-bb62-904893f98ab0 tempest-ProjectMemberTests-1806793813 None] Creating volume 6406a8a7-81e7-4d65-9e67-ebcdd4c998a8 {{(pid=87444) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 04:55:13 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-48920267-d9ef-46ac-bb62-904893f98ab0 tempest-ProjectMemberTests-1806793813 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 04:55:13 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-48920267-d9ef-46ac-bb62-904893f98ab0 tempest-ProjectMemberTests-1806793813 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 04:55:13 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-48920267-d9ef-46ac-bb62-904893f98ab0 tempest-ProjectMemberTests-1806793813 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922': None} {{(pid=87444) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 04:55:14 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-48920267-d9ef-46ac-bb62-904893f98ab0 tempest-ProjectMemberTests-1806793813 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922'] {{(pid=87444) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 04:55:14 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-48920267-d9ef-46ac-bb62-904893f98ab0 tempest-ProjectMemberTests-1806793813 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 04:55:14 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-48920267-d9ef-46ac-bb62-904893f98ab0 tempest-ProjectMemberTests-1806793813 None] Selected osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922 as target Quobyte volume. {{(pid=87444) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 04:55:14 devstack cinder-volume[87444]: INFO cinder.volume.drivers.remotefs [None req-48920267-d9ef-46ac-bb62-904893f98ab0 tempest-ProjectMemberTests-1806793813 None] casted to osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922 Jul 10 04:55:14 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-48920267-d9ef-46ac-bb62-904893f98ab0 tempest-ProjectMemberTests-1806793813 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-6406a8a7-81e7-4d65-9e67-ebcdd4c998a8 1073741824 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:55:14 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-9ff710b3-4e05-4749-9608-96ec85af2030 tempest-ProjectReaderTests-860343347 None] Lock "cinder-f0353d0d-2df6-4a66-b81f-23325cb33bc0-delete_snapshot" acquired by "delete_snapshot" :: waited 0.079s {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 04:55:14 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-9ff710b3-4e05-4749-9608-96ec85af2030 tempest-ProjectReaderTests-860343347 None] Acquiring lock "cinder-quobyte-276892c2-e3b5-4401-86fb-224df177008f" by "delete_snapshot" {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 04:55:14 devstack sudo[106326]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-6406a8a7-81e7-4d65-9e67-ebcdd4c998a8 1073741824 Jul 10 04:55:14 devstack sudo[106326]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:55:14 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-9ff710b3-4e05-4749-9608-96ec85af2030 tempest-ProjectReaderTests-860343347 None] Lock "cinder-quobyte-276892c2-e3b5-4401-86fb-224df177008f" acquired by "delete_snapshot" :: waited 0.016s {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 04:55:14 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-9ff710b3-4e05-4749-9608-96ec85af2030 tempest-ProjectReaderTests-860343347 None] Acquiring lock "cinder-quobyte-f0353d0d-2df6-4a66-b81f-23325cb33bc0" by "_delete_snapshot" {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 04:55:14 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-9ff710b3-4e05-4749-9608-96ec85af2030 tempest-ProjectReaderTests-860343347 None] Lock "cinder-quobyte-f0353d0d-2df6-4a66-b81f-23325cb33bc0" acquired by "_delete_snapshot" :: waited 0.012s {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 04:55:14 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.remotefs [None req-9ff710b3-4e05-4749-9608-96ec85af2030 tempest-ProjectReaderTests-860343347 None] Deleting offline snapshot f0353d0d-2df6-4a66-b81f-23325cb33bc0 of volume 276892c2-e3b5-4401-86fb-224df177008f {{(pid=87444) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 10 04:55:14 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.remotefs [None req-9ff710b3-4e05-4749-9608-96ec85af2030 tempest-ProjectReaderTests-860343347 None] snapshot_file for this snap is: volume-276892c2-e3b5-4401-86fb-224df177008f.f0353d0d-2df6-4a66-b81f-23325cb33bc0 {{(pid=87444) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 10 04:55:14 devstack cinder-volume[87444]: DEBUG oslo.privsep.daemon [-] privsep: reply[40270f3b-d69b-4d55-bac2-a5fb534797ab]: (4, 'qcow2') {{(pid=88499) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 04:55:14 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-9ff710b3-4e05-4749-9608-96ec85af2030 tempest-ProjectReaderTests-860343347 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-276892c2-e3b5-4401-86fb-224df177008f.f0353d0d-2df6-4a66-b81f-23325cb33bc0 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:55:14 devstack sudo[106328]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-276892c2-e3b5-4401-86fb-224df177008f.f0353d0d-2df6-4a66-b81f-23325cb33bc0 Jul 10 04:55:14 devstack sudo[106328]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:55:14 devstack sudo[106326]: pam_unix(sudo:session): session closed for user root Jul 10 04:55:14 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-48920267-d9ef-46ac-bb62-904893f98ab0 tempest-ProjectMemberTests-1806793813 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-6406a8a7-81e7-4d65-9e67-ebcdd4c998a8 1073741824" returned: 0 in 0.815s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:55:14 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-48920267-d9ef-46ac-bb62-904893f98ab0 tempest-ProjectMemberTests-1806793813 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-6406a8a7-81e7-4d65-9e67-ebcdd4c998a8 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:55:14 devstack sudo[106328]: pam_unix(sudo:session): session closed for user root Jul 10 04:55:14 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-9ff710b3-4e05-4749-9608-96ec85af2030 tempest-ProjectReaderTests-860343347 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-276892c2-e3b5-4401-86fb-224df177008f.f0353d0d-2df6-4a66-b81f-23325cb33bc0" returned: 0 in 0.777s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:55:14 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.remotefs [None req-9ff710b3-4e05-4749-9608-96ec85af2030 tempest-ProjectReaderTests-860343347 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-276892c2-e3b5-4401-86fb-224df177008f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87444) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 10 04:55:14 devstack sudo[106336]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-6406a8a7-81e7-4d65-9e67-ebcdd4c998a8 Jul 10 04:55:14 devstack sudo[106336]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:55:14 devstack cinder-volume[87444]: DEBUG oslo.privsep.daemon [-] privsep: reply[26216907-3a67-49c4-8efe-cdd572ab2ab9]: (4, 'qcow2') {{(pid=88499) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 04:55:14 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-9ff710b3-4e05-4749-9608-96ec85af2030 tempest-ProjectReaderTests-860343347 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-276892c2-e3b5-4401-86fb-224df177008f {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:55:15 devstack sudo[106338]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-276892c2-e3b5-4401-86fb-224df177008f Jul 10 04:55:15 devstack sudo[106338]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:55:15 devstack sudo[106336]: pam_unix(sudo:session): session closed for user root Jul 10 04:55:15 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-48920267-d9ef-46ac-bb62-904893f98ab0 tempest-ProjectMemberTests-1806793813 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-6406a8a7-81e7-4d65-9e67-ebcdd4c998a8" returned: 0 in 0.659s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:55:15 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-48920267-d9ef-46ac-bb62-904893f98ab0 tempest-ProjectMemberTests-1806793813 None] <== create_volume: return (1518ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922'} {{(pid=87444) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 04:55:15 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-48920267-d9ef-46ac-bb62-904893f98ab0 tempest-ProjectMemberTests-1806793813 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.521s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 04:55:15 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-48920267-d9ef-46ac-bb62-904893f98ab0 tempest-ProjectMemberTests-1806793813 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (636b2a87-30d7-45fe-8731-2cb5c334b3d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6406a8a7-81e7-4d65-9e67-ebcdd4c998a8', 'volume_size': 1}' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:55:15 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-48920267-d9ef-46ac-bb62-904893f98ab0 tempest-ProjectMemberTests-1806793813 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (749dbf52-04af-483d-825e-e42dee3d2562) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:55:15 devstack cinder-volume[87444]: INFO cinder.volume.flows.manager.create_volume [None req-48920267-d9ef-46ac-bb62-904893f98ab0 tempest-ProjectMemberTests-1806793813 None] Volume volume-6406a8a7-81e7-4d65-9e67-ebcdd4c998a8 (6406a8a7-81e7-4d65-9e67-ebcdd4c998a8): created successfully Jul 10 04:55:15 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-48920267-d9ef-46ac-bb62-904893f98ab0 tempest-ProjectMemberTests-1806793813 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (749dbf52-04af-483d-825e-e42dee3d2562) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:55:15 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-48920267-d9ef-46ac-bb62-904893f98ab0 tempest-ProjectMemberTests-1806793813 None] Flow 'volume_create_manager' (387f3a20-a67f-435c-8263-5f50b08cc5c6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87444) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 04:55:15 devstack cinder-volume[87444]: INFO cinder.volume.manager [None req-48920267-d9ef-46ac-bb62-904893f98ab0 tempest-ProjectMemberTests-1806793813 None] Created volume successfully. Jul 10 04:55:15 devstack sudo[106338]: pam_unix(sudo:session): session closed for user root Jul 10 04:55:15 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-9ff710b3-4e05-4749-9608-96ec85af2030 tempest-ProjectReaderTests-860343347 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-276892c2-e3b5-4401-86fb-224df177008f" returned: 0 in 0.755s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:55:15 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-9ff710b3-4e05-4749-9608-96ec85af2030 tempest-ProjectReaderTests-860343347 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-276892c2-e3b5-4401-86fb-224df177008f.f0353d0d-2df6-4a66-b81f-23325cb33bc0 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:55:15 devstack sudo[106346]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-276892c2-e3b5-4401-86fb-224df177008f.f0353d0d-2df6-4a66-b81f-23325cb33bc0 Jul 10 04:55:15 devstack sudo[106346]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:55:16 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-2993437c-8476-432a-bee1-f1859bea5054 tempest-ProjectMemberTests-1806793813 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 04:55:16 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-2993437c-8476-432a-bee1-f1859bea5054 tempest-ProjectMemberTests-1806793813 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 04:55:16 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.remotefs [None req-2993437c-8476-432a-bee1-f1859bea5054 tempest-ProjectMemberTests-1806793813 None] Creating offline snapshot f0ce8848-8653-4021-b9fb-9b85575c4f89 of volume 6406a8a7-81e7-4d65-9e67-ebcdd4c998a8 {{(pid=87444) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 10 04:55:16 devstack cinder-volume[87444]: DEBUG oslo.privsep.daemon [-] privsep: reply[53841a5c-464b-4d20-b092-e0408bc27fd9]: (4, 'qcow2') {{(pid=88499) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 04:55:16 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-2993437c-8476-432a-bee1-f1859bea5054 tempest-ProjectMemberTests-1806793813 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-6406a8a7-81e7-4d65-9e67-ebcdd4c998a8 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:55:16 devstack sudo[106743]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-6406a8a7-81e7-4d65-9e67-ebcdd4c998a8 Jul 10 04:55:16 devstack sudo[106743]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:55:16 devstack sudo[106346]: pam_unix(sudo:session): session closed for user root Jul 10 04:55:16 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-9ff710b3-4e05-4749-9608-96ec85af2030 tempest-ProjectReaderTests-860343347 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-276892c2-e3b5-4401-86fb-224df177008f.f0353d0d-2df6-4a66-b81f-23325cb33bc0" returned: 0 in 0.809s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:55:16 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-9ff710b3-4e05-4749-9608-96ec85af2030 tempest-ProjectReaderTests-860343347 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-276892c2-e3b5-4401-86fb-224df177008f.f0353d0d-2df6-4a66-b81f-23325cb33bc0 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:55:16 devstack sudo[106770]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-276892c2-e3b5-4401-86fb-224df177008f.f0353d0d-2df6-4a66-b81f-23325cb33bc0 Jul 10 04:55:16 devstack sudo[106770]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:55:16 devstack sudo[106743]: pam_unix(sudo:session): session closed for user root Jul 10 04:55:16 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-2993437c-8476-432a-bee1-f1859bea5054 tempest-ProjectMemberTests-1806793813 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-6406a8a7-81e7-4d65-9e67-ebcdd4c998a8" returned: 0 in 0.757s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:55:16 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-2993437c-8476-432a-bee1-f1859bea5054 tempest-ProjectMemberTests-1806793813 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-6406a8a7-81e7-4d65-9e67-ebcdd4c998a8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-6406a8a7-81e7-4d65-9e67-ebcdd4c998a8.f0ce8848-8653-4021-b9fb-9b85575c4f89 1G {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:55:17 devstack sudo[106775]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-6406a8a7-81e7-4d65-9e67-ebcdd4c998a8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-6406a8a7-81e7-4d65-9e67-ebcdd4c998a8.f0ce8848-8653-4021-b9fb-9b85575c4f89 1G Jul 10 04:55:17 devstack sudo[106775]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:55:17 devstack sudo[106770]: pam_unix(sudo:session): session closed for user root Jul 10 04:55:17 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-9ff710b3-4e05-4749-9608-96ec85af2030 tempest-ProjectReaderTests-860343347 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-276892c2-e3b5-4401-86fb-224df177008f.f0353d0d-2df6-4a66-b81f-23325cb33bc0" returned: 0 in 0.667s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:55:17 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-9ff710b3-4e05-4749-9608-96ec85af2030 tempest-ProjectReaderTests-860343347 None] Lock "cinder-quobyte-f0353d0d-2df6-4a66-b81f-23325cb33bc0" released by "_delete_snapshot" :: held 3.120s {{(pid=87444) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 04:55:17 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-9ff710b3-4e05-4749-9608-96ec85af2030 tempest-ProjectReaderTests-860343347 None] Lock "cinder-quobyte-276892c2-e3b5-4401-86fb-224df177008f" released by "delete_snapshot" :: held 3.140s {{(pid=87444) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 04:55:17 devstack cinder-volume[87444]: DEBUG cinder.quota [None req-9ff710b3-4e05-4749-9608-96ec85af2030 tempest-ProjectReaderTests-860343347 None] Created reservations ['15732bef-0afa-4104-a0de-19a4f52ac35b', 'e22b9ece-e2b5-48da-b9eb-34d5982ae86a', 'affca5aa-a799-4e43-9c44-b080a42db3eb', '730b62fc-e1da-451b-9cb7-05eef8eeeba7'] {{(pid=87444) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 04:55:17 devstack cinder-volume[87444]: INFO cinder.volume.manager [None req-9ff710b3-4e05-4749-9608-96ec85af2030 tempest-ProjectReaderTests-860343347 None] Delete snapshot completed successfully. Jul 10 04:55:17 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-9ff710b3-4e05-4749-9608-96ec85af2030 tempest-ProjectReaderTests-860343347 None] Lock "cinder-f0353d0d-2df6-4a66-b81f-23325cb33bc0-delete_snapshot" released by "delete_snapshot" :: held 3.289s {{(pid=87444) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 04:55:17 devstack sudo[106775]: pam_unix(sudo:session): session closed for user root Jul 10 04:55:17 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-2993437c-8476-432a-bee1-f1859bea5054 tempest-ProjectMemberTests-1806793813 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-6406a8a7-81e7-4d65-9e67-ebcdd4c998a8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-6406a8a7-81e7-4d65-9e67-ebcdd4c998a8.f0ce8848-8653-4021-b9fb-9b85575c4f89 1G" returned: 0 in 0.807s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:55:17 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-2993437c-8476-432a-bee1-f1859bea5054 tempest-ProjectMemberTests-1806793813 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6406a8a7-81e7-4d65-9e67-ebcdd4c998a8 -F qcow2 /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-6406a8a7-81e7-4d65-9e67-ebcdd4c998a8.f0ce8848-8653-4021-b9fb-9b85575c4f89 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:55:17 devstack sudo[106781]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6406a8a7-81e7-4d65-9e67-ebcdd4c998a8 -F qcow2 /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-6406a8a7-81e7-4d65-9e67-ebcdd4c998a8.f0ce8848-8653-4021-b9fb-9b85575c4f89 Jul 10 04:55:17 devstack sudo[106781]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:55:18 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-12cf17bd-1d5d-4467-a3b0-b44a80db3108 tempest-ProjectReaderTests-860343347 None] Acquiring lock "cinder-276892c2-e3b5-4401-86fb-224df177008f-delete_volume" by "delete_volume" {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 04:55:18 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-12cf17bd-1d5d-4467-a3b0-b44a80db3108 tempest-ProjectReaderTests-860343347 None] Lock "cinder-276892c2-e3b5-4401-86fb-224df177008f-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 04:55:18 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-12cf17bd-1d5d-4467-a3b0-b44a80db3108 tempest-ProjectReaderTests-860343347 None] Acquiring lock "cinder-quobyte-276892c2-e3b5-4401-86fb-224df177008f" by "delete_volume" {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 04:55:18 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-12cf17bd-1d5d-4467-a3b0-b44a80db3108 tempest-ProjectReaderTests-860343347 None] Lock "cinder-quobyte-276892c2-e3b5-4401-86fb-224df177008f" acquired by "delete_volume" :: waited 0.014s {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 04:55:18 devstack cinder-volume[87444]: DEBUG oslo.privsep.daemon [-] privsep: reply[406efb71-ee4a-4a96-bd80-6f13b12dc131]: (4, 'qcow2') {{(pid=88499) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 04:55:18 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-12cf17bd-1d5d-4467-a3b0-b44a80db3108 tempest-ProjectReaderTests-860343347 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-276892c2-e3b5-4401-86fb-224df177008f {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:55:18 devstack sudo[106783]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-276892c2-e3b5-4401-86fb-224df177008f Jul 10 04:55:18 devstack sudo[106783]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:55:18 devstack sudo[106781]: pam_unix(sudo:session): session closed for user root Jul 10 04:55:18 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-2993437c-8476-432a-bee1-f1859bea5054 tempest-ProjectMemberTests-1806793813 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6406a8a7-81e7-4d65-9e67-ebcdd4c998a8 -F qcow2 /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-6406a8a7-81e7-4d65-9e67-ebcdd4c998a8.f0ce8848-8653-4021-b9fb-9b85575c4f89" returned: 0 in 0.736s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:55:18 devstack cinder-volume[87444]: WARNING cinder.volume.drivers.remotefs [None req-2993437c-8476-432a-bee1-f1859bea5054 tempest-ProjectMemberTests-1806793813 None] /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-6406a8a7-81e7-4d65-9e67-ebcdd4c998a8.f0ce8848-8653-4021-b9fb-9b85575c4f89 is being set with open permissions: ugo+rw Jul 10 04:55:18 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-2993437c-8476-432a-bee1-f1859bea5054 tempest-ProjectMemberTests-1806793813 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-6406a8a7-81e7-4d65-9e67-ebcdd4c998a8.f0ce8848-8653-4021-b9fb-9b85575c4f89 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:55:18 devstack sudo[106788]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-6406a8a7-81e7-4d65-9e67-ebcdd4c998a8.f0ce8848-8653-4021-b9fb-9b85575c4f89 Jul 10 04:55:18 devstack sudo[106788]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:55:19 devstack sudo[106783]: pam_unix(sudo:session): session closed for user root Jul 10 04:55:19 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-12cf17bd-1d5d-4467-a3b0-b44a80db3108 tempest-ProjectReaderTests-860343347 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-276892c2-e3b5-4401-86fb-224df177008f" returned: 0 in 0.759s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:55:19 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-12cf17bd-1d5d-4467-a3b0-b44a80db3108 tempest-ProjectReaderTests-860343347 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-276892c2-e3b5-4401-86fb-224df177008f {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:55:19 devstack sudo[106793]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-276892c2-e3b5-4401-86fb-224df177008f Jul 10 04:55:19 devstack sudo[106793]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:55:19 devstack sudo[106788]: pam_unix(sudo:session): session closed for user root Jul 10 04:55:19 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-2993437c-8476-432a-bee1-f1859bea5054 tempest-ProjectMemberTests-1806793813 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-6406a8a7-81e7-4d65-9e67-ebcdd4c998a8.f0ce8848-8653-4021-b9fb-9b85575c4f89" returned: 0 in 0.686s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:55:19 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-2993437c-8476-432a-bee1-f1859bea5054 tempest-ProjectMemberTests-1806793813 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-6406a8a7-81e7-4d65-9e67-ebcdd4c998a8.info {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:55:19 devstack sudo[106796]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-6406a8a7-81e7-4d65-9e67-ebcdd4c998a8.info Jul 10 04:55:19 devstack sudo[106796]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:55:19 devstack sudo[106793]: pam_unix(sudo:session): session closed for user root Jul 10 04:55:19 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-12cf17bd-1d5d-4467-a3b0-b44a80db3108 tempest-ProjectReaderTests-860343347 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-276892c2-e3b5-4401-86fb-224df177008f" returned: 0 in 0.648s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:55:19 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-12cf17bd-1d5d-4467-a3b0-b44a80db3108 tempest-ProjectReaderTests-860343347 None] Lock "cinder-quobyte-276892c2-e3b5-4401-86fb-224df177008f" released by "delete_volume" :: held 1.471s {{(pid=87444) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 04:55:19 devstack cinder-volume[87444]: DEBUG cinder.quota [None req-12cf17bd-1d5d-4467-a3b0-b44a80db3108 tempest-ProjectReaderTests-860343347 None] Created reservations ['defa941c-299c-4313-972d-5f53a14657c2', 'c8116115-36f7-4311-8cf6-4c45c58f473d', '64dcf957-ccdb-42b7-8c01-18cf3d020c55', 'cd7615c1-9c64-4f18-bb04-f0462e9d6c8d'] {{(pid=87444) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 04:55:19 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-12cf17bd-1d5d-4467-a3b0-b44a80db3108 tempest-ProjectReaderTests-860343347 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 04:55:19 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-12cf17bd-1d5d-4467-a3b0-b44a80db3108 tempest-ProjectReaderTests-860343347 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 04:55:19 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-12cf17bd-1d5d-4467-a3b0-b44a80db3108 tempest-ProjectReaderTests-860343347 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922': None} {{(pid=87444) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 04:55:19 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-12cf17bd-1d5d-4467-a3b0-b44a80db3108 tempest-ProjectReaderTests-860343347 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922'] {{(pid=87444) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 04:55:19 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-12cf17bd-1d5d-4467-a3b0-b44a80db3108 tempest-ProjectReaderTests-860343347 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 04:55:19 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-12cf17bd-1d5d-4467-a3b0-b44a80db3108 tempest-ProjectReaderTests-860343347 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:55:19 devstack sudo[106800]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097 Jul 10 04:55:19 devstack sudo[106800]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:55:19 devstack sudo[106796]: pam_unix(sudo:session): session closed for user root Jul 10 04:55:19 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-2993437c-8476-432a-bee1-f1859bea5054 tempest-ProjectMemberTests-1806793813 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-6406a8a7-81e7-4d65-9e67-ebcdd4c998a8.info" returned: 0 in 0.673s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:55:19 devstack cinder-volume[87444]: WARNING cinder.volume.drivers.remotefs [None req-2993437c-8476-432a-bee1-f1859bea5054 tempest-ProjectMemberTests-1806793813 None] /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-6406a8a7-81e7-4d65-9e67-ebcdd4c998a8.info is being set with open permissions: ugo+rw Jul 10 04:55:19 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-2993437c-8476-432a-bee1-f1859bea5054 tempest-ProjectMemberTests-1806793813 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-6406a8a7-81e7-4d65-9e67-ebcdd4c998a8.info {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:55:19 devstack sudo[106802]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-6406a8a7-81e7-4d65-9e67-ebcdd4c998a8.info Jul 10 04:55:19 devstack sudo[106802]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:55:20 devstack sudo[106800]: pam_unix(sudo:session): session closed for user root Jul 10 04:55:20 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-12cf17bd-1d5d-4467-a3b0-b44a80db3108 tempest-ProjectReaderTests-860343347 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097" returned: 0 in 0.663s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:55:20 devstack cinder-volume[87444]: DEBUG cinder.manager [None req-12cf17bd-1d5d-4467-a3b0-b44a80db3108 tempest-ProjectReaderTests-860343347 None] Notifying Schedulers of capabilities ... {{(pid=87444) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 04:55:20 devstack cinder-volume[87444]: INFO cinder.volume.manager [None req-12cf17bd-1d5d-4467-a3b0-b44a80db3108 tempest-ProjectReaderTests-860343347 None] Deleted volume successfully. Jul 10 04:55:20 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-12cf17bd-1d5d-4467-a3b0-b44a80db3108 tempest-ProjectReaderTests-860343347 None] Lock "cinder-276892c2-e3b5-4401-86fb-224df177008f-delete_volume" released by "delete_volume" :: held 2.355s {{(pid=87444) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 04:55:20 devstack sudo[106802]: pam_unix(sudo:session): session closed for user root Jul 10 04:55:20 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-2993437c-8476-432a-bee1-f1859bea5054 tempest-ProjectMemberTests-1806793813 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-6406a8a7-81e7-4d65-9e67-ebcdd4c998a8.info" returned: 0 in 0.653s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:55:20 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-2993437c-8476-432a-bee1-f1859bea5054 tempest-ProjectMemberTests-1806793813 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.409s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 04:55:20 devstack cinder-volume[87444]: INFO cinder.volume.manager [None req-2993437c-8476-432a-bee1-f1859bea5054 tempest-ProjectMemberTests-1806793813 None] Create snapshot completed successfully Jul 10 04:55:20 devstack cinder-volume[87444]: DEBUG cinder.volume.flows.manager.create_volume [None req-aed123ee-463c-45c9-aa54-6ae27c5c31c1 tempest-ProjectReaderTests-860343347 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87444) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 04:55:20 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-aed123ee-463c-45c9-aa54-6ae27c5c31c1 tempest-ProjectReaderTests-860343347 None] Flow 'volume_create_manager' (9bfa11a3-f2b8-4701-9e06-db348d187621) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 04:55:20 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-aed123ee-463c-45c9-aa54-6ae27c5c31c1 tempest-ProjectReaderTests-860343347 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3d22e04f-9715-4ca7-a037-55b316b675ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:55:20 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-aed123ee-463c-45c9-aa54-6ae27c5c31c1 tempest-ProjectReaderTests-860343347 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3d22e04f-9715-4ca7-a037-55b316b675ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T02:55:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1832611425',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1301848e-7c8f-46d2-af49-3645f3753773,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='181feec0fe8f488b8b6345b78eb67c5c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T02:55:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T02:55:21Z,use_quota=True,user_id='c9a1d6a7ee0a44ff83a1bceb660b8015',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(317e369e-1e06-434d-ae95-a335f0e6c903),volume_type_id=317e369e-1e06-434d-ae95-a335f0e6c903)' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:55:20 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-aed123ee-463c-45c9-aa54-6ae27c5c31c1 tempest-ProjectReaderTests-860343347 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6960650d-18d2-4195-862d-6e068f61ec4f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:55:20 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-aed123ee-463c-45c9-aa54-6ae27c5c31c1 tempest-ProjectReaderTests-860343347 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6960650d-18d2-4195-862d-6e068f61ec4f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:55:20 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-aed123ee-463c-45c9-aa54-6ae27c5c31c1 tempest-ProjectReaderTests-860343347 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b9982f39-1b0e-4e0c-833c-0409fc2ed754) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:55:20 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-aed123ee-463c-45c9-aa54-6ae27c5c31c1 tempest-ProjectReaderTests-860343347 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b9982f39-1b0e-4e0c-833c-0409fc2ed754) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1301848e-7c8f-46d2-af49-3645f3753773', 'volume_name': 'volume-1301848e-7c8f-46d2-af49-3645f3753773', 'volume_size': 1}' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:55:20 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-aed123ee-463c-45c9-aa54-6ae27c5c31c1 tempest-ProjectReaderTests-860343347 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3f1e3475-6436-4748-91c5-dd22a2a48bda) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:55:20 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-aed123ee-463c-45c9-aa54-6ae27c5c31c1 tempest-ProjectReaderTests-860343347 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3f1e3475-6436-4748-91c5-dd22a2a48bda) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:55:20 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-aed123ee-463c-45c9-aa54-6ae27c5c31c1 tempest-ProjectReaderTests-860343347 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c3f0133f-71bb-4caf-a8a4-7fac4decb56b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:55:20 devstack cinder-volume[87444]: INFO cinder.volume.flows.manager.create_volume [None req-aed123ee-463c-45c9-aa54-6ae27c5c31c1 tempest-ProjectReaderTests-860343347 None] Volume 1301848e-7c8f-46d2-af49-3645f3753773: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1301848e-7c8f-46d2-af49-3645f3753773', 'volume_size': 1} Jul 10 04:55:20 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-aed123ee-463c-45c9-aa54-6ae27c5c31c1 tempest-ProjectReaderTests-860343347 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 04:55:20 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-aed123ee-463c-45c9-aa54-6ae27c5c31c1 tempest-ProjectReaderTests-860343347 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 04:55:20 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-aed123ee-463c-45c9-aa54-6ae27c5c31c1 tempest-ProjectReaderTests-860343347 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T02:55:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1832611425',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1301848e-7c8f-46d2-af49-3645f3753773,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='181feec0fe8f488b8b6345b78eb67c5c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T02:55:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T02:55:21Z,use_quota=True,user_id='c9a1d6a7ee0a44ff83a1bceb660b8015',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(317e369e-1e06-434d-ae95-a335f0e6c903),volume_type_id=317e369e-1e06-434d-ae95-a335f0e6c903)}" {{(pid=87444) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 04:55:20 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.remotefs [None req-aed123ee-463c-45c9-aa54-6ae27c5c31c1 tempest-ProjectReaderTests-860343347 None] Creating volume 1301848e-7c8f-46d2-af49-3645f3753773 {{(pid=87444) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 04:55:20 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-aed123ee-463c-45c9-aa54-6ae27c5c31c1 tempest-ProjectReaderTests-860343347 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 04:55:20 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-aed123ee-463c-45c9-aa54-6ae27c5c31c1 tempest-ProjectReaderTests-860343347 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 04:55:20 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-aed123ee-463c-45c9-aa54-6ae27c5c31c1 tempest-ProjectReaderTests-860343347 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922': None} {{(pid=87444) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 04:55:20 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-aed123ee-463c-45c9-aa54-6ae27c5c31c1 tempest-ProjectReaderTests-860343347 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922'] {{(pid=87444) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 04:55:20 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-aed123ee-463c-45c9-aa54-6ae27c5c31c1 tempest-ProjectReaderTests-860343347 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 04:55:20 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-aed123ee-463c-45c9-aa54-6ae27c5c31c1 tempest-ProjectReaderTests-860343347 None] Selected osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922 as target Quobyte volume. {{(pid=87444) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 04:55:20 devstack cinder-volume[87444]: INFO cinder.volume.drivers.remotefs [None req-aed123ee-463c-45c9-aa54-6ae27c5c31c1 tempest-ProjectReaderTests-860343347 None] casted to osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922 Jul 10 04:55:20 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-aed123ee-463c-45c9-aa54-6ae27c5c31c1 tempest-ProjectReaderTests-860343347 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-1301848e-7c8f-46d2-af49-3645f3753773 1073741824 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:55:20 devstack sudo[106807]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-1301848e-7c8f-46d2-af49-3645f3753773 1073741824 Jul 10 04:55:20 devstack sudo[106807]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:55:21 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-b2af7f21-9fc7-40fc-857e-557e722f3199 tempest-ProjectMemberTests-1806793813 None] Acquiring lock "cinder-f0ce8848-8653-4021-b9fb-9b85575c4f89-delete_snapshot" by "delete_snapshot" {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 04:55:21 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-b2af7f21-9fc7-40fc-857e-557e722f3199 tempest-ProjectMemberTests-1806793813 None] Lock "cinder-f0ce8848-8653-4021-b9fb-9b85575c4f89-delete_snapshot" acquired by "delete_snapshot" :: waited 0.034s {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 04:55:21 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-b2af7f21-9fc7-40fc-857e-557e722f3199 tempest-ProjectMemberTests-1806793813 None] Acquiring lock "cinder-quobyte-6406a8a7-81e7-4d65-9e67-ebcdd4c998a8" by "delete_snapshot" {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 04:55:21 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-b2af7f21-9fc7-40fc-857e-557e722f3199 tempest-ProjectMemberTests-1806793813 None] Lock "cinder-quobyte-6406a8a7-81e7-4d65-9e67-ebcdd4c998a8" acquired by "delete_snapshot" :: waited 0.019s {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 04:55:21 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-b2af7f21-9fc7-40fc-857e-557e722f3199 tempest-ProjectMemberTests-1806793813 None] Acquiring lock "cinder-quobyte-f0ce8848-8653-4021-b9fb-9b85575c4f89" by "_delete_snapshot" {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 04:55:21 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-b2af7f21-9fc7-40fc-857e-557e722f3199 tempest-ProjectMemberTests-1806793813 None] Lock "cinder-quobyte-f0ce8848-8653-4021-b9fb-9b85575c4f89" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 04:55:21 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.remotefs [None req-b2af7f21-9fc7-40fc-857e-557e722f3199 tempest-ProjectMemberTests-1806793813 None] Deleting offline snapshot f0ce8848-8653-4021-b9fb-9b85575c4f89 of volume 6406a8a7-81e7-4d65-9e67-ebcdd4c998a8 {{(pid=87444) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 10 04:55:21 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.remotefs [None req-b2af7f21-9fc7-40fc-857e-557e722f3199 tempest-ProjectMemberTests-1806793813 None] snapshot_file for this snap is: volume-6406a8a7-81e7-4d65-9e67-ebcdd4c998a8.f0ce8848-8653-4021-b9fb-9b85575c4f89 {{(pid=87444) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 10 04:55:21 devstack cinder-volume[87444]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b5992bf-d17a-4370-aa24-8f6e79241e44]: (4, 'qcow2') {{(pid=88499) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 04:55:21 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-b2af7f21-9fc7-40fc-857e-557e722f3199 tempest-ProjectMemberTests-1806793813 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-6406a8a7-81e7-4d65-9e67-ebcdd4c998a8.f0ce8848-8653-4021-b9fb-9b85575c4f89 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:55:21 devstack sudo[106811]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-6406a8a7-81e7-4d65-9e67-ebcdd4c998a8.f0ce8848-8653-4021-b9fb-9b85575c4f89 Jul 10 04:55:21 devstack sudo[106811]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:55:21 devstack sudo[106807]: pam_unix(sudo:session): session closed for user root Jul 10 04:55:21 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-aed123ee-463c-45c9-aa54-6ae27c5c31c1 tempest-ProjectReaderTests-860343347 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-1301848e-7c8f-46d2-af49-3645f3753773 1073741824" returned: 0 in 0.844s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:55:21 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-aed123ee-463c-45c9-aa54-6ae27c5c31c1 tempest-ProjectReaderTests-860343347 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-1301848e-7c8f-46d2-af49-3645f3753773 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:55:21 devstack sudo[106815]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-1301848e-7c8f-46d2-af49-3645f3753773 Jul 10 04:55:21 devstack sudo[106815]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:55:22 devstack sudo[106811]: pam_unix(sudo:session): session closed for user root Jul 10 04:55:22 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-b2af7f21-9fc7-40fc-857e-557e722f3199 tempest-ProjectMemberTests-1806793813 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-6406a8a7-81e7-4d65-9e67-ebcdd4c998a8.f0ce8848-8653-4021-b9fb-9b85575c4f89" returned: 0 in 0.767s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:55:22 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.remotefs [None req-b2af7f21-9fc7-40fc-857e-557e722f3199 tempest-ProjectMemberTests-1806793813 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6406a8a7-81e7-4d65-9e67-ebcdd4c998a8(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87444) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 10 04:55:22 devstack cinder-volume[87444]: DEBUG oslo.privsep.daemon [-] privsep: reply[2068c16e-ee39-45cb-b091-a2f4d1515dc4]: (4, 'qcow2') {{(pid=88499) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 04:55:22 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-b2af7f21-9fc7-40fc-857e-557e722f3199 tempest-ProjectMemberTests-1806793813 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-6406a8a7-81e7-4d65-9e67-ebcdd4c998a8 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:55:22 devstack sudo[106820]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-6406a8a7-81e7-4d65-9e67-ebcdd4c998a8 Jul 10 04:55:22 devstack sudo[106820]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:55:22 devstack sudo[106815]: pam_unix(sudo:session): session closed for user root Jul 10 04:55:22 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-aed123ee-463c-45c9-aa54-6ae27c5c31c1 tempest-ProjectReaderTests-860343347 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-1301848e-7c8f-46d2-af49-3645f3753773" returned: 0 in 0.636s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:55:22 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-aed123ee-463c-45c9-aa54-6ae27c5c31c1 tempest-ProjectReaderTests-860343347 None] <== create_volume: return (1525ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922'} {{(pid=87444) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 04:55:22 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-aed123ee-463c-45c9-aa54-6ae27c5c31c1 tempest-ProjectReaderTests-860343347 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.527s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 04:55:22 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-aed123ee-463c-45c9-aa54-6ae27c5c31c1 tempest-ProjectReaderTests-860343347 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c3f0133f-71bb-4caf-a8a4-7fac4decb56b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1301848e-7c8f-46d2-af49-3645f3753773', 'volume_size': 1}' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:55:22 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-aed123ee-463c-45c9-aa54-6ae27c5c31c1 tempest-ProjectReaderTests-860343347 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cd676048-420c-4ada-841e-f4578f23689a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:55:22 devstack cinder-volume[87444]: INFO cinder.volume.flows.manager.create_volume [None req-aed123ee-463c-45c9-aa54-6ae27c5c31c1 tempest-ProjectReaderTests-860343347 None] Volume volume-1301848e-7c8f-46d2-af49-3645f3753773 (1301848e-7c8f-46d2-af49-3645f3753773): created successfully Jul 10 04:55:22 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-aed123ee-463c-45c9-aa54-6ae27c5c31c1 tempest-ProjectReaderTests-860343347 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cd676048-420c-4ada-841e-f4578f23689a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:55:22 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-aed123ee-463c-45c9-aa54-6ae27c5c31c1 tempest-ProjectReaderTests-860343347 None] Flow 'volume_create_manager' (9bfa11a3-f2b8-4701-9e06-db348d187621) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87444) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 04:55:22 devstack cinder-volume[87444]: INFO cinder.volume.manager [None req-aed123ee-463c-45c9-aa54-6ae27c5c31c1 tempest-ProjectReaderTests-860343347 None] Created volume successfully. Jul 10 04:55:23 devstack sudo[106820]: pam_unix(sudo:session): session closed for user root Jul 10 04:55:23 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-b2af7f21-9fc7-40fc-857e-557e722f3199 tempest-ProjectMemberTests-1806793813 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-6406a8a7-81e7-4d65-9e67-ebcdd4c998a8" returned: 0 in 0.759s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:55:23 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-b2af7f21-9fc7-40fc-857e-557e722f3199 tempest-ProjectMemberTests-1806793813 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-6406a8a7-81e7-4d65-9e67-ebcdd4c998a8.f0ce8848-8653-4021-b9fb-9b85575c4f89 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:55:23 devstack sudo[106826]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-6406a8a7-81e7-4d65-9e67-ebcdd4c998a8.f0ce8848-8653-4021-b9fb-9b85575c4f89 Jul 10 04:55:23 devstack sudo[106826]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:55:23 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-f0b41f50-da80-4dbb-ad6d-27334a534bfe tempest-ProjectReaderTests-860343347 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 04:55:23 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-f0b41f50-da80-4dbb-ad6d-27334a534bfe tempest-ProjectReaderTests-860343347 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 04:55:23 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.remotefs [None req-f0b41f50-da80-4dbb-ad6d-27334a534bfe tempest-ProjectReaderTests-860343347 None] Creating offline snapshot e8e17f42-fb58-4379-a42d-340ee44ca710 of volume 1301848e-7c8f-46d2-af49-3645f3753773 {{(pid=87444) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 10 04:55:23 devstack cinder-volume[87444]: DEBUG oslo.privsep.daemon [-] privsep: reply[21f067c6-c5c0-408d-8050-dcb00b84704f]: (4, 'qcow2') {{(pid=88499) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 04:55:23 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-f0b41f50-da80-4dbb-ad6d-27334a534bfe tempest-ProjectReaderTests-860343347 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-1301848e-7c8f-46d2-af49-3645f3753773 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:55:23 devstack sudo[106828]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-1301848e-7c8f-46d2-af49-3645f3753773 Jul 10 04:55:23 devstack sudo[106828]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:55:23 devstack sudo[106826]: pam_unix(sudo:session): session closed for user root Jul 10 04:55:23 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-b2af7f21-9fc7-40fc-857e-557e722f3199 tempest-ProjectMemberTests-1806793813 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-6406a8a7-81e7-4d65-9e67-ebcdd4c998a8.f0ce8848-8653-4021-b9fb-9b85575c4f89" returned: 0 in 0.742s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:55:23 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-b2af7f21-9fc7-40fc-857e-557e722f3199 tempest-ProjectMemberTests-1806793813 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-6406a8a7-81e7-4d65-9e67-ebcdd4c998a8.f0ce8848-8653-4021-b9fb-9b85575c4f89 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:55:23 devstack sudo[106837]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-6406a8a7-81e7-4d65-9e67-ebcdd4c998a8.f0ce8848-8653-4021-b9fb-9b85575c4f89 Jul 10 04:55:23 devstack sudo[106837]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:55:23 devstack sudo[106828]: pam_unix(sudo:session): session closed for user root Jul 10 04:55:23 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-f0b41f50-da80-4dbb-ad6d-27334a534bfe tempest-ProjectReaderTests-860343347 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-1301848e-7c8f-46d2-af49-3645f3753773" returned: 0 in 0.754s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:55:23 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-f0b41f50-da80-4dbb-ad6d-27334a534bfe tempest-ProjectReaderTests-860343347 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-1301848e-7c8f-46d2-af49-3645f3753773,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-1301848e-7c8f-46d2-af49-3645f3753773.e8e17f42-fb58-4379-a42d-340ee44ca710 1G {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:55:23 devstack sudo[106839]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-1301848e-7c8f-46d2-af49-3645f3753773,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-1301848e-7c8f-46d2-af49-3645f3753773.e8e17f42-fb58-4379-a42d-340ee44ca710 1G Jul 10 04:55:23 devstack sudo[106839]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:55:24 devstack sudo[106837]: pam_unix(sudo:session): session closed for user root Jul 10 04:55:24 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-b2af7f21-9fc7-40fc-857e-557e722f3199 tempest-ProjectMemberTests-1806793813 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-6406a8a7-81e7-4d65-9e67-ebcdd4c998a8.f0ce8848-8653-4021-b9fb-9b85575c4f89" returned: 0 in 0.648s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:55:24 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-b2af7f21-9fc7-40fc-857e-557e722f3199 tempest-ProjectMemberTests-1806793813 None] Lock "cinder-quobyte-f0ce8848-8653-4021-b9fb-9b85575c4f89" released by "_delete_snapshot" :: held 3.020s {{(pid=87444) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 04:55:24 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-b2af7f21-9fc7-40fc-857e-557e722f3199 tempest-ProjectMemberTests-1806793813 None] Lock "cinder-quobyte-6406a8a7-81e7-4d65-9e67-ebcdd4c998a8" released by "delete_snapshot" :: held 3.050s {{(pid=87444) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 04:55:24 devstack cinder-volume[87444]: DEBUG cinder.quota [None req-b2af7f21-9fc7-40fc-857e-557e722f3199 tempest-ProjectMemberTests-1806793813 None] Created reservations ['e99e8af7-4774-4e50-aa8a-d545f71417c6', '43010e61-c112-41d0-9914-34803356e262', 'b2dab88c-8cc9-4d31-8e37-e3d5074b0500', '8399c6b0-5b24-4e89-84bd-6770facb5711'] {{(pid=87444) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 04:55:24 devstack cinder-volume[87444]: INFO cinder.volume.manager [None req-b2af7f21-9fc7-40fc-857e-557e722f3199 tempest-ProjectMemberTests-1806793813 None] Delete snapshot completed successfully. Jul 10 04:55:24 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-b2af7f21-9fc7-40fc-857e-557e722f3199 tempest-ProjectMemberTests-1806793813 None] Lock "cinder-f0ce8848-8653-4021-b9fb-9b85575c4f89-delete_snapshot" released by "delete_snapshot" :: held 3.190s {{(pid=87444) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 04:55:24 devstack sudo[106839]: pam_unix(sudo:session): session closed for user root Jul 10 04:55:24 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-f0b41f50-da80-4dbb-ad6d-27334a534bfe tempest-ProjectReaderTests-860343347 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-1301848e-7c8f-46d2-af49-3645f3753773,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-1301848e-7c8f-46d2-af49-3645f3753773.e8e17f42-fb58-4379-a42d-340ee44ca710 1G" returned: 0 in 0.813s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:55:24 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-f0b41f50-da80-4dbb-ad6d-27334a534bfe tempest-ProjectReaderTests-860343347 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1301848e-7c8f-46d2-af49-3645f3753773 -F qcow2 /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-1301848e-7c8f-46d2-af49-3645f3753773.e8e17f42-fb58-4379-a42d-340ee44ca710 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:55:24 devstack sudo[106846]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1301848e-7c8f-46d2-af49-3645f3753773 -F qcow2 /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-1301848e-7c8f-46d2-af49-3645f3753773.e8e17f42-fb58-4379-a42d-340ee44ca710 Jul 10 04:55:24 devstack sudo[106846]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:55:25 devstack sudo[106846]: pam_unix(sudo:session): session closed for user root Jul 10 04:55:25 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-f0b41f50-da80-4dbb-ad6d-27334a534bfe tempest-ProjectReaderTests-860343347 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1301848e-7c8f-46d2-af49-3645f3753773 -F qcow2 /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-1301848e-7c8f-46d2-af49-3645f3753773.e8e17f42-fb58-4379-a42d-340ee44ca710" returned: 0 in 0.664s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:55:25 devstack cinder-volume[87444]: WARNING cinder.volume.drivers.remotefs [None req-f0b41f50-da80-4dbb-ad6d-27334a534bfe tempest-ProjectReaderTests-860343347 None] /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-1301848e-7c8f-46d2-af49-3645f3753773.e8e17f42-fb58-4379-a42d-340ee44ca710 is being set with open permissions: ugo+rw Jul 10 04:55:25 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-f0b41f50-da80-4dbb-ad6d-27334a534bfe tempest-ProjectReaderTests-860343347 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-1301848e-7c8f-46d2-af49-3645f3753773.e8e17f42-fb58-4379-a42d-340ee44ca710 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:55:25 devstack sudo[106851]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-1301848e-7c8f-46d2-af49-3645f3753773.e8e17f42-fb58-4379-a42d-340ee44ca710 Jul 10 04:55:25 devstack sudo[106851]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:55:25 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-260dbecf-809d-4d6e-a056-dda044b4c4ea tempest-ProjectMemberTests-1806793813 None] Acquiring lock "cinder-6406a8a7-81e7-4d65-9e67-ebcdd4c998a8-delete_volume" by "delete_volume" {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 04:55:25 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-260dbecf-809d-4d6e-a056-dda044b4c4ea tempest-ProjectMemberTests-1806793813 None] Lock "cinder-6406a8a7-81e7-4d65-9e67-ebcdd4c998a8-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 04:55:25 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-260dbecf-809d-4d6e-a056-dda044b4c4ea tempest-ProjectMemberTests-1806793813 None] Acquiring lock "cinder-quobyte-6406a8a7-81e7-4d65-9e67-ebcdd4c998a8" by "delete_volume" {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 04:55:25 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-260dbecf-809d-4d6e-a056-dda044b4c4ea tempest-ProjectMemberTests-1806793813 None] Lock "cinder-quobyte-6406a8a7-81e7-4d65-9e67-ebcdd4c998a8" acquired by "delete_volume" :: waited 0.015s {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 04:55:25 devstack cinder-volume[87444]: DEBUG oslo.privsep.daemon [-] privsep: reply[8879150b-db69-4475-9937-34d366af2a70]: (4, 'qcow2') {{(pid=88499) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 04:55:25 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-260dbecf-809d-4d6e-a056-dda044b4c4ea tempest-ProjectMemberTests-1806793813 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-6406a8a7-81e7-4d65-9e67-ebcdd4c998a8 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:55:25 devstack sudo[106853]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-6406a8a7-81e7-4d65-9e67-ebcdd4c998a8 Jul 10 04:55:25 devstack sudo[106853]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:55:26 devstack sudo[106851]: pam_unix(sudo:session): session closed for user root Jul 10 04:55:26 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-f0b41f50-da80-4dbb-ad6d-27334a534bfe tempest-ProjectReaderTests-860343347 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-1301848e-7c8f-46d2-af49-3645f3753773.e8e17f42-fb58-4379-a42d-340ee44ca710" returned: 0 in 0.661s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:55:26 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-f0b41f50-da80-4dbb-ad6d-27334a534bfe tempest-ProjectReaderTests-860343347 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-1301848e-7c8f-46d2-af49-3645f3753773.info {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:55:26 devstack sudo[106856]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-1301848e-7c8f-46d2-af49-3645f3753773.info Jul 10 04:55:26 devstack sudo[106856]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:55:26 devstack sudo[106853]: pam_unix(sudo:session): session closed for user root Jul 10 04:55:26 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-260dbecf-809d-4d6e-a056-dda044b4c4ea tempest-ProjectMemberTests-1806793813 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-6406a8a7-81e7-4d65-9e67-ebcdd4c998a8" returned: 0 in 0.788s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:55:26 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-260dbecf-809d-4d6e-a056-dda044b4c4ea tempest-ProjectMemberTests-1806793813 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-6406a8a7-81e7-4d65-9e67-ebcdd4c998a8 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:55:26 devstack sudo[106861]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-6406a8a7-81e7-4d65-9e67-ebcdd4c998a8 Jul 10 04:55:26 devstack sudo[106861]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:55:26 devstack sudo[106856]: pam_unix(sudo:session): session closed for user root Jul 10 04:55:26 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-f0b41f50-da80-4dbb-ad6d-27334a534bfe tempest-ProjectReaderTests-860343347 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-1301848e-7c8f-46d2-af49-3645f3753773.info" returned: 0 in 0.660s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:55:26 devstack cinder-volume[87444]: WARNING cinder.volume.drivers.remotefs [None req-f0b41f50-da80-4dbb-ad6d-27334a534bfe tempest-ProjectReaderTests-860343347 None] /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-1301848e-7c8f-46d2-af49-3645f3753773.info is being set with open permissions: ugo+rw Jul 10 04:55:26 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-f0b41f50-da80-4dbb-ad6d-27334a534bfe tempest-ProjectReaderTests-860343347 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-1301848e-7c8f-46d2-af49-3645f3753773.info {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:55:26 devstack sudo[106864]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-1301848e-7c8f-46d2-af49-3645f3753773.info Jul 10 04:55:26 devstack sudo[106864]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:55:27 devstack sudo[106861]: pam_unix(sudo:session): session closed for user root Jul 10 04:55:27 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-260dbecf-809d-4d6e-a056-dda044b4c4ea tempest-ProjectMemberTests-1806793813 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-6406a8a7-81e7-4d65-9e67-ebcdd4c998a8" returned: 0 in 0.644s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:55:27 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-260dbecf-809d-4d6e-a056-dda044b4c4ea tempest-ProjectMemberTests-1806793813 None] Lock "cinder-quobyte-6406a8a7-81e7-4d65-9e67-ebcdd4c998a8" released by "delete_volume" :: held 1.497s {{(pid=87444) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 04:55:27 devstack cinder-volume[87444]: DEBUG cinder.quota [None req-260dbecf-809d-4d6e-a056-dda044b4c4ea tempest-ProjectMemberTests-1806793813 None] Created reservations ['eb2445a0-e5c1-4bfc-af0f-301bd3fdaddf', '8fa70603-7e5e-4708-afae-874040160e06', '6ac0cc61-50eb-4e73-9801-714fea20fb4f', '7375501d-42f0-4c4f-ba15-dd7d502ee2f2'] {{(pid=87444) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 04:55:27 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-260dbecf-809d-4d6e-a056-dda044b4c4ea tempest-ProjectMemberTests-1806793813 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 04:55:27 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-260dbecf-809d-4d6e-a056-dda044b4c4ea tempest-ProjectMemberTests-1806793813 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 04:55:27 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-260dbecf-809d-4d6e-a056-dda044b4c4ea tempest-ProjectMemberTests-1806793813 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922': None} {{(pid=87444) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 04:55:27 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-260dbecf-809d-4d6e-a056-dda044b4c4ea tempest-ProjectMemberTests-1806793813 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922'] {{(pid=87444) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 04:55:27 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-260dbecf-809d-4d6e-a056-dda044b4c4ea tempest-ProjectMemberTests-1806793813 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 04:55:27 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-260dbecf-809d-4d6e-a056-dda044b4c4ea tempest-ProjectMemberTests-1806793813 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:55:27 devstack sudo[106868]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097 Jul 10 04:55:27 devstack sudo[106868]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:55:27 devstack sudo[106864]: pam_unix(sudo:session): session closed for user root Jul 10 04:55:27 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-f0b41f50-da80-4dbb-ad6d-27334a534bfe tempest-ProjectReaderTests-860343347 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-1301848e-7c8f-46d2-af49-3645f3753773.info" returned: 0 in 0.674s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:55:27 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-f0b41f50-da80-4dbb-ad6d-27334a534bfe tempest-ProjectReaderTests-860343347 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.309s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 04:55:27 devstack cinder-volume[87444]: INFO cinder.volume.manager [None req-f0b41f50-da80-4dbb-ad6d-27334a534bfe tempest-ProjectReaderTests-860343347 None] Create snapshot completed successfully Jul 10 04:55:27 devstack sudo[106868]: pam_unix(sudo:session): session closed for user root Jul 10 04:55:27 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-260dbecf-809d-4d6e-a056-dda044b4c4ea tempest-ProjectMemberTests-1806793813 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097" returned: 0 in 0.668s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:55:27 devstack cinder-volume[87444]: DEBUG cinder.manager [None req-260dbecf-809d-4d6e-a056-dda044b4c4ea tempest-ProjectMemberTests-1806793813 None] Notifying Schedulers of capabilities ... {{(pid=87444) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 04:55:27 devstack cinder-volume[87444]: INFO cinder.volume.manager [None req-260dbecf-809d-4d6e-a056-dda044b4c4ea tempest-ProjectMemberTests-1806793813 None] Deleted volume successfully. Jul 10 04:55:28 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-260dbecf-809d-4d6e-a056-dda044b4c4ea tempest-ProjectMemberTests-1806793813 None] Lock "cinder-6406a8a7-81e7-4d65-9e67-ebcdd4c998a8-delete_volume" released by "delete_volume" :: held 2.385s {{(pid=87444) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 04:55:28 devstack cinder-volume[87444]: DEBUG cinder.volume.flows.manager.create_volume [None req-c5ca4e04-8ca2-426a-9127-2badb6426bc6 tempest-ProjectMemberTests-1806793813 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87444) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 04:55:28 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-c5ca4e04-8ca2-426a-9127-2badb6426bc6 tempest-ProjectMemberTests-1806793813 None] Flow 'volume_create_manager' (626a20c6-76ee-4241-9e27-db2ac723c819) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 04:55:28 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-c5ca4e04-8ca2-426a-9127-2badb6426bc6 tempest-ProjectMemberTests-1806793813 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5466ea35-fabb-458e-b83f-1c28796c80d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:55:28 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-7764e553-2e31-4e8a-a471-128572742870 tempest-ProjectReaderTests-860343347 None] Acquiring lock "cinder-e8e17f42-fb58-4379-a42d-340ee44ca710-delete_snapshot" by "delete_snapshot" {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 04:55:28 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-c5ca4e04-8ca2-426a-9127-2badb6426bc6 tempest-ProjectMemberTests-1806793813 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5466ea35-fabb-458e-b83f-1c28796c80d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T02:55:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1539135540',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c2e68c98-4ac0-4e6d-b003-4cd9576479fb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cadbf6455bcb4ed48f08a3c15f1d84e3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T02:55:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T02:55:28Z,use_quota=True,user_id='2aceae1efa264e87bd2696a5a256f622',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(317e369e-1e06-434d-ae95-a335f0e6c903),volume_type_id=317e369e-1e06-434d-ae95-a335f0e6c903)' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:55:28 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-c5ca4e04-8ca2-426a-9127-2badb6426bc6 tempest-ProjectMemberTests-1806793813 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c7ab5d78-facb-4ed9-8e67-a49d84946cf0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:55:28 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-c5ca4e04-8ca2-426a-9127-2badb6426bc6 tempest-ProjectMemberTests-1806793813 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c7ab5d78-facb-4ed9-8e67-a49d84946cf0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:55:28 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-c5ca4e04-8ca2-426a-9127-2badb6426bc6 tempest-ProjectMemberTests-1806793813 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5b369d0a-74ba-4d75-b829-e093cbbec832) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:55:28 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-c5ca4e04-8ca2-426a-9127-2badb6426bc6 tempest-ProjectMemberTests-1806793813 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5b369d0a-74ba-4d75-b829-e093cbbec832) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c2e68c98-4ac0-4e6d-b003-4cd9576479fb', 'volume_name': 'volume-c2e68c98-4ac0-4e6d-b003-4cd9576479fb', 'volume_size': 1}' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:55:28 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-c5ca4e04-8ca2-426a-9127-2badb6426bc6 tempest-ProjectMemberTests-1806793813 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2688a503-0524-4e58-89e5-782f2c2ea631) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:55:28 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-c5ca4e04-8ca2-426a-9127-2badb6426bc6 tempest-ProjectMemberTests-1806793813 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2688a503-0524-4e58-89e5-782f2c2ea631) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:55:28 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-c5ca4e04-8ca2-426a-9127-2badb6426bc6 tempest-ProjectMemberTests-1806793813 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b73cc16c-d780-475b-8901-501518cd55bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:55:28 devstack cinder-volume[87444]: INFO cinder.volume.flows.manager.create_volume [None req-c5ca4e04-8ca2-426a-9127-2badb6426bc6 tempest-ProjectMemberTests-1806793813 None] Volume c2e68c98-4ac0-4e6d-b003-4cd9576479fb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c2e68c98-4ac0-4e6d-b003-4cd9576479fb', 'volume_size': 1} Jul 10 04:55:28 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-c5ca4e04-8ca2-426a-9127-2badb6426bc6 tempest-ProjectMemberTests-1806793813 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 04:55:28 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-c5ca4e04-8ca2-426a-9127-2badb6426bc6 tempest-ProjectMemberTests-1806793813 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 04:55:28 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-c5ca4e04-8ca2-426a-9127-2badb6426bc6 tempest-ProjectMemberTests-1806793813 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T02:55:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1539135540',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c2e68c98-4ac0-4e6d-b003-4cd9576479fb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cadbf6455bcb4ed48f08a3c15f1d84e3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T02:55:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T02:55:28Z,use_quota=True,user_id='2aceae1efa264e87bd2696a5a256f622',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(317e369e-1e06-434d-ae95-a335f0e6c903),volume_type_id=317e369e-1e06-434d-ae95-a335f0e6c903)}" {{(pid=87444) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 04:55:28 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.remotefs [None req-c5ca4e04-8ca2-426a-9127-2badb6426bc6 tempest-ProjectMemberTests-1806793813 None] Creating volume c2e68c98-4ac0-4e6d-b003-4cd9576479fb {{(pid=87444) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 04:55:28 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-c5ca4e04-8ca2-426a-9127-2badb6426bc6 tempest-ProjectMemberTests-1806793813 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 04:55:28 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-c5ca4e04-8ca2-426a-9127-2badb6426bc6 tempest-ProjectMemberTests-1806793813 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 04:55:28 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-c5ca4e04-8ca2-426a-9127-2badb6426bc6 tempest-ProjectMemberTests-1806793813 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922': None} {{(pid=87444) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 04:55:28 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-c5ca4e04-8ca2-426a-9127-2badb6426bc6 tempest-ProjectMemberTests-1806793813 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922'] {{(pid=87444) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 04:55:28 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-c5ca4e04-8ca2-426a-9127-2badb6426bc6 tempest-ProjectMemberTests-1806793813 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 04:55:28 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-c5ca4e04-8ca2-426a-9127-2badb6426bc6 tempest-ProjectMemberTests-1806793813 None] Selected osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922 as target Quobyte volume. {{(pid=87444) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 04:55:28 devstack cinder-volume[87444]: INFO cinder.volume.drivers.remotefs [None req-c5ca4e04-8ca2-426a-9127-2badb6426bc6 tempest-ProjectMemberTests-1806793813 None] casted to osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922 Jul 10 04:55:28 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-c5ca4e04-8ca2-426a-9127-2badb6426bc6 tempest-ProjectMemberTests-1806793813 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-c2e68c98-4ac0-4e6d-b003-4cd9576479fb 1073741824 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:55:28 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-7764e553-2e31-4e8a-a471-128572742870 tempest-ProjectReaderTests-860343347 None] Lock "cinder-e8e17f42-fb58-4379-a42d-340ee44ca710-delete_snapshot" acquired by "delete_snapshot" :: waited 0.082s {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 04:55:28 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-7764e553-2e31-4e8a-a471-128572742870 tempest-ProjectReaderTests-860343347 None] Acquiring lock "cinder-quobyte-1301848e-7c8f-46d2-af49-3645f3753773" by "delete_snapshot" {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 04:55:28 devstack sudo[106871]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-c2e68c98-4ac0-4e6d-b003-4cd9576479fb 1073741824 Jul 10 04:55:28 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-7764e553-2e31-4e8a-a471-128572742870 tempest-ProjectReaderTests-860343347 None] Lock "cinder-quobyte-1301848e-7c8f-46d2-af49-3645f3753773" acquired by "delete_snapshot" :: waited 0.016s {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 04:55:28 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-7764e553-2e31-4e8a-a471-128572742870 tempest-ProjectReaderTests-860343347 None] Acquiring lock "cinder-quobyte-e8e17f42-fb58-4379-a42d-340ee44ca710" by "_delete_snapshot" {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 04:55:28 devstack sudo[106871]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:55:28 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-7764e553-2e31-4e8a-a471-128572742870 tempest-ProjectReaderTests-860343347 None] Lock "cinder-quobyte-e8e17f42-fb58-4379-a42d-340ee44ca710" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 04:55:28 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.remotefs [None req-7764e553-2e31-4e8a-a471-128572742870 tempest-ProjectReaderTests-860343347 None] Deleting offline snapshot e8e17f42-fb58-4379-a42d-340ee44ca710 of volume 1301848e-7c8f-46d2-af49-3645f3753773 {{(pid=87444) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 10 04:55:28 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.remotefs [None req-7764e553-2e31-4e8a-a471-128572742870 tempest-ProjectReaderTests-860343347 None] snapshot_file for this snap is: volume-1301848e-7c8f-46d2-af49-3645f3753773.e8e17f42-fb58-4379-a42d-340ee44ca710 {{(pid=87444) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 10 04:55:28 devstack cinder-volume[87444]: DEBUG oslo.privsep.daemon [-] privsep: reply[15de0e1d-4223-4256-8a9e-3c6c589dd47f]: (4, 'qcow2') {{(pid=88499) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 04:55:28 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-7764e553-2e31-4e8a-a471-128572742870 tempest-ProjectReaderTests-860343347 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-1301848e-7c8f-46d2-af49-3645f3753773.e8e17f42-fb58-4379-a42d-340ee44ca710 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:55:28 devstack sudo[106873]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-1301848e-7c8f-46d2-af49-3645f3753773.e8e17f42-fb58-4379-a42d-340ee44ca710 Jul 10 04:55:28 devstack sudo[106873]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:55:29 devstack sudo[106871]: pam_unix(sudo:session): session closed for user root Jul 10 04:55:29 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-c5ca4e04-8ca2-426a-9127-2badb6426bc6 tempest-ProjectMemberTests-1806793813 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-c2e68c98-4ac0-4e6d-b003-4cd9576479fb 1073741824" returned: 0 in 0.844s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:55:29 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-c5ca4e04-8ca2-426a-9127-2badb6426bc6 tempest-ProjectMemberTests-1806793813 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-c2e68c98-4ac0-4e6d-b003-4cd9576479fb {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:55:29 devstack sudo[106873]: pam_unix(sudo:session): session closed for user root Jul 10 04:55:29 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-7764e553-2e31-4e8a-a471-128572742870 tempest-ProjectReaderTests-860343347 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-1301848e-7c8f-46d2-af49-3645f3753773.e8e17f42-fb58-4379-a42d-340ee44ca710" returned: 0 in 0.810s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:55:29 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.remotefs [None req-7764e553-2e31-4e8a-a471-128572742870 tempest-ProjectReaderTests-860343347 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1301848e-7c8f-46d2-af49-3645f3753773(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87444) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 10 04:55:29 devstack sudo[106881]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-c2e68c98-4ac0-4e6d-b003-4cd9576479fb Jul 10 04:55:29 devstack sudo[106881]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:55:29 devstack cinder-volume[87444]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f58547f-05dd-484e-932a-edc42b4edae8]: (4, 'qcow2') {{(pid=88499) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 04:55:29 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-7764e553-2e31-4e8a-a471-128572742870 tempest-ProjectReaderTests-860343347 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-1301848e-7c8f-46d2-af49-3645f3753773 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:55:29 devstack sudo[106883]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-1301848e-7c8f-46d2-af49-3645f3753773 Jul 10 04:55:29 devstack sudo[106883]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:55:29 devstack sudo[106881]: pam_unix(sudo:session): session closed for user root Jul 10 04:55:29 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-c5ca4e04-8ca2-426a-9127-2badb6426bc6 tempest-ProjectMemberTests-1806793813 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-c2e68c98-4ac0-4e6d-b003-4cd9576479fb" returned: 0 in 0.670s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:55:29 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-c5ca4e04-8ca2-426a-9127-2badb6426bc6 tempest-ProjectMemberTests-1806793813 None] <== create_volume: return (1559ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922'} {{(pid=87444) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 04:55:29 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-c5ca4e04-8ca2-426a-9127-2badb6426bc6 tempest-ProjectMemberTests-1806793813 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.561s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 04:55:29 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-c5ca4e04-8ca2-426a-9127-2badb6426bc6 tempest-ProjectMemberTests-1806793813 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b73cc16c-d780-475b-8901-501518cd55bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c2e68c98-4ac0-4e6d-b003-4cd9576479fb', 'volume_size': 1}' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:55:29 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-c5ca4e04-8ca2-426a-9127-2badb6426bc6 tempest-ProjectMemberTests-1806793813 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d1b2df85-d8d1-43df-a552-e247b3bc6e55) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:55:29 devstack cinder-volume[87444]: INFO cinder.volume.flows.manager.create_volume [None req-c5ca4e04-8ca2-426a-9127-2badb6426bc6 tempest-ProjectMemberTests-1806793813 None] Volume volume-c2e68c98-4ac0-4e6d-b003-4cd9576479fb (c2e68c98-4ac0-4e6d-b003-4cd9576479fb): created successfully Jul 10 04:55:29 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-c5ca4e04-8ca2-426a-9127-2badb6426bc6 tempest-ProjectMemberTests-1806793813 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d1b2df85-d8d1-43df-a552-e247b3bc6e55) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:55:30 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-c5ca4e04-8ca2-426a-9127-2badb6426bc6 tempest-ProjectMemberTests-1806793813 None] Flow 'volume_create_manager' (626a20c6-76ee-4241-9e27-db2ac723c819) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87444) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 04:55:30 devstack cinder-volume[87444]: INFO cinder.volume.manager [None req-c5ca4e04-8ca2-426a-9127-2badb6426bc6 tempest-ProjectMemberTests-1806793813 None] Created volume successfully. Jul 10 04:55:30 devstack sudo[106883]: pam_unix(sudo:session): session closed for user root Jul 10 04:55:30 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-7764e553-2e31-4e8a-a471-128572742870 tempest-ProjectReaderTests-860343347 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-1301848e-7c8f-46d2-af49-3645f3753773" returned: 0 in 0.742s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:55:30 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-7764e553-2e31-4e8a-a471-128572742870 tempest-ProjectReaderTests-860343347 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-1301848e-7c8f-46d2-af49-3645f3753773.e8e17f42-fb58-4379-a42d-340ee44ca710 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:55:30 devstack sudo[106889]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-1301848e-7c8f-46d2-af49-3645f3753773.e8e17f42-fb58-4379-a42d-340ee44ca710 Jul 10 04:55:30 devstack sudo[106889]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:55:30 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-f64e70ea-e9da-4dda-bafb-4ecc8e33f0d8 tempest-ProjectMemberTests-1806793813 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 04:55:30 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-f64e70ea-e9da-4dda-bafb-4ecc8e33f0d8 tempest-ProjectMemberTests-1806793813 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 04:55:30 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.remotefs [None req-f64e70ea-e9da-4dda-bafb-4ecc8e33f0d8 tempest-ProjectMemberTests-1806793813 None] Creating offline snapshot 6f847573-d3ff-4536-af02-a7fa7bcc714e of volume c2e68c98-4ac0-4e6d-b003-4cd9576479fb {{(pid=87444) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 10 04:55:30 devstack cinder-volume[87444]: DEBUG oslo.privsep.daemon [-] privsep: reply[43544e3c-0cee-4053-97d6-9f08869809db]: (4, 'qcow2') {{(pid=88499) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 04:55:30 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-f64e70ea-e9da-4dda-bafb-4ecc8e33f0d8 tempest-ProjectMemberTests-1806793813 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-c2e68c98-4ac0-4e6d-b003-4cd9576479fb {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:55:30 devstack sudo[106891]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-c2e68c98-4ac0-4e6d-b003-4cd9576479fb Jul 10 04:55:30 devstack sudo[106891]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:55:30 devstack sudo[106889]: pam_unix(sudo:session): session closed for user root Jul 10 04:55:30 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-7764e553-2e31-4e8a-a471-128572742870 tempest-ProjectReaderTests-860343347 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-1301848e-7c8f-46d2-af49-3645f3753773.e8e17f42-fb58-4379-a42d-340ee44ca710" returned: 0 in 0.771s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:55:30 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-7764e553-2e31-4e8a-a471-128572742870 tempest-ProjectReaderTests-860343347 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-1301848e-7c8f-46d2-af49-3645f3753773.e8e17f42-fb58-4379-a42d-340ee44ca710 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:55:30 devstack sudo[106896]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-1301848e-7c8f-46d2-af49-3645f3753773.e8e17f42-fb58-4379-a42d-340ee44ca710 Jul 10 04:55:30 devstack sudo[106896]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:55:31 devstack sudo[106891]: pam_unix(sudo:session): session closed for user root Jul 10 04:55:31 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-f64e70ea-e9da-4dda-bafb-4ecc8e33f0d8 tempest-ProjectMemberTests-1806793813 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-c2e68c98-4ac0-4e6d-b003-4cd9576479fb" returned: 0 in 0.772s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:55:31 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-f64e70ea-e9da-4dda-bafb-4ecc8e33f0d8 tempest-ProjectMemberTests-1806793813 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-c2e68c98-4ac0-4e6d-b003-4cd9576479fb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-c2e68c98-4ac0-4e6d-b003-4cd9576479fb.6f847573-d3ff-4536-af02-a7fa7bcc714e 1G {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:55:31 devstack sudo[106901]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-c2e68c98-4ac0-4e6d-b003-4cd9576479fb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-c2e68c98-4ac0-4e6d-b003-4cd9576479fb.6f847573-d3ff-4536-af02-a7fa7bcc714e 1G Jul 10 04:55:31 devstack sudo[106901]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:55:31 devstack sudo[106896]: pam_unix(sudo:session): session closed for user root Jul 10 04:55:31 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-7764e553-2e31-4e8a-a471-128572742870 tempest-ProjectReaderTests-860343347 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-1301848e-7c8f-46d2-af49-3645f3753773.e8e17f42-fb58-4379-a42d-340ee44ca710" returned: 0 in 0.644s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:55:31 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-7764e553-2e31-4e8a-a471-128572742870 tempest-ProjectReaderTests-860343347 None] Lock "cinder-quobyte-e8e17f42-fb58-4379-a42d-340ee44ca710" released by "_delete_snapshot" :: held 3.075s {{(pid=87444) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 04:55:31 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-7764e553-2e31-4e8a-a471-128572742870 tempest-ProjectReaderTests-860343347 None] Lock "cinder-quobyte-1301848e-7c8f-46d2-af49-3645f3753773" released by "delete_snapshot" :: held 3.100s {{(pid=87444) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 04:55:31 devstack cinder-volume[87444]: DEBUG cinder.quota [None req-7764e553-2e31-4e8a-a471-128572742870 tempest-ProjectReaderTests-860343347 None] Created reservations ['df70a278-f120-40a9-8d00-cc9e28e1dfff', 'd87c4a12-03da-4d6c-8689-e3ce7921e245', '45a88d16-c36c-4f90-ba17-2dde068aee1f', '2736fa35-7684-4980-99a2-419b090aa7ed'] {{(pid=87444) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 04:55:31 devstack cinder-volume[87444]: INFO cinder.volume.manager [None req-7764e553-2e31-4e8a-a471-128572742870 tempest-ProjectReaderTests-860343347 None] Delete snapshot completed successfully. Jul 10 04:55:31 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-7764e553-2e31-4e8a-a471-128572742870 tempest-ProjectReaderTests-860343347 None] Lock "cinder-e8e17f42-fb58-4379-a42d-340ee44ca710-delete_snapshot" released by "delete_snapshot" :: held 3.237s {{(pid=87444) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 04:55:32 devstack sudo[106901]: pam_unix(sudo:session): session closed for user root Jul 10 04:55:32 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-f64e70ea-e9da-4dda-bafb-4ecc8e33f0d8 tempest-ProjectMemberTests-1806793813 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-c2e68c98-4ac0-4e6d-b003-4cd9576479fb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-c2e68c98-4ac0-4e6d-b003-4cd9576479fb.6f847573-d3ff-4536-af02-a7fa7bcc714e 1G" returned: 0 in 0.783s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:55:32 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-f64e70ea-e9da-4dda-bafb-4ecc8e33f0d8 tempest-ProjectMemberTests-1806793813 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c2e68c98-4ac0-4e6d-b003-4cd9576479fb -F qcow2 /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-c2e68c98-4ac0-4e6d-b003-4cd9576479fb.6f847573-d3ff-4536-af02-a7fa7bcc714e {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:55:32 devstack sudo[106907]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c2e68c98-4ac0-4e6d-b003-4cd9576479fb -F qcow2 /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-c2e68c98-4ac0-4e6d-b003-4cd9576479fb.6f847573-d3ff-4536-af02-a7fa7bcc714e Jul 10 04:55:32 devstack sudo[106907]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:55:32 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-9c04efb5-f6af-4a47-9e65-f50a9d32189a tempest-ProjectReaderTests-860343347 None] Acquiring lock "cinder-1301848e-7c8f-46d2-af49-3645f3753773-delete_volume" by "delete_volume" {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 04:55:32 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-9c04efb5-f6af-4a47-9e65-f50a9d32189a tempest-ProjectReaderTests-860343347 None] Lock "cinder-1301848e-7c8f-46d2-af49-3645f3753773-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 04:55:32 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-9c04efb5-f6af-4a47-9e65-f50a9d32189a tempest-ProjectReaderTests-860343347 None] Acquiring lock "cinder-quobyte-1301848e-7c8f-46d2-af49-3645f3753773" by "delete_volume" {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 04:55:32 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-9c04efb5-f6af-4a47-9e65-f50a9d32189a tempest-ProjectReaderTests-860343347 None] Lock "cinder-quobyte-1301848e-7c8f-46d2-af49-3645f3753773" acquired by "delete_volume" :: waited 0.013s {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 04:55:32 devstack cinder-volume[87444]: DEBUG oslo.privsep.daemon [-] privsep: reply[84349379-309a-4f8f-bb7e-cc561f274e53]: (4, 'qcow2') {{(pid=88499) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 04:55:32 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-9c04efb5-f6af-4a47-9e65-f50a9d32189a tempest-ProjectReaderTests-860343347 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-1301848e-7c8f-46d2-af49-3645f3753773 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:55:32 devstack sudo[106911]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-1301848e-7c8f-46d2-af49-3645f3753773 Jul 10 04:55:32 devstack sudo[106911]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:55:32 devstack sudo[106907]: pam_unix(sudo:session): session closed for user root Jul 10 04:55:32 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-f64e70ea-e9da-4dda-bafb-4ecc8e33f0d8 tempest-ProjectMemberTests-1806793813 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c2e68c98-4ac0-4e6d-b003-4cd9576479fb -F qcow2 /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-c2e68c98-4ac0-4e6d-b003-4cd9576479fb.6f847573-d3ff-4536-af02-a7fa7bcc714e" returned: 0 in 0.700s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:55:32 devstack cinder-volume[87444]: WARNING cinder.volume.drivers.remotefs [None req-f64e70ea-e9da-4dda-bafb-4ecc8e33f0d8 tempest-ProjectMemberTests-1806793813 None] /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-c2e68c98-4ac0-4e6d-b003-4cd9576479fb.6f847573-d3ff-4536-af02-a7fa7bcc714e is being set with open permissions: ugo+rw Jul 10 04:55:32 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-f64e70ea-e9da-4dda-bafb-4ecc8e33f0d8 tempest-ProjectMemberTests-1806793813 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-c2e68c98-4ac0-4e6d-b003-4cd9576479fb.6f847573-d3ff-4536-af02-a7fa7bcc714e {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:55:32 devstack sudo[106914]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-c2e68c98-4ac0-4e6d-b003-4cd9576479fb.6f847573-d3ff-4536-af02-a7fa7bcc714e Jul 10 04:55:32 devstack sudo[106914]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:55:33 devstack cinder-volume[87444]: DEBUG oslo_service.periodic_task [None req-01f0ce3e-6850-4e14-881d-e40d3c4ad6e5 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87444) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 10 04:55:33 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-01f0ce3e-6850-4e14-881d-e40d3c4ad6e5 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 04:55:33 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-01f0ce3e-6850-4e14-881d-e40d3c4ad6e5 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 04:55:33 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-01f0ce3e-6850-4e14-881d-e40d3c4ad6e5 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922': None} {{(pid=87444) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 04:55:33 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-01f0ce3e-6850-4e14-881d-e40d3c4ad6e5 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922'] {{(pid=87444) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 04:55:33 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-01f0ce3e-6850-4e14-881d-e40d3c4ad6e5 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 04:55:33 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-01f0ce3e-6850-4e14-881d-e40d3c4ad6e5 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:55:33 devstack sudo[106916]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097 Jul 10 04:55:33 devstack sudo[106916]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:55:33 devstack sudo[106911]: pam_unix(sudo:session): session closed for user root Jul 10 04:55:33 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-9c04efb5-f6af-4a47-9e65-f50a9d32189a tempest-ProjectReaderTests-860343347 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-1301848e-7c8f-46d2-af49-3645f3753773" returned: 0 in 0.751s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:55:33 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-9c04efb5-f6af-4a47-9e65-f50a9d32189a tempest-ProjectReaderTests-860343347 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-1301848e-7c8f-46d2-af49-3645f3753773 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:55:33 devstack sudo[106922]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-1301848e-7c8f-46d2-af49-3645f3753773 Jul 10 04:55:33 devstack sudo[106922]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:55:33 devstack sudo[106914]: pam_unix(sudo:session): session closed for user root Jul 10 04:55:33 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-f64e70ea-e9da-4dda-bafb-4ecc8e33f0d8 tempest-ProjectMemberTests-1806793813 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-c2e68c98-4ac0-4e6d-b003-4cd9576479fb.6f847573-d3ff-4536-af02-a7fa7bcc714e" returned: 0 in 0.662s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:55:33 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-f64e70ea-e9da-4dda-bafb-4ecc8e33f0d8 tempest-ProjectMemberTests-1806793813 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-c2e68c98-4ac0-4e6d-b003-4cd9576479fb.info {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:55:33 devstack sudo[106924]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-c2e68c98-4ac0-4e6d-b003-4cd9576479fb.info Jul 10 04:55:33 devstack sudo[106924]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:55:33 devstack sudo[106916]: pam_unix(sudo:session): session closed for user root Jul 10 04:55:33 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-01f0ce3e-6850-4e14-881d-e40d3c4ad6e5 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097" returned: 0 in 0.677s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:55:33 devstack cinder-volume[87444]: DEBUG cinder.manager [None req-01f0ce3e-6850-4e14-881d-e40d3c4ad6e5 None None] Notifying Schedulers of capabilities ... {{(pid=87444) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 04:55:33 devstack cinder-volume[87444]: DEBUG oslo_service.periodic_task [None req-01f0ce3e-6850-4e14-881d-e40d3c4ad6e5 None None] Running periodic task VolumeManager._thread_info {{(pid=87444) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 10 04:55:33 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-01f0ce3e-6850-4e14-881d-e40d3c4ad6e5 None None] thread count: 28 {{(pid=87444) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 10 04:55:33 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-01f0ce3e-6850-4e14-881d-e40d3c4ad6e5 None None] thread info: [<_MainThread(MainThread, started 126839257915520)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87444) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 10 04:55:34 devstack sudo[106922]: pam_unix(sudo:session): session closed for user root Jul 10 04:55:34 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-9c04efb5-f6af-4a47-9e65-f50a9d32189a tempest-ProjectReaderTests-860343347 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-1301848e-7c8f-46d2-af49-3645f3753773" returned: 0 in 0.676s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:55:34 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-9c04efb5-f6af-4a47-9e65-f50a9d32189a tempest-ProjectReaderTests-860343347 None] Lock "cinder-quobyte-1301848e-7c8f-46d2-af49-3645f3753773" released by "delete_volume" :: held 1.483s {{(pid=87444) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 04:55:34 devstack cinder-volume[87444]: DEBUG cinder.quota [None req-9c04efb5-f6af-4a47-9e65-f50a9d32189a tempest-ProjectReaderTests-860343347 None] Created reservations ['21521761-bea7-45b8-b68d-3cca39f07c93', 'd5511368-8de0-4ac6-90bc-1209052c939d', '041fcf20-8361-4e23-9ab7-d334e4a06146', 'ea832da4-943c-4fd1-945b-2b40057a498d'] {{(pid=87444) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 04:55:34 devstack sudo[106924]: pam_unix(sudo:session): session closed for user root Jul 10 04:55:34 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-f64e70ea-e9da-4dda-bafb-4ecc8e33f0d8 tempest-ProjectMemberTests-1806793813 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-c2e68c98-4ac0-4e6d-b003-4cd9576479fb.info" returned: 0 in 0.711s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:55:34 devstack cinder-volume[87444]: WARNING cinder.volume.drivers.remotefs [None req-f64e70ea-e9da-4dda-bafb-4ecc8e33f0d8 tempest-ProjectMemberTests-1806793813 None] /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-c2e68c98-4ac0-4e6d-b003-4cd9576479fb.info is being set with open permissions: ugo+rw Jul 10 04:55:34 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-f64e70ea-e9da-4dda-bafb-4ecc8e33f0d8 tempest-ProjectMemberTests-1806793813 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-c2e68c98-4ac0-4e6d-b003-4cd9576479fb.info {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:55:34 devstack sudo[106930]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-c2e68c98-4ac0-4e6d-b003-4cd9576479fb.info Jul 10 04:55:34 devstack sudo[106930]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:55:34 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-9c04efb5-f6af-4a47-9e65-f50a9d32189a tempest-ProjectReaderTests-860343347 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 04:55:34 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-9c04efb5-f6af-4a47-9e65-f50a9d32189a tempest-ProjectReaderTests-860343347 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 04:55:34 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-9c04efb5-f6af-4a47-9e65-f50a9d32189a tempest-ProjectReaderTests-860343347 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922': None} {{(pid=87444) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 04:55:34 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-9c04efb5-f6af-4a47-9e65-f50a9d32189a tempest-ProjectReaderTests-860343347 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922'] {{(pid=87444) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 04:55:34 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-9c04efb5-f6af-4a47-9e65-f50a9d32189a tempest-ProjectReaderTests-860343347 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 04:55:34 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-9c04efb5-f6af-4a47-9e65-f50a9d32189a tempest-ProjectReaderTests-860343347 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:55:34 devstack sudo[106932]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097 Jul 10 04:55:34 devstack sudo[106932]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:55:34 devstack sudo[106930]: pam_unix(sudo:session): session closed for user root Jul 10 04:55:34 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-f64e70ea-e9da-4dda-bafb-4ecc8e33f0d8 tempest-ProjectMemberTests-1806793813 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-c2e68c98-4ac0-4e6d-b003-4cd9576479fb.info" returned: 0 in 0.662s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:55:34 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-f64e70ea-e9da-4dda-bafb-4ecc8e33f0d8 tempest-ProjectMemberTests-1806793813 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.383s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 04:55:34 devstack sudo[106932]: pam_unix(sudo:session): session closed for user root Jul 10 04:55:34 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-9c04efb5-f6af-4a47-9e65-f50a9d32189a tempest-ProjectReaderTests-860343347 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097" returned: 0 in 0.657s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:55:34 devstack cinder-volume[87444]: DEBUG cinder.manager [None req-9c04efb5-f6af-4a47-9e65-f50a9d32189a tempest-ProjectReaderTests-860343347 None] Notifying Schedulers of capabilities ... {{(pid=87444) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 04:55:34 devstack cinder-volume[87444]: INFO cinder.volume.manager [None req-9c04efb5-f6af-4a47-9e65-f50a9d32189a tempest-ProjectReaderTests-860343347 None] Deleted volume successfully. Jul 10 04:55:34 devstack cinder-volume[87444]: INFO cinder.volume.manager [None req-f64e70ea-e9da-4dda-bafb-4ecc8e33f0d8 tempest-ProjectMemberTests-1806793813 None] Create snapshot completed successfully Jul 10 04:55:34 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-9c04efb5-f6af-4a47-9e65-f50a9d32189a tempest-ProjectReaderTests-860343347 None] Lock "cinder-1301848e-7c8f-46d2-af49-3645f3753773-delete_volume" released by "delete_volume" :: held 2.396s {{(pid=87444) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 04:55:35 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-bd3870b1-fc72-46d8-bded-fe1b010314ec tempest-ProjectMemberTests-1806793813 None] Acquiring lock "cinder-6f847573-d3ff-4536-af02-a7fa7bcc714e-delete_snapshot" by "delete_snapshot" {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 04:55:35 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-bd3870b1-fc72-46d8-bded-fe1b010314ec tempest-ProjectMemberTests-1806793813 None] Lock "cinder-6f847573-d3ff-4536-af02-a7fa7bcc714e-delete_snapshot" acquired by "delete_snapshot" :: waited 0.022s {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 04:55:35 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-bd3870b1-fc72-46d8-bded-fe1b010314ec tempest-ProjectMemberTests-1806793813 None] Acquiring lock "cinder-quobyte-c2e68c98-4ac0-4e6d-b003-4cd9576479fb" by "delete_snapshot" {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 04:55:35 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-bd3870b1-fc72-46d8-bded-fe1b010314ec tempest-ProjectMemberTests-1806793813 None] Lock "cinder-quobyte-c2e68c98-4ac0-4e6d-b003-4cd9576479fb" acquired by "delete_snapshot" :: waited 0.020s {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 04:55:35 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-bd3870b1-fc72-46d8-bded-fe1b010314ec tempest-ProjectMemberTests-1806793813 None] Acquiring lock "cinder-quobyte-6f847573-d3ff-4536-af02-a7fa7bcc714e" by "_delete_snapshot" {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 04:55:35 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-bd3870b1-fc72-46d8-bded-fe1b010314ec tempest-ProjectMemberTests-1806793813 None] Lock "cinder-quobyte-6f847573-d3ff-4536-af02-a7fa7bcc714e" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 04:55:35 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.remotefs [None req-bd3870b1-fc72-46d8-bded-fe1b010314ec tempest-ProjectMemberTests-1806793813 None] Deleting offline snapshot 6f847573-d3ff-4536-af02-a7fa7bcc714e of volume c2e68c98-4ac0-4e6d-b003-4cd9576479fb {{(pid=87444) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 10 04:55:35 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.remotefs [None req-bd3870b1-fc72-46d8-bded-fe1b010314ec tempest-ProjectMemberTests-1806793813 None] snapshot_file for this snap is: volume-c2e68c98-4ac0-4e6d-b003-4cd9576479fb.6f847573-d3ff-4536-af02-a7fa7bcc714e {{(pid=87444) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 10 04:55:35 devstack cinder-volume[87444]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0d5e854-b4db-46ef-935f-9d7554d474b6]: (4, 'qcow2') {{(pid=88499) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 04:55:35 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-bd3870b1-fc72-46d8-bded-fe1b010314ec tempest-ProjectMemberTests-1806793813 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-c2e68c98-4ac0-4e6d-b003-4cd9576479fb.6f847573-d3ff-4536-af02-a7fa7bcc714e {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:55:36 devstack sudo[106936]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-c2e68c98-4ac0-4e6d-b003-4cd9576479fb.6f847573-d3ff-4536-af02-a7fa7bcc714e Jul 10 04:55:36 devstack sudo[106936]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:55:36 devstack sudo[106936]: pam_unix(sudo:session): session closed for user root Jul 10 04:55:36 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-bd3870b1-fc72-46d8-bded-fe1b010314ec tempest-ProjectMemberTests-1806793813 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-c2e68c98-4ac0-4e6d-b003-4cd9576479fb.6f847573-d3ff-4536-af02-a7fa7bcc714e" returned: 0 in 0.834s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:55:36 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.remotefs [None req-bd3870b1-fc72-46d8-bded-fe1b010314ec tempest-ProjectMemberTests-1806793813 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c2e68c98-4ac0-4e6d-b003-4cd9576479fb(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87444) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 10 04:55:36 devstack cinder-volume[87444]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d450cc8-6e95-4ab5-9237-4bbf69bfda4f]: (4, 'qcow2') {{(pid=88499) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 04:55:36 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-bd3870b1-fc72-46d8-bded-fe1b010314ec tempest-ProjectMemberTests-1806793813 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-c2e68c98-4ac0-4e6d-b003-4cd9576479fb {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:55:36 devstack sudo[106942]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-c2e68c98-4ac0-4e6d-b003-4cd9576479fb Jul 10 04:55:36 devstack sudo[106942]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:55:37 devstack sudo[106942]: pam_unix(sudo:session): session closed for user root Jul 10 04:55:37 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-bd3870b1-fc72-46d8-bded-fe1b010314ec tempest-ProjectMemberTests-1806793813 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-c2e68c98-4ac0-4e6d-b003-4cd9576479fb" returned: 0 in 0.767s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:55:37 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-bd3870b1-fc72-46d8-bded-fe1b010314ec tempest-ProjectMemberTests-1806793813 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-c2e68c98-4ac0-4e6d-b003-4cd9576479fb.6f847573-d3ff-4536-af02-a7fa7bcc714e {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:55:37 devstack sudo[106947]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-c2e68c98-4ac0-4e6d-b003-4cd9576479fb.6f847573-d3ff-4536-af02-a7fa7bcc714e Jul 10 04:55:37 devstack sudo[106947]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:55:38 devstack sudo[106947]: pam_unix(sudo:session): session closed for user root Jul 10 04:55:38 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-bd3870b1-fc72-46d8-bded-fe1b010314ec tempest-ProjectMemberTests-1806793813 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-c2e68c98-4ac0-4e6d-b003-4cd9576479fb.6f847573-d3ff-4536-af02-a7fa7bcc714e" returned: 0 in 0.753s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:55:38 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-bd3870b1-fc72-46d8-bded-fe1b010314ec tempest-ProjectMemberTests-1806793813 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-c2e68c98-4ac0-4e6d-b003-4cd9576479fb.6f847573-d3ff-4536-af02-a7fa7bcc714e {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:55:38 devstack sudo[106952]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-c2e68c98-4ac0-4e6d-b003-4cd9576479fb.6f847573-d3ff-4536-af02-a7fa7bcc714e Jul 10 04:55:38 devstack sudo[106952]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:55:38 devstack sudo[106952]: pam_unix(sudo:session): session closed for user root Jul 10 04:55:38 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-bd3870b1-fc72-46d8-bded-fe1b010314ec tempest-ProjectMemberTests-1806793813 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-c2e68c98-4ac0-4e6d-b003-4cd9576479fb.6f847573-d3ff-4536-af02-a7fa7bcc714e" returned: 0 in 0.648s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:55:38 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-bd3870b1-fc72-46d8-bded-fe1b010314ec tempest-ProjectMemberTests-1806793813 None] Lock "cinder-quobyte-6f847573-d3ff-4536-af02-a7fa7bcc714e" released by "_delete_snapshot" :: held 3.100s {{(pid=87444) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 04:55:38 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-bd3870b1-fc72-46d8-bded-fe1b010314ec tempest-ProjectMemberTests-1806793813 None] Lock "cinder-quobyte-c2e68c98-4ac0-4e6d-b003-4cd9576479fb" released by "delete_snapshot" :: held 3.124s {{(pid=87444) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 04:55:39 devstack cinder-volume[87444]: DEBUG cinder.quota [None req-bd3870b1-fc72-46d8-bded-fe1b010314ec tempest-ProjectMemberTests-1806793813 None] Created reservations ['f44e1bfb-745c-4922-a9e4-5fe3f60575b0', 'a93931cd-19f1-431e-8173-e563fb791156', '4b9fd275-ebc1-4a4f-a9e4-c69f6e487534', '8219840a-2120-4c68-9539-d732a0290eab'] {{(pid=87444) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 04:55:39 devstack cinder-volume[87444]: INFO cinder.volume.manager [None req-bd3870b1-fc72-46d8-bded-fe1b010314ec tempest-ProjectMemberTests-1806793813 None] Delete snapshot completed successfully. Jul 10 04:55:39 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-bd3870b1-fc72-46d8-bded-fe1b010314ec tempest-ProjectMemberTests-1806793813 None] Lock "cinder-6f847573-d3ff-4536-af02-a7fa7bcc714e-delete_snapshot" released by "delete_snapshot" :: held 3.254s {{(pid=87444) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 04:55:40 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-2640e255-7f86-456c-a82c-6dca69c93c85 tempest-ProjectMemberTests-1806793813 None] Acquiring lock "cinder-c2e68c98-4ac0-4e6d-b003-4cd9576479fb-delete_volume" by "delete_volume" {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 04:55:40 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-2640e255-7f86-456c-a82c-6dca69c93c85 tempest-ProjectMemberTests-1806793813 None] Lock "cinder-c2e68c98-4ac0-4e6d-b003-4cd9576479fb-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 04:55:40 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-2640e255-7f86-456c-a82c-6dca69c93c85 tempest-ProjectMemberTests-1806793813 None] Acquiring lock "cinder-quobyte-c2e68c98-4ac0-4e6d-b003-4cd9576479fb" by "delete_volume" {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 04:55:40 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-2640e255-7f86-456c-a82c-6dca69c93c85 tempest-ProjectMemberTests-1806793813 None] Lock "cinder-quobyte-c2e68c98-4ac0-4e6d-b003-4cd9576479fb" acquired by "delete_volume" :: waited 0.015s {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 04:55:40 devstack cinder-volume[87444]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c3892ff-2cee-45e3-bf10-36941df41568]: (4, 'qcow2') {{(pid=88499) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 04:55:40 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-2640e255-7f86-456c-a82c-6dca69c93c85 tempest-ProjectMemberTests-1806793813 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-c2e68c98-4ac0-4e6d-b003-4cd9576479fb {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:55:40 devstack sudo[106955]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-c2e68c98-4ac0-4e6d-b003-4cd9576479fb Jul 10 04:55:40 devstack sudo[106955]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:55:40 devstack sudo[106955]: pam_unix(sudo:session): session closed for user root Jul 10 04:55:40 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-2640e255-7f86-456c-a82c-6dca69c93c85 tempest-ProjectMemberTests-1806793813 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-c2e68c98-4ac0-4e6d-b003-4cd9576479fb" returned: 0 in 0.757s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:55:40 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-2640e255-7f86-456c-a82c-6dca69c93c85 tempest-ProjectMemberTests-1806793813 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-c2e68c98-4ac0-4e6d-b003-4cd9576479fb {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:55:40 devstack sudo[106960]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-c2e68c98-4ac0-4e6d-b003-4cd9576479fb Jul 10 04:55:40 devstack sudo[106960]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:55:41 devstack sudo[106960]: pam_unix(sudo:session): session closed for user root Jul 10 04:55:41 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-2640e255-7f86-456c-a82c-6dca69c93c85 tempest-ProjectMemberTests-1806793813 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-c2e68c98-4ac0-4e6d-b003-4cd9576479fb" returned: 0 in 0.662s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:55:41 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-2640e255-7f86-456c-a82c-6dca69c93c85 tempest-ProjectMemberTests-1806793813 None] Lock "cinder-quobyte-c2e68c98-4ac0-4e6d-b003-4cd9576479fb" released by "delete_volume" :: held 1.488s {{(pid=87444) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 04:55:41 devstack cinder-volume[87444]: DEBUG cinder.quota [None req-2640e255-7f86-456c-a82c-6dca69c93c85 tempest-ProjectMemberTests-1806793813 None] Created reservations ['e104c413-1bff-49e7-8e50-7fa11ef79340', '8ec1699d-0520-4f22-b8a7-05d6ba482486', 'c4c8805c-eab1-4d29-8014-6689ebd13ba7', '06627888-609a-4276-83fc-5511ef8665f1'] {{(pid=87444) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 04:55:41 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-2640e255-7f86-456c-a82c-6dca69c93c85 tempest-ProjectMemberTests-1806793813 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 04:55:41 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-2640e255-7f86-456c-a82c-6dca69c93c85 tempest-ProjectMemberTests-1806793813 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 04:55:41 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-2640e255-7f86-456c-a82c-6dca69c93c85 tempest-ProjectMemberTests-1806793813 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922': None} {{(pid=87444) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 04:55:41 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-2640e255-7f86-456c-a82c-6dca69c93c85 tempest-ProjectMemberTests-1806793813 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922'] {{(pid=87444) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 04:55:41 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-2640e255-7f86-456c-a82c-6dca69c93c85 tempest-ProjectMemberTests-1806793813 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 04:55:41 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-2640e255-7f86-456c-a82c-6dca69c93c85 tempest-ProjectMemberTests-1806793813 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:55:41 devstack sudo[106999]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097 Jul 10 04:55:41 devstack sudo[106999]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:55:42 devstack sudo[106999]: pam_unix(sudo:session): session closed for user root Jul 10 04:55:42 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-2640e255-7f86-456c-a82c-6dca69c93c85 tempest-ProjectMemberTests-1806793813 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097" returned: 0 in 0.658s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:55:42 devstack cinder-volume[87444]: DEBUG cinder.manager [None req-2640e255-7f86-456c-a82c-6dca69c93c85 tempest-ProjectMemberTests-1806793813 None] Notifying Schedulers of capabilities ... {{(pid=87444) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 04:55:42 devstack cinder-volume[87444]: INFO cinder.volume.manager [None req-2640e255-7f86-456c-a82c-6dca69c93c85 tempest-ProjectMemberTests-1806793813 None] Deleted volume successfully. Jul 10 04:55:42 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-2640e255-7f86-456c-a82c-6dca69c93c85 tempest-ProjectMemberTests-1806793813 None] Lock "cinder-c2e68c98-4ac0-4e6d-b003-4cd9576479fb-delete_volume" released by "delete_volume" :: held 2.347s {{(pid=87444) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 04:55:42 devstack cinder-volume[87444]: DEBUG cinder.volume.flows.manager.create_volume [None req-47e06d68-7164-4b65-b869-e34442e24abf tempest-ProjectMemberTests-1806793813 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87444) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 04:55:42 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-47e06d68-7164-4b65-b869-e34442e24abf tempest-ProjectMemberTests-1806793813 None] Flow 'volume_create_manager' (8ce22fec-e2e2-4a05-9733-1a0e89c931d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 04:55:42 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-47e06d68-7164-4b65-b869-e34442e24abf tempest-ProjectMemberTests-1806793813 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (25374e93-efb5-45db-a131-ec927bf240a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:55:42 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-47e06d68-7164-4b65-b869-e34442e24abf tempest-ProjectMemberTests-1806793813 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (25374e93-efb5-45db-a131-ec927bf240a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T02:55:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1085589910',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f0f3cd59-d91a-46a6-9961-65d4af7d9353,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cadbf6455bcb4ed48f08a3c15f1d84e3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T02:55:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T02:55:43Z,use_quota=True,user_id='2aceae1efa264e87bd2696a5a256f622',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(317e369e-1e06-434d-ae95-a335f0e6c903),volume_type_id=317e369e-1e06-434d-ae95-a335f0e6c903)' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:55:42 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-47e06d68-7164-4b65-b869-e34442e24abf tempest-ProjectMemberTests-1806793813 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (09ada474-bdd7-4c72-9f7e-1d3978904b4b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:55:42 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-47e06d68-7164-4b65-b869-e34442e24abf tempest-ProjectMemberTests-1806793813 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (09ada474-bdd7-4c72-9f7e-1d3978904b4b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:55:42 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-47e06d68-7164-4b65-b869-e34442e24abf tempest-ProjectMemberTests-1806793813 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1d527aab-8543-4664-ab63-2328143294f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:55:42 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-47e06d68-7164-4b65-b869-e34442e24abf tempest-ProjectMemberTests-1806793813 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1d527aab-8543-4664-ab63-2328143294f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f0f3cd59-d91a-46a6-9961-65d4af7d9353', 'volume_name': 'volume-f0f3cd59-d91a-46a6-9961-65d4af7d9353', 'volume_size': 1}' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:55:42 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-47e06d68-7164-4b65-b869-e34442e24abf tempest-ProjectMemberTests-1806793813 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (735eaece-9203-4012-8c31-c19717009bd2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:55:42 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-47e06d68-7164-4b65-b869-e34442e24abf tempest-ProjectMemberTests-1806793813 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (735eaece-9203-4012-8c31-c19717009bd2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:55:42 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-47e06d68-7164-4b65-b869-e34442e24abf tempest-ProjectMemberTests-1806793813 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7c366203-1e34-4241-bd70-371d6318cb9c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:55:42 devstack cinder-volume[87444]: INFO cinder.volume.flows.manager.create_volume [None req-47e06d68-7164-4b65-b869-e34442e24abf tempest-ProjectMemberTests-1806793813 None] Volume f0f3cd59-d91a-46a6-9961-65d4af7d9353: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f0f3cd59-d91a-46a6-9961-65d4af7d9353', 'volume_size': 1} Jul 10 04:55:42 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-47e06d68-7164-4b65-b869-e34442e24abf tempest-ProjectMemberTests-1806793813 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 04:55:42 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-47e06d68-7164-4b65-b869-e34442e24abf tempest-ProjectMemberTests-1806793813 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 04:55:42 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-47e06d68-7164-4b65-b869-e34442e24abf tempest-ProjectMemberTests-1806793813 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T02:55:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1085589910',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f0f3cd59-d91a-46a6-9961-65d4af7d9353,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cadbf6455bcb4ed48f08a3c15f1d84e3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T02:55:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T02:55:43Z,use_quota=True,user_id='2aceae1efa264e87bd2696a5a256f622',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(317e369e-1e06-434d-ae95-a335f0e6c903),volume_type_id=317e369e-1e06-434d-ae95-a335f0e6c903)}" {{(pid=87444) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 04:55:42 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.remotefs [None req-47e06d68-7164-4b65-b869-e34442e24abf tempest-ProjectMemberTests-1806793813 None] Creating volume f0f3cd59-d91a-46a6-9961-65d4af7d9353 {{(pid=87444) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 04:55:42 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-47e06d68-7164-4b65-b869-e34442e24abf tempest-ProjectMemberTests-1806793813 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 04:55:42 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-47e06d68-7164-4b65-b869-e34442e24abf tempest-ProjectMemberTests-1806793813 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 04:55:42 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-47e06d68-7164-4b65-b869-e34442e24abf tempest-ProjectMemberTests-1806793813 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922': None} {{(pid=87444) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 04:55:42 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-47e06d68-7164-4b65-b869-e34442e24abf tempest-ProjectMemberTests-1806793813 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922'] {{(pid=87444) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 04:55:42 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-47e06d68-7164-4b65-b869-e34442e24abf tempest-ProjectMemberTests-1806793813 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 04:55:42 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-47e06d68-7164-4b65-b869-e34442e24abf tempest-ProjectMemberTests-1806793813 None] Selected osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922 as target Quobyte volume. {{(pid=87444) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 04:55:42 devstack cinder-volume[87444]: INFO cinder.volume.drivers.remotefs [None req-47e06d68-7164-4b65-b869-e34442e24abf tempest-ProjectMemberTests-1806793813 None] casted to osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922 Jul 10 04:55:42 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-47e06d68-7164-4b65-b869-e34442e24abf tempest-ProjectMemberTests-1806793813 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-f0f3cd59-d91a-46a6-9961-65d4af7d9353 1073741824 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:55:42 devstack sudo[107002]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-f0f3cd59-d91a-46a6-9961-65d4af7d9353 1073741824 Jul 10 04:55:42 devstack sudo[107002]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:55:43 devstack sudo[107002]: pam_unix(sudo:session): session closed for user root Jul 10 04:55:43 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-47e06d68-7164-4b65-b869-e34442e24abf tempest-ProjectMemberTests-1806793813 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-f0f3cd59-d91a-46a6-9961-65d4af7d9353 1073741824" returned: 0 in 0.871s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:55:43 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-47e06d68-7164-4b65-b869-e34442e24abf tempest-ProjectMemberTests-1806793813 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-f0f3cd59-d91a-46a6-9961-65d4af7d9353 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:55:43 devstack sudo[107009]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-f0f3cd59-d91a-46a6-9961-65d4af7d9353 Jul 10 04:55:43 devstack sudo[107009]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:55:44 devstack sudo[107009]: pam_unix(sudo:session): session closed for user root Jul 10 04:55:44 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-47e06d68-7164-4b65-b869-e34442e24abf tempest-ProjectMemberTests-1806793813 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-f0f3cd59-d91a-46a6-9961-65d4af7d9353" returned: 0 in 0.636s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:55:44 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-47e06d68-7164-4b65-b869-e34442e24abf tempest-ProjectMemberTests-1806793813 None] <== create_volume: return (1545ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922'} {{(pid=87444) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 04:55:44 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-47e06d68-7164-4b65-b869-e34442e24abf tempest-ProjectMemberTests-1806793813 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.547s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 04:55:44 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-47e06d68-7164-4b65-b869-e34442e24abf tempest-ProjectMemberTests-1806793813 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7c366203-1e34-4241-bd70-371d6318cb9c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f0f3cd59-d91a-46a6-9961-65d4af7d9353', 'volume_size': 1}' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:55:44 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-47e06d68-7164-4b65-b869-e34442e24abf tempest-ProjectMemberTests-1806793813 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (072f2aa6-5b0d-4518-bae4-a586fb6aa819) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:55:44 devstack cinder-volume[87444]: INFO cinder.volume.flows.manager.create_volume [None req-47e06d68-7164-4b65-b869-e34442e24abf tempest-ProjectMemberTests-1806793813 None] Volume volume-f0f3cd59-d91a-46a6-9961-65d4af7d9353 (f0f3cd59-d91a-46a6-9961-65d4af7d9353): created successfully Jul 10 04:55:44 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-47e06d68-7164-4b65-b869-e34442e24abf tempest-ProjectMemberTests-1806793813 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (072f2aa6-5b0d-4518-bae4-a586fb6aa819) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:55:44 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-47e06d68-7164-4b65-b869-e34442e24abf tempest-ProjectMemberTests-1806793813 None] Flow 'volume_create_manager' (8ce22fec-e2e2-4a05-9733-1a0e89c931d1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87444) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 04:55:44 devstack cinder-volume[87444]: INFO cinder.volume.manager [None req-47e06d68-7164-4b65-b869-e34442e24abf tempest-ProjectMemberTests-1806793813 None] Created volume successfully. Jul 10 04:55:45 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-b315078b-de77-4dd9-a61b-cc36450ffd05 tempest-ProjectMemberTests-1806793813 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 04:55:45 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-b315078b-de77-4dd9-a61b-cc36450ffd05 tempest-ProjectMemberTests-1806793813 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 04:55:45 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.remotefs [None req-b315078b-de77-4dd9-a61b-cc36450ffd05 tempest-ProjectMemberTests-1806793813 None] Creating offline snapshot 38a9c340-7c96-4ae4-ac93-409d3c9cf3be of volume f0f3cd59-d91a-46a6-9961-65d4af7d9353 {{(pid=87444) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 10 04:55:45 devstack cinder-volume[87444]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f250731-be33-4519-9443-34c77bb6d36a]: (4, 'qcow2') {{(pid=88499) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 04:55:45 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-b315078b-de77-4dd9-a61b-cc36450ffd05 tempest-ProjectMemberTests-1806793813 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-f0f3cd59-d91a-46a6-9961-65d4af7d9353 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:55:45 devstack sudo[107012]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-f0f3cd59-d91a-46a6-9961-65d4af7d9353 Jul 10 04:55:45 devstack sudo[107012]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:55:45 devstack sudo[107012]: pam_unix(sudo:session): session closed for user root Jul 10 04:55:45 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-b315078b-de77-4dd9-a61b-cc36450ffd05 tempest-ProjectMemberTests-1806793813 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-f0f3cd59-d91a-46a6-9961-65d4af7d9353" returned: 0 in 0.794s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:55:45 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-b315078b-de77-4dd9-a61b-cc36450ffd05 tempest-ProjectMemberTests-1806793813 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-f0f3cd59-d91a-46a6-9961-65d4af7d9353,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-f0f3cd59-d91a-46a6-9961-65d4af7d9353.38a9c340-7c96-4ae4-ac93-409d3c9cf3be 1G {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:55:45 devstack sudo[107017]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-f0f3cd59-d91a-46a6-9961-65d4af7d9353,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-f0f3cd59-d91a-46a6-9961-65d4af7d9353.38a9c340-7c96-4ae4-ac93-409d3c9cf3be 1G Jul 10 04:55:45 devstack sudo[107017]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:55:46 devstack sudo[107017]: pam_unix(sudo:session): session closed for user root Jul 10 04:55:46 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-b315078b-de77-4dd9-a61b-cc36450ffd05 tempest-ProjectMemberTests-1806793813 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-f0f3cd59-d91a-46a6-9961-65d4af7d9353,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-f0f3cd59-d91a-46a6-9961-65d4af7d9353.38a9c340-7c96-4ae4-ac93-409d3c9cf3be 1G" returned: 0 in 0.841s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:55:46 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-b315078b-de77-4dd9-a61b-cc36450ffd05 tempest-ProjectMemberTests-1806793813 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f0f3cd59-d91a-46a6-9961-65d4af7d9353 -F qcow2 /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-f0f3cd59-d91a-46a6-9961-65d4af7d9353.38a9c340-7c96-4ae4-ac93-409d3c9cf3be {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:55:46 devstack sudo[107026]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f0f3cd59-d91a-46a6-9961-65d4af7d9353 -F qcow2 /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-f0f3cd59-d91a-46a6-9961-65d4af7d9353.38a9c340-7c96-4ae4-ac93-409d3c9cf3be Jul 10 04:55:46 devstack sudo[107026]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:55:47 devstack sudo[107026]: pam_unix(sudo:session): session closed for user root Jul 10 04:55:47 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-b315078b-de77-4dd9-a61b-cc36450ffd05 tempest-ProjectMemberTests-1806793813 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f0f3cd59-d91a-46a6-9961-65d4af7d9353 -F qcow2 /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-f0f3cd59-d91a-46a6-9961-65d4af7d9353.38a9c340-7c96-4ae4-ac93-409d3c9cf3be" returned: 0 in 0.716s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:55:47 devstack cinder-volume[87444]: WARNING cinder.volume.drivers.remotefs [None req-b315078b-de77-4dd9-a61b-cc36450ffd05 tempest-ProjectMemberTests-1806793813 None] /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-f0f3cd59-d91a-46a6-9961-65d4af7d9353.38a9c340-7c96-4ae4-ac93-409d3c9cf3be is being set with open permissions: ugo+rw Jul 10 04:55:47 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-b315078b-de77-4dd9-a61b-cc36450ffd05 tempest-ProjectMemberTests-1806793813 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-f0f3cd59-d91a-46a6-9961-65d4af7d9353.38a9c340-7c96-4ae4-ac93-409d3c9cf3be {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:55:47 devstack sudo[107034]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-f0f3cd59-d91a-46a6-9961-65d4af7d9353.38a9c340-7c96-4ae4-ac93-409d3c9cf3be Jul 10 04:55:47 devstack sudo[107034]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:55:48 devstack sudo[107034]: pam_unix(sudo:session): session closed for user root Jul 10 04:55:48 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-b315078b-de77-4dd9-a61b-cc36450ffd05 tempest-ProjectMemberTests-1806793813 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-f0f3cd59-d91a-46a6-9961-65d4af7d9353.38a9c340-7c96-4ae4-ac93-409d3c9cf3be" returned: 0 in 0.700s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:55:48 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-b315078b-de77-4dd9-a61b-cc36450ffd05 tempest-ProjectMemberTests-1806793813 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-f0f3cd59-d91a-46a6-9961-65d4af7d9353.info {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:55:48 devstack sudo[107037]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-f0f3cd59-d91a-46a6-9961-65d4af7d9353.info Jul 10 04:55:48 devstack sudo[107037]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:55:48 devstack sudo[107037]: pam_unix(sudo:session): session closed for user root Jul 10 04:55:48 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-b315078b-de77-4dd9-a61b-cc36450ffd05 tempest-ProjectMemberTests-1806793813 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-f0f3cd59-d91a-46a6-9961-65d4af7d9353.info" returned: 0 in 0.715s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:55:48 devstack cinder-volume[87444]: WARNING cinder.volume.drivers.remotefs [None req-b315078b-de77-4dd9-a61b-cc36450ffd05 tempest-ProjectMemberTests-1806793813 None] /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-f0f3cd59-d91a-46a6-9961-65d4af7d9353.info is being set with open permissions: ugo+rw Jul 10 04:55:48 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-b315078b-de77-4dd9-a61b-cc36450ffd05 tempest-ProjectMemberTests-1806793813 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-f0f3cd59-d91a-46a6-9961-65d4af7d9353.info {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:55:48 devstack sudo[107041]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-f0f3cd59-d91a-46a6-9961-65d4af7d9353.info Jul 10 04:55:48 devstack sudo[107041]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:55:49 devstack sudo[107041]: pam_unix(sudo:session): session closed for user root Jul 10 04:55:49 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-b315078b-de77-4dd9-a61b-cc36450ffd05 tempest-ProjectMemberTests-1806793813 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-f0f3cd59-d91a-46a6-9961-65d4af7d9353.info" returned: 0 in 0.707s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:55:49 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-b315078b-de77-4dd9-a61b-cc36450ffd05 tempest-ProjectMemberTests-1806793813 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.568s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 04:55:49 devstack cinder-volume[87444]: INFO cinder.volume.manager [None req-b315078b-de77-4dd9-a61b-cc36450ffd05 tempest-ProjectMemberTests-1806793813 None] Create snapshot completed successfully Jul 10 04:55:50 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-026dd4be-d8ff-4e4b-8c1c-67d48275e1f1 tempest-ProjectMemberTests-1806793813 None] Acquiring lock "cinder-38a9c340-7c96-4ae4-ac93-409d3c9cf3be-delete_snapshot" by "delete_snapshot" {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 04:55:50 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-026dd4be-d8ff-4e4b-8c1c-67d48275e1f1 tempest-ProjectMemberTests-1806793813 None] Lock "cinder-38a9c340-7c96-4ae4-ac93-409d3c9cf3be-delete_snapshot" acquired by "delete_snapshot" :: waited 0.020s {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 04:55:50 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-026dd4be-d8ff-4e4b-8c1c-67d48275e1f1 tempest-ProjectMemberTests-1806793813 None] Acquiring lock "cinder-quobyte-f0f3cd59-d91a-46a6-9961-65d4af7d9353" by "delete_snapshot" {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 04:55:50 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-026dd4be-d8ff-4e4b-8c1c-67d48275e1f1 tempest-ProjectMemberTests-1806793813 None] Lock "cinder-quobyte-f0f3cd59-d91a-46a6-9961-65d4af7d9353" acquired by "delete_snapshot" :: waited 0.019s {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 04:55:50 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-026dd4be-d8ff-4e4b-8c1c-67d48275e1f1 tempest-ProjectMemberTests-1806793813 None] Acquiring lock "cinder-quobyte-38a9c340-7c96-4ae4-ac93-409d3c9cf3be" by "_delete_snapshot" {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 04:55:50 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-026dd4be-d8ff-4e4b-8c1c-67d48275e1f1 tempest-ProjectMemberTests-1806793813 None] Lock "cinder-quobyte-38a9c340-7c96-4ae4-ac93-409d3c9cf3be" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 04:55:50 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.remotefs [None req-026dd4be-d8ff-4e4b-8c1c-67d48275e1f1 tempest-ProjectMemberTests-1806793813 None] Deleting offline snapshot 38a9c340-7c96-4ae4-ac93-409d3c9cf3be of volume f0f3cd59-d91a-46a6-9961-65d4af7d9353 {{(pid=87444) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 10 04:55:50 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.remotefs [None req-026dd4be-d8ff-4e4b-8c1c-67d48275e1f1 tempest-ProjectMemberTests-1806793813 None] snapshot_file for this snap is: volume-f0f3cd59-d91a-46a6-9961-65d4af7d9353.38a9c340-7c96-4ae4-ac93-409d3c9cf3be {{(pid=87444) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 10 04:55:50 devstack cinder-volume[87444]: DEBUG oslo.privsep.daemon [-] privsep: reply[33bac896-8b51-4ae0-ac82-7d634508c2d5]: (4, 'qcow2') {{(pid=88499) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 04:55:50 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-026dd4be-d8ff-4e4b-8c1c-67d48275e1f1 tempest-ProjectMemberTests-1806793813 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-f0f3cd59-d91a-46a6-9961-65d4af7d9353.38a9c340-7c96-4ae4-ac93-409d3c9cf3be {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:55:50 devstack sudo[107044]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-f0f3cd59-d91a-46a6-9961-65d4af7d9353.38a9c340-7c96-4ae4-ac93-409d3c9cf3be Jul 10 04:55:50 devstack sudo[107044]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:55:51 devstack sudo[107044]: pam_unix(sudo:session): session closed for user root Jul 10 04:55:51 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-026dd4be-d8ff-4e4b-8c1c-67d48275e1f1 tempest-ProjectMemberTests-1806793813 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-f0f3cd59-d91a-46a6-9961-65d4af7d9353.38a9c340-7c96-4ae4-ac93-409d3c9cf3be" returned: 0 in 0.812s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:55:51 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.remotefs [None req-026dd4be-d8ff-4e4b-8c1c-67d48275e1f1 tempest-ProjectMemberTests-1806793813 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f0f3cd59-d91a-46a6-9961-65d4af7d9353(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87444) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 10 04:55:51 devstack cinder-volume[87444]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d7bfa22-772b-4669-9ccb-627461a5d94d]: (4, 'qcow2') {{(pid=88499) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 04:55:51 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-026dd4be-d8ff-4e4b-8c1c-67d48275e1f1 tempest-ProjectMemberTests-1806793813 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-f0f3cd59-d91a-46a6-9961-65d4af7d9353 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:55:51 devstack sudo[107049]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-f0f3cd59-d91a-46a6-9961-65d4af7d9353 Jul 10 04:55:51 devstack sudo[107049]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:55:52 devstack sudo[107049]: pam_unix(sudo:session): session closed for user root Jul 10 04:55:52 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-026dd4be-d8ff-4e4b-8c1c-67d48275e1f1 tempest-ProjectMemberTests-1806793813 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-f0f3cd59-d91a-46a6-9961-65d4af7d9353" returned: 0 in 0.841s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:55:52 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-026dd4be-d8ff-4e4b-8c1c-67d48275e1f1 tempest-ProjectMemberTests-1806793813 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-f0f3cd59-d91a-46a6-9961-65d4af7d9353.38a9c340-7c96-4ae4-ac93-409d3c9cf3be {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:55:52 devstack sudo[107054]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-f0f3cd59-d91a-46a6-9961-65d4af7d9353.38a9c340-7c96-4ae4-ac93-409d3c9cf3be Jul 10 04:55:52 devstack sudo[107054]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:55:52 devstack sudo[107054]: pam_unix(sudo:session): session closed for user root Jul 10 04:55:52 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-026dd4be-d8ff-4e4b-8c1c-67d48275e1f1 tempest-ProjectMemberTests-1806793813 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-f0f3cd59-d91a-46a6-9961-65d4af7d9353.38a9c340-7c96-4ae4-ac93-409d3c9cf3be" returned: 0 in 0.730s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:55:52 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-026dd4be-d8ff-4e4b-8c1c-67d48275e1f1 tempest-ProjectMemberTests-1806793813 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-f0f3cd59-d91a-46a6-9961-65d4af7d9353.38a9c340-7c96-4ae4-ac93-409d3c9cf3be {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:55:52 devstack sudo[107059]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-f0f3cd59-d91a-46a6-9961-65d4af7d9353.38a9c340-7c96-4ae4-ac93-409d3c9cf3be Jul 10 04:55:52 devstack sudo[107059]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:55:53 devstack sudo[107059]: pam_unix(sudo:session): session closed for user root Jul 10 04:55:53 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-026dd4be-d8ff-4e4b-8c1c-67d48275e1f1 tempest-ProjectMemberTests-1806793813 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-f0f3cd59-d91a-46a6-9961-65d4af7d9353.38a9c340-7c96-4ae4-ac93-409d3c9cf3be" returned: 0 in 0.747s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:55:53 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-026dd4be-d8ff-4e4b-8c1c-67d48275e1f1 tempest-ProjectMemberTests-1806793813 None] Lock "cinder-quobyte-38a9c340-7c96-4ae4-ac93-409d3c9cf3be" released by "_delete_snapshot" :: held 3.244s {{(pid=87444) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 04:55:53 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-026dd4be-d8ff-4e4b-8c1c-67d48275e1f1 tempest-ProjectMemberTests-1806793813 None] Lock "cinder-quobyte-f0f3cd59-d91a-46a6-9961-65d4af7d9353" released by "delete_snapshot" :: held 3.274s {{(pid=87444) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 04:55:53 devstack cinder-volume[87444]: DEBUG cinder.quota [None req-026dd4be-d8ff-4e4b-8c1c-67d48275e1f1 tempest-ProjectMemberTests-1806793813 None] Created reservations ['2ef18f56-bd42-4f28-93d2-63ac56c89ed0', '5f238766-7451-455a-9509-440e7727a8b9', 'd5998953-0f29-4bea-9465-0cad34bf27e3', '13bdc03e-ae25-434c-8e6c-05102ec60617'] {{(pid=87444) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 04:55:53 devstack cinder-volume[87444]: INFO cinder.volume.manager [None req-026dd4be-d8ff-4e4b-8c1c-67d48275e1f1 tempest-ProjectMemberTests-1806793813 None] Delete snapshot completed successfully. Jul 10 04:55:53 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-026dd4be-d8ff-4e4b-8c1c-67d48275e1f1 tempest-ProjectMemberTests-1806793813 None] Lock "cinder-38a9c340-7c96-4ae4-ac93-409d3c9cf3be-delete_snapshot" released by "delete_snapshot" :: held 3.425s {{(pid=87444) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 04:55:54 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-2208e008-8385-42ab-8f44-fd7ee869c91a tempest-ProjectMemberTests-1806793813 None] Acquiring lock "cinder-f0f3cd59-d91a-46a6-9961-65d4af7d9353-delete_volume" by "delete_volume" {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 04:55:54 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-2208e008-8385-42ab-8f44-fd7ee869c91a tempest-ProjectMemberTests-1806793813 None] Lock "cinder-f0f3cd59-d91a-46a6-9961-65d4af7d9353-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 04:55:54 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-2208e008-8385-42ab-8f44-fd7ee869c91a tempest-ProjectMemberTests-1806793813 None] Acquiring lock "cinder-quobyte-f0f3cd59-d91a-46a6-9961-65d4af7d9353" by "delete_volume" {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 04:55:54 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-2208e008-8385-42ab-8f44-fd7ee869c91a tempest-ProjectMemberTests-1806793813 None] Lock "cinder-quobyte-f0f3cd59-d91a-46a6-9961-65d4af7d9353" acquired by "delete_volume" :: waited 0.017s {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 04:55:54 devstack cinder-volume[87444]: DEBUG oslo.privsep.daemon [-] privsep: reply[e831f36a-dcf9-4a7e-a807-5752d1988c6b]: (4, 'qcow2') {{(pid=88499) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 04:55:54 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-2208e008-8385-42ab-8f44-fd7ee869c91a tempest-ProjectMemberTests-1806793813 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-f0f3cd59-d91a-46a6-9961-65d4af7d9353 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:55:54 devstack sudo[107063]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-f0f3cd59-d91a-46a6-9961-65d4af7d9353 Jul 10 04:55:54 devstack sudo[107063]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:55:55 devstack sudo[107063]: pam_unix(sudo:session): session closed for user root Jul 10 04:55:55 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-2208e008-8385-42ab-8f44-fd7ee869c91a tempest-ProjectMemberTests-1806793813 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-f0f3cd59-d91a-46a6-9961-65d4af7d9353" returned: 0 in 0.787s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:55:55 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-2208e008-8385-42ab-8f44-fd7ee869c91a tempest-ProjectMemberTests-1806793813 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-f0f3cd59-d91a-46a6-9961-65d4af7d9353 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:55:55 devstack sudo[107069]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-f0f3cd59-d91a-46a6-9961-65d4af7d9353 Jul 10 04:55:55 devstack sudo[107069]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:55:56 devstack sudo[107069]: pam_unix(sudo:session): session closed for user root Jul 10 04:55:56 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-2208e008-8385-42ab-8f44-fd7ee869c91a tempest-ProjectMemberTests-1806793813 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-f0f3cd59-d91a-46a6-9961-65d4af7d9353" returned: 0 in 0.691s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:55:56 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-2208e008-8385-42ab-8f44-fd7ee869c91a tempest-ProjectMemberTests-1806793813 None] Lock "cinder-quobyte-f0f3cd59-d91a-46a6-9961-65d4af7d9353" released by "delete_volume" :: held 1.552s {{(pid=87444) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 04:55:56 devstack cinder-volume[87444]: DEBUG cinder.quota [None req-2208e008-8385-42ab-8f44-fd7ee869c91a tempest-ProjectMemberTests-1806793813 None] Created reservations ['d39a5d32-e008-4705-a505-4b16c1f5bb5e', 'aeca0842-5ab2-4904-8944-f1fd4694eb04', 'daad5b93-5d14-42cd-a9ba-c8d7166450c7', 'f718a1c5-3d85-4f84-8686-3502e108e004'] {{(pid=87444) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 04:55:56 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-2208e008-8385-42ab-8f44-fd7ee869c91a tempest-ProjectMemberTests-1806793813 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 04:55:56 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-2208e008-8385-42ab-8f44-fd7ee869c91a tempest-ProjectMemberTests-1806793813 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 04:55:56 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-2208e008-8385-42ab-8f44-fd7ee869c91a tempest-ProjectMemberTests-1806793813 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922': None} {{(pid=87444) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 04:55:56 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-2208e008-8385-42ab-8f44-fd7ee869c91a tempest-ProjectMemberTests-1806793813 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922'] {{(pid=87444) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 04:55:56 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-2208e008-8385-42ab-8f44-fd7ee869c91a tempest-ProjectMemberTests-1806793813 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 04:55:56 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-2208e008-8385-42ab-8f44-fd7ee869c91a tempest-ProjectMemberTests-1806793813 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:55:56 devstack sudo[107072]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097 Jul 10 04:55:56 devstack sudo[107072]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:55:56 devstack sudo[107072]: pam_unix(sudo:session): session closed for user root Jul 10 04:55:56 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-2208e008-8385-42ab-8f44-fd7ee869c91a tempest-ProjectMemberTests-1806793813 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097" returned: 0 in 0.706s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:55:56 devstack cinder-volume[87444]: DEBUG cinder.manager [None req-2208e008-8385-42ab-8f44-fd7ee869c91a tempest-ProjectMemberTests-1806793813 None] Notifying Schedulers of capabilities ... {{(pid=87444) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 04:55:56 devstack cinder-volume[87444]: INFO cinder.volume.manager [None req-2208e008-8385-42ab-8f44-fd7ee869c91a tempest-ProjectMemberTests-1806793813 None] Deleted volume successfully. Jul 10 04:55:57 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-2208e008-8385-42ab-8f44-fd7ee869c91a tempest-ProjectMemberTests-1806793813 None] Lock "cinder-f0f3cd59-d91a-46a6-9961-65d4af7d9353-delete_volume" released by "delete_volume" :: held 2.473s {{(pid=87444) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 04:55:57 devstack cinder-volume[87444]: DEBUG cinder.volume.flows.manager.create_volume [None req-8ed57119-d530-4498-92d2-53baec591db7 tempest-ProjectMemberTests-1806793813 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87444) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 04:55:57 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-8ed57119-d530-4498-92d2-53baec591db7 tempest-ProjectMemberTests-1806793813 None] Flow 'volume_create_manager' (718b0cee-8780-4fd6-a0cd-7a3401f0c031) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 04:55:57 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-8ed57119-d530-4498-92d2-53baec591db7 tempest-ProjectMemberTests-1806793813 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f89ae77e-0260-48b9-ba42-bdae0ae35ffb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:55:57 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-8ed57119-d530-4498-92d2-53baec591db7 tempest-ProjectMemberTests-1806793813 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f89ae77e-0260-48b9-ba42-bdae0ae35ffb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T02:55:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-234840728',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4f1fcef9-0bd8-43ae-a232-289aba50dfbf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cadbf6455bcb4ed48f08a3c15f1d84e3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T02:55:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T02:55:57Z,use_quota=True,user_id='2aceae1efa264e87bd2696a5a256f622',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(317e369e-1e06-434d-ae95-a335f0e6c903),volume_type_id=317e369e-1e06-434d-ae95-a335f0e6c903)' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:55:57 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-8ed57119-d530-4498-92d2-53baec591db7 tempest-ProjectMemberTests-1806793813 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (721ee125-99ac-4c62-b523-0f1f137f72a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:55:57 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-8ed57119-d530-4498-92d2-53baec591db7 tempest-ProjectMemberTests-1806793813 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (721ee125-99ac-4c62-b523-0f1f137f72a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:55:57 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-8ed57119-d530-4498-92d2-53baec591db7 tempest-ProjectMemberTests-1806793813 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8501d590-c055-4c81-812b-0a8066559502) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:55:57 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-8ed57119-d530-4498-92d2-53baec591db7 tempest-ProjectMemberTests-1806793813 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8501d590-c055-4c81-812b-0a8066559502) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4f1fcef9-0bd8-43ae-a232-289aba50dfbf', 'volume_name': 'volume-4f1fcef9-0bd8-43ae-a232-289aba50dfbf', 'volume_size': 1}' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:55:57 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-8ed57119-d530-4498-92d2-53baec591db7 tempest-ProjectMemberTests-1806793813 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7a3f0ded-9936-4e45-83f7-b26d7e403b6d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:55:57 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-8ed57119-d530-4498-92d2-53baec591db7 tempest-ProjectMemberTests-1806793813 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7a3f0ded-9936-4e45-83f7-b26d7e403b6d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:55:57 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-8ed57119-d530-4498-92d2-53baec591db7 tempest-ProjectMemberTests-1806793813 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8652728c-f958-43d6-aa07-13763f15200a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:55:57 devstack cinder-volume[87444]: INFO cinder.volume.flows.manager.create_volume [None req-8ed57119-d530-4498-92d2-53baec591db7 tempest-ProjectMemberTests-1806793813 None] Volume 4f1fcef9-0bd8-43ae-a232-289aba50dfbf: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4f1fcef9-0bd8-43ae-a232-289aba50dfbf', 'volume_size': 1} Jul 10 04:55:57 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-8ed57119-d530-4498-92d2-53baec591db7 tempest-ProjectMemberTests-1806793813 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 04:55:57 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-8ed57119-d530-4498-92d2-53baec591db7 tempest-ProjectMemberTests-1806793813 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 04:55:57 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-8ed57119-d530-4498-92d2-53baec591db7 tempest-ProjectMemberTests-1806793813 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T02:55:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-234840728',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4f1fcef9-0bd8-43ae-a232-289aba50dfbf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cadbf6455bcb4ed48f08a3c15f1d84e3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T02:55:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T02:55:57Z,use_quota=True,user_id='2aceae1efa264e87bd2696a5a256f622',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(317e369e-1e06-434d-ae95-a335f0e6c903),volume_type_id=317e369e-1e06-434d-ae95-a335f0e6c903)}" {{(pid=87444) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 04:55:57 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.remotefs [None req-8ed57119-d530-4498-92d2-53baec591db7 tempest-ProjectMemberTests-1806793813 None] Creating volume 4f1fcef9-0bd8-43ae-a232-289aba50dfbf {{(pid=87444) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 04:55:57 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-8ed57119-d530-4498-92d2-53baec591db7 tempest-ProjectMemberTests-1806793813 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 04:55:57 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-8ed57119-d530-4498-92d2-53baec591db7 tempest-ProjectMemberTests-1806793813 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 04:55:57 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-8ed57119-d530-4498-92d2-53baec591db7 tempest-ProjectMemberTests-1806793813 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922': None} {{(pid=87444) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 04:55:57 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-8ed57119-d530-4498-92d2-53baec591db7 tempest-ProjectMemberTests-1806793813 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922'] {{(pid=87444) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 04:55:57 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-8ed57119-d530-4498-92d2-53baec591db7 tempest-ProjectMemberTests-1806793813 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 04:55:57 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-8ed57119-d530-4498-92d2-53baec591db7 tempest-ProjectMemberTests-1806793813 None] Selected osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922 as target Quobyte volume. {{(pid=87444) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 04:55:57 devstack cinder-volume[87444]: INFO cinder.volume.drivers.remotefs [None req-8ed57119-d530-4498-92d2-53baec591db7 tempest-ProjectMemberTests-1806793813 None] casted to osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922 Jul 10 04:55:57 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-8ed57119-d530-4498-92d2-53baec591db7 tempest-ProjectMemberTests-1806793813 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-4f1fcef9-0bd8-43ae-a232-289aba50dfbf 1073741824 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:55:57 devstack sudo[107075]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-4f1fcef9-0bd8-43ae-a232-289aba50dfbf 1073741824 Jul 10 04:55:57 devstack sudo[107075]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:55:58 devstack sudo[107075]: pam_unix(sudo:session): session closed for user root Jul 10 04:55:58 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-8ed57119-d530-4498-92d2-53baec591db7 tempest-ProjectMemberTests-1806793813 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-4f1fcef9-0bd8-43ae-a232-289aba50dfbf 1073741824" returned: 0 in 0.843s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:55:58 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-8ed57119-d530-4498-92d2-53baec591db7 tempest-ProjectMemberTests-1806793813 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-4f1fcef9-0bd8-43ae-a232-289aba50dfbf {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:55:58 devstack sudo[107081]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-4f1fcef9-0bd8-43ae-a232-289aba50dfbf Jul 10 04:55:58 devstack sudo[107081]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:55:59 devstack sudo[107081]: pam_unix(sudo:session): session closed for user root Jul 10 04:55:59 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-8ed57119-d530-4498-92d2-53baec591db7 tempest-ProjectMemberTests-1806793813 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-4f1fcef9-0bd8-43ae-a232-289aba50dfbf" returned: 0 in 0.743s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:55:59 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-8ed57119-d530-4498-92d2-53baec591db7 tempest-ProjectMemberTests-1806793813 None] <== create_volume: return (1630ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922'} {{(pid=87444) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 04:55:59 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-8ed57119-d530-4498-92d2-53baec591db7 tempest-ProjectMemberTests-1806793813 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.632s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 04:55:59 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-8ed57119-d530-4498-92d2-53baec591db7 tempest-ProjectMemberTests-1806793813 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8652728c-f958-43d6-aa07-13763f15200a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4f1fcef9-0bd8-43ae-a232-289aba50dfbf', 'volume_size': 1}' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:55:59 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-8ed57119-d530-4498-92d2-53baec591db7 tempest-ProjectMemberTests-1806793813 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0538bb5d-4ba6-4473-ac52-fc50e8cffbe4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:55:59 devstack cinder-volume[87444]: INFO cinder.volume.flows.manager.create_volume [None req-8ed57119-d530-4498-92d2-53baec591db7 tempest-ProjectMemberTests-1806793813 None] Volume volume-4f1fcef9-0bd8-43ae-a232-289aba50dfbf (4f1fcef9-0bd8-43ae-a232-289aba50dfbf): created successfully Jul 10 04:55:59 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-8ed57119-d530-4498-92d2-53baec591db7 tempest-ProjectMemberTests-1806793813 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0538bb5d-4ba6-4473-ac52-fc50e8cffbe4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:55:59 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-8ed57119-d530-4498-92d2-53baec591db7 tempest-ProjectMemberTests-1806793813 None] Flow 'volume_create_manager' (718b0cee-8780-4fd6-a0cd-7a3401f0c031) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87444) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 04:55:59 devstack cinder-volume[87444]: INFO cinder.volume.manager [None req-8ed57119-d530-4498-92d2-53baec591db7 tempest-ProjectMemberTests-1806793813 None] Created volume successfully. Jul 10 04:55:59 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-ba7bf978-9dc0-46a8-97b1-551c44f9ddb1 tempest-ProjectMemberTests-1806793813 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 04:55:59 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-ba7bf978-9dc0-46a8-97b1-551c44f9ddb1 tempest-ProjectMemberTests-1806793813 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 04:55:59 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.remotefs [None req-ba7bf978-9dc0-46a8-97b1-551c44f9ddb1 tempest-ProjectMemberTests-1806793813 None] Creating offline snapshot a738854a-31a3-48a8-87e1-8d4336d0fcd5 of volume 4f1fcef9-0bd8-43ae-a232-289aba50dfbf {{(pid=87444) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 10 04:55:59 devstack cinder-volume[87444]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1aa2025-d4f0-4fc8-bee1-90ebd85da4f8]: (4, 'qcow2') {{(pid=88499) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 04:55:59 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-ba7bf978-9dc0-46a8-97b1-551c44f9ddb1 tempest-ProjectMemberTests-1806793813 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-4f1fcef9-0bd8-43ae-a232-289aba50dfbf {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:55:59 devstack sudo[107084]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-4f1fcef9-0bd8-43ae-a232-289aba50dfbf Jul 10 04:55:59 devstack sudo[107084]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:56:00 devstack sudo[107084]: pam_unix(sudo:session): session closed for user root Jul 10 04:56:00 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-ba7bf978-9dc0-46a8-97b1-551c44f9ddb1 tempest-ProjectMemberTests-1806793813 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-4f1fcef9-0bd8-43ae-a232-289aba50dfbf" returned: 0 in 0.798s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:56:00 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-ba7bf978-9dc0-46a8-97b1-551c44f9ddb1 tempest-ProjectMemberTests-1806793813 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-4f1fcef9-0bd8-43ae-a232-289aba50dfbf,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-4f1fcef9-0bd8-43ae-a232-289aba50dfbf.a738854a-31a3-48a8-87e1-8d4336d0fcd5 1G {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:56:00 devstack sudo[107090]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-4f1fcef9-0bd8-43ae-a232-289aba50dfbf,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-4f1fcef9-0bd8-43ae-a232-289aba50dfbf.a738854a-31a3-48a8-87e1-8d4336d0fcd5 1G Jul 10 04:56:00 devstack sudo[107090]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:56:01 devstack sudo[107090]: pam_unix(sudo:session): session closed for user root Jul 10 04:56:01 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-ba7bf978-9dc0-46a8-97b1-551c44f9ddb1 tempest-ProjectMemberTests-1806793813 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-4f1fcef9-0bd8-43ae-a232-289aba50dfbf,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-4f1fcef9-0bd8-43ae-a232-289aba50dfbf.a738854a-31a3-48a8-87e1-8d4336d0fcd5 1G" returned: 0 in 0.864s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:56:01 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-ba7bf978-9dc0-46a8-97b1-551c44f9ddb1 tempest-ProjectMemberTests-1806793813 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4f1fcef9-0bd8-43ae-a232-289aba50dfbf -F qcow2 /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-4f1fcef9-0bd8-43ae-a232-289aba50dfbf.a738854a-31a3-48a8-87e1-8d4336d0fcd5 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:56:01 devstack sudo[107095]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4f1fcef9-0bd8-43ae-a232-289aba50dfbf -F qcow2 /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-4f1fcef9-0bd8-43ae-a232-289aba50dfbf.a738854a-31a3-48a8-87e1-8d4336d0fcd5 Jul 10 04:56:01 devstack sudo[107095]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:56:01 devstack sudo[107095]: pam_unix(sudo:session): session closed for user root Jul 10 04:56:01 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-ba7bf978-9dc0-46a8-97b1-551c44f9ddb1 tempest-ProjectMemberTests-1806793813 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4f1fcef9-0bd8-43ae-a232-289aba50dfbf -F qcow2 /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-4f1fcef9-0bd8-43ae-a232-289aba50dfbf.a738854a-31a3-48a8-87e1-8d4336d0fcd5" returned: 0 in 0.706s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:56:01 devstack cinder-volume[87444]: WARNING cinder.volume.drivers.remotefs [None req-ba7bf978-9dc0-46a8-97b1-551c44f9ddb1 tempest-ProjectMemberTests-1806793813 None] /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-4f1fcef9-0bd8-43ae-a232-289aba50dfbf.a738854a-31a3-48a8-87e1-8d4336d0fcd5 is being set with open permissions: ugo+rw Jul 10 04:56:01 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-ba7bf978-9dc0-46a8-97b1-551c44f9ddb1 tempest-ProjectMemberTests-1806793813 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-4f1fcef9-0bd8-43ae-a232-289aba50dfbf.a738854a-31a3-48a8-87e1-8d4336d0fcd5 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:56:01 devstack sudo[107102]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-4f1fcef9-0bd8-43ae-a232-289aba50dfbf.a738854a-31a3-48a8-87e1-8d4336d0fcd5 Jul 10 04:56:01 devstack sudo[107102]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:56:02 devstack sudo[107102]: pam_unix(sudo:session): session closed for user root Jul 10 04:56:02 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-ba7bf978-9dc0-46a8-97b1-551c44f9ddb1 tempest-ProjectMemberTests-1806793813 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-4f1fcef9-0bd8-43ae-a232-289aba50dfbf.a738854a-31a3-48a8-87e1-8d4336d0fcd5" returned: 0 in 0.734s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:56:02 devstack cinder-volume[87444]: DEBUG dbcounter [-] [87444] Writing DB stats cinder:UPDATE=121,cinder:SELECT=104,cinder:INSERT=37,cinder:DELETE=7 {{(pid=87444) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 10 04:56:02 devstack cinder-volume[87444]: DEBUG dbcounter [-] [87444] Writing DB stats cinder:SELECT=88,cinder:INSERT=32,cinder:UPDATE=129,cinder:DELETE=13 {{(pid=87444) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 10 04:56:02 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-ba7bf978-9dc0-46a8-97b1-551c44f9ddb1 tempest-ProjectMemberTests-1806793813 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-4f1fcef9-0bd8-43ae-a232-289aba50dfbf.info {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:56:02 devstack sudo[107107]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-4f1fcef9-0bd8-43ae-a232-289aba50dfbf.info Jul 10 04:56:02 devstack sudo[107107]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:56:03 devstack sudo[107107]: pam_unix(sudo:session): session closed for user root Jul 10 04:56:03 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-ba7bf978-9dc0-46a8-97b1-551c44f9ddb1 tempest-ProjectMemberTests-1806793813 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-4f1fcef9-0bd8-43ae-a232-289aba50dfbf.info" returned: 0 in 0.646s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:56:03 devstack cinder-volume[87444]: WARNING cinder.volume.drivers.remotefs [None req-ba7bf978-9dc0-46a8-97b1-551c44f9ddb1 tempest-ProjectMemberTests-1806793813 None] /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-4f1fcef9-0bd8-43ae-a232-289aba50dfbf.info is being set with open permissions: ugo+rw Jul 10 04:56:03 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-ba7bf978-9dc0-46a8-97b1-551c44f9ddb1 tempest-ProjectMemberTests-1806793813 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-4f1fcef9-0bd8-43ae-a232-289aba50dfbf.info {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:56:03 devstack sudo[107110]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-4f1fcef9-0bd8-43ae-a232-289aba50dfbf.info Jul 10 04:56:03 devstack sudo[107110]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:56:04 devstack sudo[107110]: pam_unix(sudo:session): session closed for user root Jul 10 04:56:04 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-ba7bf978-9dc0-46a8-97b1-551c44f9ddb1 tempest-ProjectMemberTests-1806793813 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-4f1fcef9-0bd8-43ae-a232-289aba50dfbf.info" returned: 0 in 0.702s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:56:04 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-ba7bf978-9dc0-46a8-97b1-551c44f9ddb1 tempest-ProjectMemberTests-1806793813 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.545s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 04:56:04 devstack cinder-volume[87444]: INFO cinder.volume.manager [None req-ba7bf978-9dc0-46a8-97b1-551c44f9ddb1 tempest-ProjectMemberTests-1806793813 None] Create snapshot completed successfully Jul 10 04:56:04 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-2d50641b-c8c5-43dd-8f3a-17e38b050268 tempest-ProjectMemberTests-1806793813 None] Acquiring lock "cinder-a738854a-31a3-48a8-87e1-8d4336d0fcd5-delete_snapshot" by "delete_snapshot" {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 04:56:04 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-2d50641b-c8c5-43dd-8f3a-17e38b050268 tempest-ProjectMemberTests-1806793813 None] Lock "cinder-a738854a-31a3-48a8-87e1-8d4336d0fcd5-delete_snapshot" acquired by "delete_snapshot" :: waited 0.025s {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 04:56:04 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-2d50641b-c8c5-43dd-8f3a-17e38b050268 tempest-ProjectMemberTests-1806793813 None] Acquiring lock "cinder-quobyte-4f1fcef9-0bd8-43ae-a232-289aba50dfbf" by "delete_snapshot" {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 04:56:04 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-2d50641b-c8c5-43dd-8f3a-17e38b050268 tempest-ProjectMemberTests-1806793813 None] Lock "cinder-quobyte-4f1fcef9-0bd8-43ae-a232-289aba50dfbf" acquired by "delete_snapshot" :: waited 0.022s {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 04:56:04 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-2d50641b-c8c5-43dd-8f3a-17e38b050268 tempest-ProjectMemberTests-1806793813 None] Acquiring lock "cinder-quobyte-a738854a-31a3-48a8-87e1-8d4336d0fcd5" by "_delete_snapshot" {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 04:56:04 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-2d50641b-c8c5-43dd-8f3a-17e38b050268 tempest-ProjectMemberTests-1806793813 None] Lock "cinder-quobyte-a738854a-31a3-48a8-87e1-8d4336d0fcd5" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 04:56:04 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.remotefs [None req-2d50641b-c8c5-43dd-8f3a-17e38b050268 tempest-ProjectMemberTests-1806793813 None] Deleting offline snapshot a738854a-31a3-48a8-87e1-8d4336d0fcd5 of volume 4f1fcef9-0bd8-43ae-a232-289aba50dfbf {{(pid=87444) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 10 04:56:04 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.remotefs [None req-2d50641b-c8c5-43dd-8f3a-17e38b050268 tempest-ProjectMemberTests-1806793813 None] snapshot_file for this snap is: volume-4f1fcef9-0bd8-43ae-a232-289aba50dfbf.a738854a-31a3-48a8-87e1-8d4336d0fcd5 {{(pid=87444) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 10 04:56:04 devstack cinder-volume[87444]: DEBUG oslo.privsep.daemon [-] privsep: reply[3fd84139-d1ae-4c8b-9e8e-553cfae1eabf]: (4, 'qcow2') {{(pid=88499) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 04:56:04 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-2d50641b-c8c5-43dd-8f3a-17e38b050268 tempest-ProjectMemberTests-1806793813 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-4f1fcef9-0bd8-43ae-a232-289aba50dfbf.a738854a-31a3-48a8-87e1-8d4336d0fcd5 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:56:05 devstack sudo[107114]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-4f1fcef9-0bd8-43ae-a232-289aba50dfbf.a738854a-31a3-48a8-87e1-8d4336d0fcd5 Jul 10 04:56:05 devstack sudo[107114]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:56:05 devstack sudo[107114]: pam_unix(sudo:session): session closed for user root Jul 10 04:56:05 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-2d50641b-c8c5-43dd-8f3a-17e38b050268 tempest-ProjectMemberTests-1806793813 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-4f1fcef9-0bd8-43ae-a232-289aba50dfbf.a738854a-31a3-48a8-87e1-8d4336d0fcd5" returned: 0 in 0.806s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:56:05 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.remotefs [None req-2d50641b-c8c5-43dd-8f3a-17e38b050268 tempest-ProjectMemberTests-1806793813 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4f1fcef9-0bd8-43ae-a232-289aba50dfbf(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87444) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 10 04:56:05 devstack cinder-volume[87444]: DEBUG oslo.privsep.daemon [-] privsep: reply[cca7c575-6b35-4a5f-aed7-61f83d8f0293]: (4, 'qcow2') {{(pid=88499) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 04:56:05 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-2d50641b-c8c5-43dd-8f3a-17e38b050268 tempest-ProjectMemberTests-1806793813 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-4f1fcef9-0bd8-43ae-a232-289aba50dfbf {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:56:05 devstack sudo[107120]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-4f1fcef9-0bd8-43ae-a232-289aba50dfbf Jul 10 04:56:05 devstack sudo[107120]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:56:06 devstack sudo[107120]: pam_unix(sudo:session): session closed for user root Jul 10 04:56:06 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-2d50641b-c8c5-43dd-8f3a-17e38b050268 tempest-ProjectMemberTests-1806793813 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-4f1fcef9-0bd8-43ae-a232-289aba50dfbf" returned: 0 in 0.823s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:56:06 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-2d50641b-c8c5-43dd-8f3a-17e38b050268 tempest-ProjectMemberTests-1806793813 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-4f1fcef9-0bd8-43ae-a232-289aba50dfbf.a738854a-31a3-48a8-87e1-8d4336d0fcd5 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:56:06 devstack sudo[107125]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-4f1fcef9-0bd8-43ae-a232-289aba50dfbf.a738854a-31a3-48a8-87e1-8d4336d0fcd5 Jul 10 04:56:06 devstack sudo[107125]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:56:07 devstack sudo[107125]: pam_unix(sudo:session): session closed for user root Jul 10 04:56:07 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-2d50641b-c8c5-43dd-8f3a-17e38b050268 tempest-ProjectMemberTests-1806793813 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-4f1fcef9-0bd8-43ae-a232-289aba50dfbf.a738854a-31a3-48a8-87e1-8d4336d0fcd5" returned: 0 in 0.794s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:56:07 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-2d50641b-c8c5-43dd-8f3a-17e38b050268 tempest-ProjectMemberTests-1806793813 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-4f1fcef9-0bd8-43ae-a232-289aba50dfbf.a738854a-31a3-48a8-87e1-8d4336d0fcd5 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:56:07 devstack sudo[107131]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-4f1fcef9-0bd8-43ae-a232-289aba50dfbf.a738854a-31a3-48a8-87e1-8d4336d0fcd5 Jul 10 04:56:07 devstack sudo[107131]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:56:08 devstack sudo[107131]: pam_unix(sudo:session): session closed for user root Jul 10 04:56:08 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-2d50641b-c8c5-43dd-8f3a-17e38b050268 tempest-ProjectMemberTests-1806793813 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-4f1fcef9-0bd8-43ae-a232-289aba50dfbf.a738854a-31a3-48a8-87e1-8d4336d0fcd5" returned: 0 in 0.678s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:56:08 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-2d50641b-c8c5-43dd-8f3a-17e38b050268 tempest-ProjectMemberTests-1806793813 None] Lock "cinder-quobyte-a738854a-31a3-48a8-87e1-8d4336d0fcd5" released by "_delete_snapshot" :: held 3.211s {{(pid=87444) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 04:56:08 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-2d50641b-c8c5-43dd-8f3a-17e38b050268 tempest-ProjectMemberTests-1806793813 None] Lock "cinder-quobyte-4f1fcef9-0bd8-43ae-a232-289aba50dfbf" released by "delete_snapshot" :: held 3.233s {{(pid=87444) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 04:56:08 devstack cinder-volume[87444]: DEBUG cinder.quota [None req-2d50641b-c8c5-43dd-8f3a-17e38b050268 tempest-ProjectMemberTests-1806793813 None] Created reservations ['196c643c-9860-41fe-a92a-610a7efad30b', '74bfdb5d-d276-48e1-add2-fed5b0fe3cb7', '3bedb579-c490-4ea4-8a5d-7975af72d98b', '7e392934-9304-4379-bea7-2376bca505ac'] {{(pid=87444) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 04:56:08 devstack cinder-volume[87444]: INFO cinder.volume.manager [None req-2d50641b-c8c5-43dd-8f3a-17e38b050268 tempest-ProjectMemberTests-1806793813 None] Delete snapshot completed successfully. Jul 10 04:56:08 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-2d50641b-c8c5-43dd-8f3a-17e38b050268 tempest-ProjectMemberTests-1806793813 None] Lock "cinder-a738854a-31a3-48a8-87e1-8d4336d0fcd5-delete_snapshot" released by "delete_snapshot" :: held 3.383s {{(pid=87444) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 04:56:09 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-fa67a444-93a0-4f81-a021-3042951a4eaa tempest-ProjectMemberTests-1806793813 None] Acquiring lock "cinder-4f1fcef9-0bd8-43ae-a232-289aba50dfbf-delete_volume" by "delete_volume" {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 04:56:09 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-fa67a444-93a0-4f81-a021-3042951a4eaa tempest-ProjectMemberTests-1806793813 None] Lock "cinder-4f1fcef9-0bd8-43ae-a232-289aba50dfbf-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 04:56:09 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-fa67a444-93a0-4f81-a021-3042951a4eaa tempest-ProjectMemberTests-1806793813 None] Acquiring lock "cinder-quobyte-4f1fcef9-0bd8-43ae-a232-289aba50dfbf" by "delete_volume" {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 04:56:09 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-fa67a444-93a0-4f81-a021-3042951a4eaa tempest-ProjectMemberTests-1806793813 None] Lock "cinder-quobyte-4f1fcef9-0bd8-43ae-a232-289aba50dfbf" acquired by "delete_volume" :: waited 0.025s {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 04:56:09 devstack cinder-volume[87444]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c3e2492-4490-492f-ad6f-df9b35a38b3d]: (4, 'qcow2') {{(pid=88499) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 04:56:09 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-fa67a444-93a0-4f81-a021-3042951a4eaa tempest-ProjectMemberTests-1806793813 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-4f1fcef9-0bd8-43ae-a232-289aba50dfbf {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:56:09 devstack sudo[107134]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-4f1fcef9-0bd8-43ae-a232-289aba50dfbf Jul 10 04:56:09 devstack sudo[107134]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:56:10 devstack sudo[107134]: pam_unix(sudo:session): session closed for user root Jul 10 04:56:10 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-fa67a444-93a0-4f81-a021-3042951a4eaa tempest-ProjectMemberTests-1806793813 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-4f1fcef9-0bd8-43ae-a232-289aba50dfbf" returned: 0 in 0.783s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:56:10 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-fa67a444-93a0-4f81-a021-3042951a4eaa tempest-ProjectMemberTests-1806793813 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-4f1fcef9-0bd8-43ae-a232-289aba50dfbf {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:56:10 devstack sudo[107139]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-4f1fcef9-0bd8-43ae-a232-289aba50dfbf Jul 10 04:56:10 devstack sudo[107139]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:56:10 devstack cinder-volume[87444]: DEBUG cinder.volume.flows.manager.create_volume [None req-cdb75bae-6645-472e-b0f0-a5f420d94af6 tempest-SnapshotDependencyTests-222048441 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87444) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 04:56:10 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-cdb75bae-6645-472e-b0f0-a5f420d94af6 tempest-SnapshotDependencyTests-222048441 None] Flow 'volume_create_manager' (de2471f8-ace6-4377-90e8-a696e9cb6ce2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 04:56:10 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-cdb75bae-6645-472e-b0f0-a5f420d94af6 tempest-SnapshotDependencyTests-222048441 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cb69ed21-52b6-45e0-a79c-d1a7383764f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:56:10 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-cdb75bae-6645-472e-b0f0-a5f420d94af6 tempest-SnapshotDependencyTests-222048441 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cb69ed21-52b6-45e0-a79c-d1a7383764f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T02:56:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-651871276',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=504d02ee-8f24-47bf-ad86-6addf5c8e35c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='01ec409540f8482abb9e3698c11b892e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T02:56:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T02:56:10Z,use_quota=True,user_id='443639c6952140728a53918d75168f02',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(317e369e-1e06-434d-ae95-a335f0e6c903),volume_type_id=317e369e-1e06-434d-ae95-a335f0e6c903)' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:56:10 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-cdb75bae-6645-472e-b0f0-a5f420d94af6 tempest-SnapshotDependencyTests-222048441 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (effb80b2-98d0-4df0-8816-98b1dbd081f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:56:10 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-cdb75bae-6645-472e-b0f0-a5f420d94af6 tempest-SnapshotDependencyTests-222048441 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (effb80b2-98d0-4df0-8816-98b1dbd081f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:56:10 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-cdb75bae-6645-472e-b0f0-a5f420d94af6 tempest-SnapshotDependencyTests-222048441 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (59da96ff-c4a5-42f4-bdf9-744daf9cf13f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:56:10 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-cdb75bae-6645-472e-b0f0-a5f420d94af6 tempest-SnapshotDependencyTests-222048441 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (59da96ff-c4a5-42f4-bdf9-744daf9cf13f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '504d02ee-8f24-47bf-ad86-6addf5c8e35c', 'volume_name': 'volume-504d02ee-8f24-47bf-ad86-6addf5c8e35c', 'volume_size': 1}' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:56:10 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-cdb75bae-6645-472e-b0f0-a5f420d94af6 tempest-SnapshotDependencyTests-222048441 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e6b2aa42-02c3-40ed-8169-003a5e84c37a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:56:10 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-cdb75bae-6645-472e-b0f0-a5f420d94af6 tempest-SnapshotDependencyTests-222048441 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e6b2aa42-02c3-40ed-8169-003a5e84c37a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:56:10 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-cdb75bae-6645-472e-b0f0-a5f420d94af6 tempest-SnapshotDependencyTests-222048441 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (19237054-3446-441b-940d-ef98e5419c1f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:56:10 devstack cinder-volume[87444]: INFO cinder.volume.flows.manager.create_volume [None req-cdb75bae-6645-472e-b0f0-a5f420d94af6 tempest-SnapshotDependencyTests-222048441 None] Volume 504d02ee-8f24-47bf-ad86-6addf5c8e35c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-504d02ee-8f24-47bf-ad86-6addf5c8e35c', 'volume_size': 1} Jul 10 04:56:10 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-cdb75bae-6645-472e-b0f0-a5f420d94af6 tempest-SnapshotDependencyTests-222048441 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 04:56:10 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-cdb75bae-6645-472e-b0f0-a5f420d94af6 tempest-SnapshotDependencyTests-222048441 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 04:56:10 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-cdb75bae-6645-472e-b0f0-a5f420d94af6 tempest-SnapshotDependencyTests-222048441 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T02:56:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-651871276',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=504d02ee-8f24-47bf-ad86-6addf5c8e35c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='01ec409540f8482abb9e3698c11b892e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T02:56:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T02:56:10Z,use_quota=True,user_id='443639c6952140728a53918d75168f02',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(317e369e-1e06-434d-ae95-a335f0e6c903),volume_type_id=317e369e-1e06-434d-ae95-a335f0e6c903)}" {{(pid=87444) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 04:56:10 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.remotefs [None req-cdb75bae-6645-472e-b0f0-a5f420d94af6 tempest-SnapshotDependencyTests-222048441 None] Creating volume 504d02ee-8f24-47bf-ad86-6addf5c8e35c {{(pid=87444) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 04:56:10 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-cdb75bae-6645-472e-b0f0-a5f420d94af6 tempest-SnapshotDependencyTests-222048441 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 04:56:10 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-cdb75bae-6645-472e-b0f0-a5f420d94af6 tempest-SnapshotDependencyTests-222048441 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 04:56:10 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-cdb75bae-6645-472e-b0f0-a5f420d94af6 tempest-SnapshotDependencyTests-222048441 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922': None} {{(pid=87444) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 04:56:10 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-cdb75bae-6645-472e-b0f0-a5f420d94af6 tempest-SnapshotDependencyTests-222048441 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922'] {{(pid=87444) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 04:56:10 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-cdb75bae-6645-472e-b0f0-a5f420d94af6 tempest-SnapshotDependencyTests-222048441 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 04:56:10 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-cdb75bae-6645-472e-b0f0-a5f420d94af6 tempest-SnapshotDependencyTests-222048441 None] Selected osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922 as target Quobyte volume. {{(pid=87444) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 04:56:10 devstack cinder-volume[87444]: INFO cinder.volume.drivers.remotefs [None req-cdb75bae-6645-472e-b0f0-a5f420d94af6 tempest-SnapshotDependencyTests-222048441 None] casted to osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922 Jul 10 04:56:10 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-cdb75bae-6645-472e-b0f0-a5f420d94af6 tempest-SnapshotDependencyTests-222048441 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-504d02ee-8f24-47bf-ad86-6addf5c8e35c 1073741824 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:56:10 devstack sudo[107141]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-504d02ee-8f24-47bf-ad86-6addf5c8e35c 1073741824 Jul 10 04:56:10 devstack sudo[107141]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:56:10 devstack sudo[107139]: pam_unix(sudo:session): session closed for user root Jul 10 04:56:10 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-fa67a444-93a0-4f81-a021-3042951a4eaa tempest-ProjectMemberTests-1806793813 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-4f1fcef9-0bd8-43ae-a232-289aba50dfbf" returned: 0 in 0.704s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:56:10 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-fa67a444-93a0-4f81-a021-3042951a4eaa tempest-ProjectMemberTests-1806793813 None] Lock "cinder-quobyte-4f1fcef9-0bd8-43ae-a232-289aba50dfbf" released by "delete_volume" :: held 1.552s {{(pid=87444) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 04:56:10 devstack cinder-volume[87444]: DEBUG cinder.quota [None req-fa67a444-93a0-4f81-a021-3042951a4eaa tempest-ProjectMemberTests-1806793813 None] Created reservations ['51ef4a8b-3dec-4411-8ef6-b3f8f5c5f72c', '4594f60e-80f2-472c-b793-b5555b74e23e', 'b3b1f181-0960-4236-9f95-8e952e32963b', 'a19d6f6e-3092-4da2-aa60-2749de269cd3'] {{(pid=87444) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 04:56:10 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-fa67a444-93a0-4f81-a021-3042951a4eaa tempest-ProjectMemberTests-1806793813 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 04:56:10 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-fa67a444-93a0-4f81-a021-3042951a4eaa tempest-ProjectMemberTests-1806793813 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 04:56:10 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-fa67a444-93a0-4f81-a021-3042951a4eaa tempest-ProjectMemberTests-1806793813 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922': None} {{(pid=87444) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 04:56:10 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-fa67a444-93a0-4f81-a021-3042951a4eaa tempest-ProjectMemberTests-1806793813 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922'] {{(pid=87444) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 04:56:10 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-fa67a444-93a0-4f81-a021-3042951a4eaa tempest-ProjectMemberTests-1806793813 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 04:56:10 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-fa67a444-93a0-4f81-a021-3042951a4eaa tempest-ProjectMemberTests-1806793813 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:56:10 devstack sudo[107144]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097 Jul 10 04:56:10 devstack sudo[107144]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:56:11 devstack sudo[107141]: pam_unix(sudo:session): session closed for user root Jul 10 04:56:11 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-cdb75bae-6645-472e-b0f0-a5f420d94af6 tempest-SnapshotDependencyTests-222048441 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-504d02ee-8f24-47bf-ad86-6addf5c8e35c 1073741824" returned: 0 in 0.815s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:56:11 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-cdb75bae-6645-472e-b0f0-a5f420d94af6 tempest-SnapshotDependencyTests-222048441 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-504d02ee-8f24-47bf-ad86-6addf5c8e35c {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:56:11 devstack sudo[107149]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-504d02ee-8f24-47bf-ad86-6addf5c8e35c Jul 10 04:56:11 devstack sudo[107149]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:56:11 devstack sudo[107144]: pam_unix(sudo:session): session closed for user root Jul 10 04:56:11 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-fa67a444-93a0-4f81-a021-3042951a4eaa tempest-ProjectMemberTests-1806793813 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097" returned: 0 in 0.708s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:56:11 devstack cinder-volume[87444]: DEBUG cinder.manager [None req-fa67a444-93a0-4f81-a021-3042951a4eaa tempest-ProjectMemberTests-1806793813 None] Notifying Schedulers of capabilities ... {{(pid=87444) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 04:56:11 devstack cinder-volume[87444]: INFO cinder.volume.manager [None req-fa67a444-93a0-4f81-a021-3042951a4eaa tempest-ProjectMemberTests-1806793813 None] Deleted volume successfully. Jul 10 04:56:11 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-fa67a444-93a0-4f81-a021-3042951a4eaa tempest-ProjectMemberTests-1806793813 None] Lock "cinder-4f1fcef9-0bd8-43ae-a232-289aba50dfbf-delete_volume" released by "delete_volume" :: held 2.498s {{(pid=87444) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 04:56:11 devstack cinder-volume[87444]: DEBUG cinder.volume.flows.manager.create_volume [None req-e4931ee7-cf5a-474c-a8df-5b1c76baad68 tempest-ProjectMemberTests-1806793813 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87444) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 04:56:11 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-e4931ee7-cf5a-474c-a8df-5b1c76baad68 tempest-ProjectMemberTests-1806793813 None] Flow 'volume_create_manager' (6f06ca9b-357c-4455-bea2-08369b065850) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 04:56:11 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-e4931ee7-cf5a-474c-a8df-5b1c76baad68 tempest-ProjectMemberTests-1806793813 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7a6e260b-e875-4a31-b6f8-55ab5077f968) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:56:11 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-e4931ee7-cf5a-474c-a8df-5b1c76baad68 tempest-ProjectMemberTests-1806793813 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7a6e260b-e875-4a31-b6f8-55ab5077f968) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T02:56:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-580963996',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c40c9da6-2692-44d8-88a1-b71866332e7b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cadbf6455bcb4ed48f08a3c15f1d84e3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T02:56:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T02:56:12Z,use_quota=True,user_id='2aceae1efa264e87bd2696a5a256f622',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(317e369e-1e06-434d-ae95-a335f0e6c903),volume_type_id=317e369e-1e06-434d-ae95-a335f0e6c903)' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:56:11 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-e4931ee7-cf5a-474c-a8df-5b1c76baad68 tempest-ProjectMemberTests-1806793813 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cb254d62-1e40-4db3-af6e-807db987d334) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:56:11 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-e4931ee7-cf5a-474c-a8df-5b1c76baad68 tempest-ProjectMemberTests-1806793813 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cb254d62-1e40-4db3-af6e-807db987d334) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:56:11 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-e4931ee7-cf5a-474c-a8df-5b1c76baad68 tempest-ProjectMemberTests-1806793813 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (593141b7-9c3c-428d-9536-e9b0bca828ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:56:11 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-e4931ee7-cf5a-474c-a8df-5b1c76baad68 tempest-ProjectMemberTests-1806793813 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (593141b7-9c3c-428d-9536-e9b0bca828ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c40c9da6-2692-44d8-88a1-b71866332e7b', 'volume_name': 'volume-c40c9da6-2692-44d8-88a1-b71866332e7b', 'volume_size': 1}' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:56:11 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-e4931ee7-cf5a-474c-a8df-5b1c76baad68 tempest-ProjectMemberTests-1806793813 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d2663d7d-cf79-4172-8675-2331304c29d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:56:11 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-e4931ee7-cf5a-474c-a8df-5b1c76baad68 tempest-ProjectMemberTests-1806793813 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d2663d7d-cf79-4172-8675-2331304c29d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:56:11 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-e4931ee7-cf5a-474c-a8df-5b1c76baad68 tempest-ProjectMemberTests-1806793813 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0eae413c-79aa-4bc2-ba65-7f52caf377e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:56:11 devstack cinder-volume[87444]: INFO cinder.volume.flows.manager.create_volume [None req-e4931ee7-cf5a-474c-a8df-5b1c76baad68 tempest-ProjectMemberTests-1806793813 None] Volume c40c9da6-2692-44d8-88a1-b71866332e7b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c40c9da6-2692-44d8-88a1-b71866332e7b', 'volume_size': 1} Jul 10 04:56:11 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-e4931ee7-cf5a-474c-a8df-5b1c76baad68 tempest-ProjectMemberTests-1806793813 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 04:56:11 devstack sudo[107149]: pam_unix(sudo:session): session closed for user root Jul 10 04:56:11 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-cdb75bae-6645-472e-b0f0-a5f420d94af6 tempest-SnapshotDependencyTests-222048441 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-504d02ee-8f24-47bf-ad86-6addf5c8e35c" returned: 0 in 0.678s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:56:11 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-cdb75bae-6645-472e-b0f0-a5f420d94af6 tempest-SnapshotDependencyTests-222048441 None] <== create_volume: return (1537ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922'} {{(pid=87444) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 04:56:11 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-cdb75bae-6645-472e-b0f0-a5f420d94af6 tempest-SnapshotDependencyTests-222048441 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.539s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 04:56:11 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-e4931ee7-cf5a-474c-a8df-5b1c76baad68 tempest-ProjectMemberTests-1806793813 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.054s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 04:56:12 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-e4931ee7-cf5a-474c-a8df-5b1c76baad68 tempest-ProjectMemberTests-1806793813 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T02:56:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-580963996',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c40c9da6-2692-44d8-88a1-b71866332e7b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cadbf6455bcb4ed48f08a3c15f1d84e3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T02:56:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T02:56:12Z,use_quota=True,user_id='2aceae1efa264e87bd2696a5a256f622',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(317e369e-1e06-434d-ae95-a335f0e6c903),volume_type_id=317e369e-1e06-434d-ae95-a335f0e6c903)}" {{(pid=87444) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 04:56:12 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.remotefs [None req-e4931ee7-cf5a-474c-a8df-5b1c76baad68 tempest-ProjectMemberTests-1806793813 None] Creating volume c40c9da6-2692-44d8-88a1-b71866332e7b {{(pid=87444) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 04:56:12 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-e4931ee7-cf5a-474c-a8df-5b1c76baad68 tempest-ProjectMemberTests-1806793813 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 04:56:12 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-e4931ee7-cf5a-474c-a8df-5b1c76baad68 tempest-ProjectMemberTests-1806793813 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 04:56:12 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-e4931ee7-cf5a-474c-a8df-5b1c76baad68 tempest-ProjectMemberTests-1806793813 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922': None} {{(pid=87444) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 04:56:12 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-e4931ee7-cf5a-474c-a8df-5b1c76baad68 tempest-ProjectMemberTests-1806793813 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922'] {{(pid=87444) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 04:56:12 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-e4931ee7-cf5a-474c-a8df-5b1c76baad68 tempest-ProjectMemberTests-1806793813 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 04:56:12 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-e4931ee7-cf5a-474c-a8df-5b1c76baad68 tempest-ProjectMemberTests-1806793813 None] Selected osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922 as target Quobyte volume. {{(pid=87444) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 04:56:12 devstack cinder-volume[87444]: INFO cinder.volume.drivers.remotefs [None req-e4931ee7-cf5a-474c-a8df-5b1c76baad68 tempest-ProjectMemberTests-1806793813 None] casted to osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922 Jul 10 04:56:12 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-e4931ee7-cf5a-474c-a8df-5b1c76baad68 tempest-ProjectMemberTests-1806793813 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-c40c9da6-2692-44d8-88a1-b71866332e7b 1073741824 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:56:12 devstack sudo[107153]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-c40c9da6-2692-44d8-88a1-b71866332e7b 1073741824 Jul 10 04:56:12 devstack sudo[107153]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:56:12 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-cdb75bae-6645-472e-b0f0-a5f420d94af6 tempest-SnapshotDependencyTests-222048441 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (19237054-3446-441b-940d-ef98e5419c1f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-504d02ee-8f24-47bf-ad86-6addf5c8e35c', 'volume_size': 1}' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:56:12 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-cdb75bae-6645-472e-b0f0-a5f420d94af6 tempest-SnapshotDependencyTests-222048441 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (deb31fd3-5078-4b0c-bcf3-e29e2a187647) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:56:12 devstack cinder-volume[87444]: INFO cinder.volume.flows.manager.create_volume [None req-cdb75bae-6645-472e-b0f0-a5f420d94af6 tempest-SnapshotDependencyTests-222048441 None] Volume volume-504d02ee-8f24-47bf-ad86-6addf5c8e35c (504d02ee-8f24-47bf-ad86-6addf5c8e35c): created successfully Jul 10 04:56:12 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-cdb75bae-6645-472e-b0f0-a5f420d94af6 tempest-SnapshotDependencyTests-222048441 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (deb31fd3-5078-4b0c-bcf3-e29e2a187647) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:56:12 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-cdb75bae-6645-472e-b0f0-a5f420d94af6 tempest-SnapshotDependencyTests-222048441 None] Flow 'volume_create_manager' (de2471f8-ace6-4377-90e8-a696e9cb6ce2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87444) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 04:56:12 devstack cinder-volume[87444]: INFO cinder.volume.manager [None req-cdb75bae-6645-472e-b0f0-a5f420d94af6 tempest-SnapshotDependencyTests-222048441 None] Created volume successfully. Jul 10 04:56:12 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-26a0b0ef-03a3-4510-bc1c-f38d82ec693c tempest-SnapshotDependencyTests-222048441 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 04:56:12 devstack sudo[107153]: pam_unix(sudo:session): session closed for user root Jul 10 04:56:12 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-e4931ee7-cf5a-474c-a8df-5b1c76baad68 tempest-ProjectMemberTests-1806793813 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-c40c9da6-2692-44d8-88a1-b71866332e7b 1073741824" returned: 0 in 0.853s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:56:12 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-e4931ee7-cf5a-474c-a8df-5b1c76baad68 tempest-ProjectMemberTests-1806793813 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-c40c9da6-2692-44d8-88a1-b71866332e7b {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:56:12 devstack sudo[107158]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-c40c9da6-2692-44d8-88a1-b71866332e7b Jul 10 04:56:12 devstack sudo[107158]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:56:13 devstack sudo[107158]: pam_unix(sudo:session): session closed for user root Jul 10 04:56:13 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-e4931ee7-cf5a-474c-a8df-5b1c76baad68 tempest-ProjectMemberTests-1806793813 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-c40c9da6-2692-44d8-88a1-b71866332e7b" returned: 0 in 0.625s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:56:13 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-e4931ee7-cf5a-474c-a8df-5b1c76baad68 tempest-ProjectMemberTests-1806793813 None] <== create_volume: return (1512ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922'} {{(pid=87444) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 04:56:13 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-e4931ee7-cf5a-474c-a8df-5b1c76baad68 tempest-ProjectMemberTests-1806793813 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.515s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 04:56:13 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-26a0b0ef-03a3-4510-bc1c-f38d82ec693c tempest-SnapshotDependencyTests-222048441 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.829s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 04:56:13 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-e4931ee7-cf5a-474c-a8df-5b1c76baad68 tempest-ProjectMemberTests-1806793813 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0eae413c-79aa-4bc2-ba65-7f52caf377e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c40c9da6-2692-44d8-88a1-b71866332e7b', 'volume_size': 1}' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:56:13 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-e4931ee7-cf5a-474c-a8df-5b1c76baad68 tempest-ProjectMemberTests-1806793813 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d63352a3-b151-4e73-89b6-c71e0fe73c24) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:56:13 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.remotefs [None req-26a0b0ef-03a3-4510-bc1c-f38d82ec693c tempest-SnapshotDependencyTests-222048441 None] Creating offline snapshot fa7454fd-99f6-4d57-8b57-421fea1fecae of volume 504d02ee-8f24-47bf-ad86-6addf5c8e35c {{(pid=87444) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 10 04:56:13 devstack cinder-volume[87444]: INFO cinder.volume.flows.manager.create_volume [None req-e4931ee7-cf5a-474c-a8df-5b1c76baad68 tempest-ProjectMemberTests-1806793813 None] Volume volume-c40c9da6-2692-44d8-88a1-b71866332e7b (c40c9da6-2692-44d8-88a1-b71866332e7b): created successfully Jul 10 04:56:13 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-e4931ee7-cf5a-474c-a8df-5b1c76baad68 tempest-ProjectMemberTests-1806793813 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d63352a3-b151-4e73-89b6-c71e0fe73c24) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:56:13 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-e4931ee7-cf5a-474c-a8df-5b1c76baad68 tempest-ProjectMemberTests-1806793813 None] Flow 'volume_create_manager' (6f06ca9b-357c-4455-bea2-08369b065850) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87444) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 04:56:13 devstack cinder-volume[87444]: DEBUG oslo.privsep.daemon [-] privsep: reply[9bd88638-f072-49e3-abcb-5c86921fe940]: (4, 'qcow2') {{(pid=88499) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 04:56:13 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-26a0b0ef-03a3-4510-bc1c-f38d82ec693c tempest-SnapshotDependencyTests-222048441 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-504d02ee-8f24-47bf-ad86-6addf5c8e35c {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:56:13 devstack cinder-volume[87444]: INFO cinder.volume.manager [None req-e4931ee7-cf5a-474c-a8df-5b1c76baad68 tempest-ProjectMemberTests-1806793813 None] Created volume successfully. Jul 10 04:56:13 devstack sudo[107161]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-504d02ee-8f24-47bf-ad86-6addf5c8e35c Jul 10 04:56:13 devstack sudo[107161]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:56:14 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-a1a6b7e6-4447-4626-8a07-895ec055985a tempest-ProjectMemberTests-1806793813 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 04:56:14 devstack sudo[107161]: pam_unix(sudo:session): session closed for user root Jul 10 04:56:14 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-26a0b0ef-03a3-4510-bc1c-f38d82ec693c tempest-SnapshotDependencyTests-222048441 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-504d02ee-8f24-47bf-ad86-6addf5c8e35c" returned: 0 in 0.738s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:56:14 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-26a0b0ef-03a3-4510-bc1c-f38d82ec693c tempest-SnapshotDependencyTests-222048441 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-504d02ee-8f24-47bf-ad86-6addf5c8e35c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-504d02ee-8f24-47bf-ad86-6addf5c8e35c.fa7454fd-99f6-4d57-8b57-421fea1fecae 1G {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:56:14 devstack sudo[107167]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-504d02ee-8f24-47bf-ad86-6addf5c8e35c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-504d02ee-8f24-47bf-ad86-6addf5c8e35c.fa7454fd-99f6-4d57-8b57-421fea1fecae 1G Jul 10 04:56:14 devstack sudo[107167]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:56:15 devstack sudo[107167]: pam_unix(sudo:session): session closed for user root Jul 10 04:56:15 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-26a0b0ef-03a3-4510-bc1c-f38d82ec693c tempest-SnapshotDependencyTests-222048441 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-504d02ee-8f24-47bf-ad86-6addf5c8e35c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-504d02ee-8f24-47bf-ad86-6addf5c8e35c.fa7454fd-99f6-4d57-8b57-421fea1fecae 1G" returned: 0 in 0.784s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:56:15 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-26a0b0ef-03a3-4510-bc1c-f38d82ec693c tempest-SnapshotDependencyTests-222048441 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-504d02ee-8f24-47bf-ad86-6addf5c8e35c -F qcow2 /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-504d02ee-8f24-47bf-ad86-6addf5c8e35c.fa7454fd-99f6-4d57-8b57-421fea1fecae {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:56:15 devstack sudo[107172]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-504d02ee-8f24-47bf-ad86-6addf5c8e35c -F qcow2 /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-504d02ee-8f24-47bf-ad86-6addf5c8e35c.fa7454fd-99f6-4d57-8b57-421fea1fecae Jul 10 04:56:15 devstack sudo[107172]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:56:15 devstack sudo[107172]: pam_unix(sudo:session): session closed for user root Jul 10 04:56:15 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-26a0b0ef-03a3-4510-bc1c-f38d82ec693c tempest-SnapshotDependencyTests-222048441 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-504d02ee-8f24-47bf-ad86-6addf5c8e35c -F qcow2 /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-504d02ee-8f24-47bf-ad86-6addf5c8e35c.fa7454fd-99f6-4d57-8b57-421fea1fecae" returned: 0 in 0.677s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:56:15 devstack cinder-volume[87444]: WARNING cinder.volume.drivers.remotefs [None req-26a0b0ef-03a3-4510-bc1c-f38d82ec693c tempest-SnapshotDependencyTests-222048441 None] /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-504d02ee-8f24-47bf-ad86-6addf5c8e35c.fa7454fd-99f6-4d57-8b57-421fea1fecae is being set with open permissions: ugo+rw Jul 10 04:56:15 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-26a0b0ef-03a3-4510-bc1c-f38d82ec693c tempest-SnapshotDependencyTests-222048441 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-504d02ee-8f24-47bf-ad86-6addf5c8e35c.fa7454fd-99f6-4d57-8b57-421fea1fecae {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:56:15 devstack sudo[107177]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-504d02ee-8f24-47bf-ad86-6addf5c8e35c.fa7454fd-99f6-4d57-8b57-421fea1fecae Jul 10 04:56:15 devstack sudo[107177]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:56:16 devstack sudo[107177]: pam_unix(sudo:session): session closed for user root Jul 10 04:56:16 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-26a0b0ef-03a3-4510-bc1c-f38d82ec693c tempest-SnapshotDependencyTests-222048441 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-504d02ee-8f24-47bf-ad86-6addf5c8e35c.fa7454fd-99f6-4d57-8b57-421fea1fecae" returned: 0 in 0.660s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:56:16 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-26a0b0ef-03a3-4510-bc1c-f38d82ec693c tempest-SnapshotDependencyTests-222048441 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-504d02ee-8f24-47bf-ad86-6addf5c8e35c.info {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:56:16 devstack sudo[107180]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-504d02ee-8f24-47bf-ad86-6addf5c8e35c.info Jul 10 04:56:16 devstack sudo[107180]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:56:17 devstack sudo[107180]: pam_unix(sudo:session): session closed for user root Jul 10 04:56:17 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-26a0b0ef-03a3-4510-bc1c-f38d82ec693c tempest-SnapshotDependencyTests-222048441 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-504d02ee-8f24-47bf-ad86-6addf5c8e35c.info" returned: 0 in 0.645s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:56:17 devstack cinder-volume[87444]: WARNING cinder.volume.drivers.remotefs [None req-26a0b0ef-03a3-4510-bc1c-f38d82ec693c tempest-SnapshotDependencyTests-222048441 None] /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-504d02ee-8f24-47bf-ad86-6addf5c8e35c.info is being set with open permissions: ugo+rw Jul 10 04:56:17 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-26a0b0ef-03a3-4510-bc1c-f38d82ec693c tempest-SnapshotDependencyTests-222048441 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-504d02ee-8f24-47bf-ad86-6addf5c8e35c.info {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:56:17 devstack sudo[107183]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-504d02ee-8f24-47bf-ad86-6addf5c8e35c.info Jul 10 04:56:17 devstack sudo[107183]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:56:17 devstack sudo[107183]: pam_unix(sudo:session): session closed for user root Jul 10 04:56:17 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-26a0b0ef-03a3-4510-bc1c-f38d82ec693c tempest-SnapshotDependencyTests-222048441 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-504d02ee-8f24-47bf-ad86-6addf5c8e35c.info" returned: 0 in 0.659s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:56:17 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-26a0b0ef-03a3-4510-bc1c-f38d82ec693c tempest-SnapshotDependencyTests-222048441 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.262s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 04:56:17 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-a1a6b7e6-4447-4626-8a07-895ec055985a tempest-ProjectMemberTests-1806793813 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 3.738s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 04:56:17 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.remotefs [None req-a1a6b7e6-4447-4626-8a07-895ec055985a tempest-ProjectMemberTests-1806793813 None] Creating offline snapshot 2ac3a629-cbd0-487e-a734-76be0bbeaee9 of volume c40c9da6-2692-44d8-88a1-b71866332e7b {{(pid=87444) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 10 04:56:17 devstack cinder-volume[87444]: INFO cinder.volume.manager [None req-26a0b0ef-03a3-4510-bc1c-f38d82ec693c tempest-SnapshotDependencyTests-222048441 None] Create snapshot completed successfully Jul 10 04:56:17 devstack cinder-volume[87444]: DEBUG oslo.privsep.daemon [-] privsep: reply[9da8697d-a430-445e-938a-251258aae122]: (4, 'qcow2') {{(pid=88499) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 04:56:17 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-a1a6b7e6-4447-4626-8a07-895ec055985a tempest-ProjectMemberTests-1806793813 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-c40c9da6-2692-44d8-88a1-b71866332e7b {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:56:17 devstack sudo[107186]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-c40c9da6-2692-44d8-88a1-b71866332e7b Jul 10 04:56:17 devstack sudo[107186]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:56:18 devstack sudo[107186]: pam_unix(sudo:session): session closed for user root Jul 10 04:56:18 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-a1a6b7e6-4447-4626-8a07-895ec055985a tempest-ProjectMemberTests-1806793813 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-c40c9da6-2692-44d8-88a1-b71866332e7b" returned: 0 in 0.746s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:56:18 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-a1a6b7e6-4447-4626-8a07-895ec055985a tempest-ProjectMemberTests-1806793813 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-c40c9da6-2692-44d8-88a1-b71866332e7b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-c40c9da6-2692-44d8-88a1-b71866332e7b.2ac3a629-cbd0-487e-a734-76be0bbeaee9 1G {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:56:18 devstack sudo[107191]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-c40c9da6-2692-44d8-88a1-b71866332e7b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-c40c9da6-2692-44d8-88a1-b71866332e7b.2ac3a629-cbd0-487e-a734-76be0bbeaee9 1G Jul 10 04:56:18 devstack sudo[107191]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:56:19 devstack sudo[107191]: pam_unix(sudo:session): session closed for user root Jul 10 04:56:19 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-a1a6b7e6-4447-4626-8a07-895ec055985a tempest-ProjectMemberTests-1806793813 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-c40c9da6-2692-44d8-88a1-b71866332e7b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-c40c9da6-2692-44d8-88a1-b71866332e7b.2ac3a629-cbd0-487e-a734-76be0bbeaee9 1G" returned: 0 in 0.823s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:56:19 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-a1a6b7e6-4447-4626-8a07-895ec055985a tempest-ProjectMemberTests-1806793813 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c40c9da6-2692-44d8-88a1-b71866332e7b -F qcow2 /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-c40c9da6-2692-44d8-88a1-b71866332e7b.2ac3a629-cbd0-487e-a734-76be0bbeaee9 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:56:19 devstack sudo[107196]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c40c9da6-2692-44d8-88a1-b71866332e7b -F qcow2 /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-c40c9da6-2692-44d8-88a1-b71866332e7b.2ac3a629-cbd0-487e-a734-76be0bbeaee9 Jul 10 04:56:19 devstack sudo[107196]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:56:19 devstack cinder-volume[87444]: DEBUG cinder.volume.flows.manager.create_volume [None req-e0938ffe-fb8f-4224-b847-c5ff81ef6276 tempest-SnapshotDependencyTests-222048441 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87444) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 04:56:19 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-e0938ffe-fb8f-4224-b847-c5ff81ef6276 tempest-SnapshotDependencyTests-222048441 None] Flow 'volume_create_manager' (b87ad578-b946-4e26-8fe7-368ae30d39ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 04:56:19 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-e0938ffe-fb8f-4224-b847-c5ff81ef6276 tempest-SnapshotDependencyTests-222048441 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3ed1762c-9c93-4e54-9351-485e92f1f192) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:56:19 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-e0938ffe-fb8f-4224-b847-c5ff81ef6276 tempest-SnapshotDependencyTests-222048441 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3ed1762c-9c93-4e54-9351-485e92f1f192) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T02:56:19Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3ac3f596-a37c-4700-a332-1109539f552f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='01ec409540f8482abb9e3698c11b892e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T02:56:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=fa7454fd-99f6-4d57-8b57-421fea1fecae,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T02:56:19Z,use_quota=True,user_id='443639c6952140728a53918d75168f02',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(317e369e-1e06-434d-ae95-a335f0e6c903),volume_type_id=317e369e-1e06-434d-ae95-a335f0e6c903)' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:56:19 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-e0938ffe-fb8f-4224-b847-c5ff81ef6276 tempest-SnapshotDependencyTests-222048441 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c91b8359-fc20-4ddc-9b81-8e3f163fd0e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:56:19 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-e0938ffe-fb8f-4224-b847-c5ff81ef6276 tempest-SnapshotDependencyTests-222048441 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c91b8359-fc20-4ddc-9b81-8e3f163fd0e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:56:19 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-e0938ffe-fb8f-4224-b847-c5ff81ef6276 tempest-SnapshotDependencyTests-222048441 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (253a6b0a-bb02-4a7b-be29-068e1dc7b5f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:56:19 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-e0938ffe-fb8f-4224-b847-c5ff81ef6276 tempest-SnapshotDependencyTests-222048441 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (253a6b0a-bb02-4a7b-be29-068e1dc7b5f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '3ac3f596-a37c-4700-a332-1109539f552f', 'volume_name': 'volume-3ac3f596-a37c-4700-a332-1109539f552f', 'volume_size': 1, 'snapshot_id': 'fa7454fd-99f6-4d57-8b57-421fea1fecae'}' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:56:19 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-e0938ffe-fb8f-4224-b847-c5ff81ef6276 tempest-SnapshotDependencyTests-222048441 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (56c3297e-141c-4d8c-8542-a8f3b8edf0cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:56:19 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-e0938ffe-fb8f-4224-b847-c5ff81ef6276 tempest-SnapshotDependencyTests-222048441 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (56c3297e-141c-4d8c-8542-a8f3b8edf0cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:56:19 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-e0938ffe-fb8f-4224-b847-c5ff81ef6276 tempest-SnapshotDependencyTests-222048441 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1805c064-895c-4807-bbc3-6a4d2aecebac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:56:19 devstack cinder-volume[87444]: INFO cinder.volume.flows.manager.create_volume [None req-e0938ffe-fb8f-4224-b847-c5ff81ef6276 tempest-SnapshotDependencyTests-222048441 None] Volume 3ac3f596-a37c-4700-a332-1109539f552f: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-3ac3f596-a37c-4700-a332-1109539f552f', 'volume_size': 1, 'snapshot_id': 'fa7454fd-99f6-4d57-8b57-421fea1fecae'} Jul 10 04:56:19 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-e0938ffe-fb8f-4224-b847-c5ff81ef6276 tempest-SnapshotDependencyTests-222048441 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 04:56:20 devstack sudo[107196]: pam_unix(sudo:session): session closed for user root Jul 10 04:56:20 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-a1a6b7e6-4447-4626-8a07-895ec055985a tempest-ProjectMemberTests-1806793813 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c40c9da6-2692-44d8-88a1-b71866332e7b -F qcow2 /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-c40c9da6-2692-44d8-88a1-b71866332e7b.2ac3a629-cbd0-487e-a734-76be0bbeaee9" returned: 0 in 0.674s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:56:20 devstack cinder-volume[87444]: WARNING cinder.volume.drivers.remotefs [None req-a1a6b7e6-4447-4626-8a07-895ec055985a tempest-ProjectMemberTests-1806793813 None] /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-c40c9da6-2692-44d8-88a1-b71866332e7b.2ac3a629-cbd0-487e-a734-76be0bbeaee9 is being set with open permissions: ugo+rw Jul 10 04:56:20 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-a1a6b7e6-4447-4626-8a07-895ec055985a tempest-ProjectMemberTests-1806793813 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-c40c9da6-2692-44d8-88a1-b71866332e7b.2ac3a629-cbd0-487e-a734-76be0bbeaee9 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:56:20 devstack sudo[107201]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-c40c9da6-2692-44d8-88a1-b71866332e7b.2ac3a629-cbd0-487e-a734-76be0bbeaee9 Jul 10 04:56:20 devstack sudo[107201]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:56:20 devstack sudo[107201]: pam_unix(sudo:session): session closed for user root Jul 10 04:56:20 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-a1a6b7e6-4447-4626-8a07-895ec055985a tempest-ProjectMemberTests-1806793813 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-c40c9da6-2692-44d8-88a1-b71866332e7b.2ac3a629-cbd0-487e-a734-76be0bbeaee9" returned: 0 in 0.635s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:56:20 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-a1a6b7e6-4447-4626-8a07-895ec055985a tempest-ProjectMemberTests-1806793813 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-c40c9da6-2692-44d8-88a1-b71866332e7b.info {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:56:20 devstack sudo[107204]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-c40c9da6-2692-44d8-88a1-b71866332e7b.info Jul 10 04:56:20 devstack sudo[107204]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:56:21 devstack sudo[107204]: pam_unix(sudo:session): session closed for user root Jul 10 04:56:21 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-a1a6b7e6-4447-4626-8a07-895ec055985a tempest-ProjectMemberTests-1806793813 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-c40c9da6-2692-44d8-88a1-b71866332e7b.info" returned: 0 in 0.635s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:56:21 devstack cinder-volume[87444]: WARNING cinder.volume.drivers.remotefs [None req-a1a6b7e6-4447-4626-8a07-895ec055985a tempest-ProjectMemberTests-1806793813 None] /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-c40c9da6-2692-44d8-88a1-b71866332e7b.info is being set with open permissions: ugo+rw Jul 10 04:56:21 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-a1a6b7e6-4447-4626-8a07-895ec055985a tempest-ProjectMemberTests-1806793813 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-c40c9da6-2692-44d8-88a1-b71866332e7b.info {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:56:21 devstack sudo[107207]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-c40c9da6-2692-44d8-88a1-b71866332e7b.info Jul 10 04:56:21 devstack sudo[107207]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:56:22 devstack sudo[107207]: pam_unix(sudo:session): session closed for user root Jul 10 04:56:22 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-a1a6b7e6-4447-4626-8a07-895ec055985a tempest-ProjectMemberTests-1806793813 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-c40c9da6-2692-44d8-88a1-b71866332e7b.info" returned: 0 in 0.639s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:56:22 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-a1a6b7e6-4447-4626-8a07-895ec055985a tempest-ProjectMemberTests-1806793813 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.246s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 04:56:22 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-e0938ffe-fb8f-4224-b847-c5ff81ef6276 tempest-SnapshotDependencyTests-222048441 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 2.409s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 04:56:22 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-e0938ffe-fb8f-4224-b847-c5ff81ef6276 tempest-SnapshotDependencyTests-222048441 None] Acquiring lock "cinder-quobyte-fa7454fd-99f6-4d57-8b57-421fea1fecae-3ac3f596-a37c-4700-a332-1109539f552f" by "_create_volume_from_snapshot" {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 04:56:22 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-e0938ffe-fb8f-4224-b847-c5ff81ef6276 tempest-SnapshotDependencyTests-222048441 None] Lock "cinder-quobyte-fa7454fd-99f6-4d57-8b57-421fea1fecae-3ac3f596-a37c-4700-a332-1109539f552f" acquired by "_create_volume_from_snapshot" :: waited 0.021s {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 04:56:22 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-e0938ffe-fb8f-4224-b847-c5ff81ef6276 tempest-SnapshotDependencyTests-222048441 None] Creating volume 3ac3f596-a37c-4700-a332-1109539f552f from snapshot fa7454fd-99f6-4d57-8b57-421fea1fecae {{(pid=87444) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Jul 10 04:56:22 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-e0938ffe-fb8f-4224-b847-c5ff81ef6276 tempest-SnapshotDependencyTests-222048441 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 04:56:22 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-e0938ffe-fb8f-4224-b847-c5ff81ef6276 tempest-SnapshotDependencyTests-222048441 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 04:56:22 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-e0938ffe-fb8f-4224-b847-c5ff81ef6276 tempest-SnapshotDependencyTests-222048441 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922': None} {{(pid=87444) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 04:56:22 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-e0938ffe-fb8f-4224-b847-c5ff81ef6276 tempest-SnapshotDependencyTests-222048441 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922'] {{(pid=87444) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 04:56:22 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-e0938ffe-fb8f-4224-b847-c5ff81ef6276 tempest-SnapshotDependencyTests-222048441 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 04:56:22 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-e0938ffe-fb8f-4224-b847-c5ff81ef6276 tempest-SnapshotDependencyTests-222048441 None] Selected osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922 as target Quobyte volume. {{(pid=87444) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 04:56:22 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-e0938ffe-fb8f-4224-b847-c5ff81ef6276 tempest-SnapshotDependencyTests-222048441 None] Acquiring lock "cinder-quobyte-3ac3f596-a37c-4700-a332-1109539f552f" by "_copy_volume_from_snapshot" {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 04:56:22 devstack cinder-volume[87444]: INFO cinder.volume.manager [None req-a1a6b7e6-4447-4626-8a07-895ec055985a tempest-ProjectMemberTests-1806793813 None] Create snapshot completed successfully Jul 10 04:56:22 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-e0938ffe-fb8f-4224-b847-c5ff81ef6276 tempest-SnapshotDependencyTests-222048441 None] Lock "cinder-quobyte-3ac3f596-a37c-4700-a332-1109539f552f" acquired by "_copy_volume_from_snapshot" :: waited 0.017s {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 04:56:22 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-e0938ffe-fb8f-4224-b847-c5ff81ef6276 tempest-SnapshotDependencyTests-222048441 None] snapshot: fa7454fd-99f6-4d57-8b57-421fea1fecae, volume: 3ac3f596-a37c-4700-a332-1109539f552f, {{(pid=87444) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jul 10 04:56:22 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-e0938ffe-fb8f-4224-b847-c5ff81ef6276 tempest-SnapshotDependencyTests-222048441 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 04:56:22 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-e0938ffe-fb8f-4224-b847-c5ff81ef6276 tempest-SnapshotDependencyTests-222048441 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 04:56:22 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-e0938ffe-fb8f-4224-b847-c5ff81ef6276 tempest-SnapshotDependencyTests-222048441 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922': None} {{(pid=87444) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 04:56:22 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-e0938ffe-fb8f-4224-b847-c5ff81ef6276 tempest-SnapshotDependencyTests-222048441 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922'] {{(pid=87444) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 04:56:22 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-e0938ffe-fb8f-4224-b847-c5ff81ef6276 tempest-SnapshotDependencyTests-222048441 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 04:56:22 devstack cinder-volume[87444]: DEBUG oslo.privsep.daemon [-] privsep: reply[58868447-8188-4d4f-88da-f4e373133992]: (4, 'qcow2') {{(pid=88499) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 04:56:22 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-e0938ffe-fb8f-4224-b847-c5ff81ef6276 tempest-SnapshotDependencyTests-222048441 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-504d02ee-8f24-47bf-ad86-6addf5c8e35c.fa7454fd-99f6-4d57-8b57-421fea1fecae {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:56:22 devstack sudo[107210]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-504d02ee-8f24-47bf-ad86-6addf5c8e35c.fa7454fd-99f6-4d57-8b57-421fea1fecae Jul 10 04:56:22 devstack sudo[107210]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:56:22 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-d117aaf1-6735-42a3-8289-c9f70f1068c4 tempest-ProjectMemberTests-1806793813 None] Acquiring lock "cinder-2ac3a629-cbd0-487e-a734-76be0bbeaee9-delete_snapshot" by "delete_snapshot" {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 04:56:22 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-d117aaf1-6735-42a3-8289-c9f70f1068c4 tempest-ProjectMemberTests-1806793813 None] Lock "cinder-2ac3a629-cbd0-487e-a734-76be0bbeaee9-delete_snapshot" acquired by "delete_snapshot" :: waited 0.018s {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 04:56:22 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-d117aaf1-6735-42a3-8289-c9f70f1068c4 tempest-ProjectMemberTests-1806793813 None] Acquiring lock "cinder-quobyte-c40c9da6-2692-44d8-88a1-b71866332e7b" by "delete_snapshot" {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 04:56:22 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-d117aaf1-6735-42a3-8289-c9f70f1068c4 tempest-ProjectMemberTests-1806793813 None] Lock "cinder-quobyte-c40c9da6-2692-44d8-88a1-b71866332e7b" acquired by "delete_snapshot" :: waited 0.020s {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 04:56:22 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-d117aaf1-6735-42a3-8289-c9f70f1068c4 tempest-ProjectMemberTests-1806793813 None] Acquiring lock "cinder-quobyte-2ac3a629-cbd0-487e-a734-76be0bbeaee9" by "_delete_snapshot" {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 04:56:22 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-d117aaf1-6735-42a3-8289-c9f70f1068c4 tempest-ProjectMemberTests-1806793813 None] Lock "cinder-quobyte-2ac3a629-cbd0-487e-a734-76be0bbeaee9" acquired by "_delete_snapshot" :: waited 0.011s {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 04:56:22 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.remotefs [None req-d117aaf1-6735-42a3-8289-c9f70f1068c4 tempest-ProjectMemberTests-1806793813 None] Deleting offline snapshot 2ac3a629-cbd0-487e-a734-76be0bbeaee9 of volume c40c9da6-2692-44d8-88a1-b71866332e7b {{(pid=87444) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 10 04:56:22 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.remotefs [None req-d117aaf1-6735-42a3-8289-c9f70f1068c4 tempest-ProjectMemberTests-1806793813 None] snapshot_file for this snap is: volume-c40c9da6-2692-44d8-88a1-b71866332e7b.2ac3a629-cbd0-487e-a734-76be0bbeaee9 {{(pid=87444) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 10 04:56:22 devstack cinder-volume[87444]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a152773-dcdd-4f91-8ab5-efe0dd7e69cb]: (4, 'qcow2') {{(pid=88499) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 04:56:22 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-d117aaf1-6735-42a3-8289-c9f70f1068c4 tempest-ProjectMemberTests-1806793813 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-c40c9da6-2692-44d8-88a1-b71866332e7b.2ac3a629-cbd0-487e-a734-76be0bbeaee9 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:56:22 devstack sudo[107212]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-c40c9da6-2692-44d8-88a1-b71866332e7b.2ac3a629-cbd0-487e-a734-76be0bbeaee9 Jul 10 04:56:22 devstack sudo[107212]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:56:22 devstack sudo[107210]: pam_unix(sudo:session): session closed for user root Jul 10 04:56:22 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-e0938ffe-fb8f-4224-b847-c5ff81ef6276 tempest-SnapshotDependencyTests-222048441 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-504d02ee-8f24-47bf-ad86-6addf5c8e35c.fa7454fd-99f6-4d57-8b57-421fea1fecae" returned: 0 in 0.767s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:56:22 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.remotefs [None req-e0938ffe-fb8f-4224-b847-c5ff81ef6276 tempest-SnapshotDependencyTests-222048441 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-504d02ee-8f24-47bf-ad86-6addf5c8e35c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87444) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 10 04:56:22 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-e0938ffe-fb8f-4224-b847-c5ff81ef6276 tempest-SnapshotDependencyTests-222048441 None] will copy from snapshot at /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-504d02ee-8f24-47bf-ad86-6addf5c8e35c {{(pid=87444) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jul 10 04:56:22 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-e0938ffe-fb8f-4224-b847-c5ff81ef6276 tempest-SnapshotDependencyTests-222048441 None] Creating direct copy from snapshot {{(pid=87444) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jul 10 04:56:22 devstack cinder-volume[87444]: DEBUG oslo.privsep.daemon [-] privsep: reply[bba47e5e-3656-4b87-90fb-d38d0bb76492]: (4, 'qcow2') {{(pid=88499) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 04:56:22 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-e0938ffe-fb8f-4224-b847-c5ff81ef6276 tempest-SnapshotDependencyTests-222048441 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-504d02ee-8f24-47bf-ad86-6addf5c8e35c {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:56:23 devstack sudo[107217]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-504d02ee-8f24-47bf-ad86-6addf5c8e35c Jul 10 04:56:23 devstack sudo[107217]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:56:23 devstack sudo[107212]: pam_unix(sudo:session): session closed for user root Jul 10 04:56:23 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-d117aaf1-6735-42a3-8289-c9f70f1068c4 tempest-ProjectMemberTests-1806793813 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-c40c9da6-2692-44d8-88a1-b71866332e7b.2ac3a629-cbd0-487e-a734-76be0bbeaee9" returned: 0 in 0.773s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:56:23 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.remotefs [None req-d117aaf1-6735-42a3-8289-c9f70f1068c4 tempest-ProjectMemberTests-1806793813 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c40c9da6-2692-44d8-88a1-b71866332e7b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87444) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 10 04:56:23 devstack cinder-volume[87444]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d42cf89-d9d0-49eb-b3a3-e143f345533c]: (4, 'qcow2') {{(pid=88499) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 04:56:23 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-d117aaf1-6735-42a3-8289-c9f70f1068c4 tempest-ProjectMemberTests-1806793813 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-c40c9da6-2692-44d8-88a1-b71866332e7b {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:56:23 devstack sudo[107222]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-c40c9da6-2692-44d8-88a1-b71866332e7b Jul 10 04:56:23 devstack sudo[107222]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:56:23 devstack sudo[107217]: pam_unix(sudo:session): session closed for user root Jul 10 04:56:23 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-e0938ffe-fb8f-4224-b847-c5ff81ef6276 tempest-SnapshotDependencyTests-222048441 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-504d02ee-8f24-47bf-ad86-6addf5c8e35c" returned: 0 in 0.771s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:56:23 devstack cinder-volume[87444]: DEBUG cinder.utils [None req-e0938ffe-fb8f-4224-b847-c5ff81ef6276 tempest-SnapshotDependencyTests-222048441 None] Path /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-3ac3f596-a37c-4700-a332-1109539f552f not found in is_blk_device check {{(pid=87444) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 10 04:56:23 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-e0938ffe-fb8f-4224-b847-c5ff81ef6276 tempest-SnapshotDependencyTests-222048441 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-504d02ee-8f24-47bf-ad86-6addf5c8e35c /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-3ac3f596-a37c-4700-a332-1109539f552f {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:56:23 devstack sudo[107228]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-504d02ee-8f24-47bf-ad86-6addf5c8e35c /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-3ac3f596-a37c-4700-a332-1109539f552f Jul 10 04:56:23 devstack sudo[107228]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:56:24 devstack sudo[107222]: pam_unix(sudo:session): session closed for user root Jul 10 04:56:24 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-d117aaf1-6735-42a3-8289-c9f70f1068c4 tempest-ProjectMemberTests-1806793813 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-c40c9da6-2692-44d8-88a1-b71866332e7b" returned: 0 in 0.762s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:56:24 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-d117aaf1-6735-42a3-8289-c9f70f1068c4 tempest-ProjectMemberTests-1806793813 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-c40c9da6-2692-44d8-88a1-b71866332e7b.2ac3a629-cbd0-487e-a734-76be0bbeaee9 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:56:24 devstack sudo[107233]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-c40c9da6-2692-44d8-88a1-b71866332e7b.2ac3a629-cbd0-487e-a734-76be0bbeaee9 Jul 10 04:56:24 devstack sudo[107233]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:56:25 devstack sudo[107233]: pam_unix(sudo:session): session closed for user root Jul 10 04:56:25 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-d117aaf1-6735-42a3-8289-c9f70f1068c4 tempest-ProjectMemberTests-1806793813 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-c40c9da6-2692-44d8-88a1-b71866332e7b.2ac3a629-cbd0-487e-a734-76be0bbeaee9" returned: 0 in 1.065s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:56:25 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-d117aaf1-6735-42a3-8289-c9f70f1068c4 tempest-ProjectMemberTests-1806793813 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-c40c9da6-2692-44d8-88a1-b71866332e7b.2ac3a629-cbd0-487e-a734-76be0bbeaee9 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:56:25 devstack sudo[107248]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-c40c9da6-2692-44d8-88a1-b71866332e7b.2ac3a629-cbd0-487e-a734-76be0bbeaee9 Jul 10 04:56:25 devstack sudo[107248]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:56:26 devstack sudo[107248]: pam_unix(sudo:session): session closed for user root Jul 10 04:56:26 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-d117aaf1-6735-42a3-8289-c9f70f1068c4 tempest-ProjectMemberTests-1806793813 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-c40c9da6-2692-44d8-88a1-b71866332e7b.2ac3a629-cbd0-487e-a734-76be0bbeaee9" returned: 0 in 1.037s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:56:26 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-d117aaf1-6735-42a3-8289-c9f70f1068c4 tempest-ProjectMemberTests-1806793813 None] Lock "cinder-quobyte-2ac3a629-cbd0-487e-a734-76be0bbeaee9" released by "_delete_snapshot" :: held 3.772s {{(pid=87444) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 04:56:26 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-d117aaf1-6735-42a3-8289-c9f70f1068c4 tempest-ProjectMemberTests-1806793813 None] Lock "cinder-quobyte-c40c9da6-2692-44d8-88a1-b71866332e7b" released by "delete_snapshot" :: held 3.799s {{(pid=87444) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 04:56:26 devstack cinder-volume[87444]: DEBUG cinder.quota [None req-d117aaf1-6735-42a3-8289-c9f70f1068c4 tempest-ProjectMemberTests-1806793813 None] Created reservations ['a305528a-c349-45a2-b2ee-01d6209224f8', 'ca04e1f5-b3cd-40b9-9744-65822c53150c', '194ddce9-5f06-44be-8dc3-12813e24535a', '9c2208f1-24ff-436b-845f-d532dd691bf8'] {{(pid=87444) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 04:56:26 devstack cinder-volume[87444]: INFO cinder.volume.manager [None req-d117aaf1-6735-42a3-8289-c9f70f1068c4 tempest-ProjectMemberTests-1806793813 None] Delete snapshot completed successfully. Jul 10 04:56:26 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-d117aaf1-6735-42a3-8289-c9f70f1068c4 tempest-ProjectMemberTests-1806793813 None] Lock "cinder-2ac3a629-cbd0-487e-a734-76be0bbeaee9-delete_snapshot" released by "delete_snapshot" :: held 4.081s {{(pid=87444) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 04:56:26 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-b3e400e8-553c-41ec-bace-5ca0e26ba7e7 tempest-ProjectMemberTests-1806793813 None] Acquiring lock "cinder-c40c9da6-2692-44d8-88a1-b71866332e7b-delete_volume" by "delete_volume" {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 04:56:26 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-b3e400e8-553c-41ec-bace-5ca0e26ba7e7 tempest-ProjectMemberTests-1806793813 None] Lock "cinder-c40c9da6-2692-44d8-88a1-b71866332e7b-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 04:56:26 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-b3e400e8-553c-41ec-bace-5ca0e26ba7e7 tempest-ProjectMemberTests-1806793813 None] Acquiring lock "cinder-quobyte-c40c9da6-2692-44d8-88a1-b71866332e7b" by "delete_volume" {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 04:56:26 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-b3e400e8-553c-41ec-bace-5ca0e26ba7e7 tempest-ProjectMemberTests-1806793813 None] Lock "cinder-quobyte-c40c9da6-2692-44d8-88a1-b71866332e7b" acquired by "delete_volume" :: waited 0.035s {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 04:56:27 devstack cinder-volume[87444]: DEBUG oslo.privsep.daemon [-] privsep: reply[433ec305-db72-4ec1-9cd6-613d74e6ac5d]: (4, 'qcow2') {{(pid=88499) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 04:56:27 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-b3e400e8-553c-41ec-bace-5ca0e26ba7e7 tempest-ProjectMemberTests-1806793813 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-c40c9da6-2692-44d8-88a1-b71866332e7b {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:56:27 devstack sudo[107252]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-c40c9da6-2692-44d8-88a1-b71866332e7b Jul 10 04:56:27 devstack sudo[107252]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:56:28 devstack sudo[107252]: pam_unix(sudo:session): session closed for user root Jul 10 04:56:28 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-b3e400e8-553c-41ec-bace-5ca0e26ba7e7 tempest-ProjectMemberTests-1806793813 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-c40c9da6-2692-44d8-88a1-b71866332e7b" returned: 0 in 1.177s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:56:28 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-b3e400e8-553c-41ec-bace-5ca0e26ba7e7 tempest-ProjectMemberTests-1806793813 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-c40c9da6-2692-44d8-88a1-b71866332e7b {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:56:28 devstack sudo[107257]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-c40c9da6-2692-44d8-88a1-b71866332e7b Jul 10 04:56:28 devstack sudo[107257]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:56:28 devstack sudo[107228]: pam_unix(sudo:session): session closed for user root Jul 10 04:56:28 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-e0938ffe-fb8f-4224-b847-c5ff81ef6276 tempest-SnapshotDependencyTests-222048441 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-504d02ee-8f24-47bf-ad86-6addf5c8e35c /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-3ac3f596-a37c-4700-a332-1109539f552f" returned: 0 in 5.096s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:56:28 devstack cinder-volume[87444]: DEBUG oslo.privsep.daemon [-] privsep: reply[eee3b812-672e-4d9f-8b0c-83da9915a3f8]: (4, 'qcow2') {{(pid=88499) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 04:56:28 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-e0938ffe-fb8f-4224-b847-c5ff81ef6276 tempest-SnapshotDependencyTests-222048441 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-504d02ee-8f24-47bf-ad86-6addf5c8e35c {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:56:28 devstack sudo[107259]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-504d02ee-8f24-47bf-ad86-6addf5c8e35c Jul 10 04:56:28 devstack sudo[107259]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:56:29 devstack sudo[107257]: pam_unix(sudo:session): session closed for user root Jul 10 04:56:29 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-b3e400e8-553c-41ec-bace-5ca0e26ba7e7 tempest-ProjectMemberTests-1806793813 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-c40c9da6-2692-44d8-88a1-b71866332e7b" returned: 0 in 0.800s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:56:29 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-b3e400e8-553c-41ec-bace-5ca0e26ba7e7 tempest-ProjectMemberTests-1806793813 None] Lock "cinder-quobyte-c40c9da6-2692-44d8-88a1-b71866332e7b" released by "delete_volume" :: held 2.130s {{(pid=87444) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 04:56:29 devstack cinder-volume[87444]: DEBUG cinder.quota [None req-b3e400e8-553c-41ec-bace-5ca0e26ba7e7 tempest-ProjectMemberTests-1806793813 None] Created reservations ['7a96af01-d0de-4b18-b5c5-f4455c1292e2', '25db381e-17b9-4021-89b6-d8f4919e40fa', '46f64354-36bd-4ecb-adef-e78e3596cf17', '32bd09bc-cca6-4380-9b25-f4dca79b76ac'] {{(pid=87444) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 04:56:29 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-b3e400e8-553c-41ec-bace-5ca0e26ba7e7 tempest-ProjectMemberTests-1806793813 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 04:56:29 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-b3e400e8-553c-41ec-bace-5ca0e26ba7e7 tempest-ProjectMemberTests-1806793813 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 04:56:29 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-b3e400e8-553c-41ec-bace-5ca0e26ba7e7 tempest-ProjectMemberTests-1806793813 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922': None} {{(pid=87444) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 04:56:29 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-b3e400e8-553c-41ec-bace-5ca0e26ba7e7 tempest-ProjectMemberTests-1806793813 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922'] {{(pid=87444) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 04:56:29 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-b3e400e8-553c-41ec-bace-5ca0e26ba7e7 tempest-ProjectMemberTests-1806793813 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 04:56:29 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-b3e400e8-553c-41ec-bace-5ca0e26ba7e7 tempest-ProjectMemberTests-1806793813 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:56:29 devstack sudo[107262]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097 Jul 10 04:56:29 devstack sudo[107262]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:56:29 devstack cinder-volume[87444]: DEBUG cinder.volume.flows.manager.create_volume [None req-aeb2bd7f-e8f9-42de-a896-2e1282c92f07 tempest-ProjectMemberTests-1806793813 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87444) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 04:56:29 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-aeb2bd7f-e8f9-42de-a896-2e1282c92f07 tempest-ProjectMemberTests-1806793813 None] Flow 'volume_create_manager' (9d95ecaa-3eae-4ba3-9fd6-d7330bbfb8f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 04:56:29 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-aeb2bd7f-e8f9-42de-a896-2e1282c92f07 tempest-ProjectMemberTests-1806793813 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c5f2f150-492b-4e8b-b227-eb198f12c5fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:56:29 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-aeb2bd7f-e8f9-42de-a896-2e1282c92f07 tempest-ProjectMemberTests-1806793813 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c5f2f150-492b-4e8b-b227-eb198f12c5fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T02:56:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-506783292',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7ddcef8c-2d58-427f-a21b-141672229fe7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cadbf6455bcb4ed48f08a3c15f1d84e3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T02:56:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T02:56:30Z,use_quota=True,user_id='2aceae1efa264e87bd2696a5a256f622',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(317e369e-1e06-434d-ae95-a335f0e6c903),volume_type_id=317e369e-1e06-434d-ae95-a335f0e6c903)' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:56:29 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-aeb2bd7f-e8f9-42de-a896-2e1282c92f07 tempest-ProjectMemberTests-1806793813 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5b3c693b-dad9-40ea-a126-75cdf1c4e5d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:56:29 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-aeb2bd7f-e8f9-42de-a896-2e1282c92f07 tempest-ProjectMemberTests-1806793813 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5b3c693b-dad9-40ea-a126-75cdf1c4e5d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:56:29 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-aeb2bd7f-e8f9-42de-a896-2e1282c92f07 tempest-ProjectMemberTests-1806793813 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f1d36074-b135-4b25-99aa-a98b0e71f61e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:56:29 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-aeb2bd7f-e8f9-42de-a896-2e1282c92f07 tempest-ProjectMemberTests-1806793813 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f1d36074-b135-4b25-99aa-a98b0e71f61e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7ddcef8c-2d58-427f-a21b-141672229fe7', 'volume_name': 'volume-7ddcef8c-2d58-427f-a21b-141672229fe7', 'volume_size': 1}' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:56:29 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-aeb2bd7f-e8f9-42de-a896-2e1282c92f07 tempest-ProjectMemberTests-1806793813 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5eec795f-48f1-4138-9333-19916ec8955b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:56:29 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-aeb2bd7f-e8f9-42de-a896-2e1282c92f07 tempest-ProjectMemberTests-1806793813 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5eec795f-48f1-4138-9333-19916ec8955b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:56:29 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-aeb2bd7f-e8f9-42de-a896-2e1282c92f07 tempest-ProjectMemberTests-1806793813 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a73507dc-3172-4efa-9dc1-41ae3af195df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:56:29 devstack cinder-volume[87444]: INFO cinder.volume.flows.manager.create_volume [None req-aeb2bd7f-e8f9-42de-a896-2e1282c92f07 tempest-ProjectMemberTests-1806793813 None] Volume 7ddcef8c-2d58-427f-a21b-141672229fe7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7ddcef8c-2d58-427f-a21b-141672229fe7', 'volume_size': 1} Jul 10 04:56:29 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-aeb2bd7f-e8f9-42de-a896-2e1282c92f07 tempest-ProjectMemberTests-1806793813 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 04:56:29 devstack sudo[107259]: pam_unix(sudo:session): session closed for user root Jul 10 04:56:29 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-e0938ffe-fb8f-4224-b847-c5ff81ef6276 tempest-SnapshotDependencyTests-222048441 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-504d02ee-8f24-47bf-ad86-6addf5c8e35c" returned: 0 in 0.992s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:56:29 devstack cinder-volume[87444]: DEBUG cinder.image.image_utils [None req-e0938ffe-fb8f-4224-b847-c5ff81ef6276 tempest-SnapshotDependencyTests-222048441 None] Image conversion details: src /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-504d02ee-8f24-47bf-ad86-6addf5c8e35c, size 1024.00 MB, duration 5.10 sec, destination /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-3ac3f596-a37c-4700-a332-1109539f552f {{(pid=87444) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:561}} Jul 10 04:56:29 devstack cinder-volume[87444]: INFO cinder.image.image_utils [None req-e0938ffe-fb8f-4224-b847-c5ff81ef6276 tempest-SnapshotDependencyTests-222048441 None] Converted 1024.00 MB image at 200.88 MB/s Jul 10 04:56:29 devstack cinder-volume[87444]: WARNING cinder.volume.drivers.remotefs [None req-e0938ffe-fb8f-4224-b847-c5ff81ef6276 tempest-SnapshotDependencyTests-222048441 None] /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-3ac3f596-a37c-4700-a332-1109539f552f is being set with open permissions: ugo+rw Jul 10 04:56:29 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-e0938ffe-fb8f-4224-b847-c5ff81ef6276 tempest-SnapshotDependencyTests-222048441 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-3ac3f596-a37c-4700-a332-1109539f552f {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:56:29 devstack sudo[107268]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-3ac3f596-a37c-4700-a332-1109539f552f Jul 10 04:56:29 devstack sudo[107268]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:56:29 devstack sudo[107262]: pam_unix(sudo:session): session closed for user root Jul 10 04:56:29 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-b3e400e8-553c-41ec-bace-5ca0e26ba7e7 tempest-ProjectMemberTests-1806793813 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097" returned: 0 in 0.708s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:56:29 devstack cinder-volume[87444]: DEBUG cinder.manager [None req-b3e400e8-553c-41ec-bace-5ca0e26ba7e7 tempest-ProjectMemberTests-1806793813 None] Notifying Schedulers of capabilities ... {{(pid=87444) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 04:56:29 devstack cinder-volume[87444]: INFO cinder.volume.manager [None req-b3e400e8-553c-41ec-bace-5ca0e26ba7e7 tempest-ProjectMemberTests-1806793813 None] Deleted volume successfully. Jul 10 04:56:29 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-b3e400e8-553c-41ec-bace-5ca0e26ba7e7 tempest-ProjectMemberTests-1806793813 None] Lock "cinder-c40c9da6-2692-44d8-88a1-b71866332e7b-delete_volume" released by "delete_volume" :: held 3.087s {{(pid=87444) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 04:56:30 devstack sudo[107268]: pam_unix(sudo:session): session closed for user root Jul 10 04:56:30 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-e0938ffe-fb8f-4224-b847-c5ff81ef6276 tempest-SnapshotDependencyTests-222048441 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-3ac3f596-a37c-4700-a332-1109539f552f" returned: 0 in 0.646s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:56:30 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-e0938ffe-fb8f-4224-b847-c5ff81ef6276 tempest-SnapshotDependencyTests-222048441 None] Lock "cinder-quobyte-3ac3f596-a37c-4700-a332-1109539f552f" released by "_copy_volume_from_snapshot" :: held 8.361s {{(pid=87444) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 04:56:30 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-e0938ffe-fb8f-4224-b847-c5ff81ef6276 tempest-SnapshotDependencyTests-222048441 None] Lock "cinder-quobyte-fa7454fd-99f6-4d57-8b57-421fea1fecae-3ac3f596-a37c-4700-a332-1109539f552f" released by "_create_volume_from_snapshot" :: held 8.397s {{(pid=87444) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 04:56:30 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-e0938ffe-fb8f-4224-b847-c5ff81ef6276 tempest-SnapshotDependencyTests-222048441 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 8.419s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 04:56:30 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-aeb2bd7f-e8f9-42de-a896-2e1282c92f07 tempest-ProjectMemberTests-1806793813 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.712s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 04:56:30 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-aeb2bd7f-e8f9-42de-a896-2e1282c92f07 tempest-ProjectMemberTests-1806793813 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T02:56:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-506783292',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7ddcef8c-2d58-427f-a21b-141672229fe7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cadbf6455bcb4ed48f08a3c15f1d84e3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T02:56:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T02:56:30Z,use_quota=True,user_id='2aceae1efa264e87bd2696a5a256f622',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(317e369e-1e06-434d-ae95-a335f0e6c903),volume_type_id=317e369e-1e06-434d-ae95-a335f0e6c903)}" {{(pid=87444) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 04:56:30 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.remotefs [None req-aeb2bd7f-e8f9-42de-a896-2e1282c92f07 tempest-ProjectMemberTests-1806793813 None] Creating volume 7ddcef8c-2d58-427f-a21b-141672229fe7 {{(pid=87444) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 04:56:30 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-aeb2bd7f-e8f9-42de-a896-2e1282c92f07 tempest-ProjectMemberTests-1806793813 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 04:56:30 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-aeb2bd7f-e8f9-42de-a896-2e1282c92f07 tempest-ProjectMemberTests-1806793813 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 04:56:30 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-aeb2bd7f-e8f9-42de-a896-2e1282c92f07 tempest-ProjectMemberTests-1806793813 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922': None} {{(pid=87444) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 04:56:30 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-aeb2bd7f-e8f9-42de-a896-2e1282c92f07 tempest-ProjectMemberTests-1806793813 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922'] {{(pid=87444) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 04:56:30 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-aeb2bd7f-e8f9-42de-a896-2e1282c92f07 tempest-ProjectMemberTests-1806793813 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 04:56:30 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-aeb2bd7f-e8f9-42de-a896-2e1282c92f07 tempest-ProjectMemberTests-1806793813 None] Selected osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922 as target Quobyte volume. {{(pid=87444) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 04:56:30 devstack cinder-volume[87444]: INFO cinder.volume.drivers.remotefs [None req-aeb2bd7f-e8f9-42de-a896-2e1282c92f07 tempest-ProjectMemberTests-1806793813 None] casted to osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922 Jul 10 04:56:30 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-aeb2bd7f-e8f9-42de-a896-2e1282c92f07 tempest-ProjectMemberTests-1806793813 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-7ddcef8c-2d58-427f-a21b-141672229fe7 1073741824 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:56:30 devstack sudo[107271]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-7ddcef8c-2d58-427f-a21b-141672229fe7 1073741824 Jul 10 04:56:30 devstack sudo[107271]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:56:30 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-e0938ffe-fb8f-4224-b847-c5ff81ef6276 tempest-SnapshotDependencyTests-222048441 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1805c064-895c-4807-bbc3-6a4d2aecebac) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3ac3f596-a37c-4700-a332-1109539f552f', 'volume_size': 1, 'snapshot_id': 'fa7454fd-99f6-4d57-8b57-421fea1fecae'}' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:56:30 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-e0938ffe-fb8f-4224-b847-c5ff81ef6276 tempest-SnapshotDependencyTests-222048441 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (19603a20-8005-4dc1-b427-81b0f8125c08) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:56:30 devstack cinder-volume[87444]: INFO cinder.volume.flows.manager.create_volume [None req-e0938ffe-fb8f-4224-b847-c5ff81ef6276 tempest-SnapshotDependencyTests-222048441 None] Volume volume-3ac3f596-a37c-4700-a332-1109539f552f (3ac3f596-a37c-4700-a332-1109539f552f): created successfully Jul 10 04:56:30 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-e0938ffe-fb8f-4224-b847-c5ff81ef6276 tempest-SnapshotDependencyTests-222048441 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (19603a20-8005-4dc1-b427-81b0f8125c08) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:56:30 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-e0938ffe-fb8f-4224-b847-c5ff81ef6276 tempest-SnapshotDependencyTests-222048441 None] Flow 'volume_create_manager' (b87ad578-b946-4e26-8fe7-368ae30d39ce) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87444) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 04:56:30 devstack cinder-volume[87444]: INFO cinder.volume.manager [None req-e0938ffe-fb8f-4224-b847-c5ff81ef6276 tempest-SnapshotDependencyTests-222048441 None] Created volume successfully. Jul 10 04:56:31 devstack sudo[107271]: pam_unix(sudo:session): session closed for user root Jul 10 04:56:31 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-aeb2bd7f-e8f9-42de-a896-2e1282c92f07 tempest-ProjectMemberTests-1806793813 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-7ddcef8c-2d58-427f-a21b-141672229fe7 1073741824" returned: 0 in 0.801s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:56:31 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-aeb2bd7f-e8f9-42de-a896-2e1282c92f07 tempest-ProjectMemberTests-1806793813 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-7ddcef8c-2d58-427f-a21b-141672229fe7 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:56:31 devstack sudo[107276]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-7ddcef8c-2d58-427f-a21b-141672229fe7 Jul 10 04:56:31 devstack sudo[107276]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:56:31 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-e02f7354-d158-40b5-b900-48b312436944 tempest-SnapshotDependencyTests-222048441 None] Acquiring lock "cinder-fa7454fd-99f6-4d57-8b57-421fea1fecae-delete_snapshot" by "delete_snapshot" {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 04:56:31 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-e02f7354-d158-40b5-b900-48b312436944 tempest-SnapshotDependencyTests-222048441 None] Lock "cinder-fa7454fd-99f6-4d57-8b57-421fea1fecae-delete_snapshot" acquired by "delete_snapshot" :: waited 0.024s {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 04:56:31 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-e02f7354-d158-40b5-b900-48b312436944 tempest-SnapshotDependencyTests-222048441 None] Acquiring lock "cinder-quobyte-504d02ee-8f24-47bf-ad86-6addf5c8e35c" by "delete_snapshot" {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 04:56:31 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-e02f7354-d158-40b5-b900-48b312436944 tempest-SnapshotDependencyTests-222048441 None] Lock "cinder-quobyte-504d02ee-8f24-47bf-ad86-6addf5c8e35c" acquired by "delete_snapshot" :: waited 0.025s {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 04:56:31 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-e02f7354-d158-40b5-b900-48b312436944 tempest-SnapshotDependencyTests-222048441 None] Acquiring lock "cinder-quobyte-fa7454fd-99f6-4d57-8b57-421fea1fecae" by "_delete_snapshot" {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 04:56:31 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-e02f7354-d158-40b5-b900-48b312436944 tempest-SnapshotDependencyTests-222048441 None] Lock "cinder-quobyte-fa7454fd-99f6-4d57-8b57-421fea1fecae" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 04:56:31 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.remotefs [None req-e02f7354-d158-40b5-b900-48b312436944 tempest-SnapshotDependencyTests-222048441 None] Deleting offline snapshot fa7454fd-99f6-4d57-8b57-421fea1fecae of volume 504d02ee-8f24-47bf-ad86-6addf5c8e35c {{(pid=87444) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 10 04:56:31 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.remotefs [None req-e02f7354-d158-40b5-b900-48b312436944 tempest-SnapshotDependencyTests-222048441 None] snapshot_file for this snap is: volume-504d02ee-8f24-47bf-ad86-6addf5c8e35c.fa7454fd-99f6-4d57-8b57-421fea1fecae {{(pid=87444) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 10 04:56:31 devstack cinder-volume[87444]: DEBUG oslo.privsep.daemon [-] privsep: reply[203a9648-057b-4e3c-beaa-ca390aa86016]: (4, 'qcow2') {{(pid=88499) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 04:56:31 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-e02f7354-d158-40b5-b900-48b312436944 tempest-SnapshotDependencyTests-222048441 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-504d02ee-8f24-47bf-ad86-6addf5c8e35c.fa7454fd-99f6-4d57-8b57-421fea1fecae {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:56:31 devstack sudo[107278]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-504d02ee-8f24-47bf-ad86-6addf5c8e35c.fa7454fd-99f6-4d57-8b57-421fea1fecae Jul 10 04:56:31 devstack sudo[107278]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:56:31 devstack sudo[107276]: pam_unix(sudo:session): session closed for user root Jul 10 04:56:31 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-aeb2bd7f-e8f9-42de-a896-2e1282c92f07 tempest-ProjectMemberTests-1806793813 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-7ddcef8c-2d58-427f-a21b-141672229fe7" returned: 0 in 0.640s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:56:31 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-aeb2bd7f-e8f9-42de-a896-2e1282c92f07 tempest-ProjectMemberTests-1806793813 None] <== create_volume: return (1480ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922'} {{(pid=87444) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 04:56:31 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-aeb2bd7f-e8f9-42de-a896-2e1282c92f07 tempest-ProjectMemberTests-1806793813 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.483s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 04:56:31 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-aeb2bd7f-e8f9-42de-a896-2e1282c92f07 tempest-ProjectMemberTests-1806793813 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a73507dc-3172-4efa-9dc1-41ae3af195df) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7ddcef8c-2d58-427f-a21b-141672229fe7', 'volume_size': 1}' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:56:31 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-aeb2bd7f-e8f9-42de-a896-2e1282c92f07 tempest-ProjectMemberTests-1806793813 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (abf4299d-e6a9-4611-bc53-9d5ca1314e94) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:56:31 devstack cinder-volume[87444]: INFO cinder.volume.flows.manager.create_volume [None req-aeb2bd7f-e8f9-42de-a896-2e1282c92f07 tempest-ProjectMemberTests-1806793813 None] Volume volume-7ddcef8c-2d58-427f-a21b-141672229fe7 (7ddcef8c-2d58-427f-a21b-141672229fe7): created successfully Jul 10 04:56:31 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-aeb2bd7f-e8f9-42de-a896-2e1282c92f07 tempest-ProjectMemberTests-1806793813 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (abf4299d-e6a9-4611-bc53-9d5ca1314e94) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:56:31 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-aeb2bd7f-e8f9-42de-a896-2e1282c92f07 tempest-ProjectMemberTests-1806793813 None] Flow 'volume_create_manager' (9d95ecaa-3eae-4ba3-9fd6-d7330bbfb8f3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87444) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 04:56:31 devstack cinder-volume[87444]: INFO cinder.volume.manager [None req-aeb2bd7f-e8f9-42de-a896-2e1282c92f07 tempest-ProjectMemberTests-1806793813 None] Created volume successfully. Jul 10 04:56:32 devstack sudo[107278]: pam_unix(sudo:session): session closed for user root Jul 10 04:56:32 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-e02f7354-d158-40b5-b900-48b312436944 tempest-SnapshotDependencyTests-222048441 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-504d02ee-8f24-47bf-ad86-6addf5c8e35c.fa7454fd-99f6-4d57-8b57-421fea1fecae" returned: 0 in 0.777s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:56:32 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.remotefs [None req-e02f7354-d158-40b5-b900-48b312436944 tempest-SnapshotDependencyTests-222048441 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-504d02ee-8f24-47bf-ad86-6addf5c8e35c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87444) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 10 04:56:32 devstack cinder-volume[87444]: DEBUG oslo.privsep.daemon [-] privsep: reply[81739897-eb4b-424e-9467-27e1ac431459]: (4, 'qcow2') {{(pid=88499) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 04:56:32 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-e02f7354-d158-40b5-b900-48b312436944 tempest-SnapshotDependencyTests-222048441 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-504d02ee-8f24-47bf-ad86-6addf5c8e35c {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:56:32 devstack sudo[107284]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-504d02ee-8f24-47bf-ad86-6addf5c8e35c Jul 10 04:56:32 devstack sudo[107284]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:56:32 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-638f9928-37b1-46c9-b475-02a3582aef79 tempest-ProjectMemberTests-1806793813 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 04:56:32 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-638f9928-37b1-46c9-b475-02a3582aef79 tempest-ProjectMemberTests-1806793813 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 04:56:32 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.remotefs [None req-638f9928-37b1-46c9-b475-02a3582aef79 tempest-ProjectMemberTests-1806793813 None] Creating offline snapshot 25fd67e1-44b5-402f-adad-0a1f21341bd4 of volume 7ddcef8c-2d58-427f-a21b-141672229fe7 {{(pid=87444) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 10 04:56:32 devstack cinder-volume[87444]: DEBUG oslo.privsep.daemon [-] privsep: reply[81a22436-8251-424f-9526-9a2b0cf9fcc7]: (4, 'qcow2') {{(pid=88499) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 04:56:32 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-638f9928-37b1-46c9-b475-02a3582aef79 tempest-ProjectMemberTests-1806793813 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-7ddcef8c-2d58-427f-a21b-141672229fe7 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:56:33 devstack cinder-volume[87444]: DEBUG oslo_service.periodic_task [None req-01f0ce3e-6850-4e14-881d-e40d3c4ad6e5 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87444) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 10 04:56:33 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-01f0ce3e-6850-4e14-881d-e40d3c4ad6e5 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 04:56:33 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-01f0ce3e-6850-4e14-881d-e40d3c4ad6e5 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 04:56:33 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-01f0ce3e-6850-4e14-881d-e40d3c4ad6e5 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922': None} {{(pid=87444) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 04:56:33 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-01f0ce3e-6850-4e14-881d-e40d3c4ad6e5 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922'] {{(pid=87444) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 04:56:33 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-01f0ce3e-6850-4e14-881d-e40d3c4ad6e5 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 04:56:33 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-01f0ce3e-6850-4e14-881d-e40d3c4ad6e5 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:56:33 devstack sudo[107290]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097 Jul 10 04:56:33 devstack sudo[107290]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:56:33 devstack sudo[107284]: pam_unix(sudo:session): session closed for user root Jul 10 04:56:33 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-e02f7354-d158-40b5-b900-48b312436944 tempest-SnapshotDependencyTests-222048441 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-504d02ee-8f24-47bf-ad86-6addf5c8e35c" returned: 0 in 0.755s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:56:33 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-e02f7354-d158-40b5-b900-48b312436944 tempest-SnapshotDependencyTests-222048441 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-504d02ee-8f24-47bf-ad86-6addf5c8e35c.fa7454fd-99f6-4d57-8b57-421fea1fecae {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:56:33 devstack sudo[107289]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-7ddcef8c-2d58-427f-a21b-141672229fe7 Jul 10 04:56:33 devstack sudo[107289]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:56:33 devstack sudo[107292]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-504d02ee-8f24-47bf-ad86-6addf5c8e35c.fa7454fd-99f6-4d57-8b57-421fea1fecae Jul 10 04:56:33 devstack sudo[107292]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:56:33 devstack sudo[107290]: pam_unix(sudo:session): session closed for user root Jul 10 04:56:33 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-01f0ce3e-6850-4e14-881d-e40d3c4ad6e5 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097" returned: 0 in 0.676s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:56:33 devstack cinder-volume[87444]: DEBUG cinder.manager [None req-01f0ce3e-6850-4e14-881d-e40d3c4ad6e5 None None] Notifying Schedulers of capabilities ... {{(pid=87444) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 04:56:33 devstack cinder-volume[87444]: DEBUG oslo_service.periodic_task [None req-01f0ce3e-6850-4e14-881d-e40d3c4ad6e5 None None] Running periodic task VolumeManager._thread_info {{(pid=87444) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 10 04:56:33 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-01f0ce3e-6850-4e14-881d-e40d3c4ad6e5 None None] thread count: 28 {{(pid=87444) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 10 04:56:33 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-01f0ce3e-6850-4e14-881d-e40d3c4ad6e5 None None] thread info: [<_MainThread(MainThread, started 126839257915520)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87444) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 10 04:56:33 devstack sudo[107289]: pam_unix(sudo:session): session closed for user root Jul 10 04:56:33 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-638f9928-37b1-46c9-b475-02a3582aef79 tempest-ProjectMemberTests-1806793813 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-7ddcef8c-2d58-427f-a21b-141672229fe7" returned: 0 in 0.801s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:56:33 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-638f9928-37b1-46c9-b475-02a3582aef79 tempest-ProjectMemberTests-1806793813 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-7ddcef8c-2d58-427f-a21b-141672229fe7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-7ddcef8c-2d58-427f-a21b-141672229fe7.25fd67e1-44b5-402f-adad-0a1f21341bd4 1G {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:56:33 devstack sudo[107303]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-7ddcef8c-2d58-427f-a21b-141672229fe7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-7ddcef8c-2d58-427f-a21b-141672229fe7.25fd67e1-44b5-402f-adad-0a1f21341bd4 1G Jul 10 04:56:33 devstack sudo[107303]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:56:33 devstack sudo[107292]: pam_unix(sudo:session): session closed for user root Jul 10 04:56:33 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-e02f7354-d158-40b5-b900-48b312436944 tempest-SnapshotDependencyTests-222048441 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-504d02ee-8f24-47bf-ad86-6addf5c8e35c.fa7454fd-99f6-4d57-8b57-421fea1fecae" returned: 0 in 0.760s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:56:33 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-e02f7354-d158-40b5-b900-48b312436944 tempest-SnapshotDependencyTests-222048441 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-504d02ee-8f24-47bf-ad86-6addf5c8e35c.fa7454fd-99f6-4d57-8b57-421fea1fecae {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:56:33 devstack sudo[107305]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-504d02ee-8f24-47bf-ad86-6addf5c8e35c.fa7454fd-99f6-4d57-8b57-421fea1fecae Jul 10 04:56:33 devstack sudo[107305]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:56:34 devstack sudo[107305]: pam_unix(sudo:session): session closed for user root Jul 10 04:56:34 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-e02f7354-d158-40b5-b900-48b312436944 tempest-SnapshotDependencyTests-222048441 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-504d02ee-8f24-47bf-ad86-6addf5c8e35c.fa7454fd-99f6-4d57-8b57-421fea1fecae" returned: 0 in 0.661s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:56:34 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-e02f7354-d158-40b5-b900-48b312436944 tempest-SnapshotDependencyTests-222048441 None] Lock "cinder-quobyte-fa7454fd-99f6-4d57-8b57-421fea1fecae" released by "_delete_snapshot" :: held 3.057s {{(pid=87444) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 04:56:34 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-e02f7354-d158-40b5-b900-48b312436944 tempest-SnapshotDependencyTests-222048441 None] Lock "cinder-quobyte-504d02ee-8f24-47bf-ad86-6addf5c8e35c" released by "delete_snapshot" :: held 3.083s {{(pid=87444) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 04:56:34 devstack sudo[107303]: pam_unix(sudo:session): session closed for user root Jul 10 04:56:34 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-638f9928-37b1-46c9-b475-02a3582aef79 tempest-ProjectMemberTests-1806793813 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-7ddcef8c-2d58-427f-a21b-141672229fe7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-7ddcef8c-2d58-427f-a21b-141672229fe7.25fd67e1-44b5-402f-adad-0a1f21341bd4 1G" returned: 0 in 0.785s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:56:34 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-638f9928-37b1-46c9-b475-02a3582aef79 tempest-ProjectMemberTests-1806793813 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7ddcef8c-2d58-427f-a21b-141672229fe7 -F qcow2 /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-7ddcef8c-2d58-427f-a21b-141672229fe7.25fd67e1-44b5-402f-adad-0a1f21341bd4 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:56:34 devstack sudo[107312]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7ddcef8c-2d58-427f-a21b-141672229fe7 -F qcow2 /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-7ddcef8c-2d58-427f-a21b-141672229fe7.25fd67e1-44b5-402f-adad-0a1f21341bd4 Jul 10 04:56:34 devstack sudo[107312]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:56:34 devstack cinder-volume[87444]: DEBUG cinder.quota [None req-e02f7354-d158-40b5-b900-48b312436944 tempest-SnapshotDependencyTests-222048441 None] Created reservations ['137e51f1-d634-4f46-939f-188e016299a8', 'd03739f9-fa16-4eaa-b727-77508c874e4e', '055d4c24-68ec-4d42-b568-fe07657aeaba', '1e55ff49-36ed-4fe8-9a39-c101672b6e58'] {{(pid=87444) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 04:56:34 devstack cinder-volume[87444]: INFO cinder.volume.manager [None req-e02f7354-d158-40b5-b900-48b312436944 tempest-SnapshotDependencyTests-222048441 None] Delete snapshot completed successfully. Jul 10 04:56:34 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-e02f7354-d158-40b5-b900-48b312436944 tempest-SnapshotDependencyTests-222048441 None] Lock "cinder-fa7454fd-99f6-4d57-8b57-421fea1fecae-delete_snapshot" released by "delete_snapshot" :: held 3.249s {{(pid=87444) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 04:56:35 devstack sudo[107312]: pam_unix(sudo:session): session closed for user root Jul 10 04:56:35 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-638f9928-37b1-46c9-b475-02a3582aef79 tempest-ProjectMemberTests-1806793813 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7ddcef8c-2d58-427f-a21b-141672229fe7 -F qcow2 /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-7ddcef8c-2d58-427f-a21b-141672229fe7.25fd67e1-44b5-402f-adad-0a1f21341bd4" returned: 0 in 0.693s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:56:35 devstack cinder-volume[87444]: WARNING cinder.volume.drivers.remotefs [None req-638f9928-37b1-46c9-b475-02a3582aef79 tempest-ProjectMemberTests-1806793813 None] /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-7ddcef8c-2d58-427f-a21b-141672229fe7.25fd67e1-44b5-402f-adad-0a1f21341bd4 is being set with open permissions: ugo+rw Jul 10 04:56:35 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-638f9928-37b1-46c9-b475-02a3582aef79 tempest-ProjectMemberTests-1806793813 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-7ddcef8c-2d58-427f-a21b-141672229fe7.25fd67e1-44b5-402f-adad-0a1f21341bd4 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:56:35 devstack sudo[107318]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-7ddcef8c-2d58-427f-a21b-141672229fe7.25fd67e1-44b5-402f-adad-0a1f21341bd4 Jul 10 04:56:35 devstack sudo[107318]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:56:35 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-3091aebc-f9cf-4cf7-b8fa-d981bdfea090 tempest-SnapshotDependencyTests-222048441 None] Acquiring lock "cinder-504d02ee-8f24-47bf-ad86-6addf5c8e35c-delete_volume" by "delete_volume" {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 04:56:35 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-3091aebc-f9cf-4cf7-b8fa-d981bdfea090 tempest-SnapshotDependencyTests-222048441 None] Lock "cinder-504d02ee-8f24-47bf-ad86-6addf5c8e35c-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 04:56:35 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-3091aebc-f9cf-4cf7-b8fa-d981bdfea090 tempest-SnapshotDependencyTests-222048441 None] Acquiring lock "cinder-quobyte-504d02ee-8f24-47bf-ad86-6addf5c8e35c" by "delete_volume" {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 04:56:35 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-3091aebc-f9cf-4cf7-b8fa-d981bdfea090 tempest-SnapshotDependencyTests-222048441 None] Lock "cinder-quobyte-504d02ee-8f24-47bf-ad86-6addf5c8e35c" acquired by "delete_volume" :: waited 0.023s {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 04:56:35 devstack cinder-volume[87444]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8a92c9f-a119-4985-99d7-ea81b323079c]: (4, 'qcow2') {{(pid=88499) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 04:56:35 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-3091aebc-f9cf-4cf7-b8fa-d981bdfea090 tempest-SnapshotDependencyTests-222048441 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-504d02ee-8f24-47bf-ad86-6addf5c8e35c {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:56:35 devstack sudo[107321]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-504d02ee-8f24-47bf-ad86-6addf5c8e35c Jul 10 04:56:35 devstack sudo[107318]: pam_unix(sudo:session): session closed for user root Jul 10 04:56:35 devstack sudo[107321]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:56:35 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-638f9928-37b1-46c9-b475-02a3582aef79 tempest-ProjectMemberTests-1806793813 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-7ddcef8c-2d58-427f-a21b-141672229fe7.25fd67e1-44b5-402f-adad-0a1f21341bd4" returned: 0 in 0.652s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:56:35 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-638f9928-37b1-46c9-b475-02a3582aef79 tempest-ProjectMemberTests-1806793813 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-7ddcef8c-2d58-427f-a21b-141672229fe7.info {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:56:35 devstack sudo[107323]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-7ddcef8c-2d58-427f-a21b-141672229fe7.info Jul 10 04:56:35 devstack sudo[107323]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:56:36 devstack sudo[107321]: pam_unix(sudo:session): session closed for user root Jul 10 04:56:36 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-3091aebc-f9cf-4cf7-b8fa-d981bdfea090 tempest-SnapshotDependencyTests-222048441 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-504d02ee-8f24-47bf-ad86-6addf5c8e35c" returned: 0 in 0.762s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:56:36 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-3091aebc-f9cf-4cf7-b8fa-d981bdfea090 tempest-SnapshotDependencyTests-222048441 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-504d02ee-8f24-47bf-ad86-6addf5c8e35c {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:56:36 devstack sudo[107329]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-504d02ee-8f24-47bf-ad86-6addf5c8e35c Jul 10 04:56:36 devstack sudo[107329]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:56:36 devstack sudo[107323]: pam_unix(sudo:session): session closed for user root Jul 10 04:56:36 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-638f9928-37b1-46c9-b475-02a3582aef79 tempest-ProjectMemberTests-1806793813 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-7ddcef8c-2d58-427f-a21b-141672229fe7.info" returned: 0 in 0.671s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:56:36 devstack cinder-volume[87444]: WARNING cinder.volume.drivers.remotefs [None req-638f9928-37b1-46c9-b475-02a3582aef79 tempest-ProjectMemberTests-1806793813 None] /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-7ddcef8c-2d58-427f-a21b-141672229fe7.info is being set with open permissions: ugo+rw Jul 10 04:56:36 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-638f9928-37b1-46c9-b475-02a3582aef79 tempest-ProjectMemberTests-1806793813 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-7ddcef8c-2d58-427f-a21b-141672229fe7.info {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:56:36 devstack sudo[107331]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-7ddcef8c-2d58-427f-a21b-141672229fe7.info Jul 10 04:56:36 devstack sudo[107331]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:56:37 devstack sudo[107329]: pam_unix(sudo:session): session closed for user root Jul 10 04:56:37 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-3091aebc-f9cf-4cf7-b8fa-d981bdfea090 tempest-SnapshotDependencyTests-222048441 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-504d02ee-8f24-47bf-ad86-6addf5c8e35c" returned: 0 in 0.642s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:56:37 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-3091aebc-f9cf-4cf7-b8fa-d981bdfea090 tempest-SnapshotDependencyTests-222048441 None] Lock "cinder-quobyte-504d02ee-8f24-47bf-ad86-6addf5c8e35c" released by "delete_volume" :: held 1.462s {{(pid=87444) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 04:56:37 devstack sudo[107331]: pam_unix(sudo:session): session closed for user root Jul 10 04:56:37 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-638f9928-37b1-46c9-b475-02a3582aef79 tempest-ProjectMemberTests-1806793813 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-7ddcef8c-2d58-427f-a21b-141672229fe7.info" returned: 0 in 0.655s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:56:37 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-638f9928-37b1-46c9-b475-02a3582aef79 tempest-ProjectMemberTests-1806793813 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.336s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 04:56:37 devstack cinder-volume[87444]: DEBUG cinder.quota [None req-3091aebc-f9cf-4cf7-b8fa-d981bdfea090 tempest-SnapshotDependencyTests-222048441 None] Created reservations ['499ed983-31d3-466c-9f28-f20a772c1a57', '3bf05f8e-c27a-4983-821b-d749252cb938', '05897edf-1ae1-4d56-bde3-b21547423405', 'b61fc87e-5821-48d6-bb7f-b8865723fa4d'] {{(pid=87444) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 04:56:37 devstack cinder-volume[87444]: INFO cinder.volume.manager [None req-638f9928-37b1-46c9-b475-02a3582aef79 tempest-ProjectMemberTests-1806793813 None] Create snapshot completed successfully Jul 10 04:56:37 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-3091aebc-f9cf-4cf7-b8fa-d981bdfea090 tempest-SnapshotDependencyTests-222048441 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 04:56:37 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-3091aebc-f9cf-4cf7-b8fa-d981bdfea090 tempest-SnapshotDependencyTests-222048441 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 04:56:37 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-3091aebc-f9cf-4cf7-b8fa-d981bdfea090 tempest-SnapshotDependencyTests-222048441 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922': None} {{(pid=87444) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 04:56:37 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-3091aebc-f9cf-4cf7-b8fa-d981bdfea090 tempest-SnapshotDependencyTests-222048441 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922'] {{(pid=87444) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 04:56:37 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-3091aebc-f9cf-4cf7-b8fa-d981bdfea090 tempest-SnapshotDependencyTests-222048441 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 04:56:37 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-3091aebc-f9cf-4cf7-b8fa-d981bdfea090 tempest-SnapshotDependencyTests-222048441 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:56:37 devstack sudo[107335]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097 Jul 10 04:56:37 devstack sudo[107335]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:56:37 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-1ddb1f02-ad6b-432c-be02-cad988b288aa tempest-SnapshotDependencyTests-222048441 None] Acquiring lock "cinder-3ac3f596-a37c-4700-a332-1109539f552f-delete_volume" by "delete_volume" {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 04:56:37 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-1ddb1f02-ad6b-432c-be02-cad988b288aa tempest-SnapshotDependencyTests-222048441 None] Lock "cinder-3ac3f596-a37c-4700-a332-1109539f552f-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 04:56:37 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-1ddb1f02-ad6b-432c-be02-cad988b288aa tempest-SnapshotDependencyTests-222048441 None] Acquiring lock "cinder-quobyte-3ac3f596-a37c-4700-a332-1109539f552f" by "delete_volume" {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 04:56:37 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-1ddb1f02-ad6b-432c-be02-cad988b288aa tempest-SnapshotDependencyTests-222048441 None] Lock "cinder-quobyte-3ac3f596-a37c-4700-a332-1109539f552f" acquired by "delete_volume" :: waited 0.022s {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 04:56:38 devstack cinder-volume[87444]: DEBUG oslo.privsep.daemon [-] privsep: reply[54ed8791-6157-4412-b693-ba749e02300b]: (4, 'qcow2') {{(pid=88499) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 04:56:38 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-1ddb1f02-ad6b-432c-be02-cad988b288aa tempest-SnapshotDependencyTests-222048441 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-3ac3f596-a37c-4700-a332-1109539f552f {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:56:38 devstack sudo[107335]: pam_unix(sudo:session): session closed for user root Jul 10 04:56:38 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-3091aebc-f9cf-4cf7-b8fa-d981bdfea090 tempest-SnapshotDependencyTests-222048441 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097" returned: 0 in 0.661s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:56:38 devstack cinder-volume[87444]: DEBUG cinder.manager [None req-3091aebc-f9cf-4cf7-b8fa-d981bdfea090 tempest-SnapshotDependencyTests-222048441 None] Notifying Schedulers of capabilities ... {{(pid=87444) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 04:56:38 devstack cinder-volume[87444]: INFO cinder.volume.manager [None req-3091aebc-f9cf-4cf7-b8fa-d981bdfea090 tempest-SnapshotDependencyTests-222048441 None] Deleted volume successfully. Jul 10 04:56:38 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-3091aebc-f9cf-4cf7-b8fa-d981bdfea090 tempest-SnapshotDependencyTests-222048441 None] Lock "cinder-504d02ee-8f24-47bf-ad86-6addf5c8e35c-delete_volume" released by "delete_volume" :: held 2.365s {{(pid=87444) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 04:56:38 devstack sudo[107338]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-3ac3f596-a37c-4700-a332-1109539f552f Jul 10 04:56:38 devstack sudo[107338]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:56:38 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-061c78de-8915-442f-8bb4-0f882bd61980 tempest-ProjectMemberTests-1806793813 None] Acquiring lock "cinder-25fd67e1-44b5-402f-adad-0a1f21341bd4-delete_snapshot" by "delete_snapshot" {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 04:56:38 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-061c78de-8915-442f-8bb4-0f882bd61980 tempest-ProjectMemberTests-1806793813 None] Lock "cinder-25fd67e1-44b5-402f-adad-0a1f21341bd4-delete_snapshot" acquired by "delete_snapshot" :: waited 0.017s {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 04:56:38 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-061c78de-8915-442f-8bb4-0f882bd61980 tempest-ProjectMemberTests-1806793813 None] Acquiring lock "cinder-quobyte-7ddcef8c-2d58-427f-a21b-141672229fe7" by "delete_snapshot" {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 04:56:38 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-061c78de-8915-442f-8bb4-0f882bd61980 tempest-ProjectMemberTests-1806793813 None] Lock "cinder-quobyte-7ddcef8c-2d58-427f-a21b-141672229fe7" acquired by "delete_snapshot" :: waited 0.020s {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 04:56:38 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-061c78de-8915-442f-8bb4-0f882bd61980 tempest-ProjectMemberTests-1806793813 None] Acquiring lock "cinder-quobyte-25fd67e1-44b5-402f-adad-0a1f21341bd4" by "_delete_snapshot" {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 04:56:38 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-061c78de-8915-442f-8bb4-0f882bd61980 tempest-ProjectMemberTests-1806793813 None] Lock "cinder-quobyte-25fd67e1-44b5-402f-adad-0a1f21341bd4" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 04:56:38 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.remotefs [None req-061c78de-8915-442f-8bb4-0f882bd61980 tempest-ProjectMemberTests-1806793813 None] Deleting offline snapshot 25fd67e1-44b5-402f-adad-0a1f21341bd4 of volume 7ddcef8c-2d58-427f-a21b-141672229fe7 {{(pid=87444) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 10 04:56:38 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.remotefs [None req-061c78de-8915-442f-8bb4-0f882bd61980 tempest-ProjectMemberTests-1806793813 None] snapshot_file for this snap is: volume-7ddcef8c-2d58-427f-a21b-141672229fe7.25fd67e1-44b5-402f-adad-0a1f21341bd4 {{(pid=87444) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 10 04:56:38 devstack cinder-volume[87444]: DEBUG oslo.privsep.daemon [-] privsep: reply[92882297-76bd-4b7f-b0b7-fd833c51eb3b]: (4, 'qcow2') {{(pid=88499) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 04:56:38 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-061c78de-8915-442f-8bb4-0f882bd61980 tempest-ProjectMemberTests-1806793813 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-7ddcef8c-2d58-427f-a21b-141672229fe7.25fd67e1-44b5-402f-adad-0a1f21341bd4 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:56:38 devstack sudo[107340]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-7ddcef8c-2d58-427f-a21b-141672229fe7.25fd67e1-44b5-402f-adad-0a1f21341bd4 Jul 10 04:56:38 devstack sudo[107340]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:56:38 devstack sudo[107338]: pam_unix(sudo:session): session closed for user root Jul 10 04:56:38 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-1ddb1f02-ad6b-432c-be02-cad988b288aa tempest-SnapshotDependencyTests-222048441 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-3ac3f596-a37c-4700-a332-1109539f552f" returned: 0 in 0.798s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:56:38 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-1ddb1f02-ad6b-432c-be02-cad988b288aa tempest-SnapshotDependencyTests-222048441 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-3ac3f596-a37c-4700-a332-1109539f552f {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:56:38 devstack sudo[107345]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-3ac3f596-a37c-4700-a332-1109539f552f Jul 10 04:56:38 devstack sudo[107345]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:56:39 devstack sudo[107340]: pam_unix(sudo:session): session closed for user root Jul 10 04:56:39 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-061c78de-8915-442f-8bb4-0f882bd61980 tempest-ProjectMemberTests-1806793813 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-7ddcef8c-2d58-427f-a21b-141672229fe7.25fd67e1-44b5-402f-adad-0a1f21341bd4" returned: 0 in 0.761s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:56:39 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.remotefs [None req-061c78de-8915-442f-8bb4-0f882bd61980 tempest-ProjectMemberTests-1806793813 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7ddcef8c-2d58-427f-a21b-141672229fe7(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87444) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 10 04:56:39 devstack cinder-volume[87444]: DEBUG oslo.privsep.daemon [-] privsep: reply[3fc3fcf1-9611-4e5f-a7df-ee45c5e4be43]: (4, 'qcow2') {{(pid=88499) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 04:56:39 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-061c78de-8915-442f-8bb4-0f882bd61980 tempest-ProjectMemberTests-1806793813 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-7ddcef8c-2d58-427f-a21b-141672229fe7 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:56:39 devstack sudo[107350]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-7ddcef8c-2d58-427f-a21b-141672229fe7 Jul 10 04:56:39 devstack sudo[107350]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:56:39 devstack sudo[107345]: pam_unix(sudo:session): session closed for user root Jul 10 04:56:39 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-1ddb1f02-ad6b-432c-be02-cad988b288aa tempest-SnapshotDependencyTests-222048441 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-3ac3f596-a37c-4700-a332-1109539f552f" returned: 0 in 0.658s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:56:39 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-1ddb1f02-ad6b-432c-be02-cad988b288aa tempest-SnapshotDependencyTests-222048441 None] Lock "cinder-quobyte-3ac3f596-a37c-4700-a332-1109539f552f" released by "delete_volume" :: held 1.506s {{(pid=87444) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 04:56:39 devstack cinder-volume[87444]: DEBUG cinder.quota [None req-1ddb1f02-ad6b-432c-be02-cad988b288aa tempest-SnapshotDependencyTests-222048441 None] Created reservations ['58516097-5160-4c5d-9297-3ae8f83a4066', '7c5dbca0-02cc-4b3b-a3bd-e6183970c5bd', '85f00894-fdd8-42fd-af74-e42303ed253c', '70ebedfe-a13c-4a72-8a96-6678608df0b6'] {{(pid=87444) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 04:56:39 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-1ddb1f02-ad6b-432c-be02-cad988b288aa tempest-SnapshotDependencyTests-222048441 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 04:56:39 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-1ddb1f02-ad6b-432c-be02-cad988b288aa tempest-SnapshotDependencyTests-222048441 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 04:56:39 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-1ddb1f02-ad6b-432c-be02-cad988b288aa tempest-SnapshotDependencyTests-222048441 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922': None} {{(pid=87444) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 04:56:39 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-1ddb1f02-ad6b-432c-be02-cad988b288aa tempest-SnapshotDependencyTests-222048441 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922'] {{(pid=87444) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 04:56:39 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-1ddb1f02-ad6b-432c-be02-cad988b288aa tempest-SnapshotDependencyTests-222048441 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 04:56:39 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-1ddb1f02-ad6b-432c-be02-cad988b288aa tempest-SnapshotDependencyTests-222048441 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:56:39 devstack sudo[107353]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097 Jul 10 04:56:39 devstack sudo[107353]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:56:39 devstack sudo[107350]: pam_unix(sudo:session): session closed for user root Jul 10 04:56:39 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-061c78de-8915-442f-8bb4-0f882bd61980 tempest-ProjectMemberTests-1806793813 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-7ddcef8c-2d58-427f-a21b-141672229fe7" returned: 0 in 0.788s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:56:39 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-061c78de-8915-442f-8bb4-0f882bd61980 tempest-ProjectMemberTests-1806793813 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-7ddcef8c-2d58-427f-a21b-141672229fe7.25fd67e1-44b5-402f-adad-0a1f21341bd4 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:56:39 devstack sudo[107358]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-7ddcef8c-2d58-427f-a21b-141672229fe7.25fd67e1-44b5-402f-adad-0a1f21341bd4 Jul 10 04:56:39 devstack sudo[107358]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:56:40 devstack sudo[107353]: pam_unix(sudo:session): session closed for user root Jul 10 04:56:40 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-1ddb1f02-ad6b-432c-be02-cad988b288aa tempest-SnapshotDependencyTests-222048441 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097" returned: 0 in 0.667s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:56:40 devstack cinder-volume[87444]: DEBUG cinder.manager [None req-1ddb1f02-ad6b-432c-be02-cad988b288aa tempest-SnapshotDependencyTests-222048441 None] Notifying Schedulers of capabilities ... {{(pid=87444) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 04:56:40 devstack cinder-volume[87444]: INFO cinder.volume.manager [None req-1ddb1f02-ad6b-432c-be02-cad988b288aa tempest-SnapshotDependencyTests-222048441 None] Deleted volume successfully. Jul 10 04:56:40 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-1ddb1f02-ad6b-432c-be02-cad988b288aa tempest-SnapshotDependencyTests-222048441 None] Lock "cinder-3ac3f596-a37c-4700-a332-1109539f552f-delete_volume" released by "delete_volume" :: held 2.378s {{(pid=87444) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 04:56:40 devstack sudo[107358]: pam_unix(sudo:session): session closed for user root Jul 10 04:56:40 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-061c78de-8915-442f-8bb4-0f882bd61980 tempest-ProjectMemberTests-1806793813 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-7ddcef8c-2d58-427f-a21b-141672229fe7.25fd67e1-44b5-402f-adad-0a1f21341bd4" returned: 0 in 0.810s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:56:40 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-061c78de-8915-442f-8bb4-0f882bd61980 tempest-ProjectMemberTests-1806793813 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-7ddcef8c-2d58-427f-a21b-141672229fe7.25fd67e1-44b5-402f-adad-0a1f21341bd4 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:56:40 devstack sudo[107364]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-7ddcef8c-2d58-427f-a21b-141672229fe7.25fd67e1-44b5-402f-adad-0a1f21341bd4 Jul 10 04:56:40 devstack sudo[107364]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:56:41 devstack sudo[107364]: pam_unix(sudo:session): session closed for user root Jul 10 04:56:41 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-061c78de-8915-442f-8bb4-0f882bd61980 tempest-ProjectMemberTests-1806793813 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-7ddcef8c-2d58-427f-a21b-141672229fe7.25fd67e1-44b5-402f-adad-0a1f21341bd4" returned: 0 in 0.703s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:56:41 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-061c78de-8915-442f-8bb4-0f882bd61980 tempest-ProjectMemberTests-1806793813 None] Lock "cinder-quobyte-25fd67e1-44b5-402f-adad-0a1f21341bd4" released by "_delete_snapshot" :: held 3.164s {{(pid=87444) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 04:56:41 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-061c78de-8915-442f-8bb4-0f882bd61980 tempest-ProjectMemberTests-1806793813 None] Lock "cinder-quobyte-7ddcef8c-2d58-427f-a21b-141672229fe7" released by "delete_snapshot" :: held 3.192s {{(pid=87444) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 04:56:41 devstack cinder-volume[87444]: DEBUG cinder.quota [None req-061c78de-8915-442f-8bb4-0f882bd61980 tempest-ProjectMemberTests-1806793813 None] Created reservations ['41d34ab9-7b49-4b65-8e1c-a4f811001c99', '68609e83-3e7d-4764-be51-fadd073c13dc', '0cfc7d6b-d0e8-4389-826f-c66013acdb09', 'c45c04b1-5843-4910-b7b8-16d7ede54b85'] {{(pid=87444) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 04:56:41 devstack cinder-volume[87444]: INFO cinder.volume.manager [None req-061c78de-8915-442f-8bb4-0f882bd61980 tempest-ProjectMemberTests-1806793813 None] Delete snapshot completed successfully. Jul 10 04:56:41 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-061c78de-8915-442f-8bb4-0f882bd61980 tempest-ProjectMemberTests-1806793813 None] Lock "cinder-25fd67e1-44b5-402f-adad-0a1f21341bd4-delete_snapshot" released by "delete_snapshot" :: held 3.382s {{(pid=87444) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 04:56:42 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-ecbef525-6bf7-4a17-9732-af4d27f14e58 tempest-ProjectMemberTests-1806793813 None] Acquiring lock "cinder-7ddcef8c-2d58-427f-a21b-141672229fe7-delete_volume" by "delete_volume" {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 04:56:42 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-ecbef525-6bf7-4a17-9732-af4d27f14e58 tempest-ProjectMemberTests-1806793813 None] Lock "cinder-7ddcef8c-2d58-427f-a21b-141672229fe7-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 04:56:42 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-ecbef525-6bf7-4a17-9732-af4d27f14e58 tempest-ProjectMemberTests-1806793813 None] Acquiring lock "cinder-quobyte-7ddcef8c-2d58-427f-a21b-141672229fe7" by "delete_volume" {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 04:56:42 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-ecbef525-6bf7-4a17-9732-af4d27f14e58 tempest-ProjectMemberTests-1806793813 None] Lock "cinder-quobyte-7ddcef8c-2d58-427f-a21b-141672229fe7" acquired by "delete_volume" :: waited 0.018s {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 04:56:42 devstack cinder-volume[87444]: DEBUG oslo.privsep.daemon [-] privsep: reply[c780548a-bbac-4159-9b36-1a2d52b3b6aa]: (4, 'qcow2') {{(pid=88499) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 04:56:42 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-ecbef525-6bf7-4a17-9732-af4d27f14e58 tempest-ProjectMemberTests-1806793813 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-7ddcef8c-2d58-427f-a21b-141672229fe7 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:56:42 devstack sudo[107405]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-7ddcef8c-2d58-427f-a21b-141672229fe7 Jul 10 04:56:42 devstack sudo[107405]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:56:43 devstack sudo[107405]: pam_unix(sudo:session): session closed for user root Jul 10 04:56:43 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-ecbef525-6bf7-4a17-9732-af4d27f14e58 tempest-ProjectMemberTests-1806793813 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-7ddcef8c-2d58-427f-a21b-141672229fe7" returned: 0 in 0.814s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:56:43 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-ecbef525-6bf7-4a17-9732-af4d27f14e58 tempest-ProjectMemberTests-1806793813 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-7ddcef8c-2d58-427f-a21b-141672229fe7 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:56:43 devstack sudo[107410]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-7ddcef8c-2d58-427f-a21b-141672229fe7 Jul 10 04:56:43 devstack sudo[107410]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:56:44 devstack sudo[107410]: pam_unix(sudo:session): session closed for user root Jul 10 04:56:44 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-ecbef525-6bf7-4a17-9732-af4d27f14e58 tempest-ProjectMemberTests-1806793813 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-7ddcef8c-2d58-427f-a21b-141672229fe7" returned: 0 in 0.734s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:56:44 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-ecbef525-6bf7-4a17-9732-af4d27f14e58 tempest-ProjectMemberTests-1806793813 None] Lock "cinder-quobyte-7ddcef8c-2d58-427f-a21b-141672229fe7" released by "delete_volume" :: held 1.616s {{(pid=87444) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 04:56:44 devstack cinder-volume[87444]: DEBUG cinder.quota [None req-ecbef525-6bf7-4a17-9732-af4d27f14e58 tempest-ProjectMemberTests-1806793813 None] Created reservations ['d33d0e11-92f0-4e62-af5b-affdb1132e83', 'e4203151-e715-4ed4-81c1-3de1bae49d3a', '03ab8c09-a060-4c84-8a75-1b53f6a83950', '3ef31703-f338-4ccb-ba29-597b498ae8dc'] {{(pid=87444) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 04:56:44 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-ecbef525-6bf7-4a17-9732-af4d27f14e58 tempest-ProjectMemberTests-1806793813 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 04:56:44 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-ecbef525-6bf7-4a17-9732-af4d27f14e58 tempest-ProjectMemberTests-1806793813 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 04:56:44 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-ecbef525-6bf7-4a17-9732-af4d27f14e58 tempest-ProjectMemberTests-1806793813 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922': None} {{(pid=87444) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 04:56:44 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-ecbef525-6bf7-4a17-9732-af4d27f14e58 tempest-ProjectMemberTests-1806793813 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922'] {{(pid=87444) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 04:56:44 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-ecbef525-6bf7-4a17-9732-af4d27f14e58 tempest-ProjectMemberTests-1806793813 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 04:56:44 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-ecbef525-6bf7-4a17-9732-af4d27f14e58 tempest-ProjectMemberTests-1806793813 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:56:44 devstack sudo[107415]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097 Jul 10 04:56:44 devstack sudo[107415]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:56:45 devstack sudo[107415]: pam_unix(sudo:session): session closed for user root Jul 10 04:56:45 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-ecbef525-6bf7-4a17-9732-af4d27f14e58 tempest-ProjectMemberTests-1806793813 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097" returned: 0 in 0.749s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:56:45 devstack cinder-volume[87444]: DEBUG cinder.manager [None req-ecbef525-6bf7-4a17-9732-af4d27f14e58 tempest-ProjectMemberTests-1806793813 None] Notifying Schedulers of capabilities ... {{(pid=87444) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 04:56:45 devstack cinder-volume[87444]: INFO cinder.volume.manager [None req-ecbef525-6bf7-4a17-9732-af4d27f14e58 tempest-ProjectMemberTests-1806793813 None] Deleted volume successfully. Jul 10 04:56:45 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-ecbef525-6bf7-4a17-9732-af4d27f14e58 tempest-ProjectMemberTests-1806793813 None] Lock "cinder-7ddcef8c-2d58-427f-a21b-141672229fe7-delete_volume" released by "delete_volume" :: held 2.568s {{(pid=87444) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 04:56:54 devstack cinder-volume[87444]: DEBUG dbcounter [-] [87444] Writing DB stats cinder:SELECT=60,cinder:INSERT=21,cinder:UPDATE=82,cinder:DELETE=6 {{(pid=87444) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 10 04:56:55 devstack cinder-volume[87444]: DEBUG dbcounter [-] [87444] Writing DB stats cinder:DELETE=7,cinder:SELECT=64,cinder:INSERT=22,cinder:UPDATE=74 {{(pid=87444) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 10 04:56:57 devstack cinder-volume[87444]: DEBUG cinder.volume.flows.manager.create_volume [None req-9fb940d8-034e-4075-ab16-91e2829f503f tempest-ProjectReaderTests-1042761782 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87444) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 04:56:57 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-9fb940d8-034e-4075-ab16-91e2829f503f tempest-ProjectReaderTests-1042761782 None] Flow 'volume_create_manager' (5cd151dc-8394-41db-af36-d879a016010f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 04:56:57 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-9fb940d8-034e-4075-ab16-91e2829f503f tempest-ProjectReaderTests-1042761782 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4818ec5c-56c9-41dc-ae07-3bb74ae33672) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:56:57 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-9fb940d8-034e-4075-ab16-91e2829f503f tempest-ProjectReaderTests-1042761782 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4818ec5c-56c9-41dc-ae07-3bb74ae33672) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T02:56:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1219356737',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6ebd585e-e101-4111-b221-2e0cf618f670,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='61d01bcde2cd47508471651a90c1a8cf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T02:56:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T02:56:57Z,use_quota=True,user_id='a85d74b08f5044cb97b2dfa2f69dde4e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(317e369e-1e06-434d-ae95-a335f0e6c903),volume_type_id=317e369e-1e06-434d-ae95-a335f0e6c903)' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:56:57 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-9fb940d8-034e-4075-ab16-91e2829f503f tempest-ProjectReaderTests-1042761782 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c2512287-5b53-4d11-b55d-180c77b82b44) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:56:57 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-9fb940d8-034e-4075-ab16-91e2829f503f tempest-ProjectReaderTests-1042761782 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c2512287-5b53-4d11-b55d-180c77b82b44) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:56:57 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-9fb940d8-034e-4075-ab16-91e2829f503f tempest-ProjectReaderTests-1042761782 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e9d8a77e-e209-426d-b02c-548a94cb770f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:56:57 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-9fb940d8-034e-4075-ab16-91e2829f503f tempest-ProjectReaderTests-1042761782 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e9d8a77e-e209-426d-b02c-548a94cb770f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6ebd585e-e101-4111-b221-2e0cf618f670', 'volume_name': 'volume-6ebd585e-e101-4111-b221-2e0cf618f670', 'volume_size': 1}' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:56:57 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-9fb940d8-034e-4075-ab16-91e2829f503f tempest-ProjectReaderTests-1042761782 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8a7dc09f-f1f0-4940-827b-d380e1936e6a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:56:57 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-9fb940d8-034e-4075-ab16-91e2829f503f tempest-ProjectReaderTests-1042761782 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8a7dc09f-f1f0-4940-827b-d380e1936e6a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:56:57 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-9fb940d8-034e-4075-ab16-91e2829f503f tempest-ProjectReaderTests-1042761782 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f1bdbcb9-e856-44cb-bfbb-84e977ef0963) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:56:57 devstack cinder-volume[87444]: INFO cinder.volume.flows.manager.create_volume [None req-9fb940d8-034e-4075-ab16-91e2829f503f tempest-ProjectReaderTests-1042761782 None] Volume 6ebd585e-e101-4111-b221-2e0cf618f670: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6ebd585e-e101-4111-b221-2e0cf618f670', 'volume_size': 1} Jul 10 04:56:57 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-9fb940d8-034e-4075-ab16-91e2829f503f tempest-ProjectReaderTests-1042761782 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 04:56:57 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-9fb940d8-034e-4075-ab16-91e2829f503f tempest-ProjectReaderTests-1042761782 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 04:56:57 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-9fb940d8-034e-4075-ab16-91e2829f503f tempest-ProjectReaderTests-1042761782 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T02:56:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1219356737',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6ebd585e-e101-4111-b221-2e0cf618f670,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='61d01bcde2cd47508471651a90c1a8cf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T02:56:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T02:56:57Z,use_quota=True,user_id='a85d74b08f5044cb97b2dfa2f69dde4e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(317e369e-1e06-434d-ae95-a335f0e6c903),volume_type_id=317e369e-1e06-434d-ae95-a335f0e6c903)}" {{(pid=87444) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 04:56:57 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.remotefs [None req-9fb940d8-034e-4075-ab16-91e2829f503f tempest-ProjectReaderTests-1042761782 None] Creating volume 6ebd585e-e101-4111-b221-2e0cf618f670 {{(pid=87444) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 04:56:57 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-9fb940d8-034e-4075-ab16-91e2829f503f tempest-ProjectReaderTests-1042761782 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 04:56:57 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-9fb940d8-034e-4075-ab16-91e2829f503f tempest-ProjectReaderTests-1042761782 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 04:56:57 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-9fb940d8-034e-4075-ab16-91e2829f503f tempest-ProjectReaderTests-1042761782 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922': None} {{(pid=87444) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 04:56:57 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-9fb940d8-034e-4075-ab16-91e2829f503f tempest-ProjectReaderTests-1042761782 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922'] {{(pid=87444) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 04:56:57 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-9fb940d8-034e-4075-ab16-91e2829f503f tempest-ProjectReaderTests-1042761782 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 04:56:57 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-9fb940d8-034e-4075-ab16-91e2829f503f tempest-ProjectReaderTests-1042761782 None] Selected osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922 as target Quobyte volume. {{(pid=87444) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 04:56:57 devstack cinder-volume[87444]: INFO cinder.volume.drivers.remotefs [None req-9fb940d8-034e-4075-ab16-91e2829f503f tempest-ProjectReaderTests-1042761782 None] casted to osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922 Jul 10 04:56:57 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-9fb940d8-034e-4075-ab16-91e2829f503f tempest-ProjectReaderTests-1042761782 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-6ebd585e-e101-4111-b221-2e0cf618f670 1073741824 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:56:57 devstack sudo[107428]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-6ebd585e-e101-4111-b221-2e0cf618f670 1073741824 Jul 10 04:56:57 devstack sudo[107428]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:56:58 devstack sudo[107428]: pam_unix(sudo:session): session closed for user root Jul 10 04:56:58 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-9fb940d8-034e-4075-ab16-91e2829f503f tempest-ProjectReaderTests-1042761782 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-6ebd585e-e101-4111-b221-2e0cf618f670 1073741824" returned: 0 in 0.793s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:56:58 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-9fb940d8-034e-4075-ab16-91e2829f503f tempest-ProjectReaderTests-1042761782 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-6ebd585e-e101-4111-b221-2e0cf618f670 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:56:58 devstack sudo[107434]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-6ebd585e-e101-4111-b221-2e0cf618f670 Jul 10 04:56:58 devstack sudo[107434]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:56:59 devstack sudo[107434]: pam_unix(sudo:session): session closed for user root Jul 10 04:56:59 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-9fb940d8-034e-4075-ab16-91e2829f503f tempest-ProjectReaderTests-1042761782 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-6ebd585e-e101-4111-b221-2e0cf618f670" returned: 0 in 0.635s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:56:59 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-9fb940d8-034e-4075-ab16-91e2829f503f tempest-ProjectReaderTests-1042761782 None] <== create_volume: return (1468ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922'} {{(pid=87444) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 04:56:59 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-9fb940d8-034e-4075-ab16-91e2829f503f tempest-ProjectReaderTests-1042761782 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.471s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 04:56:59 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-9fb940d8-034e-4075-ab16-91e2829f503f tempest-ProjectReaderTests-1042761782 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f1bdbcb9-e856-44cb-bfbb-84e977ef0963) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6ebd585e-e101-4111-b221-2e0cf618f670', 'volume_size': 1}' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:56:59 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-9fb940d8-034e-4075-ab16-91e2829f503f tempest-ProjectReaderTests-1042761782 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (95a32158-1bee-40fe-b414-79c1c1e09632) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:56:59 devstack cinder-volume[87444]: INFO cinder.volume.flows.manager.create_volume [None req-9fb940d8-034e-4075-ab16-91e2829f503f tempest-ProjectReaderTests-1042761782 None] Volume volume-6ebd585e-e101-4111-b221-2e0cf618f670 (6ebd585e-e101-4111-b221-2e0cf618f670): created successfully Jul 10 04:56:59 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-9fb940d8-034e-4075-ab16-91e2829f503f tempest-ProjectReaderTests-1042761782 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (95a32158-1bee-40fe-b414-79c1c1e09632) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:56:59 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-9fb940d8-034e-4075-ab16-91e2829f503f tempest-ProjectReaderTests-1042761782 None] Flow 'volume_create_manager' (5cd151dc-8394-41db-af36-d879a016010f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87444) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 04:56:59 devstack cinder-volume[87444]: INFO cinder.volume.manager [None req-9fb940d8-034e-4075-ab16-91e2829f503f tempest-ProjectReaderTests-1042761782 None] Created volume successfully. Jul 10 04:56:59 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-0f967165-9c0f-46e8-8460-f0e2d8180887 tempest-ProjectReaderTests-1042761782 None] Acquiring lock "cinder-6ebd585e-e101-4111-b221-2e0cf618f670-delete_volume" by "delete_volume" {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 04:56:59 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-0f967165-9c0f-46e8-8460-f0e2d8180887 tempest-ProjectReaderTests-1042761782 None] Lock "cinder-6ebd585e-e101-4111-b221-2e0cf618f670-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 04:56:59 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-0f967165-9c0f-46e8-8460-f0e2d8180887 tempest-ProjectReaderTests-1042761782 None] Acquiring lock "cinder-quobyte-6ebd585e-e101-4111-b221-2e0cf618f670" by "delete_volume" {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 04:56:59 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-0f967165-9c0f-46e8-8460-f0e2d8180887 tempest-ProjectReaderTests-1042761782 None] Lock "cinder-quobyte-6ebd585e-e101-4111-b221-2e0cf618f670" acquired by "delete_volume" :: waited 0.015s {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 04:56:59 devstack cinder-volume[87444]: DEBUG oslo.privsep.daemon [-] privsep: reply[863bdee5-dc7d-45cb-a500-6c456c8f366e]: (4, 'qcow2') {{(pid=88499) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 04:56:59 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-0f967165-9c0f-46e8-8460-f0e2d8180887 tempest-ProjectReaderTests-1042761782 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-6ebd585e-e101-4111-b221-2e0cf618f670 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:56:59 devstack sudo[107438]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-6ebd585e-e101-4111-b221-2e0cf618f670 Jul 10 04:56:59 devstack sudo[107438]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:57:00 devstack sudo[107438]: pam_unix(sudo:session): session closed for user root Jul 10 04:57:00 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-0f967165-9c0f-46e8-8460-f0e2d8180887 tempest-ProjectReaderTests-1042761782 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-6ebd585e-e101-4111-b221-2e0cf618f670" returned: 0 in 0.742s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:57:00 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-0f967165-9c0f-46e8-8460-f0e2d8180887 tempest-ProjectReaderTests-1042761782 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-6ebd585e-e101-4111-b221-2e0cf618f670 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:57:00 devstack sudo[107443]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-6ebd585e-e101-4111-b221-2e0cf618f670 Jul 10 04:57:00 devstack sudo[107443]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:57:01 devstack sudo[107443]: pam_unix(sudo:session): session closed for user root Jul 10 04:57:01 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-0f967165-9c0f-46e8-8460-f0e2d8180887 tempest-ProjectReaderTests-1042761782 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-6ebd585e-e101-4111-b221-2e0cf618f670" returned: 0 in 0.634s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:57:01 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-0f967165-9c0f-46e8-8460-f0e2d8180887 tempest-ProjectReaderTests-1042761782 None] Lock "cinder-quobyte-6ebd585e-e101-4111-b221-2e0cf618f670" released by "delete_volume" :: held 1.411s {{(pid=87444) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 04:57:01 devstack cinder-volume[87444]: DEBUG cinder.quota [None req-0f967165-9c0f-46e8-8460-f0e2d8180887 tempest-ProjectReaderTests-1042761782 None] Created reservations ['9123a23e-e062-47e3-970c-90357beb04ee', 'bad39fae-1bfa-4e23-a786-378139e70b4b', '60d401f2-65c1-41f5-a051-c1c77f4d4216', 'a727dec1-5a88-41b4-80f1-996fb86ef133'] {{(pid=87444) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 04:57:01 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-0f967165-9c0f-46e8-8460-f0e2d8180887 tempest-ProjectReaderTests-1042761782 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 04:57:01 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-0f967165-9c0f-46e8-8460-f0e2d8180887 tempest-ProjectReaderTests-1042761782 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 04:57:01 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-0f967165-9c0f-46e8-8460-f0e2d8180887 tempest-ProjectReaderTests-1042761782 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922': None} {{(pid=87444) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 04:57:01 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-0f967165-9c0f-46e8-8460-f0e2d8180887 tempest-ProjectReaderTests-1042761782 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922'] {{(pid=87444) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 04:57:01 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-0f967165-9c0f-46e8-8460-f0e2d8180887 tempest-ProjectReaderTests-1042761782 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 04:57:01 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-0f967165-9c0f-46e8-8460-f0e2d8180887 tempest-ProjectReaderTests-1042761782 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:57:01 devstack sudo[107446]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097 Jul 10 04:57:01 devstack sudo[107446]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:57:01 devstack sudo[107446]: pam_unix(sudo:session): session closed for user root Jul 10 04:57:01 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-0f967165-9c0f-46e8-8460-f0e2d8180887 tempest-ProjectReaderTests-1042761782 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097" returned: 0 in 0.641s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:57:01 devstack cinder-volume[87444]: DEBUG cinder.manager [None req-0f967165-9c0f-46e8-8460-f0e2d8180887 tempest-ProjectReaderTests-1042761782 None] Notifying Schedulers of capabilities ... {{(pid=87444) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 04:57:01 devstack cinder-volume[87444]: INFO cinder.volume.manager [None req-0f967165-9c0f-46e8-8460-f0e2d8180887 tempest-ProjectReaderTests-1042761782 None] Deleted volume successfully. Jul 10 04:57:01 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-0f967165-9c0f-46e8-8460-f0e2d8180887 tempest-ProjectReaderTests-1042761782 None] Lock "cinder-6ebd585e-e101-4111-b221-2e0cf618f670-delete_volume" released by "delete_volume" :: held 2.240s {{(pid=87444) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 04:57:02 devstack cinder-volume[87444]: DEBUG cinder.volume.flows.manager.create_volume [None req-bb6bc97c-58e9-4dfc-a206-53b54db54fc9 tempest-ProjectReaderTests-1042761782 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87444) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 04:57:02 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-bb6bc97c-58e9-4dfc-a206-53b54db54fc9 tempest-ProjectReaderTests-1042761782 None] Flow 'volume_create_manager' (f44a5c76-42b9-4e3d-8cd8-bff43b059112) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 04:57:02 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-bb6bc97c-58e9-4dfc-a206-53b54db54fc9 tempest-ProjectReaderTests-1042761782 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0d8cf1fe-3dfa-4dc5-9a80-ac39504cabc0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:57:02 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-bb6bc97c-58e9-4dfc-a206-53b54db54fc9 tempest-ProjectReaderTests-1042761782 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0d8cf1fe-3dfa-4dc5-9a80-ac39504cabc0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T02:57:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-450455659',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b9252735-e6ef-40f5-b8e4-39adbd2efe9e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='61d01bcde2cd47508471651a90c1a8cf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T02:57:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T02:57:02Z,use_quota=True,user_id='a85d74b08f5044cb97b2dfa2f69dde4e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(317e369e-1e06-434d-ae95-a335f0e6c903),volume_type_id=317e369e-1e06-434d-ae95-a335f0e6c903)' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:57:02 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-bb6bc97c-58e9-4dfc-a206-53b54db54fc9 tempest-ProjectReaderTests-1042761782 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b9f38d46-4032-4d88-bfd4-47fcf377746b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:57:02 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-bb6bc97c-58e9-4dfc-a206-53b54db54fc9 tempest-ProjectReaderTests-1042761782 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b9f38d46-4032-4d88-bfd4-47fcf377746b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:57:02 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-bb6bc97c-58e9-4dfc-a206-53b54db54fc9 tempest-ProjectReaderTests-1042761782 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cd03f38b-d8cb-4312-aaf9-7a9a202cf73d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:57:02 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-bb6bc97c-58e9-4dfc-a206-53b54db54fc9 tempest-ProjectReaderTests-1042761782 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cd03f38b-d8cb-4312-aaf9-7a9a202cf73d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b9252735-e6ef-40f5-b8e4-39adbd2efe9e', 'volume_name': 'volume-b9252735-e6ef-40f5-b8e4-39adbd2efe9e', 'volume_size': 1}' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:57:02 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-bb6bc97c-58e9-4dfc-a206-53b54db54fc9 tempest-ProjectReaderTests-1042761782 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (045cd62c-2ad2-4a43-956f-a89cd70800ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:57:02 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-bb6bc97c-58e9-4dfc-a206-53b54db54fc9 tempest-ProjectReaderTests-1042761782 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (045cd62c-2ad2-4a43-956f-a89cd70800ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:57:02 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-bb6bc97c-58e9-4dfc-a206-53b54db54fc9 tempest-ProjectReaderTests-1042761782 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3104effd-2cf3-4400-afb9-2ce99a1f1227) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:57:02 devstack cinder-volume[87444]: INFO cinder.volume.flows.manager.create_volume [None req-bb6bc97c-58e9-4dfc-a206-53b54db54fc9 tempest-ProjectReaderTests-1042761782 None] Volume b9252735-e6ef-40f5-b8e4-39adbd2efe9e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b9252735-e6ef-40f5-b8e4-39adbd2efe9e', 'volume_size': 1} Jul 10 04:57:02 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-bb6bc97c-58e9-4dfc-a206-53b54db54fc9 tempest-ProjectReaderTests-1042761782 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 04:57:02 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-bb6bc97c-58e9-4dfc-a206-53b54db54fc9 tempest-ProjectReaderTests-1042761782 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 04:57:02 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-bb6bc97c-58e9-4dfc-a206-53b54db54fc9 tempest-ProjectReaderTests-1042761782 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T02:57:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-450455659',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b9252735-e6ef-40f5-b8e4-39adbd2efe9e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='61d01bcde2cd47508471651a90c1a8cf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T02:57:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T02:57:02Z,use_quota=True,user_id='a85d74b08f5044cb97b2dfa2f69dde4e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(317e369e-1e06-434d-ae95-a335f0e6c903),volume_type_id=317e369e-1e06-434d-ae95-a335f0e6c903)}" {{(pid=87444) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 04:57:02 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.remotefs [None req-bb6bc97c-58e9-4dfc-a206-53b54db54fc9 tempest-ProjectReaderTests-1042761782 None] Creating volume b9252735-e6ef-40f5-b8e4-39adbd2efe9e {{(pid=87444) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 04:57:02 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-bb6bc97c-58e9-4dfc-a206-53b54db54fc9 tempest-ProjectReaderTests-1042761782 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 04:57:02 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-bb6bc97c-58e9-4dfc-a206-53b54db54fc9 tempest-ProjectReaderTests-1042761782 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 04:57:02 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-bb6bc97c-58e9-4dfc-a206-53b54db54fc9 tempest-ProjectReaderTests-1042761782 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922': None} {{(pid=87444) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 04:57:02 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-bb6bc97c-58e9-4dfc-a206-53b54db54fc9 tempest-ProjectReaderTests-1042761782 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922'] {{(pid=87444) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 04:57:02 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-bb6bc97c-58e9-4dfc-a206-53b54db54fc9 tempest-ProjectReaderTests-1042761782 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 04:57:02 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-bb6bc97c-58e9-4dfc-a206-53b54db54fc9 tempest-ProjectReaderTests-1042761782 None] Selected osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922 as target Quobyte volume. {{(pid=87444) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 04:57:02 devstack cinder-volume[87444]: INFO cinder.volume.drivers.remotefs [None req-bb6bc97c-58e9-4dfc-a206-53b54db54fc9 tempest-ProjectReaderTests-1042761782 None] casted to osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922 Jul 10 04:57:02 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-bb6bc97c-58e9-4dfc-a206-53b54db54fc9 tempest-ProjectReaderTests-1042761782 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-b9252735-e6ef-40f5-b8e4-39adbd2efe9e 1073741824 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:57:02 devstack sudo[107451]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-b9252735-e6ef-40f5-b8e4-39adbd2efe9e 1073741824 Jul 10 04:57:02 devstack sudo[107451]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:57:03 devstack sudo[107451]: pam_unix(sudo:session): session closed for user root Jul 10 04:57:03 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-bb6bc97c-58e9-4dfc-a206-53b54db54fc9 tempest-ProjectReaderTests-1042761782 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-b9252735-e6ef-40f5-b8e4-39adbd2efe9e 1073741824" returned: 0 in 0.787s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:57:03 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-bb6bc97c-58e9-4dfc-a206-53b54db54fc9 tempest-ProjectReaderTests-1042761782 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-b9252735-e6ef-40f5-b8e4-39adbd2efe9e {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:57:03 devstack sudo[107457]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-b9252735-e6ef-40f5-b8e4-39adbd2efe9e Jul 10 04:57:03 devstack sudo[107457]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:57:03 devstack sudo[107457]: pam_unix(sudo:session): session closed for user root Jul 10 04:57:03 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-bb6bc97c-58e9-4dfc-a206-53b54db54fc9 tempest-ProjectReaderTests-1042761782 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-b9252735-e6ef-40f5-b8e4-39adbd2efe9e" returned: 0 in 0.632s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:57:03 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-bb6bc97c-58e9-4dfc-a206-53b54db54fc9 tempest-ProjectReaderTests-1042761782 None] <== create_volume: return (1461ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922'} {{(pid=87444) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 04:57:03 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-bb6bc97c-58e9-4dfc-a206-53b54db54fc9 tempest-ProjectReaderTests-1042761782 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.463s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 04:57:03 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-bb6bc97c-58e9-4dfc-a206-53b54db54fc9 tempest-ProjectReaderTests-1042761782 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3104effd-2cf3-4400-afb9-2ce99a1f1227) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b9252735-e6ef-40f5-b8e4-39adbd2efe9e', 'volume_size': 1}' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:57:03 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-bb6bc97c-58e9-4dfc-a206-53b54db54fc9 tempest-ProjectReaderTests-1042761782 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b5e387d4-c01f-45a3-86b5-6f3f7d78fde0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:57:03 devstack cinder-volume[87444]: INFO cinder.volume.flows.manager.create_volume [None req-bb6bc97c-58e9-4dfc-a206-53b54db54fc9 tempest-ProjectReaderTests-1042761782 None] Volume volume-b9252735-e6ef-40f5-b8e4-39adbd2efe9e (b9252735-e6ef-40f5-b8e4-39adbd2efe9e): created successfully Jul 10 04:57:03 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-bb6bc97c-58e9-4dfc-a206-53b54db54fc9 tempest-ProjectReaderTests-1042761782 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b5e387d4-c01f-45a3-86b5-6f3f7d78fde0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:57:03 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-bb6bc97c-58e9-4dfc-a206-53b54db54fc9 tempest-ProjectReaderTests-1042761782 None] Flow 'volume_create_manager' (f44a5c76-42b9-4e3d-8cd8-bff43b059112) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87444) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 04:57:03 devstack cinder-volume[87444]: INFO cinder.volume.manager [None req-bb6bc97c-58e9-4dfc-a206-53b54db54fc9 tempest-ProjectReaderTests-1042761782 None] Created volume successfully. Jul 10 04:57:04 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-a2c70baa-8ac7-4626-a34d-846de5b04166 tempest-ProjectReaderTests-1042761782 None] Acquiring lock "cinder-b9252735-e6ef-40f5-b8e4-39adbd2efe9e-delete_volume" by "delete_volume" {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 04:57:04 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-a2c70baa-8ac7-4626-a34d-846de5b04166 tempest-ProjectReaderTests-1042761782 None] Lock "cinder-b9252735-e6ef-40f5-b8e4-39adbd2efe9e-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 04:57:04 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-a2c70baa-8ac7-4626-a34d-846de5b04166 tempest-ProjectReaderTests-1042761782 None] Acquiring lock "cinder-quobyte-b9252735-e6ef-40f5-b8e4-39adbd2efe9e" by "delete_volume" {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 04:57:04 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-a2c70baa-8ac7-4626-a34d-846de5b04166 tempest-ProjectReaderTests-1042761782 None] Lock "cinder-quobyte-b9252735-e6ef-40f5-b8e4-39adbd2efe9e" acquired by "delete_volume" :: waited 0.016s {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 04:57:04 devstack cinder-volume[87444]: DEBUG oslo.privsep.daemon [-] privsep: reply[c08eca7a-e973-4aa8-96bd-245592a2371d]: (4, 'qcow2') {{(pid=88499) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 04:57:04 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-a2c70baa-8ac7-4626-a34d-846de5b04166 tempest-ProjectReaderTests-1042761782 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-b9252735-e6ef-40f5-b8e4-39adbd2efe9e {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:57:04 devstack sudo[107461]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-b9252735-e6ef-40f5-b8e4-39adbd2efe9e Jul 10 04:57:04 devstack sudo[107461]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:57:05 devstack sudo[107461]: pam_unix(sudo:session): session closed for user root Jul 10 04:57:05 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-a2c70baa-8ac7-4626-a34d-846de5b04166 tempest-ProjectReaderTests-1042761782 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-b9252735-e6ef-40f5-b8e4-39adbd2efe9e" returned: 0 in 0.732s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:57:05 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-a2c70baa-8ac7-4626-a34d-846de5b04166 tempest-ProjectReaderTests-1042761782 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-b9252735-e6ef-40f5-b8e4-39adbd2efe9e {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:57:05 devstack sudo[107466]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-b9252735-e6ef-40f5-b8e4-39adbd2efe9e Jul 10 04:57:05 devstack sudo[107466]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:57:05 devstack sudo[107466]: pam_unix(sudo:session): session closed for user root Jul 10 04:57:05 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-a2c70baa-8ac7-4626-a34d-846de5b04166 tempest-ProjectReaderTests-1042761782 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-b9252735-e6ef-40f5-b8e4-39adbd2efe9e" returned: 0 in 0.627s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:57:05 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-a2c70baa-8ac7-4626-a34d-846de5b04166 tempest-ProjectReaderTests-1042761782 None] Lock "cinder-quobyte-b9252735-e6ef-40f5-b8e4-39adbd2efe9e" released by "delete_volume" :: held 1.397s {{(pid=87444) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 04:57:05 devstack cinder-volume[87444]: DEBUG cinder.quota [None req-a2c70baa-8ac7-4626-a34d-846de5b04166 tempest-ProjectReaderTests-1042761782 None] Created reservations ['fdc2a2b0-c8ec-4d29-ba3d-8ef730b9346e', 'bff88942-2f7a-4d4a-9bf9-c8baac9a446a', '45d68067-2e35-417c-9d8a-0f4142c74100', 'fe90aeb8-5903-4311-814a-d2d59eeb54c9'] {{(pid=87444) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 04:57:06 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-a2c70baa-8ac7-4626-a34d-846de5b04166 tempest-ProjectReaderTests-1042761782 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 04:57:06 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-a2c70baa-8ac7-4626-a34d-846de5b04166 tempest-ProjectReaderTests-1042761782 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 04:57:06 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-a2c70baa-8ac7-4626-a34d-846de5b04166 tempest-ProjectReaderTests-1042761782 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922': None} {{(pid=87444) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 04:57:06 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-a2c70baa-8ac7-4626-a34d-846de5b04166 tempest-ProjectReaderTests-1042761782 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922'] {{(pid=87444) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 04:57:06 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-a2c70baa-8ac7-4626-a34d-846de5b04166 tempest-ProjectReaderTests-1042761782 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 04:57:06 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-a2c70baa-8ac7-4626-a34d-846de5b04166 tempest-ProjectReaderTests-1042761782 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:57:06 devstack sudo[107469]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097 Jul 10 04:57:06 devstack sudo[107469]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:57:06 devstack sudo[107469]: pam_unix(sudo:session): session closed for user root Jul 10 04:57:06 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-a2c70baa-8ac7-4626-a34d-846de5b04166 tempest-ProjectReaderTests-1042761782 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097" returned: 0 in 0.653s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:57:06 devstack cinder-volume[87444]: DEBUG cinder.manager [None req-a2c70baa-8ac7-4626-a34d-846de5b04166 tempest-ProjectReaderTests-1042761782 None] Notifying Schedulers of capabilities ... {{(pid=87444) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 04:57:06 devstack cinder-volume[87444]: INFO cinder.volume.manager [None req-a2c70baa-8ac7-4626-a34d-846de5b04166 tempest-ProjectReaderTests-1042761782 None] Deleted volume successfully. Jul 10 04:57:06 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-a2c70baa-8ac7-4626-a34d-846de5b04166 tempest-ProjectReaderTests-1042761782 None] Lock "cinder-b9252735-e6ef-40f5-b8e4-39adbd2efe9e-delete_volume" released by "delete_volume" :: held 2.237s {{(pid=87444) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 04:57:07 devstack cinder-volume[87444]: DEBUG cinder.volume.flows.manager.create_volume [None req-cdaad948-cb7e-4a2a-889f-aa93846966a1 tempest-ProjectReaderTests-1042761782 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87444) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 04:57:07 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-cdaad948-cb7e-4a2a-889f-aa93846966a1 tempest-ProjectReaderTests-1042761782 None] Flow 'volume_create_manager' (a060554d-fc4a-449e-9408-da5031a106bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 04:57:07 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-cdaad948-cb7e-4a2a-889f-aa93846966a1 tempest-ProjectReaderTests-1042761782 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (63409e54-ccd4-4cab-beec-dd904b5806d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:57:07 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-cdaad948-cb7e-4a2a-889f-aa93846966a1 tempest-ProjectReaderTests-1042761782 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (63409e54-ccd4-4cab-beec-dd904b5806d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T02:57:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1056118342',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2c4e9cfc-6f2b-445d-90a4-e29c30e47bd2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='61d01bcde2cd47508471651a90c1a8cf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T02:57:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T02:57:07Z,use_quota=True,user_id='a85d74b08f5044cb97b2dfa2f69dde4e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(317e369e-1e06-434d-ae95-a335f0e6c903),volume_type_id=317e369e-1e06-434d-ae95-a335f0e6c903)' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:57:07 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-cdaad948-cb7e-4a2a-889f-aa93846966a1 tempest-ProjectReaderTests-1042761782 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8b8a9fed-c054-4f6a-b098-1ca0c92e7f24) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:57:07 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-cdaad948-cb7e-4a2a-889f-aa93846966a1 tempest-ProjectReaderTests-1042761782 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8b8a9fed-c054-4f6a-b098-1ca0c92e7f24) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:57:07 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-cdaad948-cb7e-4a2a-889f-aa93846966a1 tempest-ProjectReaderTests-1042761782 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6d60481e-9a64-4a2e-98fe-89cb6c4eff36) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:57:07 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-cdaad948-cb7e-4a2a-889f-aa93846966a1 tempest-ProjectReaderTests-1042761782 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6d60481e-9a64-4a2e-98fe-89cb6c4eff36) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2c4e9cfc-6f2b-445d-90a4-e29c30e47bd2', 'volume_name': 'volume-2c4e9cfc-6f2b-445d-90a4-e29c30e47bd2', 'volume_size': 1}' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:57:07 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-cdaad948-cb7e-4a2a-889f-aa93846966a1 tempest-ProjectReaderTests-1042761782 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (df1e838d-bc87-43cf-8b30-22f234398f65) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:57:07 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-cdaad948-cb7e-4a2a-889f-aa93846966a1 tempest-ProjectReaderTests-1042761782 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (df1e838d-bc87-43cf-8b30-22f234398f65) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:57:07 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-cdaad948-cb7e-4a2a-889f-aa93846966a1 tempest-ProjectReaderTests-1042761782 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2f138cf9-af49-4680-8d67-ffc56ae23e9a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:57:07 devstack cinder-volume[87444]: INFO cinder.volume.flows.manager.create_volume [None req-cdaad948-cb7e-4a2a-889f-aa93846966a1 tempest-ProjectReaderTests-1042761782 None] Volume 2c4e9cfc-6f2b-445d-90a4-e29c30e47bd2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2c4e9cfc-6f2b-445d-90a4-e29c30e47bd2', 'volume_size': 1} Jul 10 04:57:07 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-cdaad948-cb7e-4a2a-889f-aa93846966a1 tempest-ProjectReaderTests-1042761782 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 04:57:07 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-cdaad948-cb7e-4a2a-889f-aa93846966a1 tempest-ProjectReaderTests-1042761782 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 04:57:07 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-cdaad948-cb7e-4a2a-889f-aa93846966a1 tempest-ProjectReaderTests-1042761782 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T02:57:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1056118342',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2c4e9cfc-6f2b-445d-90a4-e29c30e47bd2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='61d01bcde2cd47508471651a90c1a8cf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T02:57:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T02:57:07Z,use_quota=True,user_id='a85d74b08f5044cb97b2dfa2f69dde4e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(317e369e-1e06-434d-ae95-a335f0e6c903),volume_type_id=317e369e-1e06-434d-ae95-a335f0e6c903)}" {{(pid=87444) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 04:57:07 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.remotefs [None req-cdaad948-cb7e-4a2a-889f-aa93846966a1 tempest-ProjectReaderTests-1042761782 None] Creating volume 2c4e9cfc-6f2b-445d-90a4-e29c30e47bd2 {{(pid=87444) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 04:57:07 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-cdaad948-cb7e-4a2a-889f-aa93846966a1 tempest-ProjectReaderTests-1042761782 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 04:57:07 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-cdaad948-cb7e-4a2a-889f-aa93846966a1 tempest-ProjectReaderTests-1042761782 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 04:57:07 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-cdaad948-cb7e-4a2a-889f-aa93846966a1 tempest-ProjectReaderTests-1042761782 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922': None} {{(pid=87444) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 04:57:07 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-cdaad948-cb7e-4a2a-889f-aa93846966a1 tempest-ProjectReaderTests-1042761782 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922'] {{(pid=87444) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 04:57:07 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-cdaad948-cb7e-4a2a-889f-aa93846966a1 tempest-ProjectReaderTests-1042761782 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 04:57:07 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-cdaad948-cb7e-4a2a-889f-aa93846966a1 tempest-ProjectReaderTests-1042761782 None] Selected osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922 as target Quobyte volume. {{(pid=87444) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 04:57:07 devstack cinder-volume[87444]: INFO cinder.volume.drivers.remotefs [None req-cdaad948-cb7e-4a2a-889f-aa93846966a1 tempest-ProjectReaderTests-1042761782 None] casted to osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922 Jul 10 04:57:07 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-cdaad948-cb7e-4a2a-889f-aa93846966a1 tempest-ProjectReaderTests-1042761782 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-2c4e9cfc-6f2b-445d-90a4-e29c30e47bd2 1073741824 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:57:07 devstack sudo[107472]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-2c4e9cfc-6f2b-445d-90a4-e29c30e47bd2 1073741824 Jul 10 04:57:07 devstack sudo[107472]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:57:07 devstack sudo[107472]: pam_unix(sudo:session): session closed for user root Jul 10 04:57:07 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-cdaad948-cb7e-4a2a-889f-aa93846966a1 tempest-ProjectReaderTests-1042761782 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-2c4e9cfc-6f2b-445d-90a4-e29c30e47bd2 1073741824" returned: 0 in 0.813s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:57:08 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-cdaad948-cb7e-4a2a-889f-aa93846966a1 tempest-ProjectReaderTests-1042761782 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-2c4e9cfc-6f2b-445d-90a4-e29c30e47bd2 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:57:08 devstack sudo[107477]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-2c4e9cfc-6f2b-445d-90a4-e29c30e47bd2 Jul 10 04:57:08 devstack sudo[107477]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:57:08 devstack sudo[107477]: pam_unix(sudo:session): session closed for user root Jul 10 04:57:08 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-cdaad948-cb7e-4a2a-889f-aa93846966a1 tempest-ProjectReaderTests-1042761782 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-2c4e9cfc-6f2b-445d-90a4-e29c30e47bd2" returned: 0 in 0.632s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:57:08 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-cdaad948-cb7e-4a2a-889f-aa93846966a1 tempest-ProjectReaderTests-1042761782 None] <== create_volume: return (1494ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922'} {{(pid=87444) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 04:57:08 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-cdaad948-cb7e-4a2a-889f-aa93846966a1 tempest-ProjectReaderTests-1042761782 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.496s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 04:57:08 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-cdaad948-cb7e-4a2a-889f-aa93846966a1 tempest-ProjectReaderTests-1042761782 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2f138cf9-af49-4680-8d67-ffc56ae23e9a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2c4e9cfc-6f2b-445d-90a4-e29c30e47bd2', 'volume_size': 1}' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:57:08 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-cdaad948-cb7e-4a2a-889f-aa93846966a1 tempest-ProjectReaderTests-1042761782 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (14dd8dd7-9b9f-4eda-8211-8ef4bd375439) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:57:08 devstack cinder-volume[87444]: INFO cinder.volume.flows.manager.create_volume [None req-cdaad948-cb7e-4a2a-889f-aa93846966a1 tempest-ProjectReaderTests-1042761782 None] Volume volume-2c4e9cfc-6f2b-445d-90a4-e29c30e47bd2 (2c4e9cfc-6f2b-445d-90a4-e29c30e47bd2): created successfully Jul 10 04:57:08 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-cdaad948-cb7e-4a2a-889f-aa93846966a1 tempest-ProjectReaderTests-1042761782 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (14dd8dd7-9b9f-4eda-8211-8ef4bd375439) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:57:08 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-cdaad948-cb7e-4a2a-889f-aa93846966a1 tempest-ProjectReaderTests-1042761782 None] Flow 'volume_create_manager' (a060554d-fc4a-449e-9408-da5031a106bb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87444) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 04:57:08 devstack cinder-volume[87444]: INFO cinder.volume.manager [None req-cdaad948-cb7e-4a2a-889f-aa93846966a1 tempest-ProjectReaderTests-1042761782 None] Created volume successfully. Jul 10 04:57:09 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-528650f1-deab-4a12-b345-9ea92ecee444 tempest-ProjectReaderTests-1042761782 None] Acquiring lock "cinder-2c4e9cfc-6f2b-445d-90a4-e29c30e47bd2-delete_volume" by "delete_volume" {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 04:57:09 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-528650f1-deab-4a12-b345-9ea92ecee444 tempest-ProjectReaderTests-1042761782 None] Lock "cinder-2c4e9cfc-6f2b-445d-90a4-e29c30e47bd2-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 04:57:09 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-528650f1-deab-4a12-b345-9ea92ecee444 tempest-ProjectReaderTests-1042761782 None] Acquiring lock "cinder-quobyte-2c4e9cfc-6f2b-445d-90a4-e29c30e47bd2" by "delete_volume" {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 04:57:09 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-528650f1-deab-4a12-b345-9ea92ecee444 tempest-ProjectReaderTests-1042761782 None] Lock "cinder-quobyte-2c4e9cfc-6f2b-445d-90a4-e29c30e47bd2" acquired by "delete_volume" :: waited 0.016s {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 04:57:09 devstack cinder-volume[87444]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f84c86a-a6d2-48cd-969a-16293515d514]: (4, 'qcow2') {{(pid=88499) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 04:57:09 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-528650f1-deab-4a12-b345-9ea92ecee444 tempest-ProjectReaderTests-1042761782 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-2c4e9cfc-6f2b-445d-90a4-e29c30e47bd2 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:57:09 devstack sudo[107480]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-2c4e9cfc-6f2b-445d-90a4-e29c30e47bd2 Jul 10 04:57:09 devstack sudo[107480]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:57:10 devstack sudo[107480]: pam_unix(sudo:session): session closed for user root Jul 10 04:57:10 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-528650f1-deab-4a12-b345-9ea92ecee444 tempest-ProjectReaderTests-1042761782 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-2c4e9cfc-6f2b-445d-90a4-e29c30e47bd2" returned: 0 in 0.736s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:57:10 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-528650f1-deab-4a12-b345-9ea92ecee444 tempest-ProjectReaderTests-1042761782 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-2c4e9cfc-6f2b-445d-90a4-e29c30e47bd2 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:57:10 devstack sudo[107485]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-2c4e9cfc-6f2b-445d-90a4-e29c30e47bd2 Jul 10 04:57:10 devstack sudo[107485]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:57:10 devstack sudo[107485]: pam_unix(sudo:session): session closed for user root Jul 10 04:57:10 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-528650f1-deab-4a12-b345-9ea92ecee444 tempest-ProjectReaderTests-1042761782 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-2c4e9cfc-6f2b-445d-90a4-e29c30e47bd2" returned: 0 in 0.648s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:57:10 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-528650f1-deab-4a12-b345-9ea92ecee444 tempest-ProjectReaderTests-1042761782 None] Lock "cinder-quobyte-2c4e9cfc-6f2b-445d-90a4-e29c30e47bd2" released by "delete_volume" :: held 1.423s {{(pid=87444) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 04:57:10 devstack cinder-volume[87444]: DEBUG cinder.quota [None req-528650f1-deab-4a12-b345-9ea92ecee444 tempest-ProjectReaderTests-1042761782 None] Created reservations ['b58c2a97-1cee-44f1-bec6-a847504251d1', '9808b4de-fab2-44e8-9c9a-3d2cbf4c9eb2', 'cb05b037-8344-40a0-9e2c-bb80be5802b9', '37043c13-0f72-4ba0-9925-394d0dfbfacf'] {{(pid=87444) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 04:57:10 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-528650f1-deab-4a12-b345-9ea92ecee444 tempest-ProjectReaderTests-1042761782 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 04:57:10 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-528650f1-deab-4a12-b345-9ea92ecee444 tempest-ProjectReaderTests-1042761782 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 04:57:10 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-528650f1-deab-4a12-b345-9ea92ecee444 tempest-ProjectReaderTests-1042761782 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922': None} {{(pid=87444) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 04:57:10 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-528650f1-deab-4a12-b345-9ea92ecee444 tempest-ProjectReaderTests-1042761782 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922'] {{(pid=87444) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 04:57:10 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-528650f1-deab-4a12-b345-9ea92ecee444 tempest-ProjectReaderTests-1042761782 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 04:57:10 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-528650f1-deab-4a12-b345-9ea92ecee444 tempest-ProjectReaderTests-1042761782 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:57:10 devstack sudo[107488]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097 Jul 10 04:57:10 devstack sudo[107488]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:57:11 devstack sudo[107488]: pam_unix(sudo:session): session closed for user root Jul 10 04:57:11 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-528650f1-deab-4a12-b345-9ea92ecee444 tempest-ProjectReaderTests-1042761782 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097" returned: 0 in 0.635s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:57:11 devstack cinder-volume[87444]: DEBUG cinder.manager [None req-528650f1-deab-4a12-b345-9ea92ecee444 tempest-ProjectReaderTests-1042761782 None] Notifying Schedulers of capabilities ... {{(pid=87444) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 04:57:11 devstack cinder-volume[87444]: INFO cinder.volume.manager [None req-528650f1-deab-4a12-b345-9ea92ecee444 tempest-ProjectReaderTests-1042761782 None] Deleted volume successfully. Jul 10 04:57:11 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-528650f1-deab-4a12-b345-9ea92ecee444 tempest-ProjectReaderTests-1042761782 None] Lock "cinder-2c4e9cfc-6f2b-445d-90a4-e29c30e47bd2-delete_volume" released by "delete_volume" :: held 2.256s {{(pid=87444) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 04:57:11 devstack cinder-volume[87444]: DEBUG cinder.volume.flows.manager.create_volume [None req-e572b907-f1d2-4b3d-aaab-138cae2ba1ee tempest-ProjectReaderTests-1042761782 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87444) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 10 04:57:11 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-e572b907-f1d2-4b3d-aaab-138cae2ba1ee tempest-ProjectReaderTests-1042761782 None] Flow 'volume_create_manager' (ca1c5304-1707-4ff7-99d1-1d9813aaa278) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 04:57:11 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-e572b907-f1d2-4b3d-aaab-138cae2ba1ee tempest-ProjectReaderTests-1042761782 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (645457cb-000a-427f-8d15-32f9e29d4284) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:57:11 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-e572b907-f1d2-4b3d-aaab-138cae2ba1ee tempest-ProjectReaderTests-1042761782 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (645457cb-000a-427f-8d15-32f9e29d4284) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T02:57:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1336703517',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5154a723-582e-4dfb-9f2f-ee0d97d93d44,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='61d01bcde2cd47508471651a90c1a8cf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T02:57:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T02:57:12Z,use_quota=True,user_id='a85d74b08f5044cb97b2dfa2f69dde4e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(317e369e-1e06-434d-ae95-a335f0e6c903),volume_type_id=317e369e-1e06-434d-ae95-a335f0e6c903)' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:57:11 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-e572b907-f1d2-4b3d-aaab-138cae2ba1ee tempest-ProjectReaderTests-1042761782 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b53a86fd-380f-4e10-ab26-115599dc072b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:57:11 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-e572b907-f1d2-4b3d-aaab-138cae2ba1ee tempest-ProjectReaderTests-1042761782 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b53a86fd-380f-4e10-ab26-115599dc072b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:57:11 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-e572b907-f1d2-4b3d-aaab-138cae2ba1ee tempest-ProjectReaderTests-1042761782 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (70ffa79e-77ef-443d-a80f-ee3ec28081bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:57:11 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-e572b907-f1d2-4b3d-aaab-138cae2ba1ee tempest-ProjectReaderTests-1042761782 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (70ffa79e-77ef-443d-a80f-ee3ec28081bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5154a723-582e-4dfb-9f2f-ee0d97d93d44', 'volume_name': 'volume-5154a723-582e-4dfb-9f2f-ee0d97d93d44', 'volume_size': 1}' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:57:11 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-e572b907-f1d2-4b3d-aaab-138cae2ba1ee tempest-ProjectReaderTests-1042761782 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (da5bf005-301d-4928-ae46-84dc4f1736c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:57:11 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-e572b907-f1d2-4b3d-aaab-138cae2ba1ee tempest-ProjectReaderTests-1042761782 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (da5bf005-301d-4928-ae46-84dc4f1736c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:57:11 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-e572b907-f1d2-4b3d-aaab-138cae2ba1ee tempest-ProjectReaderTests-1042761782 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9279d852-9ec9-48e3-93fe-bc10235e62c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:57:11 devstack cinder-volume[87444]: INFO cinder.volume.flows.manager.create_volume [None req-e572b907-f1d2-4b3d-aaab-138cae2ba1ee tempest-ProjectReaderTests-1042761782 None] Volume 5154a723-582e-4dfb-9f2f-ee0d97d93d44: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5154a723-582e-4dfb-9f2f-ee0d97d93d44', 'volume_size': 1} Jul 10 04:57:11 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-e572b907-f1d2-4b3d-aaab-138cae2ba1ee tempest-ProjectReaderTests-1042761782 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 04:57:11 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-e572b907-f1d2-4b3d-aaab-138cae2ba1ee tempest-ProjectReaderTests-1042761782 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 04:57:11 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-e572b907-f1d2-4b3d-aaab-138cae2ba1ee tempest-ProjectReaderTests-1042761782 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-10T02:57:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1336703517',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5154a723-582e-4dfb-9f2f-ee0d97d93d44,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='61d01bcde2cd47508471651a90c1a8cf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-10T02:57:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-10T02:57:12Z,use_quota=True,user_id='a85d74b08f5044cb97b2dfa2f69dde4e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(317e369e-1e06-434d-ae95-a335f0e6c903),volume_type_id=317e369e-1e06-434d-ae95-a335f0e6c903)}" {{(pid=87444) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 10 04:57:11 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.remotefs [None req-e572b907-f1d2-4b3d-aaab-138cae2ba1ee tempest-ProjectReaderTests-1042761782 None] Creating volume 5154a723-582e-4dfb-9f2f-ee0d97d93d44 {{(pid=87444) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 10 04:57:11 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-e572b907-f1d2-4b3d-aaab-138cae2ba1ee tempest-ProjectReaderTests-1042761782 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 04:57:11 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-e572b907-f1d2-4b3d-aaab-138cae2ba1ee tempest-ProjectReaderTests-1042761782 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 04:57:11 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-e572b907-f1d2-4b3d-aaab-138cae2ba1ee tempest-ProjectReaderTests-1042761782 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922': None} {{(pid=87444) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 04:57:11 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-e572b907-f1d2-4b3d-aaab-138cae2ba1ee tempest-ProjectReaderTests-1042761782 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922'] {{(pid=87444) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 04:57:11 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-e572b907-f1d2-4b3d-aaab-138cae2ba1ee tempest-ProjectReaderTests-1042761782 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 04:57:11 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-e572b907-f1d2-4b3d-aaab-138cae2ba1ee tempest-ProjectReaderTests-1042761782 None] Selected osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922 as target Quobyte volume. {{(pid=87444) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 10 04:57:11 devstack cinder-volume[87444]: INFO cinder.volume.drivers.remotefs [None req-e572b907-f1d2-4b3d-aaab-138cae2ba1ee tempest-ProjectReaderTests-1042761782 None] casted to osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922 Jul 10 04:57:11 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-e572b907-f1d2-4b3d-aaab-138cae2ba1ee tempest-ProjectReaderTests-1042761782 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-5154a723-582e-4dfb-9f2f-ee0d97d93d44 1073741824 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:57:11 devstack sudo[107491]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-5154a723-582e-4dfb-9f2f-ee0d97d93d44 1073741824 Jul 10 04:57:11 devstack sudo[107491]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:57:12 devstack sudo[107491]: pam_unix(sudo:session): session closed for user root Jul 10 04:57:12 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-e572b907-f1d2-4b3d-aaab-138cae2ba1ee tempest-ProjectReaderTests-1042761782 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-5154a723-582e-4dfb-9f2f-ee0d97d93d44 1073741824" returned: 0 in 0.856s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:57:12 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-e572b907-f1d2-4b3d-aaab-138cae2ba1ee tempest-ProjectReaderTests-1042761782 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-5154a723-582e-4dfb-9f2f-ee0d97d93d44 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:57:12 devstack sudo[107497]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-5154a723-582e-4dfb-9f2f-ee0d97d93d44 Jul 10 04:57:12 devstack sudo[107497]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:57:13 devstack sudo[107497]: pam_unix(sudo:session): session closed for user root Jul 10 04:57:13 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-e572b907-f1d2-4b3d-aaab-138cae2ba1ee tempest-ProjectReaderTests-1042761782 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-5154a723-582e-4dfb-9f2f-ee0d97d93d44" returned: 0 in 0.630s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:57:13 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-e572b907-f1d2-4b3d-aaab-138cae2ba1ee tempest-ProjectReaderTests-1042761782 None] <== create_volume: return (1531ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922'} {{(pid=87444) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 10 04:57:13 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-e572b907-f1d2-4b3d-aaab-138cae2ba1ee tempest-ProjectReaderTests-1042761782 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.533s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 04:57:13 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-e572b907-f1d2-4b3d-aaab-138cae2ba1ee tempest-ProjectReaderTests-1042761782 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9279d852-9ec9-48e3-93fe-bc10235e62c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5154a723-582e-4dfb-9f2f-ee0d97d93d44', 'volume_size': 1}' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:57:13 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-e572b907-f1d2-4b3d-aaab-138cae2ba1ee tempest-ProjectReaderTests-1042761782 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4bd1596b-99e8-4ed0-b317-5a85a9fadb17) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 10 04:57:13 devstack cinder-volume[87444]: INFO cinder.volume.flows.manager.create_volume [None req-e572b907-f1d2-4b3d-aaab-138cae2ba1ee tempest-ProjectReaderTests-1042761782 None] Volume volume-5154a723-582e-4dfb-9f2f-ee0d97d93d44 (5154a723-582e-4dfb-9f2f-ee0d97d93d44): created successfully Jul 10 04:57:13 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-e572b907-f1d2-4b3d-aaab-138cae2ba1ee tempest-ProjectReaderTests-1042761782 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4bd1596b-99e8-4ed0-b317-5a85a9fadb17) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87444) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 10 04:57:13 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-e572b907-f1d2-4b3d-aaab-138cae2ba1ee tempest-ProjectReaderTests-1042761782 None] Flow 'volume_create_manager' (ca1c5304-1707-4ff7-99d1-1d9813aaa278) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87444) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 10 04:57:13 devstack cinder-volume[87444]: INFO cinder.volume.manager [None req-e572b907-f1d2-4b3d-aaab-138cae2ba1ee tempest-ProjectReaderTests-1042761782 None] Created volume successfully. Jul 10 04:57:13 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-bbfbf56e-3cdc-4556-a9af-5fef75203130 tempest-ProjectReaderTests-1042761782 None] Acquiring lock "cinder-5154a723-582e-4dfb-9f2f-ee0d97d93d44-delete_volume" by "delete_volume" {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 04:57:13 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-bbfbf56e-3cdc-4556-a9af-5fef75203130 tempest-ProjectReaderTests-1042761782 None] Lock "cinder-5154a723-582e-4dfb-9f2f-ee0d97d93d44-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 04:57:14 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-bbfbf56e-3cdc-4556-a9af-5fef75203130 tempest-ProjectReaderTests-1042761782 None] Acquiring lock "cinder-quobyte-5154a723-582e-4dfb-9f2f-ee0d97d93d44" by "delete_volume" {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 10 04:57:14 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-bbfbf56e-3cdc-4556-a9af-5fef75203130 tempest-ProjectReaderTests-1042761782 None] Lock "cinder-quobyte-5154a723-582e-4dfb-9f2f-ee0d97d93d44" acquired by "delete_volume" :: waited 0.014s {{(pid=87444) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 10 04:57:14 devstack cinder-volume[87444]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9752167-2cad-4282-9cd0-a0dbcd0f04f0]: (4, 'qcow2') {{(pid=88499) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 10 04:57:14 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-bbfbf56e-3cdc-4556-a9af-5fef75203130 tempest-ProjectReaderTests-1042761782 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-5154a723-582e-4dfb-9f2f-ee0d97d93d44 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:57:14 devstack sudo[107501]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-5154a723-582e-4dfb-9f2f-ee0d97d93d44 Jul 10 04:57:14 devstack sudo[107501]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:57:14 devstack sudo[107501]: pam_unix(sudo:session): session closed for user root Jul 10 04:57:14 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-bbfbf56e-3cdc-4556-a9af-5fef75203130 tempest-ProjectReaderTests-1042761782 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-5154a723-582e-4dfb-9f2f-ee0d97d93d44" returned: 0 in 0.736s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:57:14 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-bbfbf56e-3cdc-4556-a9af-5fef75203130 tempest-ProjectReaderTests-1042761782 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-5154a723-582e-4dfb-9f2f-ee0d97d93d44 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:57:14 devstack sudo[107506]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-5154a723-582e-4dfb-9f2f-ee0d97d93d44 Jul 10 04:57:14 devstack sudo[107506]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:57:15 devstack sudo[107506]: pam_unix(sudo:session): session closed for user root Jul 10 04:57:15 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-bbfbf56e-3cdc-4556-a9af-5fef75203130 tempest-ProjectReaderTests-1042761782 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097/volume-5154a723-582e-4dfb-9f2f-ee0d97d93d44" returned: 0 in 0.639s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:57:15 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-bbfbf56e-3cdc-4556-a9af-5fef75203130 tempest-ProjectReaderTests-1042761782 None] Lock "cinder-quobyte-5154a723-582e-4dfb-9f2f-ee0d97d93d44" released by "delete_volume" :: held 1.417s {{(pid=87444) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 04:57:15 devstack cinder-volume[87444]: DEBUG cinder.quota [None req-bbfbf56e-3cdc-4556-a9af-5fef75203130 tempest-ProjectReaderTests-1042761782 None] Created reservations ['199c2d2c-da22-4bee-aaa9-3f1d183c3c9b', 'e5f32ecb-100e-420c-8ad8-58ad293f7d69', '3106712f-1a04-4051-be20-0ecbd76bc9a5', '750d1b16-44f0-4f28-a2ff-7995c4e7a375'] {{(pid=87444) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 10 04:57:15 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-bbfbf56e-3cdc-4556-a9af-5fef75203130 tempest-ProjectReaderTests-1042761782 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 04:57:15 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-bbfbf56e-3cdc-4556-a9af-5fef75203130 tempest-ProjectReaderTests-1042761782 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 04:57:15 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-bbfbf56e-3cdc-4556-a9af-5fef75203130 tempest-ProjectReaderTests-1042761782 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922': None} {{(pid=87444) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 04:57:15 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-bbfbf56e-3cdc-4556-a9af-5fef75203130 tempest-ProjectReaderTests-1042761782 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922'] {{(pid=87444) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 04:57:15 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-bbfbf56e-3cdc-4556-a9af-5fef75203130 tempest-ProjectReaderTests-1042761782 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 04:57:15 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-bbfbf56e-3cdc-4556-a9af-5fef75203130 tempest-ProjectReaderTests-1042761782 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:57:15 devstack sudo[107509]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097 Jul 10 04:57:15 devstack sudo[107509]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:57:16 devstack sudo[107509]: pam_unix(sudo:session): session closed for user root Jul 10 04:57:16 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-bbfbf56e-3cdc-4556-a9af-5fef75203130 tempest-ProjectReaderTests-1042761782 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097" returned: 0 in 0.677s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:57:16 devstack cinder-volume[87444]: DEBUG cinder.manager [None req-bbfbf56e-3cdc-4556-a9af-5fef75203130 tempest-ProjectReaderTests-1042761782 None] Notifying Schedulers of capabilities ... {{(pid=87444) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 04:57:16 devstack cinder-volume[87444]: INFO cinder.volume.manager [None req-bbfbf56e-3cdc-4556-a9af-5fef75203130 tempest-ProjectReaderTests-1042761782 None] Deleted volume successfully. Jul 10 04:57:16 devstack cinder-volume[87444]: DEBUG cinder.coordination [None req-bbfbf56e-3cdc-4556-a9af-5fef75203130 tempest-ProjectReaderTests-1042761782 None] Lock "cinder-5154a723-582e-4dfb-9f2f-ee0d97d93d44-delete_volume" released by "delete_volume" :: held 2.278s {{(pid=87444) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 10 04:57:25 devstack cinder-volume[87444]: DEBUG dbcounter [-] [87444] Writing DB stats cinder:SELECT=30,cinder:UPDATE=42,cinder:DELETE=4,cinder:INSERT=12 {{(pid=87444) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 10 04:57:26 devstack cinder-volume[87444]: DEBUG dbcounter [-] [87444] Writing DB stats cinder:SELECT=26,cinder:UPDATE=46,cinder:INSERT=8,cinder:DELETE=4 {{(pid=87444) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 10 04:57:33 devstack cinder-volume[87444]: DEBUG oslo_service.periodic_task [None req-01f0ce3e-6850-4e14-881d-e40d3c4ad6e5 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87444) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 10 04:57:33 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-01f0ce3e-6850-4e14-881d-e40d3c4ad6e5 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 10 04:57:33 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-01f0ce3e-6850-4e14-881d-e40d3c4ad6e5 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 10 04:57:33 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-01f0ce3e-6850-4e14-881d-e40d3c4ad6e5 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922': None} {{(pid=87444) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 10 04:57:33 devstack cinder-volume[87444]: DEBUG cinder.volume.drivers.quobyte [None req-01f0ce3e-6850-4e14-881d-e40d3c4ad6e5 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-ba173e91-d8cd-4582-a602-bb829677d922'] {{(pid=87444) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 10 04:57:33 devstack cinder-volume[87444]: DEBUG oslo_concurrency.lockutils [None req-01f0ce3e-6850-4e14-881d-e40d3c4ad6e5 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87444) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 10 04:57:33 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-01f0ce3e-6850-4e14-881d-e40d3c4ad6e5 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097 {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 10 04:57:33 devstack sudo[107765]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097 Jul 10 04:57:33 devstack sudo[107765]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 10 04:57:33 devstack sudo[107765]: pam_unix(sudo:session): session closed for user root Jul 10 04:57:33 devstack cinder-volume[87444]: DEBUG oslo_concurrency.processutils [None req-01f0ce3e-6850-4e14-881d-e40d3c4ad6e5 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/46da5ee587d449c90562c34f2f6a2097" returned: 0 in 0.649s {{(pid=87444) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 10 04:57:33 devstack cinder-volume[87444]: DEBUG cinder.manager [None req-01f0ce3e-6850-4e14-881d-e40d3c4ad6e5 None None] Notifying Schedulers of capabilities ... {{(pid=87444) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 10 04:57:33 devstack cinder-volume[87444]: DEBUG oslo_service.periodic_task [None req-01f0ce3e-6850-4e14-881d-e40d3c4ad6e5 None None] Running periodic task VolumeManager._thread_info {{(pid=87444) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 10 04:57:33 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-01f0ce3e-6850-4e14-881d-e40d3c4ad6e5 None None] thread count: 28 {{(pid=87444) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 10 04:57:33 devstack cinder-volume[87444]: DEBUG cinder.volume.manager [None req-01f0ce3e-6850-4e14-881d-e40d3c4ad6e5 None None] thread info: [<_MainThread(MainThread, started 126839257915520)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87444) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}